Proxy settings not working (again) after upgrade

Hi all

Just upgraded to 1.9.2. Been running serviio successfully now for a few years. Proxy settings worked in previous installation, but now it is broken (again.) After the previous upgrade I spent a fair bit of time trouble-shooting this, and even reported back. So bitterly dissappointed that I will need to do it all over again.

For reference, here is where I fixed it the first time around: http://forum.serviio.org/viewtopic.php?f=6&t=23783&p=115335#p115335

Getting these in the logs:

  Code:

2018-05-19 08:42:11,237 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-19 08:42:11,237 INFO  [RetryExec] Retrying request
2018-05-19 08:42:11,241 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-19 08:42:11,241 INFO  [RetryExec] Retrying request
2018-05-19 08:42:18,338 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-19 08:42:18,339 INFO  [RetryExec] Retrying request
2018-05-19 08:42:21,411 WARN  [OnlineVideoSourcesMetadataExtractor] Online metadata search failed for file BLAHBLAHBLAH - Source of Inspiration.mp4 [VideoDescription [type=EPISODE, names=[masterchef australia, null], year=null, season=10, episode=9, imdb_id=null]] using TheTVDBv2SourceAdaptor: Network is unreachable (connect failed)


I have added the same settings to 1.9.2 that was running well and working properly in 1.8.1. Even ran a diff to see what is different. But nothing.
Other Java apps on the same machine still work with the proxy settings enabled like the previous time.

  Code:

JAVA_OPTS="-Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Dorg.restlet.engine.loggerFacadeClass=org.restlet.ext.slf4j.Slf4jLoggerFacade -Dderby.system.home=$SERVIIO_HOME/library -Dserviio.home=$SERVIIO_HOME -Dffmpeg.location=ffmpeg -Ddcraw.location=dcraw -Dhttp.proxyHost=MYHOST -Dhttp.proxyPort=MYPORT -Dhttps.proxyHost=MYHOST -Dhttps.proxyPort=MYPORT -Dhttp.nonProxyHosts="192.168.2.*""

Any ideas from anyone would be kindly appreciated.

Oh and I should add:

Fedora release 26 (Twenty Six)
java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

Hi!

Try one of these two options:
- If you have your system configured to use a proxy, let java use it instead of telling to serviio (-Djava.net.useSystemProxies=true):

  Code:

JAVA_OPTS="-Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Dorg.restlet.engine.loggerFacadeClass=org.restlet.ext.slf4j.Slf4jLoggerFacade -Dderby.system.home=$SERVIIO_HOME/library -Dserviio.home=$SERVIIO_HOME -Dffmpeg.location=ffmpeg -Ddcraw.location=dcraw -Djava.net.useSystemProxies=true"

- If you prefer to do it only for serviio, as your piece of code, scape the quotes (\") with \:

  Code:

JAVA_OPTS="-Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Dorg.restlet.engine.loggerFacadeClass=org.restlet.ext.slf4j.Slf4jLoggerFacade -Dderby.system.home=$SERVIIO_HOME/library -Dserviio.home=$SERVIIO_HOME -Dffmpeg.location=ffmpeg -Ddcraw.location=dcraw -Djava.net.useSystemProxies=false -Dhttp.proxyHost=MYHOST -Dhttp.proxyPort=MYPORT -Dhttps.proxyHost=MYHOST -Dhttps.proxyPort=MYPORT -Dhttp.nonProxyHosts=\"192.168.2.*\""

PS1: I also recommend to bypass for local host on nonProxy property:

  Code:

-Dhttp.nonProxyHosts=\"192.168.2.*|127.*|localhost\"

PS2: I asume your proxy does not require authentication.

L.

Hi @bolzass

Thanks for the info. Unfortunately, no change.

On Serviio DLNA media streaming server v 1.9 (rev. a39231b8b876) all seems te be OK, and the only errors I get is thetvdb errors returning 404's, a lot of them, but seems legit errors.

On Serviio DLNA media streaming server v 1.9.2 (rev. a7a40a8528c7) the logs start off with:

  Code:

2018-05-20 07:55:46,872 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-20 07:55:46,872 INFO  [RetryExec] Retrying request
2018-05-20 07:55:53,956 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-20 07:55:53,956 INFO  [RetryExec] Retrying request
2018-05-20 07:56:01,058 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-20 07:56:01,059 INFO  [RetryExec] Retrying request


And then also a lot of of tvdb errors. The first of Serviio does not contain the errors you see in this block here. And these errors occur whether I set system proxy, manual proxy, escaped "" as you showed or don't. So I don't know, maybe it is something in the code in 1.9.2 that parses these options differently.

Also, the stuff being asked from thetvdb seems legit requests, with episodes supposed to be there, but I don't think these relate to network issues. Copy and pasting those items in a browser returns status code 34, resource could not be found (via api). But that is a problem for another thread.

Reverted back to old 1.9 install of serviio and all seems to be working again, as expected.

Hi @Luckyfriend222!

Ops, bad luck. But I recommend to keep this syntax.

A priori it doesn't seem a serviio matter than a java issue... (I'm running serviio 1.9.2 on ubuntu and never had these problems)
To help devs please turn on detailed logging (http://wiki.serviio.org/doku.php?id=detail_logging) and attach it here.

In the meanwhile, can you test your java?. I suspect about it (is jdk or from oracle?, etc.):
- Download latest official oracle 8 version (http://javadl.oracle.com/webapps/download/AutoDL?BundleId=233162_512cd62ec5174c3487ac17c61aaa89e8). You have both RPM to your fedora or tar.gz for isolated test.
- Unpack it anywhere (DLDIR) and change at serviio.sh (set it later to JAVA declarations):

  Code:

export {JAVA_HOME,JRE_HOME}=/DLDIR/jre1.8.0_171
CLASSPATH=$JAVA_HOME/lib
export PATH=${JAVA_HOME}/bin${PATH:+:$PATH}
JAVA=$JAVA_HOME/bin/java

PS: You have also at https://www.java.com/es/download/manual.jsp the main download site from oracle


Good luck!
L.

Hi @bolzass

Thanks again for replying.

Not a java issue. Changed java to one from Oracle.

  Code:

java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

Still same issue. For the time being reverted back to old Serviio. Wife is getting anxious when I keep disrupting the service. Will test during the week and turn on debug logging.

I do need to differ on the issue of it not being Serviio related. I understand your Ubuntu version is working, but I suspect it may be related to serviio due to the fact that other java application (including my chromium browser, which does adhere to system proxy settings) gets fed the same JAVA options, and they all work. And on the same system, 1.9.0 worked, so why would 1.9.2 not? If the system stays the same, it should.

Nevertheless, thanks again for trying to help, really appreciate it. Will test through the week sometime, and then report back.

Regards

Hi @Luckyfriend222!
Nevermind, your logic is overwhelming!

Sorry I didn't noticed about your oracle java (was talking in general terms), and I really was thinking more about some version "issue" (144 vs 171).
Anyway, as you say 1.9 works fine for you (although I noticed new version was more fluid;).

Do not forget uploading debug log as is the right way to look into and helpful to devs.

Regards and enjoy!

PS: I can understand you about your wife... mine is similar!

  Code:

2018-05-21 11:25:13,206 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4, ignore case: false
2018-05-21 11:25:13,207 DEBUG [VideoDAOImpl] Reading a Video (id = 9436)
2018-05-21 11:25:13,207 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,207 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,208 DEBUG [ProcessExecutor] Starting ffmpeg -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,502 DEBUG [FFmpegMetadataRetriever] Retrieving H264 profile/level for file 'STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4'
2018-05-21 11:25:13,502 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve H264 header for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,503 DEBUG [ProcessExecutor] Starting ffmpeg -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4 -frames:v 1 -c:v copy -f h264 -bsf:v h264_mp4toannexb -an pipe:
2018-05-21 11:25:13,569 DEBUG [FFmpegMetadataRetriever] File 'STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4' has H264 profile null, levels [{}] and null ref frames
2018-05-21 11:25:13,569 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,569 DEBUG [ProcessExecutor] Starting ffmpeg -threads 0 -ss 120 -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4 -an -frames:v 1 -f image2 pipe:
2018-05-21 11:25:13,585 DEBUG [MediaItemDAOImpl] Getting counts of media items by type
2018-05-21 11:25:13,664 DEBUG [AbstractCDSLibraryIndexingListener] Library updated, notifying CDS
2018-05-21 11:25:13,664 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2018-05-21 11:25:13,664 DEBUG [LocalContentCacheDecorator] Cleared cache (local_default)
2018-05-21 11:25:13,795 DEBUG [OpenSubtitlesService] Generating hash code for opensubtitles.org for file Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,800 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: VideoMetadata [title=Diners, Drive-ins and Dives S27E00 - Northeast Feasts, filePath=STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4, fileSize=539992284, audioTracks=1/AAC/95/2/44100//true, bitrate=1708, container=MP4, contentType=UNKNOWN, rating=null, duration=2528, episodeNumber=null, fps=29.97, h264Levels={}, h264Profile=null, ftyp=isom, height=544, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=1603, videoCodec=H264, videoFourCC=avc1, videoStreamIndex=0, width=968, embeddedSubtitles=[]]
2018-05-21 11:25:13,800 DEBUG [TheTVDBv2SourceAdaptor] Searching for series 'diners, drive'
2018-05-21 11:25:14,854 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-21 11:25:14,854 INFO  [RetryExec] Retrying request
2018-05-21 11:25:17,923 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-21 11:25:17,923 INFO  [RetryExec] Retrying request
2018-05-21 11:25:18,585 DEBUG [MediaItemDAOImpl] Getting counts of media items by type


And also

  Code:

WARN  [MetadataExtractionCoordinator] Extractor ONLINE_VIDEO_SOURCES failed to connect to metadata source for file STUFF/Series/Episode, will try again later: Error connecting to themoviedb.com: Network is unreachable (connect failed)


This happens for a lot of stuff. The I/O exception can be seen quite a bit throughout the log.

  Code:

2018-05-21 11:25:13,206 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4, ignore case: false
2018-05-21 11:25:13,207 DEBUG [VideoDAOImpl] Reading a Video (id = 9436)
2018-05-21 11:25:13,207 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,207 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,208 DEBUG [ProcessExecutor] Starting ffmpeg -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,502 DEBUG [FFmpegMetadataRetriever] Retrieving H264 profile/level for file 'STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4'
2018-05-21 11:25:13,502 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve H264 header for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,503 DEBUG [ProcessExecutor] Starting ffmpeg -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4 -frames:v 1 -c:v copy -f h264 -bsf:v h264_mp4toannexb -an pipe:
2018-05-21 11:25:13,569 DEBUG [FFmpegMetadataRetriever] File 'STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4' has H264 profile null, levels [{}] and null ref frames
2018-05-21 11:25:13,569 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,569 DEBUG [ProcessExecutor] Starting ffmpeg -threads 0 -ss 120 -i STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4 -an -frames:v 1 -f image2 pipe:
2018-05-21 11:25:13,585 DEBUG [MediaItemDAOImpl] Getting counts of media items by type
2018-05-21 11:25:13,664 DEBUG [AbstractCDSLibraryIndexingListener] Library updated, notifying CDS
2018-05-21 11:25:13,664 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2018-05-21 11:25:13,664 DEBUG [LocalContentCacheDecorator] Cleared cache (local_default)
2018-05-21 11:25:13,795 DEBUG [OpenSubtitlesService] Generating hash code for opensubtitles.org for file Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4
2018-05-21 11:25:13,800 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: VideoMetadata [title=Diners, Drive-ins and Dives S27E00 - Northeast Feasts, filePath=STUFF/Diners Drive-ins and Dives/Season 27/Diners, Drive-ins and Dives S27E00 - Northeast Feasts.mp4, fileSize=539992284, audioTracks=1/AAC/95/2/44100//true, bitrate=1708, container=MP4, contentType=UNKNOWN, rating=null, duration=2528, episodeNumber=null, fps=29.97, h264Levels={}, h264Profile=null, ftyp=isom, height=544, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=1603, videoCodec=H264, videoFourCC=avc1, videoStreamIndex=0, width=968, embeddedSubtitles=[]]
2018-05-21 11:25:13,800 DEBUG [TheTVDBv2SourceAdaptor] Searching for series 'diners, drive'
2018-05-21 11:25:14,854 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-21 11:25:14,854 INFO  [RetryExec] Retrying request
2018-05-21 11:25:17,923 INFO  [RetryExec] I/O exception (java.net.SocketException) caught when processing request: Network is unreachable (connect failed)
2018-05-21 11:25:17,923 INFO  [RetryExec] Retrying request
2018-05-21 11:25:18,585 DEBUG [MediaItemDAOImpl] Getting counts of media items by type


And also

  Code:

WARN  [MetadataExtractionCoordinator] Extractor ONLINE_VIDEO_SOURCES failed to connect to metadata source for file STUFF/Series/Episode, will try again later: Error connecting to themoviedb.com: Network is unreachable (connect failed)


This happens for a lot of stuff. The I/O exception can be seen quite a bit throughout the log.

Hello,

DId you manage it?