Serviio

Posted: **Sat Mar 09, 2013 8:31 pm**

Hi,

I've just upgraded to 1.2 and all seems fine except that I have some .ts files recorded from my Humax PVR. Serviio seems to be calling ffmpeg -i which is causing 100% cpu usage spikes every hour or so.

If I run the ffmpeg on the command line I get:

Code:: serviio@openmediavault:~/serviio-app/log$ ffmpeg -i /vlfs/serviio/humaxtv/Kids/Kung\ Fu\ Panda_20121225_1929.ts ffmpeg version 1.1.1 Copyright (c) 2000-2013 the FFmpeg developers built on Mar 4 2013 22:02:46 with gcc 4.4.5 (Debian 4.4.5-8) configuration: --enable-gpl --enable-libfaac --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libtheora --enable-libvorbis --enable-libx264 --enable-nonfree --enable-postproc --enable-version3 --enable-x11grab --enable-librtmp --enable-libxvid --enable-libass libavutil 52. 13.100 / 52. 13.100 libavcodec 54. 86.100 / 54. 86.100 libavformat 54. 59.106 / 54. 59.106 libavdevice 54. 3.102 / 54. 3.102 libavfilter 3. 32.100 / 3. 32.100 libswscale 2. 1.103 / 2. 1.103 libswresample 0. 17.102 / 0. 17.102 libpostproc 52. 2.100 / 52. 2.100 [aac_latm @ 0x16753c0] initializing latmctx [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS referenced [h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] non-existing PPS 0 referenced [h264 @ 0x1667d40] decode_slice_header error [h264 @ 0x1667d40] no frame! [aac_latm @ 0x167b780] initializing latmctx [h264 @ 0x1667d40] mmco: unref short failure Last message repeated 2 times [mpegts @ 0x1645500] max_analyze_duration 5000000 reached at 5013333 [mpegts @ 0x1645500] Could not find codec parameters for stream 4 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec Consider increasing the value for the 'analyzeduration' and 'probesize' options [mpegts @ 0x1645500] Could not find codec parameters for stream 5 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec Consider increasing the value for the 'analyzeduration' and 'probesize' options [mpegts @ 0x1645500] Could not find codec parameters for stream 6 (Unknown: none ([5][0][0][0] / 0x0005)): unknown codec Consider increasing the value for the 'analyzeduration' and 'probesize' options [mpegts @ 0x1645500] Could not find codec parameters for stream 7 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec Consider increasing the value for the 'analyzeduration' and 'probesize' options [NULL @ 0x16880e0] start time is not set in estimate_timings_from_pts [NULL @ 0x168e580] start time is not set in estimate_timings_from_pts [NULL @ 0x1694a20] start time is not set in estimate_timings_from_pts [NULL @ 0x169aec0] start time is not set in estimate_timings_from_pts [mpegts @ 0x1645500] PES packet size mismatch Input #0, mpegts, from '/vlfs/serviio/humaxtv/Kids/Kung Fu Panda_20121225_1929.ts': Duration: 01:25:59.35, start: 87617.346078, bitrate: 5611 kb/s Program 17472 Metadata: service_name : BBC HD service_provider: Stream #0:0[0x65]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc Stream #0:1[0x66](eng): Audio: aac_latm ([17][0][0][0] / 0x0011), 48000 Hz, stereo, fltp Stream #0:2[0x6a](eng): Audio: aac_latm ([17][0][0][0] / 0x0011), 48000 Hz, stereo, fltp (visual impaired) Stream #0:3[0x69](eng): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006) Stream #0:4[0x6e]: Unknown: none ([11][0][0][0] / 0x000B) Stream #0:5[0x6f]: Unknown: none ([11][0][0][0] / 0x000B) Stream #0:6[0x96]: Unknown: none ([5][0][0][0] / 0x0005) Stream #0:7[0x82]: Unknown: none ([11][0][0][0] / 0x000B) Program 17540 Metadata: service_name : BBC One HD service_provider: Program 17604 Metadata: service_name : ITV1 HD service_provider: Program 17664 Metadata: service_name : Channel 4 HD service_provider: Program 19648 Metadata: service_name : 303 service_provider: Program 20288 Metadata: service_name : The Space service_provider: At least one output file must be specified serviio@openmediavault:~/serviio-app/log$

The combination of a number of these running causes the spike.

At the moment I've removed the folder that contains these but I was hoping you could guide me to a way to sort this out.

Cheers

Posted: **Sat Mar 09, 2013 9:00 pm**

So it doesn't add this file?

Posted: **Sat Mar 09, 2013 9:20 pm**

You know what, I never checked that. These were in the db I moved from v1.1

However, since I removed the folder, I just put it back to see what would happen and yes the file is not added.

Posted: **Sat Mar 09, 2013 11:31 pm**

Post the log showing why it hasn't been added

Posted: **Sun Mar 10, 2013 10:05 am**

Here is an extract of the file with the relevant info:

Code:: 2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv 2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv/Mountain Gorilla 2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Found file 'Mountain Gorilla_20120603_1759.ts', checking if it's already in the Library 2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts, ignore case: false 2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Media item Mountain Gorilla_20120603_1759.ts doesn't exist in DB yet 2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it 2013-03-10 09:58:45,370 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:45,370 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:45,371 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:46,267 DEBUG [FFmpegMetadataRetriever] Retrieving H264 profile/level for file '/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts' 2013-03-10 09:58:46,268 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve H264 header for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:46,268 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts -frames:v 1 -c:v copy -f h264 -an pipe: 2013-03-10 09:58:47,410 DEBUG [FFmpegMetadataRetriever] File '/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts' has H264 profile HIGH, levels [{RF=4, H=4}] and 4 ref frames 2013-03-10 09:58:47,410 DEBUG [VideoExtractionStrategy] Found VALID value timestamp in the transport stream 2013-03-10 09:58:47,410 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts 2013-03-10 09:58:47,410 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts -ss 120 -an -frames:v 1 -f image2 pipe: 2013-03-10 09:58:49,301 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:58:54,324 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:58:59,329 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:04,338 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:09,356 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:14,361 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:19,280 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:24,299 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:29,327 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:34,341 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:39,353 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:42,877 DEBUG [DiscoveryAdvertisementNotifier] Multicasting SSDP alive using interface eth0 (eth0) and address 192.168.1.5, timeout = 0 2013-03-10 09:59:42,878 DEBUG [DiscoveryAdvertisementNotifier] Sending 6 'alive' messages describing device 4e97ce0c-21f3-3bf7-a94b-ac43c325a2c0 2013-03-10 09:59:43,684 DEBUG [FeedUpdaterThread] Checking for new and expired online resources 2013-03-10 09:59:43,684 DEBUG [OnlineRepositoryDAOImpl] Reading all OnlineRepositories 2013-03-10 09:59:44,272 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:44,686 DEBUG [DiscoveryAdvertisementNotifier] Will advertise again in 00:03:16 (advertisement duration is 1800 sec.) 2013-03-10 09:59:49,286 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:54,314 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 09:59:59,326 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 10:00:04,339 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers 2013-03-10 10:00:05,166 DEBUG [LibraryManager] Metadata found via extractor EMBEDDED: VideoMetadata [title=Mountain Gorilla_20120603_1759, filePath=/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts, fileSize=4247932928, audioBitrate=null, audioCodec=AAC, audioStreamIndex=1, bitrate=8993, channels=2, container=MPEG2TS, contentType=UNKNOWN, duration=3778, episodeNumber=null, fps=25, frequency=48000, h264Levels={RF=4, H=4}, h264Profile=HIGH, ftyp=null, height=1080, seasonNumber=null, seriesName=null, timestampType=VALID, videoBitrate=null, videoCodec=H264, videoFourCC=null, videoStreamIndex=0, width=1920, embeddedSubtitles=[]] 2013-03-10 10:00:05,167 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'mountain gorilla 20120603' (language: en) 2013-03-10 10:00:05,392 WARN [TheMovieDBSourceAdaptor] Cannot retrieve movie search results, unrecognizable file returned (possibly error) 2013-03-10 10:00:05,392 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'mountain gorilla' (language: en) 2013-03-10 10:00:06,644 DEBUG [TheMovieDBSourceAdaptor] Found 1 matches 2013-03-10 10:00:06,650 DEBUG [TheMovieDBSourceAdaptor] Found a suitable movie match, id = 21743 2013-03-10 10:00:06,650 DEBUG [TheMovieDBSourceAdaptor] Retrieving details of movie (movieId = 21743, language = en) 2013-03-10 10:00:07,954 DEBUG [TheMovieDBSourceAdaptor] Retrieved poster: http://d3gtl9l2a4fn1j.cloudfront.net/t/p/w185/tVycyutvN6JwAwsGwHOlMWcKaEs.jpg 2013-03-10 10:00:07,954 DEBUG [LibraryManager] Metadata found via extractor ONLINE_VIDEO_SOURCES: VideoMetadata [title=IMAX - Mountain Gorilla, filePath=null, fileSize=0, audioBitrate=null, audioCodec=null, audioStreamIndex=null, bitrate=null, channels=null, container=null, contentType=MOVIE, duration=null, episodeNumber=null, fps=null, frequency=null, h264Levels={}, h264Profile=null, ftyp=null, height=null, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=null, videoCodec=null, videoFourCC=null, videoStreamIndex=null, width=null, embeddedSubtitles=[]] 2013-03-10 10:00:07,964 DEBUG [CoverImageInFolderExtractor] Found cover image Mountain Gorilla_20120603_1759.thm 2013-03-10 10:00:07,964 DEBUG [LibraryManager] Skipping processing metadata for an unsupported file. Message: Cannot read cover image Mountain Gorilla_20120603_1759.thm: Can't parse this format. 2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv/Nature's Weirdest Events 2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] Found file 'Nature's Weirdest Events_20130102_1959.ts', checking if it's already in the Library 2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item Nature's Weirdest Events_20130102_1959.ts 2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts, ignore case: false 2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Media item Nature's Weirdest Events_20130102_1959.ts doesn't exist in DB yet 2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it 2013-03-10 10:00:07,965 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts 2013-03-10 10:00:07,966 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts

Posted: **Sun Mar 10, 2013 1:55 pm**

Thanks, can you attach this file: Mountain Gorilla_20120603_1759.thm

Posted: **Sun Mar 10, 2013 5:52 pm**

FIle attached.

Just for your info. I also have:

Mountain Gorilla_20120603_1759.hmt (~200KB)
Mountain Gorilla_20120603_1759.nts (~6MB)

Can also upload if required.

Cheers

Posted: **Sun Mar 10, 2013 7:35 pm**

ok, normally .thm files are used as thumbnail files in .jpg format - but this doesn't seem to be the case, which in turn causes the file not being added. I've updated the code for 1.2.1 so that it will still add the file.

Posted: **Sun Mar 10, 2013 7:39 pm**

Cool, when is that going to be available?

Posted: **Sun Mar 10, 2013 7:48 pm**

Serviio

v1.2 ffmpeg and .ts files

v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files

Re: v1.2 ffmpeg and .ts files