v1.2 ffmpeg and .ts files

Hi,

I've just upgraded to 1.2 and all seems fine except that I have some .ts files recorded from my Humax PVR. Serviio seems to be calling ffmpeg -i which is causing 100% cpu usage spikes every hour or so.

If I run the ffmpeg on the command line I get:

  Code:

serviio@openmediavault:~/serviio-app/log$ ffmpeg -i /vlfs/serviio/humaxtv/Kids/Kung\ Fu\ Panda_20121225_1929.ts
ffmpeg version 1.1.1 Copyright (c) 2000-2013 the FFmpeg developers
  built on Mar  4 2013 22:02:46 with gcc 4.4.5 (Debian 4.4.5-8)
  configuration: --enable-gpl --enable-libfaac --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libtheora --enable-libvorbis --enable-libx264 --enable-nonfree --enable-postproc --enable-version3 --enable-x11grab --enable-librtmp --enable-libxvid --enable-libass
  libavutil      52. 13.100 / 52. 13.100
  libavcodec     54. 86.100 / 54. 86.100
  libavformat    54. 59.106 / 54. 59.106
  libavdevice    54.  3.102 / 54.  3.102
  libavfilter     3. 32.100 /  3. 32.100
  libswscale      2.  1.103 /  2.  1.103
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  2.100 / 52.  2.100
[aac_latm @ 0x16753c0] initializing latmctx
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS referenced
[h264 @ 0x1667d40] non-existing SPS 0 referenced in buffering period
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] non-existing PPS 0 referenced
[h264 @ 0x1667d40] decode_slice_header error
[h264 @ 0x1667d40] no frame!
[aac_latm @ 0x167b780] initializing latmctx
[h264 @ 0x1667d40] mmco: unref short failure
    Last message repeated 2 times
[mpegts @ 0x1645500] max_analyze_duration 5000000 reached at 5013333
[mpegts @ 0x1645500] Could not find codec parameters for stream 4 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec
Consider increasing the value for the 'analyzeduration' and 'probesize' options
[mpegts @ 0x1645500] Could not find codec parameters for stream 5 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec
Consider increasing the value for the 'analyzeduration' and 'probesize' options
[mpegts @ 0x1645500] Could not find codec parameters for stream 6 (Unknown: none ([5][0][0][0] / 0x0005)): unknown codec
Consider increasing the value for the 'analyzeduration' and 'probesize' options
[mpegts @ 0x1645500] Could not find codec parameters for stream 7 (Unknown: none ([11][0][0][0] / 0x000B)): unknown codec
Consider increasing the value for the 'analyzeduration' and 'probesize' options
[NULL @ 0x16880e0] start time is not set in estimate_timings_from_pts
[NULL @ 0x168e580] start time is not set in estimate_timings_from_pts
[NULL @ 0x1694a20] start time is not set in estimate_timings_from_pts
[NULL @ 0x169aec0] start time is not set in estimate_timings_from_pts
[mpegts @ 0x1645500] PES packet size mismatch
Input #0, mpegts, from '/vlfs/serviio/humaxtv/Kids/Kung Fu Panda_20121225_1929.ts':
  Duration: 01:25:59.35, start: 87617.346078, bitrate: 5611 kb/s
  Program 17472
    Metadata:
      service_name    : BBC HD
      service_provider:
    Stream #0:0[0x65]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
    Stream #0:1[0x66](eng): Audio: aac_latm ([17][0][0][0] / 0x0011), 48000 Hz, stereo, fltp
    Stream #0:2[0x6a](eng): Audio: aac_latm ([17][0][0][0] / 0x0011), 48000 Hz, stereo, fltp (visual impaired)
    Stream #0:3[0x69](eng): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
    Stream #0:4[0x6e]: Unknown: none ([11][0][0][0] / 0x000B)
    Stream #0:5[0x6f]: Unknown: none ([11][0][0][0] / 0x000B)
    Stream #0:6[0x96]: Unknown: none ([5][0][0][0] / 0x0005)
    Stream #0:7[0x82]: Unknown: none ([11][0][0][0] / 0x000B)
  Program 17540
    Metadata:
      service_name    : BBC One HD
      service_provider:
  Program 17604
    Metadata:
      service_name    : ITV1 HD
      service_provider:
  Program 17664
    Metadata:
      service_name    : Channel 4 HD
      service_provider:
  Program 19648
    Metadata:
      service_name    : 303
      service_provider:
  Program 20288
    Metadata:
      service_name    : The Space
      service_provider:
At least one output file must be specified
serviio@openmediavault:~/serviio-app/log$


The combination of a number of these running causes the spike.

At the moment I've removed the folder that contains these but I was hoping you could guide me to a way to sort this out.

Cheers

[zip]

So it doesn't add this file?

You know what, I never checked that. These were in the db I moved from v1.1

However, since I removed the folder, I just put it back to see what would happen and yes the file is not added.

[zip]

Post the log showing why it hasn't been added

Here is an extract of the file with the relevant info:

  Code:

2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv
2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv/Mountain Gorilla
2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] Found file 'Mountain Gorilla_20120603_1759.ts', checking if it's already in the Library
2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts, ignore case: false
2013-03-10 09:58:45,370 DEBUG [MediaItemDAOImpl] Media item Mountain Gorilla_20120603_1759.ts doesn't exist in DB yet
2013-03-10 09:58:45,370 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it
2013-03-10 09:58:45,370 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:45,370 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:45,371 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:46,267 DEBUG [FFmpegMetadataRetriever] Retrieving H264 profile/level for file '/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts'
2013-03-10 09:58:46,268 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve H264 header for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:46,268 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts -frames:v 1 -c:v copy -f h264 -an pipe:
2013-03-10 09:58:47,410 DEBUG [FFmpegMetadataRetriever] File '/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts' has H264 profile HIGH, levels [{RF=4, H=4}] and 4 ref frames
2013-03-10 09:58:47,410 DEBUG [VideoExtractionStrategy] Found VALID value timestamp in the transport stream
2013-03-10 09:58:47,410 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts
2013-03-10 09:58:47,410 DEBUG [ProcessExecutor] Starting ffmpeg -i /vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts -ss 120 -an -frames:v 1 -f image2 pipe:
2013-03-10 09:58:49,301 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:58:54,324 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:58:59,329 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:04,338 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:09,356 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:14,361 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:19,280 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:24,299 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:29,327 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:34,341 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:39,353 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:42,877 DEBUG [DiscoveryAdvertisementNotifier] Multicasting SSDP alive using interface eth0 (eth0) and address 192.168.1.5, timeout = 0
2013-03-10 09:59:42,878 DEBUG [DiscoveryAdvertisementNotifier] Sending 6 'alive' messages describing device 4e97ce0c-21f3-3bf7-a94b-ac43c325a2c0
2013-03-10 09:59:43,684 DEBUG [FeedUpdaterThread] Checking for new and expired online resources
2013-03-10 09:59:43,684 DEBUG [OnlineRepositoryDAOImpl] Reading all OnlineRepositories
2013-03-10 09:59:44,272 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:44,686 DEBUG [DiscoveryAdvertisementNotifier] Will advertise again in 00:03:16 (advertisement duration is 1800 sec.)
2013-03-10 09:59:49,286 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:54,314 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 09:59:59,326 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 10:00:04,339 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2013-03-10 10:00:05,166 DEBUG [LibraryManager] Metadata found via extractor EMBEDDED: VideoMetadata [title=Mountain Gorilla_20120603_1759, filePath=/vlfs/serviio/humaxtv/Mountain Gorilla/Mountain Gorilla_20120603_1759.ts, fileSize=4247932928, audioBitrate=null, audioCodec=AAC, audioStreamIndex=1, bitrate=8993, channels=2, container=MPEG2TS, contentType=UNKNOWN, duration=3778, episodeNumber=null, fps=25, frequency=48000, h264Levels={RF=4, H=4}, h264Profile=HIGH, ftyp=null, height=1080, seasonNumber=null, seriesName=null, timestampType=VALID, videoBitrate=null, videoCodec=H264, videoFourCC=null, videoStreamIndex=0, width=1920, embeddedSubtitles=[]]
2013-03-10 10:00:05,167 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'mountain gorilla 20120603'  (language: en)
2013-03-10 10:00:05,392 WARN  [TheMovieDBSourceAdaptor] Cannot retrieve movie search results, unrecognizable file returned (possibly error)
2013-03-10 10:00:05,392 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'mountain gorilla'  (language: en)
2013-03-10 10:00:06,644 DEBUG [TheMovieDBSourceAdaptor] Found 1 matches
2013-03-10 10:00:06,650 DEBUG [TheMovieDBSourceAdaptor] Found a suitable movie match, id = 21743
2013-03-10 10:00:06,650 DEBUG [TheMovieDBSourceAdaptor] Retrieving details of movie (movieId = 21743, language = en)
2013-03-10 10:00:07,954 DEBUG [TheMovieDBSourceAdaptor] Retrieved poster: http://d3gtl9l2a4fn1j.cloudfront.net/t/p/w185/tVycyutvN6JwAwsGwHOlMWcKaEs.jpg
2013-03-10 10:00:07,954 DEBUG [LibraryManager] Metadata found via extractor ONLINE_VIDEO_SOURCES: VideoMetadata [title=IMAX - Mountain Gorilla, filePath=null, fileSize=0, audioBitrate=null, audioCodec=null, audioStreamIndex=null, bitrate=null, channels=null, container=null, contentType=MOVIE, duration=null, episodeNumber=null, fps=null, frequency=null, h264Levels={}, h264Profile=null, ftyp=null, height=null, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=null, videoCodec=null, videoFourCC=null, videoStreamIndex=null, width=null, embeddedSubtitles=[]]
2013-03-10 10:00:07,964 DEBUG [CoverImageInFolderExtractor] Found cover image Mountain Gorilla_20120603_1759.thm
2013-03-10 10:00:07,964 DEBUG [LibraryManager] Skipping processing metadata for an unsupported file. Message: Cannot read cover image Mountain Gorilla_20120603_1759.thm: Can't parse this format.
2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /vlfs/serviio/humaxtv/Nature's Weirdest Events
2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] Found file 'Nature's Weirdest Events_20130102_1959.ts', checking if it's already in the Library
2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item Nature's Weirdest Events_20130102_1959.ts
2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts, ignore case: false
2013-03-10 10:00:07,965 DEBUG [MediaItemDAOImpl] Media item Nature's Weirdest Events_20130102_1959.ts doesn't exist in DB yet
2013-03-10 10:00:07,965 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it
2013-03-10 10:00:07,965 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts
2013-03-10 10:00:07,966 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /vlfs/serviio/humaxtv/Nature's Weirdest Events/Nature's Weirdest Events_20130102_1959.ts


[zip]

Thanks, can you attach this file: Mountain Gorilla_20120603_1759.thm

FIle attached.

Just for your info. I also have:

Mountain Gorilla_20120603_1759.hmt (~200KB)
Mountain Gorilla_20120603_1759.nts (~6MB)

Can also upload if required.

Cheers

[zip]

ok, normally .thm files are used as thumbnail files in .jpg format - but this doesn't seem to be the case, which in turn causes the file not being added. I've updated the code for 1.2.1 so that it will still add the file.

Cool, when is that going to be available?

[zip]

soon