Transcoding MKV Audio for LG TV

[zip]

Ok, I changed that on the support site, thanks. MKV is not a supported transcoding target container.
Does the file play if you add it into the library after you manually transcode it?

So I should let the ffmpeg run until it's finished and place the transcoding-temp-125-MPEG2TS.stf file in my Movies Library and see if my TV sees and plays it? Do I need to rename that to another file extension or do the devices recognize an .stf file?

[zip]

yes, rename it to .ts for example

Ok, what file extension options can I try on a transcoded file? .ts, .stf, etc. Can these files be renamed to .MKV?

[zip]

extension doesn't make any difference, it only has to be one of the supported ones - for Serviio to 'see' the file, so .ts, .mpg, .mkv will all work.

Ok, cool. I don't see the matroska option under Match container on the Transcoding configuration support page. Is this just missing from the page or is that not a legit match container?

Matches:
container - compulsary; FFmpeg name of container; possible values: asf (WMV), mpeg (MPEG2PS), mpegts (MPEG2TS)

Is there a way to transcode any video that has DTS (dca) into another audio codec like AC3 or AAC without specifying a target container? Since matroska is in it's own container and runs natively on the TV I don't need to wrap MKV files into anything like mpegts. I just need the audio to change from DTS to AC3 or AAC.

I'm currently transcoding the MKV files into mpegts to try out when I get home but I would think I shouldn't need to transcode the video at all if it already plays the video with no audio when I uncheck Transcoding in the GUI. Thanks for your help.

Ok, The transcode files work ok. I notice that ffmpeg continues to transcode the file even though the TV gave up and said File not supported. The file /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/transcoding-temp-125-MPEG2TS.stf is still created. If I move this file over to my Movies Library, Serviio does not recognize this file type. If I rename the file to a .ts or .mkv, the file plays fine with audio. So is it possible that the stream is dying because Serviio doesn't recognize this file? Will I just need to change the code to save the temp transcode file to .ts or another extension?

[zip]

Ok, cool. I don't see the matroska option under Match container on the Transcoding configuration support page. Is this just missing from the page or is that not a legit match container?

Matches:
container - compulsary; FFmpeg name of container; possible values: asf (WMV), mpeg (MPEG2PS), mpegts (MPEG2TS)

Thanks for pointing that out, it's a mistake. I'll update it now.

Is there a way to transcode any video that has DTS (dca) into another audio codec like AC3 or AAC without specifying a target container? Since matroska is in it's own container and runs natively on the TV I don't need to wrap MKV files into anything like mpegts. I just need the audio to change from DTS to AC3 or AAC.

No, MKV is not a stream-friendly transcode container, as it writes some data at the end of the file, and the data is not available when you start watching. Only Mpeg2PS, TS and ASF support this.

[zip]

Ok, The transcode files work ok. I notice that ffmpeg continues to transcode the file even though the TV gave up and said File not supported. The file /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/transcoding-temp-125-MPEG2TS.stf is still created. If I move this file over to my Movies Library, Serviio does not recognize this file type. If I rename the file to a .ts or .mkv, the file plays fine with audio. So is it possible that the stream is dying because Serviio doesn't recognize this file? Will I just need to change the code to save the temp transcode file to .ts or another extension?

Yes, that is something that I cannot control at the moment, the file will finish transcoding. The extension doesn't matter in this case. Can you post bits of log when you play the transcoded file and when you try to play the MKV? It should say what format it's using and they should be the same.

Trying to play original MKV file:

  Code:

2010-08-19 18:05:18,586 DEBUG [VideoDeliveryEngine] Delivering item '135' for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-19 18:05:18,586 DEBUG [VideoDeliveryEngine] Delivering file 'Old Dogs.mkv' using transcoding
2010-08-19 18:05:18,586 DEBUG [VideoDeliveryEngine] A suitable transcoding job already exists, re-use it for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-19 18:05:18,586 DEBUG [VideoDeliveryEngine] Found Format profile for transcoded file Old Dogs.mkv: AVC_TS_MP_HD_AC3
2010-08-19 18:05:18,586 DEBUG [VideoDeliveryEngine] Sending transcoding stream
2010-08-19 18:05:18,586 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: -4611686009427371520
2010-08-19 18:05:18,586 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-19 18:05:18,586 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-19 18:05:18,586 DEBUG [ResourceTransportRequestHandler] HTTP/1.1 206 Partial Content, headers = [Content-Type: video/vnd.dlna.mpeg-tts, Content-Range: bytes 4611686018427371520-8999999999/9000000000, Cache-control: no-cache, Pragma: no-cache, Server: Mac OS X UPnP/1.0 Serviio 0.4.1, transferMode.dlna.org: Streaming, ]
2010-08-19 18:05:22,611 DEBUG [WebServer] I/O error: Broken pipe

After transcoding the file here is the DEBUG log when playing.

  Code:

2010-08-21 23:59:38,446 DEBUG [VideoDeliveryEngine] Delivering file 'Old Dogs 2.mkv' in native format
2010-08-21 23:59:38,446 DEBUG [MediaItemDAOImpl] Getting file of media item 134
2010-08-21 23:59:38,447 DEBUG [MediaItemDAOImpl] Marking MediaItem (id = 134) as read
2010-08-21 23:59:38,456 DEBUG [WebServer] Incoming connection from /192.168.1.110:50864
2010-08-21 23:59:38,457 DEBUG [ResourceTransportRequestHandler] GET /resource/134/MEDIA_ITEM HTTP/1.1, headers = [Host: 192.168.1.100:8895, Pragma: no-cache, Cache-Control: no-cache, Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, image/png, text/html, text/xml, text/plain, application/json, application/atom+xml, */*, Accept-Language: ko-kr, ko;q=0.8, en-us;q=0.5, en;q=0.3, Connection: Close, User-Agent: Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; LG_UA; AD_LOGON=LGE.NET; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; LG_UA; AD_LOGON=LGE.NET; LG NetCast-2010), ]
2010-08-21 23:59:38,457 DEBUG [ResourceTransportRequestHandler] Resource request accepted. Using client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-21 23:59:38,457 DEBUG [ResourceTransportRequestHandler] Request for resource 134 and type 'MEDIA_ITEM' received
2010-08-21 23:59:38,457 DEBUG [MediaItemDAOImpl] Reading a MediaItem (id = 134)
2010-08-21 23:59:38,471 DEBUG [VideoDAOImpl] Reading a Video (id = 134)
2010-08-21 23:59:38,480 DEBUG [VideoDeliveryEngine] Delivering item '134' for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-21 23:59:38,480 DEBUG [VideoDeliveryEngine] Delivering file 'Old Dogs 2.mkv' in native format
2010-08-21 23:59:38,480 DEBUG [MediaItemDAOImpl] Getting file of media item 134
2010-08-21 23:59:38,481 DEBUG [MediaItemDAOImpl] Marking MediaItem (id = 134) as read
2010-08-21 23:59:38,482 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2010-08-21 23:59:38,482 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: 2518327887
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: 2518327887
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-21 23:59:38,482 DEBUG [ResourceTransportRequestHandler] HTTP/1.1 200 OK, headers = [Content-Type: video/x-mkv, Cache-control: no-cache, Pragma: no-cache, Server: Mac OS X UPnP/1.0 Serviio 0.4.1, transferMode.dlna.org: Streaming, ]


It seems to be a communication issue when trying to stream a file that is being transcoded. Doesn't just seem to be related to MKV files. So the on-the-fly transcoding doesn't seem to stream to the TV. Is is possible the TV doesn't support this? Maybe the TV is timing out to fast and not letting enough of the transcode chunk to start streaming. Any ideas?

[zip]

This line in logs seens dodgy:

  Code:

010-08-19 18:05:18,586 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: -4611686009427371520

Can you post a bit more log preceding the playback? Restart Serviio (so that the transcoding cache is cleared) and try to play the mkv file again.

  Code:

2010-08-23 07:56:27,422 DEBUG [WebServer] Incoming connection from /192.168.1.110:43605
2010-08-23 07:56:27,422 DEBUG [WebServer] Incoming connection from /192.168.1.110:43606
2010-08-23 07:56:27,422 DEBUG [ResourceTransportRequestHandler] GET /resource/455/MEDIA_ITEM/AVC_TS_MP_HD_AC3 HTTP/1.1, headers = [Host: 192.168.1.100:8895, Pragma: no-cache, Cache-Control: no-cache, Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, image/png, text/html, text/xml, text/plain, application/json, application/atom+xml, */*, Accept-Language: ko-kr, ko;q=0.8, en-us;q=0.5, en;q=0.3, Connection: Close, User-Agent: Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; LG_UA; AD_LOGON=LGE.NET; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; LG_UA; AD_LOGON=LGE.NET; LG NetCast-2010), ]
2010-08-23 07:56:27,423 DEBUG [ResourceTransportRequestHandler] GET /resource/455/MEDIA_ITEM/AVC_TS_MP_HD_AC3 HTTP/1.1, headers = [Host: 192.168.1.100:8895, Pragma: no-cache, Cache-Control: no-cache, Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, image/png, text/html, text/xml, text/plain, application/json, application/atom+xml, */*, Accept-Language: ko-kr, ko;q=0.8, en-us;q=0.5, en;q=0.3, Connection: Close, User-Agent: Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; LG_UA; AD_LOGON=LGE.NET; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; LG_UA; AD_LOGON=LGE.NET; LG NetCast-2010), ]
2010-08-23 07:56:27,423 DEBUG [ResourceTransportRequestHandler] Resource request accepted. Using client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,423 DEBUG [ResourceTransportRequestHandler] Resource request accepted. Using client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,423 DEBUG [ResourceTransportRequestHandler] Request for resource 455 and type 'MEDIA_ITEM' received
2010-08-23 07:56:27,423 DEBUG [ResourceTransportRequestHandler] Request for resource 455 and type 'MEDIA_ITEM' received
2010-08-23 07:56:27,423 DEBUG [MediaItemDAOImpl] Reading a MediaItem (id = 455)
2010-08-23 07:56:27,423 DEBUG [MediaItemDAOImpl] Reading a MediaItem (id = 455)
2010-08-23 07:56:27,425 DEBUG [VideoDAOImpl] Reading a Video (id = 455)
2010-08-23 07:56:27,425 DEBUG [VideoDAOImpl] Reading a Video (id = 455)
2010-08-23 07:56:27,425 DEBUG [VideoDeliveryEngine] Delivering item '455' for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,425 DEBUG [VideoDeliveryEngine] Delivering file 'The.Hurt.Locker.1080.mkv' using transcoding
2010-08-23 07:56:27,426 DEBUG [VideoDeliveryEngine] Stopping previous transcoding job of file '/var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-61-MPEG2TS.stf'
2010-08-23 07:56:27,425 DEBUG [VideoDeliveryEngine] Delivering item '455' for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,436 DEBUG [VideoDeliveryEngine] Delivering file 'The.Hurt.Locker.1080.mkv' using transcoding
2010-08-23 07:56:27,457 DEBUG [VideoDeliveryEngine] Deleted temp file '/var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-61-MPEG2TS.stf': true
2010-08-23 07:56:27,457 DEBUG [VideoDeliveryEngine] No suitable transcoding job exists yet, start one for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,457 DEBUG [MediaItemDAOImpl] Getting file of media item 455
2010-08-23 07:56:27,458 DEBUG [FFMPEGWrapper] Invoking FFmpeg to transcode file: /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv
2010-08-23 07:56:27,458 DEBUG [VideoDeliveryEngine] No suitable transcoding job exists yet, start one for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:27,458 DEBUG [MediaItemDAOImpl] Getting file of media item 455
2010-08-23 07:56:27,459 DEBUG [FFMPEGWrapper] Invoking FFmpeg to transcode file: /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv
2010-08-23 07:56:27,460 DEBUG [ProcessExecutor] Starting /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv -y -vcodec copy -copyts -acodec ac3 -ab 192k -vbsf h264_mp4toannexb -sn -f mpegts /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-455-MPEG2TS.stf
2010-08-23 07:56:27,484 DEBUG [ProcessExecutor] Starting /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv -y -vcodec copy -copyts -acodec ac3 -ab 192k -vbsf h264_mp4toannexb -sn -f mpegts /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-455-MPEG2TS.stf
2010-08-23 07:56:28,460 DEBUG [VideoDeliveryEngine] Found Format profile for transcoded file The.Hurt.Locker.1080.mkv: AVC_TS_MP_HD_AC3
2010-08-23 07:56:28,460 DEBUG [VideoDeliveryEngine] Sending transcoding stream
2010-08-23 07:56:28,460 DEBUG [MediaItemDAOImpl] Marking MediaItem (id = 455) as read
2010-08-23 07:56:28,482 DEBUG [VideoDeliveryEngine] Found Format profile for transcoded file The.Hurt.Locker.1080.mkv: AVC_TS_MP_HD_AC3
2010-08-23 07:56:28,483 DEBUG [VideoDeliveryEngine] Sending transcoding stream
2010-08-23 07:56:28,483 DEBUG [MediaItemDAOImpl] Marking MediaItem (id = 455) as read
2010-08-23 07:56:28,487 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2010-08-23 07:56:28,488 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: 9000000000
2010-08-23 07:56:28,488 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-23 07:56:28,488 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-23 07:56:28,488 DEBUG [ResourceTransportRequestHandler] HTTP/1.1 200 OK, headers = [Content-Type: video/vnd.dlna.mpeg-tts, Cache-control: no-cache, Pragma: no-cache, Server: Mac OS X UPnP/1.0 Serviio 0.4.1, transferMode.dlna.org: Streaming, ]
2010-08-23 07:56:28,491 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2010-08-23 07:56:28,491 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: 9000000000
2010-08-23 07:56:28,491 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-23 07:56:28,491 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-23 07:56:28,491 DEBUG [ResourceTransportRequestHandler] HTTP/1.1 200 OK, headers = [Content-Type: video/vnd.dlna.mpeg-tts, Cache-control: no-cache, Pragma: no-cache, Server: Mac OS X UPnP/1.0 Serviio 0.4.1, transferMode.dlna.org: Streaming, ]
2010-08-23 07:56:28,538 DEBUG [WebServer] I/O error: Broken pipe
2010-08-23 07:56:28,540 DEBUG [WebServer] Incoming connection from /192.168.1.110:43607
2010-08-23 07:56:28,540 DEBUG [ResourceTransportRequestHandler] GET /resource/455/MEDIA_ITEM/AVC_TS_MP_HD_AC3 HTTP/1.1, headers = [Host: 192.168.1.100:8895, Pragma: no-cache, Cache-Control: no-cache, Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, image/png, text/html, text/xml, text/plain, application/json, application/atom+xml, */*, Accept-Language: ko-kr, ko;q=0.8, en-us;q=0.5, en;q=0.3, Connection: Close, Range: bytes=4611686018427371520-, User-Agent: Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1; LG_UA; AD_LOGON=LGE.NET; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; LG_UA; AD_LOGON=LGE.NET; LG NetCast-2010), ]
2010-08-23 07:56:28,540 DEBUG [ResourceTransportRequestHandler] Resource request accepted. Using client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:28,540 DEBUG [ResourceTransportRequestHandler] Request for resource 455 and type 'MEDIA_ITEM' received
2010-08-23 07:56:28,541 DEBUG [MediaItemDAOImpl] Reading a MediaItem (id = 455)
2010-08-23 07:56:28,542 DEBUG [VideoDAOImpl] Reading a Video (id = 455)
2010-08-23 07:56:28,542 DEBUG [VideoDeliveryEngine] Delivering item '455' for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:28,542 DEBUG [VideoDeliveryEngine] Delivering file 'The.Hurt.Locker.1080.mkv' using transcoding
2010-08-23 07:56:28,542 DEBUG [VideoDeliveryEngine] A suitable transcoding job already exists, re-use it for client 'IPAddress=/192.168.1.110, Profile=LG (42LE5400)'
2010-08-23 07:56:28,542 DEBUG [VideoDeliveryEngine] Found Format profile for transcoded file The.Hurt.Locker.1080.mkv: AVC_TS_MP_HD_AC3
2010-08-23 07:56:28,542 DEBUG [VideoDeliveryEngine] Sending transcoding stream
2010-08-23 07:56:28,543 DEBUG [ResourceTransportRequestHandler] Creating stream entity with length: -4611686009427371520
2010-08-23 07:56:28,543 DEBUG [ResourceTransportRequestHandler] Creating stream entity with chunked transfer
2010-08-23 07:56:28,543 DEBUG [ResourceTransportRequestHandler] Sending file back
2010-08-23 07:56:28,543 DEBUG [ResourceTransportRequestHandler] HTTP/1.1 206 Partial Content, headers = [Content-Type: video/vnd.dlna.mpeg-tts, Content-Range: bytes 4611686018427371520-8999999999/9000000000, Cache-control: no-cache, Pragma: no-cache, Server: Mac OS X UPnP/1.0 Serviio 0.4.1, transferMode.dlna.org: Streaming, ]


I can see the file transcoding into the /Var directory and the file does play ok after it's completed and I rename the file .mkv. It just won't stream it while it's transcoding.

  Code:

bash-3.2# ps -efw | grep ffmp
  501 45695 45135   0   0:05.08 ??         0:56.81 /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv -y -vcodec copy -copyts -acodec ac3 -ab 192k -vbsf h264_mp4toannexb -sn -f mpegts /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-455-MPEG2TS.stf
  501 45696 45135   0   0:05.12 ??         0:56.82 /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/Drobo/Movies/The.Hurt.Locker.1080.mkv -y -vcodec copy -copyts -acodec ac3 -ab 192k -vbsf h264_mp4toannexb -sn -f mpegts /var/folders/VY/VYbRsBRRFl0kkxD3LqRwok+++TI/-Tmp-/Serviio/Serviio/transcoding-temp-455-MPEG2TS.stf

[zip]

Something weird is going on there. It looks like the TV sends 2 requests for the video, at he same time, and the transcoding engine gets a bit confused. I'll look into it at home.

[zip]

Hmm, the TV sends weird request for byte range (a nonexistent one, starting with some huge number), that's why it gets confused.

Ok, I maybe found something that can fix this issue on this site. http://www.yctvblog.com/blog/2010/06/02/transcoding-video-for-yahoo-connected-tv-devices-using-ffmpeg/

Down towards the bottom it reads:

  Code:

Change the Position of the Video Metadata

The steps outlined above work on most 2010 Connected TV device models and web servers. To support video on older 2009 models and web servers that do not support file offsets, you need to move the video’s metadata to the front of the video file.

The problem is the metadata for the video, also known as the “moov atom,” is placed at the end of the file http://lists.mplayerhq.hu/pipermail/ffmpeg-user/2009-October/022482.html. This is only a problem when the file is larger than the Connected TV device can buffer at one time, so small files (~50MB) will not be a problem.

To fix this issue, use a tool called qt-faststart.

Does this sound like it could fix the problem?

[zip]

No, atoms are only present in MOV (MP4) container, we're transcoding into Mpeg2 (TS), which is convenient for this.

[zip]

Further about the bytes range, the TV should not even make such a request, as Serviio supports only time-based seeking for transcoded content (e.g. give me first 20 seconds, instead of give me first 20MB), so the TV has got some issues there.

It;s weird as the LG Bruray player seems to transcode hapily.

Yeah, LG may have changed the way they communicate with the 2010 TV models.

I'm having the exact same problem with a LG 32ld650...