Playing DV files from external HD on Sony BDP-S370

Hi.

First post here, bear with me. I've been quite happy with Serviio's ability to stream files via my Sony BluRay S370 and haven't had many problems getting it up and running with an array of video files stored both locally on my Macbook Pro (running OS X 10.6.8), and via a couple external HDs. I'm running 1.3.1 and using this profile: Sony BDP-Sx70/SMP-N100 (2010). Where I'm running into trouble is with my home movie collection, which includes digitized hi8/digital8 films, more recent HD MiniDV, plus some short mpeg clips in AVI containers shot with digital point and shoots. So to be clear, the files in questions are mostly .dv videos, but some are in .mov Quicktime containers, and others are .AVI mpegs. Serviio does not seem to recognize the .dv files: On the Sony the folder will say 'No playable files' and there's not even a sign of them in the detailed log, pasted below. The .mov files don't appear in the player either, but at least the log finds them and indicates they're an unknown video codec. The AVI files are added to the library and appear in the player, but they don't seem to transcode properly (a bunch of pixels display), although the audio works. Appreciate any help here. Let me know if any more info is needed.


Technical metadata for a dv and avi file follows the log.

Log:

013-09-21 16:31:47,407 INFO [PlaylistMaintainerThread] Finished looking for playlist changes
2013-09-21 16:31:47,508 DEBUG [RepositoryServerResource] Updating repository with values: Repository [id=12, folder=/Volumes/FreeAgent G/DVs, keepScanningForUpdates=true, lastScanned=null, supportedFileTypes=[VIDEO], supportsOnlineMetadata=true]
2013-09-21 16:31:47,508 DEBUG [RepositoryDAOImpl] Reading all Repositories
2013-09-21 16:31:47,509 DEBUG [RepositoryService] Found 0 repositories to be removed
2013-09-21 16:31:47,509 DEBUG [RepositoryDAOImpl] Reading a Repository (id = 12)
2013-09-21 16:31:47,518 DEBUG [AccessGroupDAOImpl] Reading all AccessGroups for Repository (id = 12)
2013-09-21 16:31:47,519 DEBUG [MediaItemDAOImpl] Reading MediaItems for Repository (id = 12)
2013-09-21 16:31:47,520 DEBUG [MediaItemDAOImpl] Marking MediaItem (id = 6168) as dirty
2013-09-21 16:31:47,538 DEBUG [RepositoryDAOImpl] Updating Repository (id = 12)
2013-09-21 16:31:47,741 DEBUG [RepositoryServerResource] Library updated, notifying CDS
2013-09-21 16:31:47,742 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2013-09-21 16:31:47,743 DEBUG [LocalContentCacheDecorator] Cleared cache (local_default)
2013-09-21 16:31:47,743 INFO [LibraryAdditionsCheckerThread] Started looking for newly added files
2013-09-21 16:31:47,745 DEBUG [RepositoryDAOImpl] Reading all Repositories
2013-09-21 16:31:47,757 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /Volumes/FreeAgent G/DVs
2013-09-21 16:31:47,758 DEBUG [LibraryAdditionsCheckerThread] Found file '2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov', checking if it's already in the Library
2013-09-21 16:31:47,758 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov
2013-09-21 16:31:47,758 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov, ignore case: false
2013-09-21 16:31:47,749 INFO [PlaylistMaintainerThread] Started looking playlist changes
2013-09-21 16:31:47,759 DEBUG [PlaylistDAOImpl] Reading all Playlists
2013-09-21 16:31:47,759 DEBUG [MediaItemDAOImpl] Media item /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov doesn't exist in DB yet
2013-09-21 16:31:47,759 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it
2013-09-21 16:31:47,760 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov
2013-09-21 16:31:47,761 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov
2013-09-21 16:31:47,763 DEBUG [ProcessExecutor] Starting /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/FreeAgent G/DVs/2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov
2013-09-21 16:31:47,781 INFO [LibraryUpdatesCheckerThread] Started looking for updates to currently shared files
2013-09-21 16:31:47,790 DEBUG [RepositoryDAOImpl] Reading all Repositories
2013-09-21 16:31:47,793 DEBUG [LibraryUpdatesCheckerThread] Looking for removed playlist files in repository: /Volumes/FreeAgent G/DVs
2013-09-21 16:31:47,793 DEBUG [PlaylistDAOImpl] Reading Playlists for Repository (id = 12)
2013-09-21 16:31:47,807 DEBUG [LibraryUpdatesCheckerThread] Looking for removed/updated files in repository: /Volumes/FreeAgent G/DVs
2013-09-21 16:31:47,807 DEBUG [MediaItemDAOImpl] Reading MediaItems for Repository (id = 12)
2013-09-21 16:31:47,810 DEBUG [MediaItemDAOImpl] Getting file of media item 6168
2013-09-21 16:31:47,811 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 12)
2013-09-21 16:31:47,812 DEBUG [LibraryUpdatesCheckerThread] Updating dirty metadata for repository: /Volumes/FreeAgent G/DVs
2013-09-21 16:31:47,812 DEBUG [MediaItemDAOImpl] Getting file of media item 6168
2013-09-21 16:31:47,813 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /Volumes/FreeAgent G/DVs/MVI_5492.AVI
2013-09-21 16:31:47,813 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /Volumes/FreeAgent G/DVs/MVI_5492.AVI
2013-09-21 16:31:47,814 DEBUG [ProcessExecutor] Starting /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -i /Volumes/FreeAgent G/DVs/MVI_5492.AVI
2013-09-21 16:31:47,829 WARN [LibraryManager] Skipping processing metadata for an unsupported file (2009-07-to-10 Henry, P&A BlackSheep, Gatineau Camping, Pool Draft, Henry.mov). Message: Unknown video codec.
2013-09-21 16:31:47,835 DEBUG [LibraryAdditionsCheckerThread] Found file 'MVI_5492.AVI', checking if it's already in the Library
2013-09-21 16:31:47,835 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /Volumes/FreeAgent G/DVs/MVI_5492.AVI
2013-09-21 16:31:47,835 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /Volumes/FreeAgent G/DVs/MVI_5492.AVI, ignore case: false
2013-09-21 16:31:47,839 DEBUG [MediaItemDAOImpl] Media item /Volumes/FreeAgent G/DVs/MVI_5492.AVI already exists in DB
2013-09-21 16:31:47,839 DEBUG [RepositoryDAOImpl] Marking Repository 12 as scanned with current timestamp
2013-09-21 16:31:47,847 DEBUG [RepositoryDAOImpl] Reading all Repositories
2013-09-21 16:31:47,851 DEBUG [AccessGroupDAOImpl] Reading all AccessGroups for Repository (id = 12)
2013-09-21 16:31:47,853 DEBUG [OnlineRepositoryDAOImpl] Reading all OnlineRepositories
2013-09-21 16:31:47,886 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: /Volumes/FreeAgent G/DVs/MVI_5492.AVI
2013-09-21 16:31:47,887 DEBUG [ProcessExecutor] Starting /Applications/Serviio.app/Contents/Resources/Java/../../MacOS/ffmpeg -threads 2 -ss 14 -i /Volumes/FreeAgent G/DVs/MVI_5492.AVI -an -frames:v 1 -f image2 pipe:
2013-09-21 16:31:47,962 DEBUG [LibraryManager] Metadata found via extractor EMBEDDED: VideoMetadata [title=MVI_5492, filePath=/Volumes/FreeAgent G/DVs/MVI_5492.AVI, fileSize=51590378, audioBitrate=88, audioCodec=LPCM, audioStreamIndex=1, bitrate=14397, channels=1, container=AVI, contentType=UNKNOWN, duration=28, episodeNumber=null, fps=30, frequency=11024, h264Levels={}, h264Profile=null, ftyp=null, height=480, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=null, videoCodec=MJPEG, videoFourCC=mjpg, videoStreamIndex=0, width=640, embeddedSubtitles=[]]
2013-09-21 16:31:48,111 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'mvi' (language: en)
2013-09-21 16:31:48,314 DEBUG [TheMovieDBSourceAdaptor] Found 0 matches
2013-09-21 16:31:48,314 DEBUG [TheMovieDBSourceAdaptor] No movie with the name has been found
2013-09-21 16:31:48,314 WARN [OnlineVideoSourcesMetadataExtractor] Online metadata search returned no results for file MVI_5492.AVI [VideoDescription [type=FILM, names=[mvi, null], year=null, season=null, episode=null]]
2013-09-21 16:31:48,323 DEBUG [VideoService] Updating video in database: MVI_5492
2013-09-21 16:31:48,328 DEBUG [VideoDAOImpl] Reading a Video (id = 6168)


--


./ffmpeg -i ~/Movies/1988-12.dv
ffmpeg version N-54096-ge41bf19 Copyright (c) 2000-2013 the FFmpeg developers
built on Jun 18 2013 11:47:55 with gcc 4.0.1 (GCC) (Apple Inc. build 5493)
configuration: --enable-static --disable-shared --disable-ffplay --disable-ffserver --enable-libmp3lame --enable-librtmp --enable-libfreetype --enable-fontconfig --enable-libass --enable-pthreads --enable-libx264 --enable-gpl --disable-mmx --extra-ldflags=-L/Users/MacAdmin/Desktop/build/target/lib --extra-cflags=-I/Users/MacAdmin/Desktop/build/target/include --extra-libs='-lpolarssl -lfreetype -lexpat -liconv'
libavutil 52. 37.101 / 52. 37.101
libavcodec 55. 16.100 / 55. 16.100
libavformat 55. 9.100 / 55. 9.100
libavdevice 55. 2.100 / 55. 2.100
libavfilter 3. 77.101 / 3. 77.101
libswscale 2. 3.100 / 2. 3.100
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 3.100 / 52. 3.100
[dv @ 0x180bc00] Estimating duration from bitrate, this may be inaccurate
Input #0, dv, from '/Users/andrew/Movies/1988-12.dv':
Metadata:
timecode : 00:00:00;00
Duration: 00:09:24.16, start: 0.000000, bitrate: 28771 kb/s
Stream #0:0: Video: dvvideo, yuv411p, 720x480 [SAR 8:9 DAR 4:3], 28771 kb/s, 29.97 tbr, 29.97 tbn, 29.97 tbc
Stream #0:1: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s
At least one output file must be specified

--

./ffmpeg -i /Users/andrew/Movies/MVI_5492.AVI
ffmpeg version N-54096-ge41bf19 Copyright (c) 2000-2013 the FFmpeg developers
built on Jun 18 2013 11:47:55 with gcc 4.0.1 (GCC) (Apple Inc. build 5493)
configuration: --enable-static --disable-shared --disable-ffplay --disable-ffserver --enable-libmp3lame --enable-librtmp --enable-libfreetype --enable-fontconfig --enable-libass --enable-pthreads --enable-libx264 --enable-gpl --disable-mmx --extra-ldflags=-L/Users/MacAdmin/Desktop/build/target/lib --extra-cflags=-I/Users/MacAdmin/Desktop/build/target/include --extra-libs='-lpolarssl -lfreetype -lexpat -liconv'
libavutil 52. 37.101 / 52. 37.101
libavcodec 55. 16.100 / 55. 16.100
libavformat 55. 9.100 / 55. 9.100
libavdevice 55. 2.100 / 55. 2.100
libavfilter 3. 77.101 / 3. 77.101
libswscale 2. 3.100 / 2. 3.100
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 3.100 / 52. 3.100
Guessed Channel Layout for Input Stream #0.1 : mono
Input #0, avi, from '/Users/andrew/Movies/MVI_5492.AVI':
Metadata:
creation_time : 2009-01-17 09:37:51
encoder : CanonMVI02
Duration: 00:00:28.67, start: 0.000000, bitrate: 14397 kb/s
Stream #0:0: Video: mjpeg (MJPG / 0x47504A4D), yuvj422p, 640x480, 30 tbr, 30 tbn, 30 tbc
Stream #0:1: Audio: pcm_u8 ([1][0][0][0] / 0x0001), 11024 Hz, mono, u8, 88 kb/s
At least one output file must be specified

[Illico]

Issue knowed : https://bitbucket.org/xnejp03/serviio/i ... high-4-2-2
https://bitbucket.org/xnejp03/serviio/i ... canon-vids

So it seems there's a known issue with the Canon mjpegs, good to know. I'm less concerned about those files than I am about the raw DVs however.

Serviio doesn't seem to even notice they exist. They're raw DVs, exported in Quicktime on a Mac from digtized Hi8/Digital8 captures. Would I have to put them in a AVI container, would that solve the problem? I didn't provide metadata for the third file in question, which were HD DV files that were in a .MOV Quicktime container. Serviio at least noticed those files in the log but nothing shows up on my player (no playable files), and the log indicates it's an unknown video codec.

I realize that playing back some of these very large files might be a bit ambitious, but I'm curious as to whether it's possible if my computer is up to the transcoding task. It would be amazing if some of these media players supported raw DV natively at some point.

[Illico]

I don't remember if serviio supports "dv" container.


You used ""Sony BDP-Sx70/SMP-N100 (2010)"" profile that inherit of bdp2012 profile.

Then could you open the profiles.xml file and edit the "Sony BDP-Sx90 (2012)" profile by
replacing the following lines:

<Matches container="avi" vCodec="dvvideo" />
<Matches container="mp4" vCodec="dvvideo" />

by

<Matches container="*" vCodec="dvvideo" />

Save and restart serviio service or reboot pc.
Then retry, your dv files should appeared.