FAQ  •  Register  •  Login

MetadataExtractionCoordinator does skip metadata

<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Tue May 10, 2022 7:03 pm

MetadataExtractionCoordinator does skip metadata

I have a strange anomaly with metadata of one DSF file. All the rest are read out properly, this one is not. I have no real means to validate the structure of a DSF file myself.
Here is the Debug log of the anomaly:

2022-05-10T08:48:07,382 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=Jazz, releaseYear=1970, album=Bitches Brew (1970)[5.0], trackNumber=1, duration=1162, albumArtist=Miles Davis, artist=Miles Davis, discNumber=1, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=2050142193, filePath=/1-01. Pharaoh_s Dance [5.0].dsf, title=Pharaoh's Dance, date=Thu Jan 01 00:00:00 EET 1970, ]

2022-05-10T08:48:07,477 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

2022-05-10T08:48:08,712 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=, duration=1604, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=2829078510, filePath=/1-02. Bitches Brew [5.0].dsf, title=1-02. Bitches Brew [5.0], date=Tue May 10 08:28:19 EEST 2022, ]

2022-05-10T08:48:08,714 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

2022-05-10T08:48:10,077 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=Jazz, releaseYear=1970, album=Bitches Brew (1970)[5.0], trackNumber=1, duration=1043, albumArtist=Miles Davis, artist=Miles Davis, discNumber=2, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=1839751149, filePath=/2-01. Spanish Key [5.0].dsf, title=Spanish Key, date=Thu Jan 01 00:00:00 EET 1970, ]

2022-05-10T08:48:10,078 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

2022-05-10T08:48:11,379 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=Jazz, releaseYear=1970, album=Bitches Brew (1970)[5.0], trackNumber=2, duration=264, albumArtist=Miles Davis, artist=Miles Davis, discNumber=2, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=465399793, filePath=/2-02. John McLaughlin [5.0].dsf, title=John McLaughlin, date=Thu Jan 01 00:00:00 EET 1970, ]

2022-05-10T08:48:11,381 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

2022-05-10T08:48:12,614 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=Jazz, releaseYear=1970, album=Bitches Brew (1970)[5.0], trackNumber=3, duration=835, albumArtist=Miles Davis, artist=Miles Davis, discNumber=2, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=1473241084, filePath=/2-03. Miles Runs The Voodoo Down [5.0].dsf, title=Miles Runs The Voodoo Down, date=Thu Jan 01 00:00:00 EET 1970, ]

2022-05-10T08:48:12,615 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

2022-05-10T08:48:13,818 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: AudioMetadata [container=DSF, genres=Jazz, releaseYear=1970, album=Bitches Brew (1970)[5.0], trackNumber=4, duration=654, albumArtist=Miles Davis, artist=Miles Davis, discNumber=2, bitrate=14112000, channels=0, sampleFrequency=2822400, fileSize=1154756587, filePath=/2-04. Sanctuary [5.0].dsf, title=Sanctuary, date=Thu Jan 01 00:00:00 EET 1970, ]

2022-05-10T08:48:13,819 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor COVER_IMAGE_IN_FOLDER: AudioMetadata [genres=, fileSize=0, ]

MediaInfo reads it out without issue, apparently:

  Code:
General
Complete name                            : /1-02. Bitches Brew [5.0].dsf
Format                                   : DSF
Format/Info                              : Direct Stream Digital Stream File
Format version                           : Version 1
File size                                : 2.63 GiB
Duration                                 : 26 min 43 s
Overall bit rate                         : 14.1 Mb/s
Album                                    : Bitches Brew (1970)[5.0]
Album/Performer                          : Miles Davis
Part/Position                            : 1
Part/Total                               : 2
Track name                               : Bitches Brew
Track name/Position                      : 2
Track name/Total                         : 2
Performer                                : Miles Davis
Genre                                    : Jazz
Recorded date                            : 1970
ISRC                                     : USSM11803916
Cover                                    : Yes
Cover MIME                               : image/jpeg
Media Type                               : SACD

Audio
Format                                   : DSD
Format/Info                              : Direct Stream Digital
Commercial name                          : DSD64
Format settings                          : Little
Duration                                 : 26 min 43 s
Bit rate                                 : 14.1 Mb/s
Channel(s)                               : 5 channels
Channel layout                           : L R C Ls Rs
Sampling rate                            : 2 822 kHz
Compression mode                         : Lossless
Stream size                              : 2.63 GiB (100%)


I am unable to see anything wrong with the ID3 tag of the file /1-02. Bitches Brew [5.0].dsf, so looking at the displaced metadata, I am thinking of a buffer overflow or similar condition.
I can upload the 2 DSF files, if that will help investigation.
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Wed Sep 28, 2022 6:15 pm

Re: MetadataExtractionCoordinator does skip metadata

I have a question to someone in the know - is this metadata extractor based on ffmpeg?
In other words, shall I expect to see a result similar to what I get from ffmpeg -i ??

I am asking, because I encountered the same problem again, with a different file. Both are multichannel versions of a DSF, that is true.
If I run ffmpeg -i on this file, I also get a partial extract of metadata.
So is this a question to ffmpeg developers instead?
<<

atc98092

User avatar

DLNA master

Posts: 5205

Joined: Fri Aug 17, 2012 10:22 pm

Location: Washington (the state)

Post Wed Sep 28, 2022 6:52 pm

Re: MetadataExtractionCoordinator does skip metadata

I'm not the developer, but I can answer at least part of that. FFMPEG is used for a number of functions, but I don't believe it's used to retrieve metadata from online sources. Serviio instead matches the file name to the online databases for a match, based on the file name, the year if included, and for TV episodes the season and episode number, which all have to be part of the file name. There is a metadata field within a media file that can contain a Title, but in general those are seldom very helpful. When I rip a DVD with MakeMKV, the file name that MakeMKV creates is usually embedded in that field. Unless I specifically enter the accurate name and year, that file name is often something bland like video0.mkv. But if you're not using an online metadata source, Serviio might very well be extracting that name from the file.
Dan

LG NANO85 4K TV, Samsung JU7100 4K TV, Sony BDP-S3500, Sharp 4K Roku TV, Insignia Roku TV, Roku Ultra, Premiere and Stick, Nvidia Shield, Yamaha RX-V583 AVR.
Primary server: Intel i5-6400, 16 gig ram, Windows 10 Pro, 22 TB hard drive space | Test server Windows 10 Pro, AMD Phenom II X4 965, 8 gig ram

HOWTO: Enable debug logging HOWTO: Identify media file contents
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Wed Sep 28, 2022 8:20 pm

Re: MetadataExtractionCoordinator does skip metadata

Updating my question myself - looks like Audio Metadata extraction relies on Jaudiotagger, so the question should be raised with their Issue Tracker.
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Thu Sep 29, 2022 12:21 pm

Re: MetadataExtractionCoordinator does skip metadata

Opened an issue in JAudiotagger github : https://bitbucket.org/ijabz/jaudiotagge ... -dsf-files
It is interesting to note, that their 2.2.4 build seems not to have that problem, but unfortunately, Serviio's current build (2.2.1) already depends on JAudiotagger 2.2.6 features, so the trivial trick of replacing the jaudiotagger.jar with older one did not work out.
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Mon Oct 03, 2022 5:40 am

Re: MetadataExtractionCoordinator does skip metadata

atc98092 wrote:I'm not the developer, but I can answer at least part of that. FFMPEG is used for a number of functions, but I don't believe it's used to retrieve metadata from online sources. Serviio instead matches the file name to the online databases for a match, based on the file name, the year if included, and for TV episodes the season and episode number, which all have to be part of the file name. There is a metadata field within a media file that can contain a Title, but in general those are seldom very helpful. When I rip a DVD with MakeMKV, the file name that MakeMKV creates is usually embedded in that field. Unless I specifically enter the accurate name and year, that file name is often something bland like video0.mkv. But if you're not using an online metadata source, Serviio might very well be extracting that name from the file.

Hi Dan
Thank you for this explanation.
I forgot to mention, that I am talking only about retrieval of the _embedded_ metadata. Essentially, these are stored in the ID3 tags and I always populate the metadata myself. For DSF files the ripping program (TraX) can do a large part automatically, as SACD-s contain this data (kind of extended CDText).
That can also be seen in the log entry:
  Code:
Metadata found via extractor EMBEDDED: AudioMetadata
<<

atc98092

User avatar

DLNA master

Posts: 5205

Joined: Fri Aug 17, 2012 10:22 pm

Location: Washington (the state)

Post Mon Oct 03, 2022 2:31 pm

Re: MetadataExtractionCoordinator does skip metadata

Yeah, FFMPEG is likely doing the metadata retrieval from within the file. When I've run FFMPEG -i on one of my video files, it does show what the file considers as the title, which usually isn't anything close to accurate on many of my movie rips. I've never used the command on the few MP3s I have, so I'll try to remember to do so to see what comes up.
Dan

LG NANO85 4K TV, Samsung JU7100 4K TV, Sony BDP-S3500, Sharp 4K Roku TV, Insignia Roku TV, Roku Ultra, Premiere and Stick, Nvidia Shield, Yamaha RX-V583 AVR.
Primary server: Intel i5-6400, 16 gig ram, Windows 10 Pro, 22 TB hard drive space | Test server Windows 10 Pro, AMD Phenom II X4 965, 8 gig ram

HOWTO: Enable debug logging HOWTO: Identify media file contents
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Mon Oct 03, 2022 7:19 pm

Re: MetadataExtractionCoordinator does skip metadata

atc98092 wrote:Yeah, FFMPEG is likely doing the metadata retrieval from within the file. When I've run FFMPEG -i on one of my video files, it does show what the file considers as the title, which usually isn't anything close to accurate on many of my movie rips. I've never used the command on the few MP3s I have, so I'll try to remember to do so to see what comes up.

No, the retrieval and database population is done by JAudiotagger. For what other purpose would it be part of Serviio?
I do not think Serviio undertakes writing of embedded ID3 metadata tags into media files (the other purpose of JAudiotagger)?
PS I have not checked, perhaps ffmpeg builds also on JAudiotagger? At any rate it also fails to fetch metadata from my 2,15+GB files.
I can send you my file that fails with current Serviio release, if that would help in any way to debug the issue.
<<

atc98092

User avatar

DLNA master

Posts: 5205

Joined: Fri Aug 17, 2012 10:22 pm

Location: Washington (the state)

Post Mon Oct 03, 2022 7:25 pm

Re: MetadataExtractionCoordinator does skip metadata

Oh yeah, you said that... Sorry, was too early this morning. :D

Since I can do nothing to make changes in Serviio, my troubleshooting would only serve to validate your issue. And I'm happy to do that. But it might get noticed faster if you post a trouble ticket on Bit Bucket for Serviio. https://bitbucket.org/xnejp03/serviio/issues
Dan

LG NANO85 4K TV, Samsung JU7100 4K TV, Sony BDP-S3500, Sharp 4K Roku TV, Insignia Roku TV, Roku Ultra, Premiere and Stick, Nvidia Shield, Yamaha RX-V583 AVR.
Primary server: Intel i5-6400, 16 gig ram, Windows 10 Pro, 22 TB hard drive space | Test server Windows 10 Pro, AMD Phenom II X4 965, 8 gig ram

HOWTO: Enable debug logging HOWTO: Identify media file contents
<<

priitv8

Serviio newbie

Posts: 14

Joined: Wed Jan 03, 2018 6:24 am

Post Tue Oct 11, 2022 6:19 am

Re: MetadataExtractionCoordinator does skip metadata

atc98092 wrote:Oh yeah, you said that... Sorry, was too early this morning. :D

Since I can do nothing to make changes in Serviio, my troubleshooting would only serve to validate your issue. And I'm happy to do that. But it might get noticed faster if you post a trouble ticket on Bit Bucket for Serviio. https://bitbucket.org/xnejp03/serviio/issues

Thank you for taking time to confirm my issue with Serviio.
You can download the test file from my server: http://varik.servehttp.com/AST/MetaDataTest.zip
I did open an issue also on BitBucket for Serviio.

Return to Serviio Support & Help

Who is online

Users browsing this forum: No registered users and 48 guests

Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by ST Software for PTF.