Library Update stalls

Hi, I'm new to serviio. please go easy on the noob.

I'm running Serviio 0.6.1 on a windows ultimate workstation with locally attached storage and some NAS. I am only looking for stream Video and Images. Streaming works fine for the items that are actually in library but that is where I am having issues. The library update fails when trying to add files from a particular folder (locally attached storage). I have removed the first file that appears to be troublesome, but the library craps out on the next file during the next refresh. All of these photos are just family photos, and these troublesome images are no different than the rest.

I have turned on debug and found the location in the log file where the file is stalling, but I'm not seeing anything that is obviously wrong in the log. Below is an excerpt from the log file where the failure is occurring. The log file continues on after these entrys, but I have only included what is around the lines where the failure occurs. Any help would be appreciated

2012-01-28 19:07:15,455 DEBUG [LibraryAdditionsCheckerThread] Found file 'christmas cards1.jpg', checking if it's already in the Library
2012-01-28 19:07:15,455 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item christmas cards1.jpg
2012-01-28 19:07:15,456 DEBUG [MediaItemDAOImpl] Media item christmas cards1.jpg doesn't exist in DB yet
2012-01-28 19:07:15,456 DEBUG [LibraryAdditionsCheckerThread] File not in Library, will add it
2012-01-28 19:07:15,471 DEBUG [ImageExtractionStrategy] Extracting metadata of image file: E:\Family Photos & Video\2008\December\Christmas Studio Phoitos\christmas cards1.jpg
2012-01-28 19:07:15,474 DEBUG [LibraryManager] Metadata found via extractor EMBEDDED: ImageMetadata [title=christmas cards1, date=Fri Dec 19 21:14:33 EST 2008, filePath=E:\Family Photos & Video\2008\December\Christmas Studio Phoitos\christmas cards1.jpg, fileSize=71913306, container=JPEG, width=8400, height=12388, colorDepth=24]
2012-01-28 19:07:15,474 DEBUG [ImageService] Adding image into database: christmas cards1
2012-01-28 19:07:15,474 DEBUG [FolderDAOImpl] Looking for folder hierarchy December\Christmas Studio Phoitos
2012-01-28 19:07:15,475 DEBUG [ImageService] Resizing and storing thumbnail image
2012-01-28 19:07:15,641 DEBUG [AbstractCDSLibraryIndexingListener] Library updated, notifying CDS
2012-01-28 19:07:15,641 DEBUG [LocalContentCacheDecorator] Cleared cache (local_resetafterplay)
2012-01-28 19:07:15,641 DEBUG [LocalContentCacheDecorator] Cleared cache (local_default)
2012-01-28 19:07:15,924 DEBUG [EventDispatcher] Sending event notification #371 for subscription 67263fbb-82d8-4102-bbc7-4bb52381cf85 to endpoint http://127.0.0.1:9020/
2012-01-28 19:07:15,926 DEBUG [RequestExecutor] Sending HTTP request to 127.0.0.1:9020
2012-01-28 19:07:15,930 DEBUG [EventDispatcher] Event notification sent and received successfully
2012-01-28 19:07:15,931 DEBUG [EventDispatcher] Sending event notification #371 for subscription 28ce20ff-3953-440d-8d81-74a3351f3173 to endpoint http://127.0.0.1:9000/
2012-01-28 19:07:15,931 DEBUG [RequestExecutor] Sending HTTP request to 127.0.0.1:9000
2012-01-28 19:07:15,933 DEBUG [EventDispatcher] Event notification sent and received successfully
2012-01-28 19:07:16,550 DEBUG [ImageUtils] Starting image resize, size = 71913306 bytes
2012-01-28 19:07:16,959 DEBUG [DiscoverySSDPMessageListener] Received a valid M-SEARCH message for search target urn:schemas-upnp-org:device:WdNAS:1 from address /192.168.1.3:64821
2012-01-28 19:07:19,774 DEBUG [DiscoverySSDPMessageListener] Received a valid M-SEARCH message for search target urn:schemas-upnp-org:device:WdNAS:1 from address /192.168.1.3:64821
2012-01-28 19:07:23,781 DEBUG [DiscoverySSDPMessageListener] Received a valid M-SEARCH message for search target urn:schemas-upnp-org:device:WdNAS:1 from address /192.168.1.3:64821
2012-01-28 19:07:25,158 DEBUG [DiscoveryAdvertisementNotifier] Multicasting SSDP alive using interface eth3 (Realtek RTL8168D/8111D Family PCI-E Gigabit Ethernet NIC (NDIS 6.20)) and address 192.168.1.3, timeout = 0
2012-01-28 19:07:25,158 DEBUG [DiscoveryAdvertisementNotifier] Sending 6 'alive' messages describing device 92364609-eb74-3e48-a97f-fb1c988d0a03

[Cerberus]

its caused by bad exif rotation data, what you need to do is remove all files that cause an issue until u have all of them in seperate folder and library completely refreshed, then manual rerotate them in windows so that correct data is saved then readd them to library shared folder and they then should work fine.

OK, I will try that now. Can you tell me if this is something you see in the log or just something you knew/learned from experience?

[Cerberus]

OK, I will try that now. Can you tell me if this is something you see in the log or just something you knew/learned from experience?

experience

well, thanks for that. I have moved the troublesome images out of the folder, and the library seems to be updating ok now. It has clearly passed the previous stall point.

But back to the original problem, I noticed that the troublesome files were scanned images, not photos from a digicam. They do have some exif information as written by PhotoShop CS3, but clearly not the volume of information you would see in a digicam exif file. I will do as you've said regarding re-rotating, but are we sure that this is rotation issues? or does it have to do with the shortage of exif data in general. Note, I have been able to successfully add other scanned images which contain no exif info at all.

Any thoughts?

[Cerberus]

well, thanks for that. I have moved the troublesome images out of the folder, and the library seems to be updating ok now. It has clearly passed the previous stall point.

But back to the original problem, I noticed that the troublesome files were scanned images, not photos from a digicam. They do have some exif information as written by PhotoShop CS3, but clearly not the volume of information you would see in a digicam exif file. I will do as you've said regarding re-rotating, but are we sure that this is rotation issues? or does it have to do with the shortage of exif data in general. Note, I have been able to successfully add other scanned images which contain no exif info at all.

Any thoughts?

yer seem to be specificly the rotation info that does it.

[zip]

Its more likely related to running out of allocated memory when dealing with large images. Increase xmx value in serviioservice.exe.vmoptions to 512m.

Hi Everyone,
Please bear with me, I am new to Serviio. I am also having this problem. The library seams to stop at the same file each time i try to update the library. The files are video files and i have tried to update serviioservice.exe.vmoptions. It now reads -Xmx1024m and it doesn't seam to have helped. Do i need to increase the memory to -Xmx2048m? I am running windows 7 64 bit. Also I am not able to see the video files on my Vizio M420SL using the builtin DLNA. I can browse the folders just fine but no video files are showing up. Is this related to the library not updating?
Thank you,
Dan

[zip]

You can try removing the image(s) causing this.

Doing my mega-index of jpgs now. The jpgs are on a Synology NAS. I am doing the indexing there.
Indexing stalled on a file PICT2875.JPG
I looked for it and found 2 instances of the same file
Z:\pix\>dir pict2875.* /s
...
Directory of Z:\pix\2011_May
26/05/2011 10:50 2,070,411 PICT2875.JPG
1 File(s) 2,070,411 bytes
Directory of Z:\pix\2011_Chloe
26/05/2011 11:50 2,070,411 PICT2875.JPG
1 File(s) 2,070,411 bytes
So I removed one copy.

But I'm not sure this is totally the cause of the stall. Before it had finished indexing I started looking at the pictures on a TV, and the last few lines of the log say
2012-05-30 20:38:35,194 INFO [LibraryAdditionsCheckerThread] Added file 'P1020453.JPG' (title: P1020453) to Library
2012-05-30 20:38:37,951 INFO [LibraryAdditionsCheckerThread] Added file 'PICT2875.JPG' (title: PICT2875) to Library
2012-05-30 21:06:00,882 INFO [RendererManager] Stored a new renderer: uuid='5f98acf9-dbf9-4ceb-a7b3-2617fae26cd4', name = 'Unrecognized device', ipAddress='10.0.1.121', profile = '1'
and it is stalled again. The status is
Checking for new files: true
Checking for updates: false
2524
PICT2875.JPG
and indexing is stalled again.

[zip]

yes, it's probably the culprit