Page 1 of 2

Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Mar 13, 2016 7:03 am
by spamjam2011
I've been pro user for several years. I started having this refresh problem in the last version, and it's still an issue in this version. As long as I force the refresh, it works, but leaving it on 'Auto Refresh' does not. Nothing has changed on my end. Is there a known bug causing this?

FYI - My library is on an internal drive, not a network drive or NAS box.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Mar 13, 2016 11:11 am
by DenyAll
What operating system (Windows. OSX, etc)? What drive type (NTFS, FAT, etc)?
Does the log file register anything when you add a media file to your shared folder?

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Mar 13, 2016 2:54 pm
by spamjam2011
OS: Windows 10
FS: NTFS

There are a few errors noted in the log file.

Lots of this error for all .DNG files.

  Code:
2016-03-13 03:04:44,288 WARN  [MediaFileIndexer] Cannot add file 20140629-Up To 2014-06 S95 Dump 1221.dng because of an unexpected error. Message: null
java.lang.NegativeArraySizeException
   at org.apache.commons.imaging.common.BinaryFunctions.readBytes(BinaryFunctions.java:69)
   at org.apache.commons.imaging.common.BinaryFileParser.readBytes(BinaryFileParser.java:101)
   at org.apache.commons.imaging.formats.jpeg.JpegUtils.traverseJFIF(JpegUtils.java:83)
   at org.apache.commons.imaging.formats.jpeg.JpegImageParser.readSegments(JpegImageParser.java:181)
   at org.apache.commons.imaging.formats.jpeg.JpegImageParser.readSegments(JpegImageParser.java:269)
   at org.apache.commons.imaging.formats.jpeg.JpegImageParser.getImageInfo(JpegImageParser.java:635)
   at org.apache.commons.imaging.Imaging.getImageInfo(Imaging.java:693)
   at org.apache.commons.imaging.Imaging.getImageInfo(Imaging.java:583)
   at org.serviio.library.local.metadata.extractor.embedded.ImageExtractionStrategy.extractMetadata(ImageExtractionStrategy.java:44)
   at org.serviio.library.local.metadata.extractor.embedded.JPEGExtractionStrategy.extractMetadata(JPEGExtractionStrategy.java:64)
   at org.serviio.library.metadata.DCRawMetadataRetriever.retrieveImageMetadata(DCRawMetadataRetriever.java:46)
   at org.serviio.library.metadata.ImageMetadataRetriever.retrieveImageMetadata(ImageMetadataRetriever.java:41)
   at org.serviio.library.local.metadata.extractor.embedded.EmbeddedMetadataExtractor.retrieveImageMetadata(EmbeddedMetadataExtractor.java:223)
   at org.serviio.library.local.metadata.extractor.embedded.EmbeddedMetadataExtractor.retrieveMetadata(EmbeddedMetadataExtractor.java:133)
   at org.serviio.library.local.metadata.extractor.MetadataExtractor.extract(MetadataExtractor.java:47)
   at org.serviio.library.local.MetadataExtractionCoordinator.extractMetadata(MetadataExtractionCoordinator.java:68)
   at org.serviio.library.local.indexing.MediaFileIndexer.addNewMediaFile(MediaFileIndexer.java:78)
   at org.serviio.library.local.indexing.DefaultLibraryMonitor.fileAdded(DefaultLibraryMonitor.java:49)
   at org.serviio.library.local.indexing.pipe.PipeManager$PipeProcessingConsumer.lambda$run$9(PipeManager.java:174)
   at org.serviio.library.local.indexing.pipe.PipeManager$PipeProcessingConsumer$$Lambda$6/14380141.accept(Unknown Source)
   at java.util.Optional.ifPresent(Optional.java:159)
   at org.serviio.library.local.indexing.pipe.PipeManager$PipeProcessingConsumer.run(PipeManager.java:169)
   at java.lang.Thread.run(Thread.java:745)


Another error

  Code:
2016-03-13 03:00:15,757 WARN  [ProcessExecutor] Process cmd has a return code of 1! This is a possible error. Detailed output follows.
libavfilter     5.  2.103 /  5.  2.103
libswscale      3.  1.101 /  3.  1.101
libswresample   1.  1.100 /  1.  1.100
libpostproc    53.  3.100 / 53.  3.100

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Mar 13, 2016 10:41 pm
by DenyAll
Lots of this error for all .DNG files.
May have to defer to @zip for this one, but do these occur when you add these .DNG files to the library?
What about other media files (eg. mp4's) - do they get added?

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Mon Mar 21, 2016 3:01 am
by spamjam2011
DenyAll wrote:
Lots of this error for all .DNG files.
May have to defer to @zip for this one, but do these occur when you add these .DNG files to the library?
What about other media files (eg. mp4's) - do they get added?


.DNG is the Adobe Digital Negative format produced by Adobe Lightroom. It appears this only occurs with .DNG files and not any other file. What I'm wondering is.. when the java error occurs trying to read the .DNG file, does it terminate the process and not add any remaining files? Is there a way to specify an extension ignore list? That might be a quick solution.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Apr 06, 2016 1:06 pm
by DenyAll
Sorry for the delay - is this still an issue with 1.6.1?

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Apr 06, 2016 6:26 pm
by zip
spamjam2011 wrote:What I'm wondering is.. when the java error occurs trying to read the .DNG file, does it terminate the process and not add any remaining files? Is there a way to specify an extension ignore list? That might be a quick solution.

No, it should not terminate the process... and you can see that you're seeing it for multiple files, so that proves that the process tries to add more files.

You could try to upgrade the provided dcraw.exe file, which is responsible to convert/extract the RAW images.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Mon May 30, 2016 1:17 pm
by Joshuar75
I'm having the same issue. I'll get a new video file uploaded, wait 3-4 days before checking the Serviio library and the file will still not be discovered till I get on the server and force a refresh. The "Keep library automatically updated" is checked. That's with Serviio Pro v 1.6.1 on a Windows 2012 Server box. It was working fine just before upgrading.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Jul 20, 2016 8:34 pm
by asnajamara
I'm having the same issue as well. My video files are not added unless I click on "force refresh".
I am running Serviio on a Synology NAS with Servio Pro 1.6.1. I reckognized the problem about 2 months ago. I am a Pro-User for a few years and did not have that problem before.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Thu Feb 16, 2017 11:31 am
by bematft
Same problem!!!!
Windows Home Server (1).
32 bit.

Serviio v1.8

Before update to 1.8 (from 1.7) was worked fine. Now I need to force refresh the libraries.
updated: It is looks like not working with [forced] too... I upload 4 days befor 2 movie and the serviio does not see them.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Thu Feb 16, 2017 1:28 pm
by atc98092
There is an option for each share location to change to the Poller method to check for updates. Have you tried that yet? Go into the share that isn't updating and enable Poller.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Feb 19, 2017 11:17 am
by bematft
atc98092 wrote:There is an option for each share location to change to the Poller method to check for updates. Have you tried that yet? Go into the share that isn't updating and enable Poller.


I tried. I uninstall serviio and delete all files from installed directory, after reinstall 1.8... It grab, learn all files corretly...

BUT not add files automatically, just by [force refresh]. :o

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Feb 19, 2017 11:22 am
by bematft
:idea: :idea: :idea:
Is there any command or command switch to command line for force refresh... I would make a batch file and schedule it with in all 5 minutes.

How many time is the duration of refreshing?

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Feb 26, 2017 4:22 pm
by agamem666
hi,

for each shared folder, uncheck "use the poller mechanism for monitoring this folder"
and in general menu "shared folder" check "keep library automatically updated"

it's work for me with serviio console close.

serviio 1.8 evaluate version. (win 10 pro 64bits)

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Feb 26, 2017 6:08 pm
by atc98092
bematft wrote::idea: :idea: :idea:
Is there any command or command switch to command line for force refresh... I would make a batch file and schedule it with in all 5 minutes.

How many time is the duration of refreshing?


I know of no such ability. Using Poller, I think it queues up every 15 minutes, but don't really know for sure. The non-poller (default) method uses the file system's knowledge to discover new files, and as such there is no time period for it. Hopefully Zip can provide further info here.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sun Feb 26, 2017 9:24 pm
by DenyAll
The default poller duration is 1 minute which can be changed by via the serviio.libraryPollerFrequency system property (in number of minutes). See http://wiki.serviio.org/doku.php?id=lib ... _mechanism.

I wrote this: viewtopic.php?f=17&t=18183 some time ago to allow you to force refresh via the command line, add to a batch or to a Windows task schedule. It was written for a different reason at the time but should still work (I haven't tested it for the latest release but it wouldn't take much to update it). Having said that...the poller mechanism should work in much the same manner - does it not work for you?

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Sat Mar 04, 2017 1:12 pm
by bematft
DenyAll wrote:The default poller duration is 1 minute which can be changed by via the serviio.libraryPollerFrequency system property (in number of minutes). See http://wiki.serviio.org/doku.php?id=lib ... _mechanism.

I wrote this: viewtopic.php?f=17&t=18183 some time ago to allow you to force refresh via the command line, add to a batch or to a Windows task schedule. It was written for a different reason at the time but should still work (I haven't tested it for the latest release but it wouldn't take much to update it). Having said that...the poller mechanism should work in much the same manner - does it not work for you?



It sounds good but not working on WHS (v1) ... with the following error message:
c:/forceserviiorefresh is not a valid Win32 application.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Mar 08, 2017 8:56 am
by DenyAll
bematft wrote:It sounds good but not working on WHS (v1) ... with the following error message:
c:/forceserviiorefresh is not a valid Win32 application.

Not sure if it's a WHS thing, but works on my Win7. You must have .NET framework installed.

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Mar 08, 2017 1:05 pm
by bematft
DenyAll wrote:
bematft wrote:It sounds good but not working on WHS (v1) ... with the following error message:
c:/forceserviiorefresh is not a valid Win32 application.

Not sure if it's a WHS thing, but works on my Win7. You must have .NET framework installed.


WHS is based on server 2003 same as windows XP (and its 32bit).

Re: Must 'Force Refresh' to see new files. Pro Version 1.6

PostPosted: Wed Mar 22, 2017 1:19 pm
by MSGBen
.NET frame version? I have Win7 and this problem is with me too.