Page 1 of 1

Problem with Feed expiry interval

PostPosted: Mon Oct 10, 2016 6:50 pm
by momchil
Hi,

On every restart Serviio 1.7 check all online feeds. My "Feed expiry interval" is set to 99999.
How I can stop this recheck every time?

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 11, 2016 4:19 pm
by momchil
Up!

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 11, 2016 8:33 pm
by zip
That's how it works. The expiry dates for feeds are in memory, so restart will erase it. The technical metadata is cached though (if the plugin creator decides it) so the slow part wont happen again even after restart.

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 11, 2016 9:28 pm
by momchil
I don't have any plugin. Only "Online sources" in Library.

And? I can't stop this recheck?

Re: Problem with Feed expiry interval

PostPosted: Wed Oct 12, 2016 12:31 pm
by zip
What are your online sources? simple feeds?

No, you can't.

Re: Problem with Feed expiry interval

PostPosted: Wed Oct 12, 2016 4:58 pm
by momchil
I have more than 100 feeds... Pf...

I will return to 1.5.2 or I will change the code.

Re: Problem with Feed expiry interval

PostPosted: Thu Oct 13, 2016 7:27 am
by zip
Are you saying 1.5.2 didn't refresh them? There should be no change AFAIK.

Re: Problem with Feed expiry interval

PostPosted: Fri Oct 14, 2016 5:35 pm
by momchil
Yes, no change...

What is this "fixed metadata caching for online content" in changelog for 1.7.1? No more rescan after every restart?

Re: Problem with Feed expiry interval

PostPosted: Sat Oct 15, 2016 6:33 am
by jk50
I believe I have the same problem . Serviio 1.7 and 1.7.1 both do the full metadata check on all online sources every time
serviio is started. This is definitely different behavior from version 1.6.1 or earlier. This happens on two different linux setups,
one kubuntu 14.4 using oracle java 8.0_45, the other neon 16.4 using openjdk 8.0_91. I also get errors in the log for every online
source from both serviio 1.7 and 1.7.1 like the following.
  Code:
2016-10-13 13:03:18,296 ERROR [IndexedDiskCache] Region [online_technical_metadata] Failure updating element, key: http://127.0.0.1:8001/cgi-bin/cable.sh?2 old: null
java.io.NotSerializableException: org.serviio.library.local.AudioTrack
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at java.util.ArrayList.writeObject(ArrayList.java:762)
   at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:498)
   at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1028)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at org.apache.jcs.utils.serialization.StandardSerializer.serialize(StandardSerializer.java:50)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDisk.serialize(IndexedDisk.java:288)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCache.doUpdate(IndexedDiskCache.java:430)
   at org.apache.jcs.auxiliary.disk.AbstractDiskCache$MyCacheListener.handlePut(AbstractDiskCache.java:603)
   at org.apache.jcs.engine.CacheEventQueue$PutEvent.doRun(CacheEventQueue.java:688)
   at org.apache.jcs.engine.CacheEventQueue$AbstractCacheEvent.run(CacheEventQueue.java:607)
   at org.apache.jcs.engine.CacheEventQueue$QProcessor.run(CacheEventQueue.java:575)

All the same online sources work fine in version 1.6.1 .

Re: Problem with Feed expiry interval

PostPosted: Mon Oct 17, 2016 8:01 am
by zip
^ this error should be what was fixed in 1.7.1. Is it still happening?

Re: Problem with Feed expiry interval

PostPosted: Mon Oct 17, 2016 11:58 am
by jk50
Yes , I just checked it again ,still getting errors like the following in linux version 1.7.1
  Code:
2016-10-17 07:44:42,681 ERROR [IndexedDiskCache] Region [online_technical_metadata] Failure updating element, key: http://127.0.0.1:8001/cgi-bin/cable.sh?2 old: null
java.io.NotSerializableException: org.serviio.library.local.AudioTrack
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at java.util.ArrayList.writeObject(ArrayList.java:762)
   at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:498)
   at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1028)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at org.apache.jcs.utils.serialization.StandardSerializer.serialize(StandardSerializer.java:50)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDisk.serialize(IndexedDisk.java:288)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCache.doUpdate(IndexedDiskCache.java:430)
   at org.apache.jcs.auxiliary.disk.AbstractDiskCache$MyCacheListener.handlePut(AbstractDiskCache.java:603)
   at org.apache.jcs.engine.CacheEventQueue$PutEvent.doRun(CacheEventQueue.java:688)
   at org.apache.jcs.engine.CacheEventQueue$AbstractCacheEvent.run(CacheEventQueue.java:607)
   at org.apache.jcs.engine.CacheEventQueue$QProcessor.run(CacheEventQueue.java:575)

Re: Problem with Feed expiry interval

PostPosted: Mon Oct 17, 2016 6:00 pm
by zip
What if you remove the feed from library, Save and add it again?

Re: Problem with Feed expiry interval

PostPosted: Mon Oct 17, 2016 7:14 pm
by jk50
Ok , I started version 1.7.1 , let it run till it finished checking all online sources and settled down.
Checked the log , for every online source same previously mentioned error. I removed a source , hit save , added same source again.
Checked the log again and the removed and replaced source got the same error again
  Code:
2016-10-17 14:38:58,155 ERROR [IndexedDiskCache] Region [online_technical_metadata] Failure updating element, key: http://127.0.0.1:8001/cgi-bin/dvd2.sh?/media/ex3/Video/K3b.iso old: null
java.io.NotSerializableException: org.serviio.library.local.AudioTrack
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at java.util.ArrayList.writeObject(ArrayList.java:762)
   at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:498)
   at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1028)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
   at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
   at org.apache.jcs.utils.serialization.StandardSerializer.serialize(StandardSerializer.java:50)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDisk.serialize(IndexedDisk.java:288)
   at org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCache.doUpdate(IndexedDiskCache.java:430)
   at org.apache.jcs.auxiliary.disk.AbstractDiskCache$MyCacheListener.handlePut(AbstractDiskCache.java:603)
   at org.apache.jcs.engine.CacheEventQueue$PutEvent.doRun(CacheEventQueue.java:688)
   at org.apache.jcs.engine.CacheEventQueue$AbstractCacheEvent.run(CacheEventQueue.java:607)
   at org.apache.jcs.engine.CacheEventQueue$QProcessor.run(CacheEventQueue.java:575)

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 18, 2016 8:48 am
by zip
Thanks, I will try to release a patch.

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 18, 2016 8:30 pm
by zip
I have released 1.7.1.1 which should fix the feed error above. get it on the download page.

Re: Problem with Feed expiry interval

PostPosted: Tue Oct 18, 2016 8:42 pm
by momchil
zip wrote:I have released 1.7.1.1 which should fix the feed error above. get it on the download page.


>>>

momchil wrote:Yes, no change...

What is this "fixed metadata caching for online content" in changelog for 1.7.1? No more rescan after every restart?

Re: Problem with Feed expiry interval

PostPosted: Wed Oct 19, 2016 7:41 am
by zip
This fixes the error jk50 had.

It will still rescan feeds on restart, as it was always doing (AFAIK), but it will now not invoke ffmpeg for all the items, as they will be properly cached.

Re: Problem with Feed expiry interval

PostPosted: Wed Oct 19, 2016 11:47 am
by jk50
Version 1.7.1.1 is working well ,thank you.

Re: Problem with Feed expiry interval

PostPosted: Sun Oct 23, 2016 10:42 am
by momchil
I have installed XUPNPD on my OpenWRT router.
Now Serviio is only for video files.

Sorry, zip, but rescan of online content after every start is not a good solution.

Re: Problem with Feed expiry interval

PostPosted: Thu Oct 27, 2016 12:41 pm
by lagunaa
zip wrote:I have released 1.7.1.1 which should fix the feed error above. get it on the download page.

Just be aware of new version 1.7.1.1 at http://www.serviio.org/download because of this forum post.
Why didn't you post it on the Announcements / News section as usual?
Neither https://bitbucket.org/xnejp03/serviio/issues mentioned that new version.
Cheers.