FAQ  •  Register  •  Login

30 sec timeout not cancelling item extraction.

<<

jhb50

DLNA master

Posts: 2843

Joined: Thu Jun 30, 2011 9:32 pm

Post Sun Aug 19, 2012 1:59 pm

30 sec timeout not cancelling item extraction.

As the following shows, the 30 second aggregate item extraction timeout kicks in but then the item extractions continue. This makes no sense.

  Code:
2012-08-19 09:35:25,017 DEBUG [OnlineLibraryManager] Resource http://www.hahasport.com/c-1.html?estreams=3 not in cache yet, loading it
2012-08-19 09:35:25,017 DEBUG [WebResourceParser] Parsing web resource 'http://www.hahasport.com/c-1.html?estreams=3'
2012-08-19 09:35:25,017 DEBUG [WebResourceParser] Found matching url extractor (HaHaSport) for resource http://www.hahasport.com/c-1.html?estreams=3
2012-08-19 09:35:25,017 DEBUG [FeedItemUrlExtractor] HaHaSport: Starting parsing resource: http://www.hahasport.com/c-1.html?estreams=3
2012-08-19 09:35:25,017 DEBUG [FeedItemUrlExtractor] HaHaSport: Parsing with hahasport 7
2012-08-19 09:35:25,018 DEBUG [FeedItemUrlExtractor] HaHaSport: Reading hahasport html
2012-08-19 09:35:26,707 DEBUG [FeedItemUrlExtractor] HaHaSport: hahasport read completed
2012-08-19 09:35:26,708 DEBUG [FeedItemUrlExtractor] HaHaSport: hahasport extraction starting
2012-08-19 09:35:27,442 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 7:45-9:45 Dundee United vs. Dundee FC-Scottish Premier League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:28,129 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Sun 7:45-9:45 Dundee United vs. Dundee FC-Scottish Premier League'
2012-08-19 09:35:28,828 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://euro2012live.tv/ch11-i.html - Sun 7:45-9:45 Dundee United vs. Dundee FC-Scottish Premier League
2012-08-19 09:35:29,510 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://mypremium.tv/stream/?id=277 - Sun 7:45-9:45 Dundee United vs. Dundee FC-Scottish Premier League
2012-08-19 09:35:30,184 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://coolsport.tv/kiwi2.php - Sun 7:45-9:45 Dundee United vs. Dundee FC-Scottish Premier League
2012-08-19 09:35:30,919 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 7:45-9:45 FC Sion vs. Young Boys Bern-Swiss Super League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:31,595 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - castal - Sun 7:45-9:45 FC Sion vs. Young Boys Bern-Swiss Super League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:32,311 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - castal - Sun 7:45-9:45 Geneve Servette vs. FC Zurich-Swiss Super League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:33,040 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - castal - Sun 8:00-10:00 Esbjerg FB vs. AC Horsens-Danish Superligaen - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:33,718 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://coolsport.tv/kiwi9.php - Sun 8:00-10:00 Esbjerg FB vs. AC Horsens-Danish Superligaen
2012-08-19 09:35:34,435 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:00-10:00 FK Dinamo Moscow vs. Terek Groznyi-Russian Premier League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:35,104 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:00-10:00 FK Dinamo Moscow vs. Terek Groznyi-Russian Premier League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:35,783 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://emb.aliez.tv/player/live.php?id=4707 - Sun 8:00-10:00 FK Dinamo Moscow vs. Terek Groznyi-Russian Premier League
2012-08-19 09:35:36,445 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://emb.aliez.tv/player/live.php?id=5574 - Sun 8:00-10:00 FK Dinamo Moscow vs. Terek Groznyi-Russian Premier League
2012-08-19 09:35:37,371 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Sun 8:00-10:00 FK Dinamo Moscow vs. Terek Groznyi-Russian Premier League'
2012-08-19 09:35:38,103 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:38,786 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - ilivet - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:39,468 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://liveall.tv/player.php?streampage=dhnd2dbfdbdf - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:40,167 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://cool-sport.net/zcast.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:40,857 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League'
2012-08-19 09:35:41,540 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.tonestream.info - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:42,202 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.megaviptv.eu/live/megavip1.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:42,888 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://hdfoots.altervista.org/live1.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:43,572 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://tinyurl.com/7qbej2l - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:44,233 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://daliansports.at.ua/embbed1.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:45,166 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://bhoystv.eu/stream.php - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:45,962 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://coolsport.tv/kiwi1.php - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:46,648 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://embed.softsportstv.eu/?width=480 - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:47,188 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://stream9999.ucoz.co.uk/99.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:47,873 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://mypremium.tv/stream/?id=1450 - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:48,565 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://embeds.ideportes.in/embed.html - Sun 8:30-10:30 Wigan Athletic vs. Chelsea-English Premier League
2012-08-19 09:35:49,279 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.fromlinks.com/v123/watch2.html - Sun 8:30-12:00 DFB Pokal Simulcast / Konferenz-German DFB Pokal
2012-08-19 09:35:49,945 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.castasap.com/channel.php?file=5063 - Sun 8:30-12:00 DFB Pokal Simulcast / Konferenz-German DFB Pokal
2012-08-19 09:35:50,619 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.castasap.com/channel.php?file=5049 - Sun 8:30-12:00 DFB Pokal Simulcast / Konferenz-German DFB Pokal
2012-08-19 09:35:51,298 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.castasap.com/channel.php?file=5051 - Sun 8:30-12:00 DFB Pokal Simulcast / Konferenz-German DFB Pokal
2012-08-19 09:35:51,995 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 Karlsruher SC vs. Hamburger SV-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:52,680 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.castasap.com/channel.php?file=5067 - Sun 8:30-10:30 Karlsruher SC vs. Hamburger SV-German DFB Pokal
2012-08-19 09:35:53,401 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.castasap.com/channel.php?file=5056 - Sun 8:30-10:30 Karlsruher SC vs. Hamburger SV-German DFB Pokal
2012-08-19 09:35:54,079 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 FC Hennef 05 - TSV 1860 Munchen-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:54,777 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 FC Hennef 05 - TSV 1860 Munchen-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:55,021 WARN  [FeedUpdaterThread] An error occured while scanning for online item information, will continue
java.io.IOException: Unexpected error while invoking plugin (HaHaSport): The operation took more than 30000 ms and has been cancelled.
   at org.serviio.library.online.WebResourceParser.parse(WebResourceParser.java:58)
   at org.serviio.library.online.OnlineLibraryManager.findResource(OnlineLibraryManager.java:171)
   at org.serviio.library.online.OnlineLibraryManager.findResourceInCacheOrParse(OnlineLibraryManager.java:186)
   at org.serviio.library.online.metadata.FeedUpdaterThread.getOnlineItems(FeedUpdaterThread.java:159)
   at org.serviio.library.online.metadata.FeedUpdaterThread.run(FeedUpdaterThread.java:96)
Caused by: java.lang.RuntimeException: The operation took more than 30000 ms and has been cancelled.
   at org.serviio.library.online.PluginExecutionProcessor.execute(PluginExecutionProcessor.java:64)
   at org.serviio.library.online.WebResourceUrlExtractor.parseWebResource(WebResourceUrlExtractor.java:29)
   at org.serviio.library.online.WebResourceParser.parse(WebResourceParser.java:56)
   ... 4 more
2012-08-19 09:35:55,468 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 FC Nottingen - Hannover 96-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:56,154 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 FC Nottingen - Hannover 96-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:56,829 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 TSV Havelse - FC Nurnberg-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:57,535 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 TSV Havelse - FC Nurnberg-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:58,234 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 Worms - Hertha BSC Berlin-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:58,988 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 Worms - Hertha BSC Berlin-German DFB Pokal - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:35:59,685 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Sun 8:30-10:30 AZ vs. Heracles-Dutch Eredivisie'
2012-08-19 09:36:00,412 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Sun 8:30-10:30 ADO den Haag vs. RKC Waalwijk-Dutch Eredivisie'
2012-08-19 09:36:01,265 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 8:30-10:30 Wisla Krakow vs. GKS Belchatow-Polish Ekstraklasa - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:36:01,948 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - ustrea - Sun 8:30-10:30 Wisla Krakow vs. GKS Belchatow-Polish Ekstraklasa - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:36:02,634 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://www.youtube.com/embed/AVI1FnpjZi4 - Sun 8:30-10:30 Wisla Krakow vs. GKS Belchatow-Polish Ekstraklasa
2012-08-19 09:36:03,331 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - castam - Sun 8:30-10:30 Wisla Krakow vs. GKS Belchatow-Polish Ekstraklasa - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:36:04,059 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 9:00-11:00 Slovan Liberec vs. Jihlava-Czech Gambrinus Liga - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:36:04,733 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://coolsport.tv/kiwi4.php - Sun 9:00-11:00 Start VS Sarpsborg -Norwegian Adeccoligaen
2012-08-19 09:36:05,424 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://coolsport.tv/kiwi4.php - Sun 9:00-11:00 Start VS Sarpsborg -Norwegian Adeccoligaen
2012-08-19 09:36:06,118 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Sun 10:00-12:00 Racing Club - Independiente-Argentina - Primera Division - Refresh at 10:35 on Sun 8/19/2012
2012-08-19 09:36:06,803 DEBUG [FeedItemUrlExtractor] HaHaSport: NEXT ITEM - http://www.veemi.com/javascript/embedPlayer.js - Sun 10:00-12:00 Racing Club - Independiente-Argentina - Primera Division - Refresh in 20 mins at 9:55 on Sun
2012-08-19 09:36:06,804 DEBUG [FeedItemUrlExtractor] HaHaSport: ADDED 'NEXT EVENT' - Sun 10:00-12:00 Racing Club - Independiente-Argentina - Primera Division - Next Refresh at 9:55 on Sun
2012-08-19 09:36:09,060 DEBUG [DiscoveryAdvertisementNotifier] Multicasting SSDP alive using interface net4 (Realtek RTL8191SE Wireless LAN 802.11n PCI-E NIC) and address 192.168.1.10, timeout = 0
2012-08-19 09:36:09,060 DEBUG [DiscoveryAdvertisementNotifier] Sending 6 'alive' messages describing device 8dee68fe-0370-3fc8-a5f5-ae4a1fb10a65
2012-08-19 09:36:10,860 DEBUG [DiscoveryAdvertisementNotifier] Will advertise again in 00:00:45
2012-08-19 09:36:18,097 DEBUG [DiscoverySSDPMessageListener] Received a valid M-SEARCH message for search target upnp:rootdevice from address /192.168.1.10:57538
2012-08-19 09:36:18,097 DEBUG [RendererDAOImpl] Reading a Renderer with ip address 192.168.1.10
2012-08-19 09:36:18,098 DEBUG [DiscoverySearchResponder] Sending 1 M-SEARCH response message(s) to /192.168.1.10:57538
2012-08-19 09:36:55,022 DEBUG [FeedUpdaterThread] Checking for new and expired online resources
<<

zip

User avatar

Serviio developer / Site Admin

Posts: 17212

Joined: Sat Oct 24, 2009 12:24 pm

Location: London, UK

Post Sun Aug 19, 2012 7:23 pm

Re: 30 sec timeout not cancelling item extraction.

Java doesn't guarantee actually stopping the thread. Are you catching some exceptions in the plugin? Especially InterruptedException or Exception - it's possible that that will be thrown by Java and if you just swallow it and continue looping it might be causing this.

Otherwise I'll try to reproduce it when I'm back from holidays in 3 weeks.
<<

jhb50

DLNA master

Posts: 2843

Joined: Thu Jun 30, 2011 9:32 pm

Post Thu Aug 23, 2012 1:25 pm

Re: 30 sec timeout not cancelling item extraction.

No, in these cases I just ran out of time because I was doing a check for 404 which I have now removed.

When a plugin does timeout during item extraction however, I think Serviio should process the items that were successfully retreived, rather than cancelling the URL extraction of those items as it does now.

Return to Plugin development

Who is online

Users browsing this forum: No registered users and 9 guests

Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by ST Software for PTF.