Thu Jan 03, 2013 4:22 pm by jhb50
OK, I now understand why you cannot extract the URL's for the items that have been created because the WebResource container has not been created and returned. I can implement my own timer to fix that.
But the bug I'm reporting is that the extract of the items, does not stop after the 30 second timeout on the ExtractItems method. As the following log shows(I've removed the m-search and playlist messages), hahasport hits the limit and the stopstream plugin starts, and then both extract in parallel.
- Code:
2013-01-02 18:47:58,262 DEBUG [OnlineLibraryManager] Resource http://www.hahasport.com/c-6.html?estreams=9 not in cache yet, loading it
2013-01-02 18:47:58,262 DEBUG [WebResourceParser] Parsing web resource 'http://www.hahasport.com/c-6.html?estreams=9'
2013-01-02 18:47:58,267 DEBUG [WebResourceParser] Found matching url extractor (HaHaSport) for resource http://www.hahasport.com/c-6.html?estreams=9
2013-01-02 18:47:58,267 DEBUG [FeedItemUrlExtractor] HaHaSport: Starting parsing resource: http://www.hahasport.com/c-6.html?estreams=9
2013-01-02 18:47:58,521 DEBUG [FeedItemUrlExtractor] HaHaSport: Parsing with hahasport V17
2013-01-02 18:48:08,821 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Wed 16:00-19:00 Chicago Bulls vs. Orlando Magic-NBA'
2013-01-02 18:48:10,228 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:00-19:00 Chicago Bulls vs. Orlando Magic-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:12,144 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA'
2013-01-02 18:48:12,617 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:13,127 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:14,876 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:00-19:00 Sacramento Kings vs. Cleveland Cavaliers-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:16,026 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:00-19:00 Sacramento Kings vs. Cleveland Cavaliers-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:17,459 DEBUG [FeedItemUrlExtractor] HaHaSport: NO SRC ITEM - 'Wed 16:00-19:00 Washington Wizards vs. Indiana Pacers-NBA'
2013-01-02 18:48:18,816 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:00-19:00 Washington Wizards vs. Indiana Pacers-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:20,223 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:00-19:00 Washington Wizards vs. Indiana Pacers-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:21,576 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - letont - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:22,984 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - ilivet - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:27,687 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://onlinefreefootball.info/1.html - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA
2013-01-02 18:48:28,274 WARN [FeedUpdaterThread] An error occured while scanning for online item information, will continue
java.io.IOException: Unexpected error while invoking plugin (HaHaSport): The operation took more than 30000 ms and has been cancelled.
at org.serviio.library.online.WebResourceParser.parse(WebResourceParser.java:58)
at org.serviio.library.online.OnlineLibraryManager.findResource(OnlineLibraryManager.java:171)
at org.serviio.library.online.OnlineLibraryManager.findResourceInCacheOrParse(OnlineLibraryManager.java:186)
at org.serviio.library.online.metadata.FeedUpdaterThread.getOnlineItems(FeedUpdaterThread.java:159)
at org.serviio.library.online.metadata.FeedUpdaterThread.run(FeedUpdaterThread.java:96)
Caused by: java.lang.RuntimeException: The operation took more than 30000 ms and has been cancelled.
at org.serviio.library.online.PluginExecutionProcessor.execute(PluginExecutionProcessor.java:64)
at org.serviio.library.online.WebResourceUrlExtractor.parseWebResource(WebResourceUrlExtractor.java:29)
at org.serviio.library.online.WebResourceParser.parse(WebResourceParser.java:56)
... 4 more
2013-01-02 18:48:28,276 DEBUG [OnlineRepositoryDAOImpl] Reading an OnlineRepository (id = 133)
2013-01-02 18:48:28,277 DEBUG [OnlineLibraryManager] Resource http://www.stopstream.tv/6?estreams=9 not in cache yet, loading it
2013-01-02 18:48:28,277 DEBUG [WebResourceParser] Parsing web resource 'http://www.stopstream.tv/6?estreams=9'
2013-01-02 18:48:28,279 DEBUG [WebResourceParser] Found matching url extractor (Stopstream) for resource http://www.stopstream.tv/6?estreams=9
2013-01-02 18:48:28,279 DEBUG [FeedItemUrlExtractor] Stopstream: Starting parsing resource: http://www.stopstream.tv/6?estreams=9
2013-01-02 18:48:28,280 DEBUG [FeedItemUrlExtractor] Stopstream: Parsing with Stopstream V1
2013-01-02 18:48:29,094 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://lsh1.magicstream.tv - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA
2013-01-02 18:48:31,542 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://heyyouyayou.webs.com/ - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA
2013-01-02 18:48:37,064 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:30-19:30 Dallas Mavericks vs. Miami Heat-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:39,109 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://watch.vipi.tv/?id=grizlies15 - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA
2013-01-02 18:48:40,555 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - ilivet - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:41,208 DEBUG [FeedItemUrlExtractor] Stopstream: NO SRC ITEM - 'Wed 16:00-19:00 Chicago Bulls vs. Orlando Magic-NBA'
2013-01-02 18:48:42,779 DEBUG [FeedItemUrlExtractor] Stopstream: LIVE ITEM - coolsp - Wed 16:00-19:00 Chicago Bulls vs. Orlando Magic-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:44,331 DEBUG [FeedItemUrlExtractor] Stopstream: LIVE ITEM - nutjob - Wed 16:00-19:00 Chicago Bulls vs. Orlando Magic-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:45,348 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:45,885 DEBUG [FeedItemUrlExtractor] Stopstream: NO SRC ITEM - 'Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA'
2013-01-02 18:48:46,731 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:47,381 DEBUG [FeedItemUrlExtractor] Stopstream: LIVE ITEM - coolsp - Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:47,544 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - coolsp - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:47,982 DEBUG [FeedItemUrlExtractor] Stopstream: LIVE ITEM - nutjob - Wed 16:00-19:00 Portland Trail Blazers vs. Toronto Raptors-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:48,638 DEBUG [FeedItemUrlExtractor] Stopstream: NO SRC ITEM - 'Wed 16:00-19:00 Sacramento Kings vs. Cleveland Cavaliers-NBA'
2013-01-02 18:48:48,946 DEBUG [FeedItemUrlExtractor] HaHaSport: LIVE ITEM - nutjob - Wed 16:30-19:30 Memphis Grizzlies vs. Boston Celtics-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:49,310 DEBUG [FeedItemUrlExtractor] Stopstream: LIVE ITEM - coolsp - Wed 16:00-19:00 Sacramento Kings vs. Cleveland Cavaliers-NBA - Refresh at 19:10 on Wed
2013-01-02 18:48:49,709 DEBUG [FeedItemUrlExtractor] HaHaSport: NULL ITEM - http://watch.vipi.tv/?id=citythunder1 - Wed 17:00-20:00 Brooklyn Nets vs. Oklahoma City Thunder-NBA
2013-01-02
You can also see that 30 seconds is just not enough time. Only 13 items were processed before it timed out. It took 4 seconds for playlists to be processed and 6 seconds for the plugin to verify the network was available then 1.5 seconds per item (I'm on a 750KB network at this location) then boom! I can see 30 seconds for each URL extract but the timeout for item extracts should be longer. Seems to me that if a movie or something is playing in parallel with the extract that that time is included in the 30 seconds which it should not be. I say this because there are some rather large gaps between the time stamps for some of the items like 5 seconds.