FAQ  •  Register  •  Login

Slowing down ffmpeg scraping

<<

mqojdn

Streaming enthusiast

Posts: 44

Joined: Thu Jan 03, 2013 6:39 pm

Post Mon Feb 04, 2013 10:17 pm

Slowing down ffmpeg scraping

In what order Serviio works?
- Runs extractUrl for all items in the feed and then starts with ffmpeg probing.
or
- Runs extractUrl and ffmpeg for each item and then proceeds to the next.

I'm asking because some sites detect the scraping and begin timing out on ffmpeg requests. And if Serviio goes item by item then I can slow it down by not returning from the plugin until the 29th second.
If not, then I propose returning some variable from extractUrl, holding the "wait before next" value.
<<

zip

User avatar

Serviio developer / Site Admin

Posts: 17212

Joined: Sat Oct 24, 2009 12:24 pm

Location: London, UK

Post Mon Feb 04, 2013 10:52 pm

Re: Slowing down ffmpeg scraping

The former
<<

mqojdn

Streaming enthusiast

Posts: 44

Joined: Thu Jan 03, 2013 6:39 pm

Post Tue Feb 05, 2013 9:59 am

Re: Slowing down ffmpeg scraping

Here is a sample http://pastie.org/pastes/6051906/download?key=xen0ogeinqtnt0wuw0bynw (the links are temporary, not sure for how long), just add that as an RSS feed. Some of the items wouldn't load because they allow only 2 concurrent connections per IP.
And for example putlocker.com would start timing out and forwarding to a captcha page, when they detect excessive scraping.

Return to Plugin development

Who is online

Users browsing this forum: No registered users and 9 guests

Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by ST Software for PTF.