Serviio

Occasionally the m3u8 index file is being truncated during transfer causing Roku to get 404 errors. I was blaming Roku for this but then looking at the .m3u8 on the Mac, I realized the URLs are being converted to a relative address for the server. It's not a timing issue because the file's transcode has been completed when it gets this error. I put in a debug to display the contents from a GET request for the file and the end was missing.


Original Chaneru Log file Posted to Roku on the problem

so when this happens, can you look in the transcoding folder and find the local m3u8 file, is that complete or truncated too?

If you can replicate it and post contents of the local file and the (truncated) result of HTTP GET, it'd be helpful.

Zip, the m3u8 file is complete, as is the transcoding itself. I can play each individual transcoded file with either VLC or Windows Media player. I cannot play the m3u8 file in VLC for some reason, but I doubt it is related, since the majority of the file plays.

I will add (for both you and Jim) that the movie will stop playing at what appears to be a percentage of total length. I sent him a 27 minute video that stops playing at 23, and I was watching another movie that was around 1:40 and it stopped playing sometime shortly before 1:30. However, it doesn't seem to be exactly the same for each video. But each video does stop at the same place.

Added code in Chaneru to do an extra get for the .m3u8 file contents after Roku logs the fact that he requested the file.
Results of a fetch by Roku - truncates at segment 153


Playlist on Server - completed - transcoding-temp-4151-roku-ORIGINAL.stf/playlist.m3u8


From Chaneru log

Weird... Are you sure you're not doing any byte range requests?

And at this point, will it return the same truncated file for consecutive manual GET requests?

No range requests and there were about 20 other requests for the file during it's play back and they all look the same after it got to that point.
One thing that was weird when I was trying Dan's movie is, I cut the segments down 25 with number 153 being in the middle.
I didn't get an error on number 153 but I got the same sort of error on segment 161 ????
The original post to Roku was on a much smaller file with 15 segments and it occurred on segment 10 BUT I can't locate the file to try it again.

I put it on a network monitor. Your are sending the data as "chunked" and 1st and only block is 800 and then the 0 flag (EOD) at the point of the truncation.

I'm using an Apache library for all http traffic, HTTP1.0 doesn't use chunked, 1.1 does.

So I'd have thought the library works. What if you open the truncated file's URL in a browser or via wget / curl?

Looking at the headers, it is 1.1
I'm on a Mac, haven't tried it on windows.
I'll move the video over and see if that works.

Moved the file to my Win7 machine, clicked on the movie at the Roku to start the transfer, killed it and waited till the transcode was completed, 165 segments.
Turned on a network monitor and started the movie again. This caused a GET of the full .m3u8 file.
The transfer is http 1.1 chunked. The difference is that this one truncates the file at segment 132.
I guess different length of URLs. So it really sounds like your output transfer / buffer is bad.

Did you try it with wget / curl? I want to make sure it's the server and not the Roku http client.

So much for that !

sh-3.2# wget -d http://192.168.1.2:8895/resource/4151/M ... GINAL.m3u8
DEBUG output created by Wget 1.11.4 on darwin9.4.0.

--2013-09-12 09:15:19-- http://192.168.1.2:8895/resource/4151/M ... GINAL.m3u8
Connecting to 192.168.1.2:8895... connected.
Created socket 3.
Releasing 0x00265fc0 (new refcount 0).
Deleting unused 0x00265fc0.

---request begin---
GET /resource/4151/MEDIA_ITEM/HLS-0/ORIGINAL.m3u8 HTTP/1.0
User-Agent: Wget/1.11.4
Accept: */*
Host: 192.168.1.2:8895
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.0 500 Internal Server Error
Date: Thu, 12 Sep 2013 14:15:19 GMT
Server: Mac OS X, UPnP/1.0 DLNADOC/1.50, Serviio/1.3.1
Content-Length: 0
Connection: Keep-Alive

---response end---
500 Internal Server Error
Registered socket 3 for persistent reuse.
Skipping 0 bytes of body: [] done.
2013-09-12 09:15:19 ERROR 500: Internal Server Error.

Any idea why I would be getting the 500 error ?

Look at serviio's log.

And then also try with http 1.1

Ok, got it ! Had to fake Serviio out, needed a valid renderer. Set User Agent to Chaneru.
This is the same as what I'm getting in the Roku/Chaneru transfers.
Oh, and I lied, there ARE multiple blocks of 800x bytes and then the 0 EOD in the network trace.

ok, thanks, I'll look at it over the weekend

Fixed for 1.4

It was caused by Serviio using the file size of the original m3u8 file (as present in the transcoding folder). But after that Serviio filters the file and puts http url instead of the local path, thus the final file size is different.

Great, thanks !

Zip, any idea when 1.4 is coming ?
Could you have a 1.3.2 with the fix ?

Not planning another 1.3.x release. 1.4 hopefully before Christmas.