Page 1 of 1

Slow speed of adding files

PostPosted: Sun Dec 19, 2010 11:02 am
by hpe
Hi,
I've got thousands of files, that I want to publish through DNLA. However it will take ages at this speed:
  Code:
2010-12-19 09:27:15,751 INFO  [LibraryAdditionsCheckerThread] Added file 'P1020336.jpg' to Library
2010-12-19 09:27:24,383 INFO  [LibraryAdditionsCheckerThread] Added file 'PICT5705.jpg' to Library
2010-12-19 09:27:35,965 INFO  [LibraryAdditionsCheckerThread] Added file 'P1020284.jpg' to Library
2010-12-19 09:27:44,964 INFO  [LibraryAdditionsCheckerThread] Added file 'PICT6112.jpg' to Library
2010-12-19 09:27:56,388 INFO  [LibraryAdditionsCheckerThread] Added file 'P1020236.jpg' to Library
2010-12-19 09:28:04,887 INFO  [LibraryAdditionsCheckerThread] Added file 'PICT5860.jpg' to Library
2010-12-19 09:28:13,437 INFO  [LibraryAdditionsCheckerThread] Added file 'PICT6165.jpg' to Library
2010-12-19 09:28:21,114 INFO  [LibraryAdditionsCheckerThread] Added file 'PICT8397.jpg' to Library
Is there a way how to speed it up?

Thanks, hpe

Re: Slow speed of adding files

PostPosted: Sun Dec 19, 2010 12:15 pm
by zip
Are these files large? Images normally don't take so long, but the server has to resize them for thumbnails and if they are huge and the PC is not fast it might take some time.

Re: Slow speed of adding files

PostPosted: Sun Dec 19, 2010 6:56 pm
by hpe
6 Megapixel, ~ 1MB each

The machine is Intel(R) Atom(TM) CPU D510 @ 1.66GHz

Couldn't be the thumbnails generation delayed? I.e. First add everything, then render thumbnails, when the server is idle?

Re: Slow speed of adding files

PostPosted: Sun Dec 19, 2010 8:43 pm
by zip
That functionality is not in the current version.

Re: Slow speed of adding files

PostPosted: Thu Feb 23, 2012 9:34 pm
by Xtream
hello!

i've the same problem as hpe.

  Code:
2012-02-23 22:27:42,863 INFO  [LibraryAdditionsCheckerThread] Added file '[2007-06-24 11-36-20] DSCF0159.jpg' (title: [2007-06-24 11-36-20] DSCF0159) to Library
2012-02-23 22:27:47,291 INFO  [LibraryAdditionsCheckerThread] Added file '[2007-06-20 15-45-38] DSCF0105.jpg' (title: [2007-06-20 15-45-38] DSCF0105) to Library
2012-02-23 22:27:51,455 INFO  [LibraryAdditionsCheckerThread] Added file '[2007-06-29 17-25-28] DSCF0232.jpg' (title: [2007-06-29 17-25-28] DSCF0232) to Library


approximatly 5 second per jpeg file and i've got 18 560 photos, so 25 hours to build library :roll:

can we disable thumbnail generation if it's that which is very slow ?

Re: Slow speed of adding files

PostPosted: Wed Dec 26, 2012 7:13 pm
by Xtream
a little up for this problem .
Here is my actual response time (with 100% cpu used). approximately 10 secondes per jpeg file. each jpg photo is 5 or 6 MB. i've got 19 000 photos so approximately 52 hours or parsing.

i used serviio 1.0-14 on synology NAS (2ghz processor, 512 mb RAM). These version seem a little bit more slow than the older.

  Code:
2012-12-26 19:59:26,867 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-19 17-33-20] DSCF0028.jpg' (title: [2006-07-19 17-33-20] DSCF0028) to Library
2012-12-26 19:59:38,352 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-13 15-15-39] DSCF0013.jpg' (title: [2006-07-13 15-15-39] DSCF0013) to Library
2012-12-26 19:59:48,756 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-25 11-36-11] DSCF0004.jpg' (title: [2006-07-25 11-36-11] DSCF0004) to Library
2012-12-26 20:00:04,738 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-15 13-53-05] DSCF0020.jpg' (title: [2006-07-15 13-53-05] DSCF0020) to Library
2012-12-26 20:00:15,012 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-08-01 12-13-07] DSCF0002.jpg' (title: [2006-08-01 12-13-07] DSCF0002) to Library
2012-12-26 20:00:26,376 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-25 11-35-45] DSCF0002.jpg' (title: [2006-07-25 11-35-45] DSCF0002) to Library
2012-12-26 20:00:36,972 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-25 20-57-06] DSCF0006.jpg' (title: [2006-07-25 20-57-06] DSCF0006) to Library
2012-12-26 20:00:48,072 INFO  [LibraryAdditionsCheckerThread] Added file '[2006-07-20 14-36-33] DSCF0032.jpg' (title: [2006-07-20 14-36-33] DSCF0032) to Library


is there a way to disable thumbnail generation or can we hope for improved response time on the next serviio version (1.1) ?

Re: Slow speed of adding files

PostPosted: Wed Dec 26, 2012 10:07 pm
by zip
With 1.1 you can disable thumbnail generation.