LazyLibrarian: Automate your ebook/author collection

[simonk83]

That assumption is totally correct, but I guess it's the books without a language that's stuffing things up

[LibrarianMike]

Well the other option is to make the main page display all the books in your preferred language and all the books with an unknown language. Would that be better?

[simonk83]

That'd do the trick I think

[LibrarianMike]

Done

[LibrarianMike]

Just made a rather large update which fixed all of the issues for newznab providers. In addition, I have added a caching feature for nzb providers so that LL searches once for an author and uses the cached book results from then on (so even if there is 300 books, you will only make 1 api call).

[Wimma]

Seems to be working pretty well for me (thanks!) but still some minor permission issues.
I left LL to post process by itself, and end up with the following (linux) permissions in my e-book folder (which is drwxrwxr-x)
Author drwx------
-> Title drwxrwxrwx
-> cover.jpg -rw-------
metadata.opf -rw-------
book.mobi -rw-rw-r--
Can this be set to other permissions anywhere in a config file? Just makes browsing via guest shares a problem.
File structure looks great though.
(I'm running LL as my normal user)

Also, while the postprocessing seemed to work fine, and filed the book away as expected, it still says it had an error. Log shows:

3-Dec-2012 21:47:54 - INFO :: SEARCHBOOKS : Paige Toon One Perfect Summer sent to SAB successfully.
13-Dec-2012 21:47:54 - DEBUG :: SEARCHBOOKS : Nzbfile has been downloaded from http://nzb.su/getnzb/bdf9e40836cc84b2cd ... ed5fe1dc0b
13-Dec-2012 21:47:55 - DEBUG :: SEARCHBOOKS : Nzbfile has been downloaded
13-Dec-2012 21:47:57 - DEBUG :: SEARCHBOOKS : nzbName Paige Toon - One Perfect Summer v. epub
13-Dec-2012 21:47:57 - DEBUG :: SEARCHBOOKS : FOUND paige toon - one perfect summer v. epub
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : nzbtitle Paige Toon One Perfect Summer is in downloads
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : Found folder /mnt/disk2/Downloads/Paige Toon One Perfect Summer.
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : /mnt/disk3/e-books/Paige Toon/One Perfect Summer does not exist, so it's safe to create it
13-Dec-2012 21:49:06 - INFO :: POSTPROCESS : Successfully moved /mnt/disk2/Downloads/Paige Toon One Perfect Summer to /mnt/disk3/e-books/Paige Toon/One Perfect Summer.
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : file extension: mobi
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : file: Paige Toon - One Perfect Summer (v5.0) (mobi).mobi
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : Downloading cover from http://d.gr-assets.com/books/1330897612m/12064651.jpg
13-Dec-2012 21:49:07 - DEBUG :: POSTPROCESS : Saved metadata to: /mnt/disk3/e-books/Paige Toon/One Perfect Summer/metadata.opf
13-Dec-2012 21:49:08 - INFO :: POSTPROCESS : Successfully processed: Paige Toon - One Perfect Summer
13-Dec-2012 21:49:08 - DEBUG :: POSTPROCESS : nzbtitle Paige Toon One Perfect Summer is in downloads
13-Dec-2012 21:49:08 - DEBUG :: POSTPROCESS : Found folder /mnt/disk2/Downloads/Paige Toon One Perfect Summer.
13-Dec-2012 21:49:08 - INFO :: POSTPROCESS : Postprocessing for One Perfect Summer has failed.
13-Dec-2012 21:49:08 - INFO :: POSTPROCESS : 1 books are downloaded and processed.

Not sure why it says has failed??
Also log shows epub, output is mobi? (sab says mobi)

[LibrarianMike]

Not sure why it says it has failed. I will make it so that all the sved files not just the book have the right permissions. 13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : file: Paige Toon - One Perfect Summer (v5.0) (mobi).mobi says te file is mobi not ePub... So not sure why you think it was an epub

[LibrarianMike]

Try the update I just pushed out then, should change the permissions for the cover and opf files as well

[Wimma]

Thanks Mike - updated and found a book.
Author still has owner only permissions though:
drwx------ 3 simon simon 4096 Dec 13 22:45 Cecelia Ahern
so can't be shared.

But I now see 777 for the book folder, cover and metadata.
simon@Holly:~$ ls /mnt/disk3/e-books/Cecelia\ Ahern/ -l
total 4
drwxrwxrwx 2 simon simon 4096 Dec 13 22:45 The Time Of My Life
simon@Holly:~$ ls /mnt/disk3/e-books/Cecelia\ Ahern/The\ Time\ Of\ My\ Life/ -l
total 356
-rwxrwxrwx 1 simon simon 8744 Dec 13 22:45 cover.jpg
-rwxrwxrwx 1 simon simon 1398 Dec 13 22:45 metadata.opf
-rw-rw-r-- 1 simon simon 345671 Dec 13 22:38 The Time Of My Life.epub
which is better, thanks.
I could only guess different people may want different permissions - could it be set as a variable in config file?
775 or 777 is fine by me, be interested to hear from anyone else though.
Permissions in linux usually invoke some arguments :\

Wrt epub/mobi above, just saw the entries in log:
13-Dec-2012 21:47:57 - DEBUG :: SEARCHBOOKS : nzbName Paige Toon - One Perfect Summer v. epub
13-Dec-2012 21:47:57 - DEBUG :: SEARCHBOOKS : FOUND paige toon - one perfect summer v. epub
and later:
13-Dec-2012 21:49:06 - DEBUG :: POSTPROCESS : file extension: mobi
hence the confusion. I can see it's a mobi from cli & sab.
Thanks for the hard work on this, some great progress to date!

Edit:
postprocessing again says failed in LL log, but seemed to work fine for me:
2012-12-13 22:45:41 INFO Postprocessing for The Time Of My Life has failed.
2012-12-13 22:45:41 INFO Successfully processed: Cecelia Ahern - The Time Of My Life

[LibrarianMike]

It could be that the nzb says ePub in the name but is actually a mobi? There's not really much room for error because LL just takes the extension off the existing file and renames the prefix to the book title. So the extension will never actually change.

[Wimma]

Yeah, no issues, so long as it works and the wife gets her books!

[Tkosh]

Spell Check on Import Options page :-)

Spesify one of the following options (or leave blank to search for any format): TO

Specify one of the following options (or leave blank to search for any format):


Latest version fixes book language issue. Evaluating newznab responses now.

[al1937]

I have tried the latest update with four different newsnab indexers and each one fails with "error 403 opening url.
I tried again with a fresh clone and got the same results.

[Tkosh]

Newsnab works for me with two different hosts. I see some issues with Postprocessing trying continuously in the log after being successful the first time

OSX/e23ad7bd1c83548be0cb51ede2927558de3fa871

[LibrarianMike]

A 403 error could well be that you have no api calls left (I haven't added the ability for LL to pick up custom newsnab errors yet. Can I ask what providers you tested? I have verified that it works with nzb.su