Amazon.de Album Scraper

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Thumbs Up  Amazon.de Album Scraper
Post: #1
Hi everyone,

I have developed an amazon.de (German) album scraper. I hope many users will test this one as I'm sure there are still some bugs in there.

Anway, the main functions should work and most of the albums are recognized.

Please help me getting this one better and better!

You can install the scraper here:
DOWNLOAD 0.0.3

Kind regards
Larry_Lobster
(This post was last modified: 2010-12-12 02:42 by Larry_Lobster.)
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #2
Hey, no German guys who are interested in this one? Confused
find quote
liquidolze Offline
Member
Posts: 83
Joined: Feb 2009
Reputation: 0
Location: Germany, NRW
Post: #3
Larry_Lobster Wrote:Hey, no German guys who are interested in this one? Confused

Doch wir sind da! Ich werds kurzfristig testen, danke schon mal Big Grin

Gruß

Oliver
find quote
malte Online
Skilled Python Coder
Posts: 1,351
Joined: Jan 2010
Reputation: 28
Location: Germany
Post: #4
Larry_Lobster Wrote:Hi everyone,

I have developed an amazon.de (German) album scraper.

Sounds illegalBig Grin

Will test it when I update my "production" environment to Dharma. I have no music on my dev pc.
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #5
First link updated due to some bugfixes/improvements
find quote
vanMiez Offline
Senior Member
Posts: 175
Joined: Apr 2010
Reputation: 0
Location: Berlin, Germany
Post: #6
werd es testen, sobald ich meine sammlung aufm laptop auf den aktuellen stand vom mediacenter bringe. sollten knapp hundert alben sein die da zur zeit differenz sind, also auch etwas aussagekräftiges für dich dabei rauskommen. meld mich dann nochmal
find quote
Zippolighter Offline
Fan
Posts: 342
Joined: Dec 2006
Reputation: 0
Location: germany
Post: #7
Works fine.

Test with Dharma RC2 on a XBMC Live installation on SSD.

Regards Zippolighter
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #8
New version 0.0.3 available (look at first post)

Changelog:
0.0.3
- Nfo support
- Fixed bug concerning umlauts
- Some results in the dialogs have not been formatted appropriately
- Search result dialog shows the year and the kind of the album (CD, Vinyl,...)

Enjoy!

Kind regards
Larry_Lobster
find quote
Zippolighter Offline
Fan
Posts: 342
Joined: Dec 2006
Reputation: 0
Location: germany
Post: #9
Quote:Changelog:
0.0.3
- Nfo support
- Fixed bug concerning umlauts
- Some results in the dialogs have not been formatted appropriately
- Search result dialog shows the year and the kind of the album (CD, Vinyl,...)

What do you mean with Nfo support??

Thanks Zippolighter
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #10
Zippolighter Wrote:What do you mean with Nfo support??

Thanks Zippolighter

Look at this one: http://wiki.xbmc.org/index.php?title=Imp...y#Albums_2
find quote
Zippolighter Offline
Fan
Posts: 342
Joined: Dec 2006
Reputation: 0
Location: germany
Post: #11
Thanks for the info, this is a new info for me. Will test this with the album.nfo

I don't know if you see my topics in the xbmc.de forum.

I think their is something wrong with the version 0.0.3 and the search dialog.

If I look for artist "2raumwohnung" and the album "lass", I got not all possible albums for this query and accordingly got wrong search results.

Another point is that the product info for the album lasso is cut at the quotation mark.

Regards Zippolighter
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #12
Zippolighter Wrote:Thanks for the info, this is a new info for me. Will test this with the album.nfo

I don't know if you see my topics in the xbmc.de forum.

I think their is something wrong with the version 0.0.3 and the search dialog.

If I look for artist "2raumwohnung" and the album "lass", I got not all possible albums for this query and accordingly got wrong search results.

Another point is that the product info for the album lasso is cut at the quotation mark.

Regards Zippolighter

Could you please provide a debug log? You find very helpful information about it in this thread: http://forum.xbmc.org/showpost.php?p=472490&postcount=1

Thank you very much for helping me that much. The more bugs are reported, the faster the scraper will become final. Smile
find quote
Zippolighter Offline
Fan
Posts: 342
Joined: Dec 2006
Reputation: 0
Location: germany
Post: #13
Wrong result of the search query Album "Lass" and Artist "2raumwohnung"

http://pastebin.ca/2018652

Cut product info. I search manually for Album "Lasso (Limited Edition)" and Artist "2raumwohnung"

http://pastebin.ca/2018654

Regards Zippolighter
find quote
Larry_Lobster Offline
Member
Posts: 96
Joined: Oct 2010
Reputation: 0
Post: #14
Zippolighter Wrote:Wrong result of the search query Album "Lass" and Artist "2raumwohnung"

http://pastebin.ca/2018652

Cut product info. I search manually for Album "Lasso (Limited Edition)" and Artist "2raumwohnung"

http://pastebin.ca/2018654

Regards Zippolighter
Wow, that was quick! Great. I will take a look.
find quote
Zippolighter Offline
Fan
Posts: 342
Joined: Dec 2006
Reputation: 0
Location: germany
Post: #15
Additional problem with the Album.nfo

I have the Album.nfo with the url "http://www.amazon.de/36grad-Remix-Album-2raumwohnung/dp/B000QFAHDO/ref=sr_1_2?s=music&ie=UTF8&qid=1292269073&sr=1-2" in the folder "2raumwohnung", subfolder "36 Grad Remixe".

The Album.nfo will not use to find the correct album, I get the searchdialog.

http://pastebin.ca/2018676

Regards Zippolighter
(This post was last modified: 2010-12-14 01:39 by Zippolighter.)
find quote
Post Reply