Dammit.....AllMusic.com (AMG) seems to have stopped scrapers..

  Thread Rating:
  • 2 Votes - 3 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
dirtymurt Offline
Senior Member
Posts: 189
Joined: Nov 2010
Reputation: 0
Post: #16
ok, getting somewhere now. you need to change scrapers in settings under audio, not from the context sensitive menu in artists/albums,

lastFM is good at scraping the artist but the album info is not there for a lot of my albums.

thanks for the help though!

[Image: widget]
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #17
dirtymurt Wrote:ok, getting somewhere now. you need to change scrapers in settings under audio, not from the context sensitive menu in artists/albums, !

yeah, sorry that's what I meant by default scraper (globally)

and yeah, LastFM sucks, that's why the Dammit in the original post Laugh

glad I could help

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
86themachine Offline
Junior Member
Posts: 33
Joined: Nov 2010
Reputation: 0
Post: #18
Hello,
Dealing with the same issue.

Can I manually add my own Album review? Any directions on how to do it?
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #19
86themachine Wrote:Hello,
Dealing with the same issue.

Can I manually add my own Album review? Any directions on how to do it?

Highly recommend XWMM available here http://forum.xbmc.org/showthread.php?tid=60643

Note that if you have the patience you can copy-paste the AllMusic review Laugh

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
86themachine Offline
Junior Member
Posts: 33
Joined: Nov 2010
Reputation: 0
Post: #20
To: DDDamian

Thanks Ill check it out asap.
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #21
With the help of a friend much more gifted than I, we found a solution to retreive artist bio & album info from AllMusic again (the best scraper IMHO).

1. Copy the raw script from the link below:
http://pastebin.com/sTRfsTpF

2. Paste it into a text file with Wordpad or a text/XML editor of your choice.

3. Save the file to \\special\addons\metadata.common.allmusic.com\allmusic.xml

4. Click yes to overwrite the existing file.

If you need help locating your \\special directory see here
http://wiki.xbmc.org/index.php?title=Userdata

Voila! The scraper will pull the data again. Credit to a better Python coder than I Cool

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-21 09:21 by DDDamian.)
find quote
john6555 Offline
Junior Member
Posts: 39
Joined: Jan 2012
Reputation: 0
Post: #22
DDDamian Wrote:With the help of a friend much more gifted than I, we found a solution to retreive artist bio & album info from AllMusic again (the best scraper IMHO).

1. Copy the raw script from the link below:
http://pastebin.com/sTRfsTpF

2. Paste it into a text file with Wordpad or a text/XML editor of your choice.

3. Save the file to \\special\addons\metadata.common.allmusic.com\allmusic.xml

4. Click yes to overwrite the existing file.

If you need help locating your \\special directory see here
http://wiki.xbmc.org/index.php?title=Userdata

Voila! The scraper will pull the data again. Credit to a better Python coder than I Cool
Very cool, thanks! Too bad re-scraping is a such a pain. Is there any better way than to delete all sources, clean library, and then re-add and re-scan everything?
find quote
john6555 Offline
Junior Member
Posts: 39
Joined: Jan 2012
Reputation: 0
Post: #23
Unfortunately still not scraping. Sad

EDIT: Nevermind... got it working, see 2 posts down.

Using Eden beta 1, Aeon MQ 3 1.2.1, Win7 x64.
(This post was last modified: 2012-01-21 19:30 by john6555.)
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #24
@john6555 - Re-check, there is a subtle difference and it is functional. Don't forget to refresh the info.

Please note that this enables retrieval of publically viewable info for private library archival purposes and not for any commercial gain, concepts both entrenched in fair usage in many countries. I should make clear that it was a private inititiative to modify open-source code for that purpose, and was not prompted nor provided by Team XBMC. I'll add the discalimer that if this does not meet the concept of fair usage in your jurisdiction please do not make use of the code provided by my friend. Any potential user of the modification should consult their local laws and practices. If you have confirmed this to be within the realm of free use in your jurisdiction be aware that you do this at your sole discretion and on your own initiative.

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-21 23:51 by DDDamian.)
find quote
john6555 Offline
Junior Member
Posts: 39
Joined: Jan 2012
Reputation: 0
Thumbs Up   
Post: #25
DDDamian Wrote:@john6555 - Re-check, there is a subtle difference and it is functional. Don't forget to refresh the info.

You are correct, it is slightly different, I'm not sure why the first time WinMerge said they are identical!

I did get it working, but I had to modify the allmusic.xml in the Program Files folder on Windows in addition to the \\special directory one.

Thanks a million!
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #26
john6555 Wrote:You are correct, it is slightly different, I'm not sure why the first time WinMerge said they are identical!

I did get it working, but I had to modify the allmusic.xml in the Program Files folder on Windows in addition to the \\special directory one.

Thanks a million!

You're welcome Wink Please be sure you have read what I posted above. This is a private modification I'm providing a link to, and is in no way part of the official XBMC releases.

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
Mman Offline
Junior Member
Posts: 31
Joined: Dec 2009
Reputation: 0
Post: #27
@DDDamian: This allows me to scrap, but for some odd reason, if an artist's bio has a link to another artist in the first line it instead scrapes that artist's page (ie, http://allmusic.com/artist/the-strokes-p478260 gives me info about Buddy Holly instead of The Strokes).
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #28
Mman Wrote:@DDDamian: This allows me to scrap, but for some odd reason, if an artist's bio has a link to another artist in the first line it instead scrapes that artist's page (ie, http://allmusic.com/artist/the-strokes-p478260 gives me info about Buddy Holly instead of The Strokes).

Interesting!? I see the page you're referring to - will check some of mine and see if I can duplicate. Just so you know - I'm not very experienced in Python so I can't guarantee a solution.

EDIT: I can confirm that's happening - will dig a little deeper....

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-22 00:05 by DDDamian.)
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #29
DDDamian Wrote:EDIT: I can confirm that's happening - will dig a little deeper....

Pushed a fix - your scraper should auto-update if you are using a recent build.

Can you confirm it's working correctly now? In your test example mine's good now.

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
john6555 Offline
Junior Member
Posts: 39
Joined: Jan 2012
Reputation: 0
Post: #30
DDDamian Wrote:Pushed a fix - your scraper should auto-update if you are using a recent build.

Can you confirm it's working correctly now? In your test example mine's good now.

What version is the fixed scraper? Don't think mine has updated yet...
find quote
Post Reply