Dammit.....AllMusic.com (AMG) seems to have stopped scrapers..

  Thread Rating:
  • 2 Votes - 3 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
fional Offline
Posting Freak
Posts: 903
Joined: May 2011
Reputation: 17
Location: Ireland
Post: #61
DDDamian Wrote:Are you getting that with artists who clearly have a bio on the AMG website?

And it seems that if there is no metadata.common.allmusic directory in your special folder XBMC looks in the install folder, based on some of the comments above. Pls make sure in one of the two locations you have the actual file patched in this thread.

Thanks for helping Smile I do have the file in both the special and the install location. Once I put it in the install location, the copyright notice left, but instead if just puts the no data message.

I checked allmusic.com and each one I tried it on there exists data on the bio and album page.

http://allmusic.com/artist/yeah-yeah-yea.../biography

http://allmusic.com/album/show-your-bones-r823806

as an example.

This is the script I used
http://pastebin.com/sTRfsTpF

The link you had on page 3. Is that not the right one?
find quote
AndrewWOz Offline
Junior Member
Posts: 15
Joined: Jun 2011
Reputation: 0
Post: #62
DDDamian Wrote:@AndrewWoz - that should be correct. Please duplicate the change in your /XBMC/Addons directory (XBMC in this case being the application folder, not the userdata path). Another user in this thread reported that worked for him.

Thanks for that. I ended up installing xbmc on my PC and got it working there, but I'll give this a go when I add some more music. Thanks for all your help, it's greatly appreciated Smile
find quote
quigleyb Offline
Junior Member
Posts: 12
Joined: Jan 2012
Reputation: 0
Post: #63
When you make the change, how do you get it to refresh the library?
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #64
quigleyb Wrote:When you make the change, how do you get it to refresh the library?

Remove the source - clean the library - add source should do it

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #65
fional Wrote:Thanks for helping Smile I do have the file in both the special and the install location. Once I put it in the install location, the copyright notice left, but instead if just puts the no data message.

Thanks for the feedback - will check into it later today and get back to you - just heading out but saw your post. Thanks for the excellent info BTW - that's how a support request should be done Nod

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
fional Offline
Posting Freak
Posts: 903
Joined: May 2011
Reputation: 17
Location: Ireland
Post: #66
DDDamian Wrote:Thanks for the feedback - will check into it later today and get back to you - just heading out but saw your post. Thanks for the excellent info BTW - that's how a support request should be done Nod

Thanks Smile I appreciate your help with this! My music collection is a tiny monster hehe
find quote
WildBuzz Offline
Junior Member
Posts: 1
Joined: Jan 2012
Reputation: 0
Post: #67
Here's the correct path for all you out there using Linux

/usr/share/xbmc/addons/metadata.common.all music.com

Also, DDDamian, thanks (you and your coder) for hooking us all up with this.
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #68
WildBuzz Wrote:Here's the correct path for all you out there using Linux

/usr/share/xbmc/addons/metadata.common.all music.com

Also, DDDamian, thanks (you and your coder) for hooking us all up with this.

Thx for both bits Big Grin and welcome to the forums.

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-30 04:26 by DDDamian.)
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #69
@fional - I tried to duplicate using exactly that artist/album. Results for artist bio (in debug log):

Code:
21:05:49 T:5736   DEBUG: FileCurl::Open(0CF7DF68) http://www.allmusic.com/artist/yeah-yeah-yeahs-p522831/biography
21:05:49 T:5736   DEBUG: scraper: GetAMGBiography returned <details><biography>Discovered in the wake of the Strokes' popularity and the subsequent garage rock revival, New York's art punk trio the Yeah Yeah Yeahs are comprised of singer Karen O, guitarist Nicolas Zinner, and drummer Brian Chase. O met Chase at Ohio's Oberlin College and met Zinner through friends after she transferred to NYU. Zinner and O formed the band in 2000; originally, they were a folky duo called Unitard, but they went electric after being inspired by Ohio's legendary avant punk scene. After the drummer they recruited initially bowed out, Chase joined the lineup.
The Yeah Yeah Yeahs wrote a slew of songs at their first rehearsal and soon wound up supporting the Strokes and the White Stripes, earning a significant buzz for their arty yet sexy take on garage punk. In late 2001, the Yeah Yeah Yeahs released their self-titled debut EP, which they recorded with Boss Hog's Jerry Teel, on their own Shifty label. Early the next year the band stepped into the international spotlight, appearing at South by Southwest, touring the U.S. with Girls Against Boys and Europe with Jon Spencer Blues Explosion, and headlining their own U.K. tour. Wichita Recordings distributed the group's EP in the U.K. and Touch and Go reissued it in the States.
In between tours, the group spent 2002 putting the finishing touches on its full-length debut and playing American dates with Sleater-Kinney, Liars, and Jon Spencer Blues Explosion. Late that year, the Yeah Yeah Yeahs released the Machine EP to tide fans over before their first full-length. The Yeah Yeah Yeahs moved to Interscope for their debut album, 2003's Fever to Tell. Boasting a cleaner sound and more eclectic songwriting than their EPs, the album continued their critical acclaim and also won them a fair amount of commercial success: the gorgeous ballad "Maps" became a hit in 2004 and pushed Fever to Tell to gold status that year. Karen O also moved to Los Angeles in 2004, making the Yeah Yeah Yeahs a bicoastal band.
The group took some time to pursue individual projects in 2005. O loaned her vocals to "Hello Tomorrow," a collaboration with producer Squeak E. Clean that provided the soundtrack to a Nike shoe commercial directed by Spike Jonze, while Zinner recorded with the side project Head Wound City and also had a book of photographs, I Hope You Are All Happy Now, published. The Yeah Yeah Yeahs reconvened in the studio that year to record their second album with Clean as producer; jokingly, Clean said that the album was about O's cat and would be called Coco Beware, but the album's real title, Show Your Bones, was revealed soon after. Released in spring 2006, the album was the band's most mature, polished work yet, and reached number 11 on the album charts. The Yeah Yeah Yeahs spent the rest of the year touring in support of the album, and returned in summer 2007 with the Is Is EP, a collection of newly recorded versions of songs written in between the band's two albums. It's Blitz!, which took the band's sound in a more streamlined, electronic direction, arrived in spring 2009.</biography></details>
21:05:49 T:5736   DEBUG: FileCurl::Open(0CF7DF68) http://www.allmusic.com/artist/yeah-yeah-yeahs-p522831/discography
21:05:50 T:5736   DEBUG: scraper: GetAMGDiscography returned <details><album><year>2003</year><title>Fever to Tell</title><label>Interscope</label></album><album><year>2006</year><title>Show Your Bones</title><label>Interscope</label></album><album><year>2009</year><title>It's Blitz!</title><label>Interscope</label></album></details>

The info on pg 3 corrects the scraping prohibition (pls read disclaimer) and if that's gone away then your files under metadata.common.allmusic.com are fine.

Please go to system>settings>addons>enabled addons>artist information>allmusic and check your version: 2.0.7 is correct

Please go to system>settings>addons>enabled addons>album information>allmusic and check your version: 2.0.1 is correct

These should have been pushed to you automatically, but if not, the update button should be available if your version doesn't match.

Hope that helps, let me know if not. If that's really your picture I'm moving to Ireland Laugh

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-30 04:31 by DDDamian.)
find quote
eakaluk Offline
Junior Member
Posts: 1
Joined: Nov 2011
Reputation: 0
Post: #70
Thx vdrfan - more just putting the announcement out there
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #71
@eakaluk - hope you didn't join just to quote my second post in this thread. If you're representing AMG, I'd like you to know that this little workaround has nothing to do with the XBMC foundation, and in my opinion *enhances* the reputation of AMG as the most expert and widely-respected source of music information out there, something which a skilled marketer could point out to potential advertisers. It's a plus that a large community would use your database as the reference standard.

"Chosen as the Number 1 source for quality music information by over a million XBMC users" in your homepage and sales bumpf would be a valuable tool at the expense of a few inconvenienced electrons flowing thru your servers, if you were willing to let those electrons pass.

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
(This post was last modified: 2012-01-30 20:59 by DDDamian.)
find quote
fional Offline
Posting Freak
Posts: 903
Joined: May 2011
Reputation: 17
Location: Ireland
Post: #72
DDDamian Wrote:@fional - I tried to duplicate using exactly that artist/album. Results for artist bio (in debug log):
The info on pg 3 corrects the scraping prohibition (pls read disclaimer) and if that's gone away then your files under metadata.common.allmusic.com are fine.

Please go to system>settings>addons>enabled addons>artist information>allmusic and check your version: 2.0.7 is correct

Please go to system>settings>addons>enabled addons>album information>allmusic and check your version: 2.0.1 is correct

These should have been pushed to you automatically, but if not, the update button should be available if your version doesn't match.

The disclaimer does go away, but nothing is used in substitute. Rather it basically nils all the fields Sad

I checked the versions and I do have 2.0.7 and 2.0.1 respectively.

That's a shame, because allmusic is vastly superior for my collection.


DDDamian Wrote:Hope that helps, let me know if not. If that's really your picture I'm moving to Ireland Laugh

aww Smile
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #73
@fional - PM sent with e-mail address - will send you files directly

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
elevans Offline
Junior Member
Posts: 3
Joined: Jan 2012
Reputation: 0
Post: #74
I've been having some trouble with this and openelec. I'm trying to update it through my windows PC.

I figured out that I needed to use WinSCP to push the allmusic.xml file to the right directory.

I couldn't find a way to access it through samba using windows explorer.

That method only gave me access to the userdata\addon_data directory, not the /storage/.xbmc/addons/ directory.

Anyway, I updated the file, rebooted the computer, tried refreshing the library, scanning new folders, etc. and still I can't get it to work...

Neither artist bios or album info will load.

Help anyone? I've switched to LastFM for now, though I do like allmusic.
find quote
DDDamian Offline
Team-XBMC Developer
Posts: 3,030
Joined: Sep 2011
Reputation: 254
Location: Canada
Post: #75
PM replied, but I'd make sure it's in both directories, and I'm unfamiliar with OpenElec. Anyone else here use it?

System: XBMC HTPC with HDMI WASAPI & AudioEngine - Denon AVR-3808CI - Denon DVD-5900 Universal Player - Denon DCM-27 CD-Changer
- Sony BDP-S580 Blu-Ray - X-Box 360 - Android tablet wireless remote - 7.1 Streem/Axiom/Velodyne Surround System
If I have been able to help feel free to add to my reputation +/- below - thanks!
find quote
Post Reply