Improved allmusic.com scraper (plus a few questions)
#76
sho Wrote:Is there a ticket for this issue?

there's one now:
http://trac.xbmc.org/ticket/7510

vdrfan Wrote:svn revision?

i'm using svn 24150 on linux,
kiboy6 is on 24107-GL if i'm not mistaken.
Do not PM or e-mail Team-Kodi members directly asking for support.
Always read the Forum rules, Kodi online-manual, FAQ, Help and Search the forum before posting.
Reply
#77
the fix in svn 24170 works fine for me.
thanx!
Do not PM or e-mail Team-Kodi members directly asking for support.
Always read the Forum rules, Kodi online-manual, FAQ, Help and Search the forum before posting.
Reply
#78
Me too....thanks!

Just to confirm, we still need to overwrite the music / scrapers folder with the one talisto posted a few pages back to see the improvements, right?
Reply
#79
no.
Reply
#80
kiboy6 Wrote:Just to confirm, we still need to overwrite the music / scrapers folder with the one talisto posted a few pages back to see the improvements, right?

Nope, my changes were added to the SVN as of r24107. Hooray! Thanks spiff! Smile
Reply
#81
Awesome...thanks spiff, and thanks again to talisto Smile


edit:
....one bizarre thing...for some reason I'm getting no biography for "tenor saw", depite there being a description at allmusic.com. All other artists seem fine.....any idea?
Reply
#82
Using Camelot Beta-1 and the preference of allmusic scraper doesnt include discogs anymore. Is this intentional?
Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 16 GB DDR3 | 128 GB SSD, 82 TB (9 x 6 TB, 7 x 4 TB)
HTPC 1: Raspberry Pi 2 | HTPC 2: Raspberry Pi 2 | HTPC 3: Raspberry Pi
Reply
#83
steve1977 Wrote:Using Camelot Beta-1 and the preference of allmusic scraper doesnt include discogs anymore. Is this intentional?

Any thoughts?
Server: Asus Sabertooth Z77 | Intel Core i5 3.4 GHz | 16 GB DDR3 | 128 GB SSD, 82 TB (9 x 6 TB, 7 x 4 TB)
HTPC 1: Raspberry Pi 2 | HTPC 2: Raspberry Pi 2 | HTPC 3: Raspberry Pi
Reply
#84
discogs blocked us - so we removed it.
Reply
#85
Dear all,

After I found out that Discogs was blocking XBMC I took the liberty to ask the guys @ Discogs about this issue.

Here is the complete answer from Teo @ Discogs help Center

"Yes, we're blocking XBMC. It was basically acting like a DDOS and impacting site performance. Contact me directly and tell me more about it. Maybe we can find a way to allow it."

I think that XBMC developers should get in touch with discogs and find a solution ti this problem. Discogs is probably the best music database so its a shame to remove it from XBMC.

I hope that something good can come out of this.

Looking forward for your comments

Kind Regards

G
Reply
#86
Thanks for the heads up.. Teo at Discogs got in touch with me via email yesterday, I'm trying to work out some solution.

TheUni
Reply
#87
theuni Wrote:Thanks for the heads up.. Teo at Discogs got in touch with me via email yesterday, I'm trying to work out some solution.

TheUni

Well that's great news mate!

I really hope both sides to find a way to make this work.

Keep us posted!

Thnx

G
Reply
#88
Is there a way to force a re-scrape of the entire music library again?

I found that I needed to nuke the entire music database in the user profile directory, and then I needed to delete all of the thumbs and artist fan art from the user profile directory as well.

Also for testing purposes I exported my whole collection, nuked the db file, but didn't clear out the various fanart and thumbnail folders 0,1,2,3,4,5 etc. I noticed that after the import some of the pics didn't exactly match what my collection folders were showing, meaning that somehow the library 'remembers' even though the db file is gone.

When I tried the exact same test AND removed the thumbnail and fanart files from the userdata directories then the newly created db was insync.

Did I stumb onto something here or is this already known?

I guess really that this is more of an import issue, however, if I do a full scrape and then I do another full scrape it seems as if the query blows by artisst that it previously determined no items were available. The only way that I found to do a full scrape was to nuke the db, nuke the artist thumbs and fanart then reimport everything. Is there any way to force a re-scrape in this scenario

Thanks ahead of time,
Belgrath
Reply
#89
Belgrath Wrote:Is there a way to force a re-scrape of the entire music library again?

I found that I needed to nuke the entire music database in the user profile directory, and then I needed to delete all of the thumbs and artist fan art from the user profile directory as well.

Also for testing purposes I exported my whole collection, nuked the db file, but didn't clear out the various fanart and thumbnail folders 0,1,2,3,4,5 etc. I noticed that after the import some of the pics didn't exactly match what my collection folders were showing, meaning that somehow the library 'remembers' even though the db file is gone.

When I tried the exact same test AND removed the thumbnail and fanart files from the userdata directories then the newly created db was insync.

Did I stumb onto something here or is this already known?

I guess really that this is more of an import issue, however, if I do a full scrape and then I do another full scrape it seems as if the query blows by artisst that it previously determined no items were available. The only way that I found to do a full scrape was to nuke the db, nuke the artist thumbs and fanart then reimport everything. Is there any way to force a re-scrape in this scenario

Thanks ahead of time,
Belgrath

Thoughts?
Reply
#90
Hi, sorry to barge in, but I think my issue may be related to the scraper.

I'm currently trying to scrape all artist info/discogs using allmusic scraper.

When I run it it only seems to scrape the artist I happen to be focusted on when I run the scraper instead of all the artists.

When I select another artist I have to select the scraper again to get the data but again only works for one at a time not the whole library.

I'm using a nightly build from 3 days ago and have updated all my scrapers. Using reFocus skin for XBMC OSX.

Can't figure out what's wrong =(
Any suggestions?
Reply

Logout Mark Read Team Forum Stats Members Help
Improved allmusic.com scraper (plus a few questions)0