Help needed with development of new scraper for filmdelta.se (Swedish Movie Scraper)?

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
vdrfan Offline
Team-XBMC Developer
Posts: 2,786
Joined: Jan 2008
Reputation: 7
Location: Germany
Post: #11
Uhm, whats the current problem with the scraper? The modified version i've attached to the ticket (see above) is working fine for me.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #12
Daniel Malmgren Wrote:edit: Ok, I found the error. They obviously has redone the search result on filmdelta.se since I did my first expression, and I've stupidly enough only tested with a page I saved down for testing. That's why my tests worked and not xbmc :-)

The nature of web-scraping Tongue
the page is always bound to change Wink

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
find quote
Daniel Malmgren Offline
Senior Member
Posts: 176
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #13
Ok. Quite small effort involved in fixing that one. Now "Sagan om ringen" actually returns quite a list of hits. My xbmc chose the wrong one though. From the wiki (at http://wiki.xbmc.org/?title=Scrapers I understand that if GetSearchResults returns more than one result the user gets to choose which one is correct. When does this choosing happen? I've never actually seen it Confused

New xml at http://pastebin.com/m648a3981

/Daniel
find quote
spiff Online
Grumpy Bastard Developer
Posts: 12,176
Joined: Nov 2003
Reputation: 82
Post: #14
let me be the first to say the obligatory;

doh!

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
spiff Online
Grumpy Bastard Developer
Posts: 12,176
Joined: Nov 2003
Reputation: 82
Post: #15
it happens if you do a manual lookup using 'movie information' from context

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
Daniel Malmgren Offline
Senior Member
Posts: 176
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #16
vdrfan Wrote:Uhm, whats the current problem with the scraper? The modified version i've attached to the ticket (see above) is working fine for me.

Well, currently I guess everything that I've implemented is working. I haven't included all possible info from filmdelta though. And the thumbs are way to low resolution, I guess I could fetch them from another place (imdb?) instead, right?

Nicezia Wrote:The nature of web-scraping Tongue
the page is always bound to change Wink

Yep. I've established a communication with the folks behind filmdelta though, my hope is that they could put up something for me that is not as bound to change. Not sure if it's going to happen though...

/Daniel
find quote
Daniel Malmgren Offline
Senior Member
Posts: 176
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #17
spiff Wrote:it happens if you do a manual lookup using 'movie information' from context

Ah. Thanks there mate. I've always wondered Big Grin

/Daniel
find quote
Daniel Malmgren Offline
Senior Member
Posts: 176
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #18
vdrfan Wrote:Uhm, whats the current problem with the scraper? The modified version i've attached to the ticket (see above) is working fine for me.

Darn. Just realized that you actually changed stuff in the xml in the ticket. Thought you just posted my xml right up. Means that I've been working in parallell with you. Eek

I'll incorporate my changes into your xml and post again...

/Daniel
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,786
Joined: Jan 2008
Reputation: 7
Location: Germany
Post: #19
doh! thanks for not ignoring me Smile

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #20
not to be thread jacking, but since there's some attention here, what's the accepted indentation on the XML (how many spaces generally do you use per indentation - so i can get the scraper editor outputting to that standard)

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
(This post was last modified: 2009-07-27 19:36 by Nicezia.)
find quote
Post Reply