IMDb scraper function in a DLL?

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
small_frenchy Offline
Junior Member
Posts: 32
Joined: Jun 2009
Reputation: 0
Post: #21
For testing :
http://www.4shared.com/file/118290170/32...ester.html

Dependencies problems are resolved
find quote
small_frenchy Offline
Junior Member
Posts: 32
Joined: Jun 2009
Reputation: 0
Post: #22
A little enhanced version. Some little (too litlle) cleanup in the main dll. Double click on fanart / thumb to see images. Better support of callbacks from the main dll to the .Net one.
I have test a lot of scraper, and it works fine in my opinion but only for movie scraper.
download the setup here :

http://www.4shared.com/file/118524777/4d...ester.html

I will publish sources (in fact a modified version of the XBMC project and the .Net wrapping) when the code will be more clean.
(This post was last modified: 2009-07-16 16:32 by small_frenchy.)
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #23
you obviously know what's going on in the scraper code, and i've got an almost complete framework done supporting all scraper types (minus the stuff i don't understand from the C++ code).


I'd like to ask for your help, cause i can barely follow the flow of the c++ code and mine is intended to be natively .Net, without the need for wrapping code, and i'm sure spiff is tired of me bothering him about what's going on in his code.

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
(This post was last modified: 2009-07-16 23:50 by Nicezia.)
find quote
spiff Offline
Grumpy Bastard Developer
Posts: 12,186
Joined: Nov 2003
Reputation: 82
Post: #24
nah i have no issues with explaining stuff. as i have said before it's what i get for refusing to document stuff Wink that being said i totally agree that joining efforts is your best choice of action

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #25
and i'm just the opposite, i've commented almost every line of my code.

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #26
My parser is solid by the way, fortunately, i could read and understand everything in the parser code, settings & scraper info, and the other things used by the parser work just like xbmc's parser. (though the functions are differently implemented due to using native .Net features rather than writing a completely new Regular Expression Engine (which i tried at the start and decently implemented but a few things i weren't happy with - then a svn error wiped the whole thing away) and as you said, XBMC can handle little discrepencies like there not being a space before the function attribute in that one scraper

so if i could just get some help figuring out exactley what goes on before running the parser (during and after the parser i've already got handled) then i can finish this completely within a day's time.

instead of trying to untangle Scraper code from XBMC why not just help me understand the little bit of code i need to understand to wrapp this up. And we can all be happy.

the only part of my code that needs any work is setting buffers before running the scraper functions.

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
(This post was last modified: 2009-07-17 01:58 by Nicezia.)
find quote
small_frenchy Offline
Junior Member
Posts: 32
Joined: Jun 2009
Reputation: 0
Post: #27
I'm not sure that I will be able to help you as you want. Anyway, I can do my best but I will not do as good as spiff.

In fact, I haven't understand a lot a thing. I've just study the call stack with the visual studio debugger at scraper call from xbmc. Then I have just fake necessary input parameter (to handle loading / unloading dll xbmc system, and also xbmc file system handling) and export functions to scrap and set callback to .Net.

Anyway, the big advantage I see in the manner is the fact that it follow the xbmc code as it grow or change. I can update from svn the scraping objects and that's all (except if the definitions of objects change).

But be sure that if I can help you in anyway I will do. Let me know.

For me, I'll continue the dll way, I have to handle ScraperSettings then continue it for tv show and music. I think the hard part is done, the rest is only more exports from the dll.

(PS : sorry for my poor english, I do my best...):o

Another version with settings handling : http://www.4shared.com/file/118733463/bc...tings.html
(This post was last modified: 2009-07-17 15:43 by small_frenchy.)
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #28
small_frenchy Wrote:I'm not sure that I will be able to help you as you want. Anyway, I can do my best but I will not do as good as spiff.

In fact, I haven't understand a lot a thing. I've just study the call stack with the visual studio debugger at scraper call from xbmc. Then I have just fake necessary input parameter (to handle loading / unloading dll xbmc system, and also xbmc file system handling) and export functions to scrap and set callback to .Net.

Anyway, the big advantage I see in the manner is the fact that it follow the xbmc code as it grow or change. I can update from svn the scraping objects and that's all (except if the definitions of objects change).

But be sure that if I can help you in anyway I will do. Let me know.

For me, I'll continue the dll way, I have to handle ScraperSettings then continue it for tv show and music. I think the hard part is done, the rest is only more exports from the dll.

(PS : sorry for my poor english, I do my best...):o

Another version with settings handling : http://www.4shared.com/file/118733463/bc...tings.html

actually i think i'm just about done now, once spiff explained to me how multiple urls are handled (and i learned that its a good idea to use the Visual studio help to look up things i don't understand in c++) I still may need a little help in understanding the flow of the scraper code if anything changes... but for now i think i'm up to speed.

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
find quote
small_frenchy Offline
Junior Member
Posts: 32
Joined: Jun 2009
Reputation: 0
Post: #29
Okay,let me know if I can help you.
find quote
Post Reply