IMDb scraper function in a DLL?

small_frenchy · 2009-06-29 13:17

Hi,
I plan to make an ASP .Net web site to manage my vidéo collection, and then create a scrapper to query the web site (In this way, all my xbmc boxes will have the same video metadata scrapped from my own application).

I have thinking to try to use the methods from IMDB.cpp and IMDB.h files. To do this, I have tried to create a win32 dll (which will be wrapped on .Net to use the methods) which will expose methods used by xbmc to scrap data (expose CIMDB::InternalFindMovie and CIMDB::InternalGetDetails)

The problem : I'm used to use win32 dll in .Net but I'm not a C++ expert (little skill, no more) and I have a lot of problem when I want to include IMDB.h file in the main code of my DLL.

Does anyone can help me ?

**jmarshall** · 2009-06-29 13:18

Why not use the opensource scraper library already available?

small_frenchy · 2009-06-29 13:42

Thanks for quick reply. I haven't see this lib. I've seen a project named "scrap" but seems to be dead. Where can I find this lib ?
[UPDATE] I found it thanks for the info !

**zag** · 2009-06-29 22:20

http://forum.xbmc.org/showthread.php?tid=50055

Nicezia · 2009-06-29 23:46

l'd suggest waiting til this weekend when i upload the most recent version which handles things alot better, and has alot more tools at your disposal.

small_frenchy · 2009-06-30 10:15

Hi,
I've just started my dev so I can wait for this week end. I've test the current function and it works well for what I need. I will let you know how things are going.

small_frenchy · 2009-07-06 11:22

I have a little problem. I've tried to use the allocine.xml scraper from the svn code source with ScraperXML. It doesn't work. It seems that the scraper has bugs in the ScraperXML view (Space missing before "function" and another little one). But this scraper works well with XBMC. That's why I have tried to put InternalGetDetail function in a dll, because I think it is the best to re-use the XBMC code.

I continue for searching to put that in a dll.

**spiff** · 2009-07-06 19:27

i really really suggest you rather figure out what's bugging in the scraperxml library. the code in xbmc is so entangled in internal stuff that i gave up separating it a while back..

Nicezia · 2009-07-07 21:06

There are a few things that XBMC can do that scraperXML can't

for instance

XBMC can parse XML fragments, while ScraperXML needs a fully qualified XML element

for instance

XBMC can parse this

Code:

<url>http://foo.com/foo.html</url>

<url>http://foo.com/foo2.html</url>

while ScraperXML would need it to be like this

Code:

<sometag>

   <url>http://foo.com/foo.html</url>

   <url>http://foo.com/foo2.html</url>

</sometag>

ScraperXML requires well formed Xml elements (for compatibility with any program that may use a different XML Parser, this is something i don't feel should be changed as compatibility with other programs and other XML handlers is one of the main goals of the code.)

perhaps it would be a good idea to document what's about this scraper isn't working with ScraperXML let me know and i'll look into fixing the scraper so it works with both.

for instance, there being no space separating the function attribute and the previous attribute, is easily repairable by changing that in the scraper.

I've had several problems with other scrapers that have small errors like that that i have been fixing to get to work with both scraperXML and XBMC.

small_frenchy · 2009-07-08 10:44

I will try to make a dll, I know it's hard, but I will make a try this week end. I think it is possible. If I failed, I will use ScraperXML and be sure I will give feedback about it.

jmarshall Team-XBMC Developer Posts: 24,564 Joined: Oct 2003 Reputation: 138	2009-06-29 13:18 Post: #2 Why not use the opensource scraper library already available? Always read the XBMC online-manual, FAQ and search the forum before posting. Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules. For troubleshooting and bug reporting please make sure you read this first.
	find quote

small_frenchy Junior Member Posts: 32 Joined: Jun 2009 Reputation: 0	2009-06-29 13:42 Post: #3 Thanks for quick reply. I haven't see this lib. I've seen a project named "scrap" but seems to be dead. Where can I find this lib ? [UPDATE] I found it thanks for the info ! (This post was last modified: 2009-06-29 14:01 by small_frenchy.)
	find quote

zag Team-XBMC Member Posts: 845 Joined: Oct 2007 Reputation: 9 Location: UK	2009-06-29 22:20 Post: #4 http://forum.xbmc.org/showthread.php?tid=50055
	find quote

Nicezia Fan Posts: 369 Joined: Nov 2006 Reputation: 0 Location: Montgomery, Alabama	2009-06-29 23:46 Post: #5 l'd suggest waiting til this weekend when i upload the most recent version which handles things alot better, and has alot more tools at your disposal. ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!
	find quote

small_frenchy Junior Member Posts: 32 Joined: Jun 2009 Reputation: 0	2009-06-30 10:15 Post: #6 Hi, I've just started my dev so I can wait for this week end. I've test the current function and it works well for what I need. I will let you know how things are going.
	find quote

small_frenchy Junior Member Posts: 32 Joined: Jun 2009 Reputation: 0	2009-07-08 10:44 Post: #10 I will try to make a dll, I know it's hard, but I will make a try this week end. I think it is possible. If I failed, I will use ScraperXML and be sure I will give feedback about it.
	find quote