OFDB broken in SVN?

  Thread Rating:
  • 1 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
popelheini Offline
Junior Member
Posts: 10
Joined: Apr 2010
Reputation: 0
Post: #1
The OFDB scraper doesn't work correct on SVN. Most of movies are unknown, can't be added manually. I have installed OFDB from 9.11 on SVN and it works perfect now.
Is it a known error?

Popel
find quote
Pezo Offline
Junior Member
Posts: 11
Joined: Jul 2011
Reputation: 0
Post: #2
OFDb Scraper 1.0.17 does not work for me either.
If I search "Pumuckl" on the OFDb site I get 6 hits, the scraper finds nothing.

Pezo
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #3
It's due to the crappy bing API which was chosen to out-rule the even more crappy OFDb search function. Unfortunately the search function is still that bad, that every title with umlauts and/or chars like "-" or ":" are not found (eg. "Herr der Ringe - ..."). Using the google search won't work either, as it will detect automated search queries and block us for a few minutes.

I am open for ideas.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #4
I've just pushed scraper version 1.1.0. Please report back if its any good Wink

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
xbmc_pitti Offline
Junior Member
Posts: 22
Joined: Dec 2010
Reputation: 0
Post: #5
vdrfan Wrote:I've just pushed scraper version 1.1.0. Please report back if its any good Wink

Hi,
the new Version doesn't utilize URLs given in .nfo files anymore.
Can you please have a look at this.
Thanks

vdrfan Wrote:Using the google search won't work either, as it will detect automated search queries and block us for a few minutes.

You have to use google search api to avoid bot blocking.
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #6
Please pastebin the nfo file so i can test it.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
xbmc_pitti Offline
Junior Member
Posts: 22
Joined: Dec 2010
Reputation: 0
Post: #7
vdrfan Wrote:Please pastebin the nfo file so i can test it.

Die Insel der Abenteuer.nfo
Code:
http://www.ofdb.de/film/144620,Die-Insel-der-Abenteuer


or

Battle for Terra (3D).nfo
Code:
<movie>
    <title>Battle for Terra (3D)</title>
    <genre>3D</genre>
</movie>    
http://www.ofdb.de/film/133062,Battle-for-Terra
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #8
Fixed in scraper version 1.1.2 (eden-pre). Should be available in the repositories in a few minutes. FYI, you might have to force the update.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
xbmc_pitti Offline
Junior Member
Posts: 22
Joined: Dec 2010
Reputation: 0
Post: #9
vdrfan Wrote:Fixed in scraper version 1.1.2 (eden-pre). Should be available in the repositories in a few minutes. FYI, you might have to force the update.


Thanks for the fast fix. Will check it out when i'm at home, and report back.
find quote
xbmc_pitti Offline
Junior Member
Posts: 22
Joined: Dec 2010
Reputation: 0
Post: #10
I made just some view tests, and it seems to work with my .nfo files again.

Thanks

Remark: The Official version 1.1.0 has the same Problem with .nfo, last working Version I know is 1.0.17
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #11
I've just pushed the latest eden-pre changes to the dharma repository. Scraper is now at version 1.1.2 for both releases.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
nebu Offline
Junior Member
Posts: 10
Joined: Aug 2009
Reputation: 0
Location: Germany
Post: #12
I am still having troubles with 1.1.2. (The scraper used to work fine for me for years before)

Scraper is set tu use folder names. On my system folders are cumbered continuously, the numbering is used in a database. The database is used to generate nfo files.

The folder is named "0726- Platoon" and contains an nfo file with the content
Code:
http://www.ofdb.de/film/1140,

Obviously this is at first recognized by the scraper:

Code:
23:59:20 T:3025307488 M:1598820352   DEBUG: scraper: NfoUrl returned <url>http://www.ofdb.de/film/1140,</url><id>1140</id>
23:59:20 T:3025307488 M:1598820352   DEBUG: VideoInfoScanner: Found matching URL NFO file: /mnt/array2/filme/0726- Platoon/0726.nfo
23:59:20 T:3025307488 M:1598820352   DEBUG: VideoInfoScanner: Fetching url 'http://www.ofdb.de/film/1140,' using OFDB scraper (content: 'movies')

But then it stats looking for the movie by searching for the folder name:
Code:
23:59:21 T:2911677296 M:1598832640   DEBUG: InternalFindMovie: Searching for '0726- platoon' using OFDB scraper (path: '/home/xbmc/.xbmc/addons/metadata.ofdb.de', content: 'movies', version: '1.1.2')
23:59:21 T:2911677296 M:1598832640   DEBUG: scraper: CreateSearchUrl returned <url>http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon</url>
23:59:21 T:2911677296 M:1598832640   DEBUG: FileCurl::Open(0xbf84c964) http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon
23:59:21 T:2911677296 M:1598832640    INFO: easy_aquire - Created session to http://api.themoviedb.org
23:59:22 T:2911677296 M:1598824448   DEBUG: FileCurl::Close(0xbf84c964) http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon
23:59:22 T:2911677296 M:1598824448   DEBUG: scraper: GetSearchResults returned <results></results>
23:59:22 T:2911677296 M:1598824448   DEBUG: InternalFindMovie: Searching for '0726- platoon' using OFDB scraper (path: '/home/xbmc/.xbmc/addons/metadata.ofdb.de', content: 'movies', version: '1.1.2')
23:59:22 T:2911677296 M:1598824448   DEBUG: scraper: CreateSearchUrl returned <url>http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon</url>
23:59:22 T:2911677296 M:1598824448   DEBUG: FileCurl::Open(0xbf84c964) http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon
23:59:23 T:2911677296 M:1598824448   DEBUG: FileCurl::Close(0xbf84c964) http://api.themoviedb.org/2.1/Movie.search/de/xml/57983e31fb435df4df77afb854740ea9/0726%2d%20platoon
23:59:23 T:2911677296 M:1598824448   DEBUG: scraper: GetSearchResults returned <results></results>
23:59:23 T:2911677296 M:1598824448   DEBUG: Thread 2911677296 terminating
....which obviously does not work.

Any hints?

Thanks,
Ben

Edit: Sometimes it works perfectly with the same setup:

Code:
00:06:06 T:3025307488 M:1599037440   DEBUG: scraper: NfoUrl returned <url>http://www.ofdb.de/film/1304,</url><id>1304</id>
00:06:06 T:3025307488 M:1599037440   DEBUG: VideoInfoScanner: Found matching URL NFO file: /mnt/array2/filme/0727- Dark City/0727.nfo
00:06:06 T:3025307488 M:1599037440   DEBUG: VideoInfoScanner: Fetching url 'http://www.ofdb.de/film/1304,' using OFDB scraper (content: 'movies')
00:06:06 T:2920065904 M:1599037440   DEBUG: thread start, auto delete: 0
00:06:06 T:2920065904 M:1599025152   DEBUG: FileCurl::Open(0xbf84c3c4) http://www.ofdb.de/film/1304,
00:06:06 T:2920065904 M:1599025152    INFO: easy_aquire - Created session to http://www.ofdb.de
00:06:07 T:2920065904 M:1599025152   DEBUG: FileCurl::Close(0xbf84c3c4) http://www.ofdb.de/film/1304,
00:06:07 T:2920065904 M:1599025152   DEBUG: scraper: GetDetails returned <?xml version="1.0" encoding="utf-8" standalone="yes"?><details><title>Dark City</title><originaltitle>Dark City<
.....



Sorry, I guess I am not supposed to post here. Could somebody move this please?
(This post was last modified: 2011-08-11 00:12 by nebu.)
find quote
vdrfan Offline
Team-XBMC Developer
Posts: 2,891
Joined: Jan 2008
Reputation: 8
Location: Germany
Post: #13
Please do NOT post log snippets. Pastebin the entire file instead.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote