[RELEASE] EPG Scraper for Switzerland, Germany, and Austria

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #11
OK As soon I have time ... I guess I can add a switch for this.
In the moment I do develop a xbmc addon that is very time-using.
Since this week I do coding like a crazy ;-)
BTW Do you use slow mode or fast mode ?
Compared to the tv_search grabber from xmltv my script is running like
a ferrari ;-)
Hans
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #12
OK Fellows :-)
In the future a svn checkout is possible with the script.
Cheers Hans
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #13
Has someone my tool running on Debian Squeeze ?
I have bug-report on the project-url for a script error on Debian
http://code.google.com/p/epg-swiss/issues/detail?id=3
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #14
I release 0.9H for testing over svn ...

svn checkout http://epg-swiss.googlecode.com/svn/trunk/ epg-swiss-read-only

Feedback would be nice
Hans
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #15
I created a patch against version 0.9H that works now with debian 6.0.

http://epg-swiss.googlecode.com/files/pa...ebian.diff

output ubuntu :
-rw-r--r-- 1 root root 32460 2010-08-17 22:25 chan280_0.html

output debian
-rw-r--r-- 1 root root 32460 2010 08-17 22:25 chan280_0.html

Inside the script I used a statement like ls -alv html | awk '{print $8} ' to get all the names of a directory.

Because debian shows like above you have to type {print $9} to have the same result.
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #16
There is a new release 0.9J for the epg-script

http://code.google.com/p/epg-swiss/downl...z&can=2&q=

Note :
The ID-has changed inside the script.
Now the script produce 100 % conform xml
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #17
If you get the latest svn trunk it is possible to run this script

- On Ubuntu 10.04. LTS
- Debian 6.0
- allmost all other linux
- Mac OS X Snow Leopard

The support for Mac OS was added by Thomas Oeding (thnx)

Regards
Hans
find quote
devport Offline
Junior Member
Posts: 15
Joined: Nov 2008
Reputation: 0
Post: #18
This grabber is great.

I found a little bug concerning program time timezone ( so that the epg was off by 1 hour in tvtime & gtvg ).

You just set the timezone to +0100 in line 392 which is wrong since those times are CET summer time by now which is UTC +0200 :

Code:
filler="00 +0100" # CET

Timezone actually depends on sumer / winter time for CET as can be read in the output of the tv_grab_eu_epgdata grabber :

http://www.linuxforen.de/forums/showthread.php?t=254468 :

Quote:Enter the time offset from UTC here. Think of it as your time zone. For example: during winter in Germany, you should enter "+0100". During summer, use "+0200". (without quotation marks)

Maybe it would be possible to set the timezone to winter / summer time accordingly. Or maybe even better all program times could be converted to UTC ( time->utc +0000 ) so that no summer / winter time conversion would be needed at all.
( I am currently working on the implementation )

Another suggestion : It would be nice if there was a way to manually set channel id and name for all channels, e.g. by using a channelname[:channelid] structure in setup.cfg ( :channelid being optional ).

Especially the channel ids are very uncommon right now ( e.g. the channel id for zdf should be zdf.de not 2.tv.search.ch ). Right now I grep threw the database to replace channel ids.
(This post was last modified: 2010-08-24 14:11 by devport.)
find quote
devport Offline
Junior Member
Posts: 15
Joined: Nov 2008
Reputation: 0
Post: #19
I found an easy solution to the timezone problem :

Replace

Code:
filler="00 +0100" # CET

with

Code:
filler="00 `TZ=Europe/Zurich date +%z`" # Current epg server timezone

It will set the timezone according to the current timezone at server location which is the timezone of the program times of the website ( +0100 at winter time, +0200 at summer time ) and it works no matter from where in the world you execute it.
(This post was last modified: 2010-08-24 15:08 by devport.)
find quote
linuxluemmel Offline
Member+
Posts: 872
Joined: Jun 2009
Reputation: 0
Location: Lucern / Switzerland
Post: #20
Thanks for the feedback. I worked over 6 weeks for the initial code release.

As soon I have time I do integrate your little patch into svn. Yes, I know the generated
id's are not the same id's that xmltv provides but I do work with channel-nummbers from 1-270 and not with the name.
You may have a patch to make the id's more xmltv compatible ?
I guess you came from german speaking part of europe ?

Regards from switzerland
Hans
(This post was last modified: 2010-08-24 15:36 by linuxluemmel.)
find quote
Post Reply