Feature Request - Sports scraper

  Thread Rating:
  • 1 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
n1md4 Offline
Fan
Posts: 397
Joined: Nov 2012
Reputation: 8
Post: #1
Hi,

I've been thinking about a sports equivalent to the movie/tv/audio DB sites; and all praise to zag who's assisted me so far.

Having done a little searching around XBMC forums, I have found the odd sport scraper, but always tailored for a particular discipline. I envisage a DB that can scraper various sport metadata; info, images, etc. I don't have a complete list yet, but will be open to any and all suggestions of what to scrape.

This is just a dream I have at the moment, and am first wanting to guage a user base. With enough interest I'll attempt to put together some pieces to make this a reality, so by way of reply, if this appeals, please let me know.

Regards,
n1md4

HTPC XBMC Gotham OpenELEC, NYXBoard, Athlon X2, OCZ SSD, 4G RAM
Storage 4x 2TB Green HDD BTRFS RAID1, Athlon X2, OCZ SSD, 4G RAM
find quote
Jeneration Offline
Junior Member
Posts: 5
Joined: Sep 2012
Reputation: 0
Post: #2
please count me in as an interested party. this would be a very welcome addition.
(This post was last modified: 2013-10-03 08:33 by Jeneration.)
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #3
To start any kind of community site like that you are going to need a fair few passionate users who can contribute first.

Basically I just don't think the interest is there for a crowd sources sports site yet (too many different sports around the world).

Maybe in the future though Smile

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
(This post was last modified: 2013-10-04 13:15 by zag.)
find quote
n1md4 Offline
Fan
Posts: 397
Joined: Nov 2012
Reputation: 8
Post: #4
You're not wrong! In which case I'll use it as a learning exercise, if it actually gets anywhere I'll post it; a "build it and they'll come" perspective Wink

HTPC XBMC Gotham OpenELEC, NYXBoard, Athlon X2, OCZ SSD, 4G RAM
Storage 4x 2TB Green HDD BTRFS RAID1, Athlon X2, OCZ SSD, 4G RAM
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #5
To be honest there was no real need for an audio site until Allmusic and Last.fm started messing around and restricting access.

ESPN is probably the best source for sports scores at the moment.

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
(This post was last modified: 2013-10-04 21:50 by zag.)
find quote
n1md4 Offline
Fan
Posts: 397
Joined: Nov 2012
Reputation: 8
Post: #6
I'll use it as a learning exercise in site building, no harm. Ironically though, I want information of the BTCC, ESPN doesn't know anything about it! Smile

HTPC XBMC Gotham OpenELEC, NYXBoard, Athlon X2, OCZ SSD, 4G RAM
Storage 4x 2TB Green HDD BTRFS RAID1, Athlon X2, OCZ SSD, 4G RAM
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #7
See if you can find any sites offering an XML or JSON API, that would be useful in automatically filling out information.

I see recently that the Premier League lost its copywrite case on fixtures and results. This makes a site much more likely in the future.

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
find quote
amalething Offline
Junior Member
Posts: 16
Joined: Feb 2013
Reputation: 0
Post: #8
I'm looking this same feature too. Sports I'm interested in are: NASCAR, Nationwide, WTCC, BTCC, DTM, and MOTOGP. Other sports would be a bonus I guess.

For those wanting to preserve a library of sports, I expect an NFO file would be very simple and relatively easy to maintain.

However I don't wish to form a library, I download all the sporting events at the weekend, and watch them throughout out the week before deleting them.

That said, when I come to watch it, I'd love for the information and artwork to be scraped for me. Creating an NFO and then deleting the event days later makes no sense.

A simple TVDB setup would work well. I have no programming skill, but I have ample of time to populate all forms of sporting event, regardless of interest.

I just wanted to put a separate note that as a temporary solution I'm going to put the events on TVDB. Even while is not technically allowed.

E.g
Title: History of British Tracks, BBC1, S2013E1 - Brands hatch.

once it's scraped just change the title in XBMC to BTCC. I guess fan art can either be on TVDB or locally scrapped.

Currently I have a playlist on my xbmc homepage tab called SPORTS, which sub playlists called BTCC, NASCAR etc, with there own artwork. however there is no episode information scraped.
(This post was last modified: 2013-10-08 12:08 by amalething.)
find quote
boodahbellie Offline
Junior Member
Posts: 6
Joined: Jan 2013
Reputation: 0
Post: #9
I would love to see something like this as well, I have a lot of NHL games that I would like to have in my library on XBMC.
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #10
Find a good source for the scores and I might be able to magic something up Wink

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
find quote
boodahbellie Offline
Junior Member
Posts: 6
Joined: Jan 2013
Reputation: 0
Post: #11
I would start at NHL.com, but beyond that, I wouldn't know where to look since I don't know what I'm looking for.

I would start at nhl.com, but I wouldn't know where to look or what to look for.
(This post was last modified: 2014-01-17 17:58 by boodahbellie.)
find quote
groty Offline
Junior Member
Posts: 12
Joined: Jan 2010
Reputation: 0
Post: #12
Possibility - if someone is good at scraping are the sports reference sites.

http://www.pro-football-reference.com/bo...090was.htm

Or possibly here, but it's a subscription service.

http://showcase.xmlteam.com/
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #13
Wow American football is complicated Smile

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
find quote
boodahbellie Offline
Junior Member
Posts: 6
Joined: Jan 2013
Reputation: 0
Post: #14
Here is one for Hockey
http://www.hockey-reference.com/
find quote
zag Offline
Team-XBMC Member
Posts: 1,668
Joined: Oct 2007
Reputation: 19
Location: UK
Post: #15
Looks like those sites use this as their source

http://www.xmlteam.com/feeds.php
http://sportsdb.org/sd

These look particularly interesting as its "open" data
http://www.sportsstandards.org/oc
http://football-data.co.uk/data.php

HTPC - XBMC Gotham, OpenELEC, Harmony Smart Remote, Intel Haswell NUC, 40gb intel SSD, Core i3, 4gb RAM
Storage - 2 x qnap 8tb 419p+ NAS
Display LG 46" LCD + Casio Bulbless projector [PICS]
[Image: widget]
(This post was last modified: 2014-03-17 22:44 by zag.)
find quote
Post Reply