xbmc.org website recovery

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
aptalca Offline
The Dude
Posts: 827
Joined: Sep 2009
Reputation: 17
Post: #1
Is there any chance of recovering last month's messages through an index such as google cache?

I know it's a stretch, but maybe? the forum was being indexed by google several times a day, and everything was text based. . .
find quote
mr.b Offline
Senior Member
Posts: 165
Joined: May 2007
Reputation: 0
Post: #2
For those that are looking to recover data in the lost threads, most of it should still be cached on google/bing/yahoo if you act fast. There's even a few tools out there that are made for recovering data via this method (see warrick). Is anyone from the xbmc team already working this angle? Perhaps people could just highlight specific threads they are after and we can work together to get them from cache before they disappear. Just trying to be helpful....
find quote
bradvido88 Offline
Donor
Posts: 736
Joined: Nov 2008
Reputation: 7
Location: MN
Post: #3
I've posted and subscribed to quite a few threads over the last month that i'd like back.
Is team-XBMC looking at this, or just letting the data disappear?

These are just a few to start out with. I've got a whole list of now-broken links in my browser history.
http://forum.xbmc.org/showthread.php?p=526213
http://forum.xbmc.org/showthread.php?p=522197
http://forum.xbmc.org/showthread.php?p=526213

I'm guessing you could probably find the ID# where it cut off and recover anything greater than that from the cache?

XBMC.MyLibrary (add anything to the library)
ForTheLibrary (ForTheRecord & XBMC Library Integration)
SageTV & XBMC PVR Integration
Delete unused thumbs
(This post was last modified: 2010-03-17 21:38 by bradvido88.)
find quote
theuni Offline
Team-XBMC Communication Manager
Posts: 1,087
Joined: Oct 2007
Reputation: 2
Location: Atlanta, Ga, USA
Post: #4
You can't just cram text into the db. There may be extreme ways of salvaging posts from google cache, but nothing I'm willing to do. Sorry guys, 2 sleepless nights is enough for me.

The info will be back in no time anyway...

TheUni
find quote
sebak Offline
Junior Member
Posts: 31
Joined: Mar 2010
Reputation: 0
Location: Belgium
Post: #5
It's not that easy as just scraping off googles cache.
First you should make a script that does just that, but then there are still a lot of problems.

You can't just put the data in the database right away. If you post a reply or thread, a lot of things change (post count, cache, ...) and to maintain integrity of the system, you need to use the API.
However, for example posts posted by users that are now also gone (users registererd within the last month) will give problems, because guests are not allowed to post. And there might be a lot of these kind of problems.

Edit: theuni was faster
(This post was last modified: 2010-03-17 23:12 by sebak.)
find quote
exobuzz Online
Fan
Posts: 530
Joined: Aug 2004
Reputation: 9
Post: #6
I would say not much can realistically be done now about lost data, but I am willing to help if xbmc want to set up offsite database replication. It is a good way of not only handling backups (backing up from slave database rather than primary, and having no "delay" whilst non innodb tables are locked, and also having a copy which is always at most a few seconds/minutes behind the main database.
find quote
Jezz_X Online
Team-XBMC Skinner
Posts: 5,263
Joined: Jun 2006
Reputation: 55
Location: Earth
Post: #7
I just think everyone should be grateful we didn't go with option 1 which was start the forum from scratch and decided to go with option 2 (use the backup before the site move)

Skins I have done....
[Image: skinsq.png]
And others in the past...

Want to know what I'm working on currently? Check me out on Google+
find quote
bradvido88 Offline
Donor
Posts: 736
Joined: Nov 2008
Reputation: 7
Location: MN
Post: #8
theuni Wrote:...Sorry guys, 2 sleepless nights is enough for me.

The info will be back in no time anyway...
Thank you for your time and help! I was just curious if XMBC had any plans. Like you said, it is not a clean and easy thing to do.

Jezz_X Wrote:I just think everyone should be grateful we didn't go with option 1 which was start the forum from scratch and decided to go with option 2 (use the backup before the site move)
Very grateful! Starting from scratch would have lost us a lot of knowledge, information and time.

XBMC.MyLibrary (add anything to the library)
ForTheLibrary (ForTheRecord & XBMC Library Integration)
SageTV & XBMC PVR Integration
Delete unused thumbs
find quote
mr.b Offline
Senior Member
Posts: 165
Joined: May 2007
Reputation: 0
Post: #9
I appreciate sleepless nights as well (I've been there). Also, i wasn't advocating reimporting into the database, rather, an html capture and attachment to a new thread.
find quote
hippojay Offline
Fan
Posts: 301
Joined: Mar 2008
Reputation: 13
Location: Sheffield, UK
Post: #10
For the few odd posts (such as guides which has post 1 updated) then google cache will probably help track down the post contents, such as this linux mavemkv one:

Luckily, you can use teh cache: keywork in a google search to bring back the cached page only:

cache:http://forum.xbmc.org/showthread.php?tid=67420

At least this allows some threads to get the first post back on track - but not for wholesale db restoration...
find quote
Post Reply