XBMC.MyLibrary - Scan any source to the library (Hulu/Netflix/Plugins) - Printable Version
+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for XBMC (/forumdisplay.php?fid=116)
+--- Thread: XBMC.MyLibrary - Scan any source to the library (Hulu/Netflix/Plugins) (/showthread.php?tid=98210)
- yonu - 2011-07-30 01:06
ok I renamed them but I get an error in XBMC that it says it can't play the file(yes I updated the library) I am using playon if that helps
- pkscuot - 2011-07-30 02:06
yonu Wrote:Very Dumb question
it's worth understanding the process this script uses to get things working, it helps with issues like this. Here goes my try.
1- the script scans your Netflix queue and creates a stub file with a .mpg extension for each movie (or TV show episode) it finds. That mpg file isn't playable, but it has to be a mpg file in order for step 2 to work.
2- the script then triggers an XBMC library update. That process attempts to scan the directory with those fake mpg files and loads them into XBMC based on the scraper you have set. If the scraper can't figure out what movie is associated with the file XBMC won't load it.
3- the script then figures out what items got loaded in step 2 and renames the items to .strm files (which will play properly). It also does some magic in the XBMC database to associate the old mob entry with the newly named .strm file.
The most common problem I have is that the scraper can't figure out the movie based on it's name. My solution there is to create a .nfo file that contains only the link to the right entry in the moviedb database and put it in the same directory as the movie with the same name (but with .nfo file extension). Then I rerun the script and everything tends to work.
- Batch - 2011-07-30 23:37
I figured out a solution for IceFilms to have their movies in the database without hammering their servers. I did some script modifications and keep the link to the page containing the links to the different mirrors instead of the mirrors themselves.
(I also did a minor hack to be able to use XBMC.MyLibrary with IceFIlms but I hope you don't mind since I'm avoiding to spam HTTP requests...)
Grown Ups (2010).strm:
When selecting a movie the script scrapes the movies page at IceFilms and let me choose what quality and mirror I want to use.
I tracked all traffic with Wireshark to be sure I didn't accidently hammer IceFilms server. When I filled my library (11639 movies) the script only did about one page request every 5 minutes from IceFilms.info since it only needed to load the pages listing the movies in alphabetic order.
Everything works quite good but I got a few problems:
1) I would like to skip the phase where old movies are deleted. Because the library is as big as it is I'm only scraping all movies once. The scrapes after that first scrape only scrapes the movies found on the "recent movies" page. I fixed this by setting the HoursThreshold really high but it would be better if I just could turn it off.
2) Problems seem to occur when the database gets to big.
Hulu via Bluecop Plugin Requires Source Type? - pkscuot - 2011-08-06 17:24
Now that Bluecop's Hulu plugin is working again, I've switched back over to using to as my Hulu source rather than PlayOn. To make my configuration simpler, I have XBMC.MyLibrary look at my Hulu Queue to figure out what to add to my library. My queue has both movies and TV Shows in it.
Given that, here's the config I'm trying use:
Set that way I get the following error:
If I add type="episodes" to the config, it works fine, except that it can't add the movies anymore. This same config worked when I was using PlayOn, so I'm wondering if there is anything I can do to have my Hulu queue parsed for both movies and episodes again.
- matmabro - 2011-08-08 02:16
So how'd you get icefilms working? I was looking at the code and it looks like it would be pretty easy to uncomplie edit and recompile to get icefilms back, but I don't want to hammer their servers and piss anyone off especially considering the recent downtime they've had over the weekend.
I've just started playing with this 2 nights ago and I'm currently stuck with mpg files, but all the popular hulu shows are in my library... I think I should be able to fix by moving my dropbox folder, but I haven't tried that yet.
This is a great little script you wrote. looking forawrd to you releasing it to the community. From what I can tell, it doesn't seem like it should be too hard to turn this into an add-on, I mean mostly you are just editing the XML document then launching the script.
- bradvido88 - 2011-08-08 15:32
Sorry I've been MIA for a couple weeks. I'll try to address most of the issues here:
pkscuot Wrote:it's worth understanding the process this script uses to get things working, it helps with issues like this. Here goes my try.Yes, that's pretty good overview of what this script does. XBMC doesn't allow scraping of .strm files (TV Episodes are allowed, strangely), so that's why they need to be .mpg's first. It it a bit Rube Goldberg, but usually works.
Batch Wrote:I figured out a solution for IceFilms to have their movies in the database without hammering their servers. I did some script modifications and keep the link to the page containing the links to the different mirrors instead of the mirrors themselves.This looks great. I don't care if you hacked the code; it's the IceFilms community that gets crabby. Hopefully you can help in getting this working for all of us as well. I'm probably just going to release this on SVN, since that's what it's currently using. I've been toying with the idea of converting it to GIT, but don't have the time. Check back on this thread for more info soon (hopefully).
1) - For now, a really high hours threshold will have to be the work-around. Maybe you can add an option when the code is avail.
2) - This tends to happen when there is a slow network. It defaults to reading the JSON on a raw TCP connection (because it's fast), but there isn't an easy way to tell when the data stream has ended, so it uses a timeout of X milliseconds. If there are network issues, this timeout can be hit when the data-stream hasn't ended. Your options are to use a wired network if you aren't already or configure it to use the slower curl option.
pkscuot Wrote:Now that Bluecop's Hulu plugin is working again, I've switched back over to using to as my Hulu source rather than PlayOn. To make my configuration simpler, I have XBMC.MyLibrary look at my Hulu Queue to figure out what to add to my library. My queue has both movies and TV Shows in it.How did you get BlueCop's Hulu to work... did you have to do anything special? It's still not working for me.
The issue you are running into is that the PlayOn custom parsing I wrote is better than the parsing for BlueCop's plugin... This can be fixed, but will take time and effort. Hopefully this can be crowd-sourced when I post the public SVN.
matmabro Wrote:@BatchThere should be no need to decompile once i release it, but there will be a need for some unlucky soul to clean up the code, since is wrote it in a furious few nights
- bradvido88 - 2011-08-08 16:35
OK, show me what you guys can do: http://code.google.com/p/xbmc-mylibrary/
- pkscuot - 2011-08-08 23:19
bradvido88 Wrote:How did you get BlueCop's Hulu to work... did you have to do anything special? It's still not working for me.
I figured there was different parsing. I'll either wait for someone to help add parsing or I'll just do the hack I came up with and add the Queue directory twice (once with each type). It creates lots of files I don't really want or need, but none of them get parsed into XBMC anyway.
Bluecop's Hulu plugin requires the most up-to-date librtmp. If you check the hulu plugin thread there is a post somewhere on where to get the current version. The one that was just released adds support for whatever magic flash thing Hulu was using. It's really nice to have it back, as the stream quality (even the 480p one) is much better than what I got through PlayOn.
- Batch - 2011-08-09 01:36
bradvido88 Wrote:OK, show me what you guys can do: http://code.google.com/p/xbmc-mylibrary/Great, will look at this tomorrow.
If I get my Icefilms modification to work better then I will share it. At the moment new movies added get recognized but not renamed. Having access to your code will probably help me solve it.
- Batch - 2011-08-09 01:42
matmabro Wrote:@BatchNow when the source code is released I see no harm in telling how I did it.
I didn't need to decompile the jar-file. I just opened it up in a text editor and replaced all occurances of "Icefilms" to "Acefilms".
If you are unsure whatever or not you are hammering their servers then you should probably avoid experimenting with Icefilms since it will get you banned.