+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for XBMC (/forumdisplay.php?fid=116)
+--- Thread: mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings (/showthread.php?tid=65644)
update to latest version == error - thingsforjason - 2010-09-28 07:46
Code:
/usr/local/bin/mythicalLibrarian: line 599: syntax error near unexpected token `fi'
/usr/local/bin/mythicalLibrarian: line 599: ` fi'Using the mythicalLibrarian --update command. All the previous updates in this manner have worked like a charm.
Will I need to reinstall from scratch, or can I modify the script to recover when/if a patch is committed?
Thanks for all your hard work on this!
- outleradam - 2010-09-28 14:25
Sorry, SVN is sorta screwy right now. I will commit a fix tonight. Barney_1 and I are working on the MythTV python bindings.To run mythicalSetup and update to stable type:
Code:
cd ~/.mythicalLibrarian/mythicalSetup
sudo ./mythicalSetup.sh- thingsforjason - 2010-09-28 18:01
outleradam Wrote:Sorry, SVN is sorta screwy right now. I will commit a fix tonight. Barney_1 and I are working on the MythTV python bindings.To run mythicalSetup and update to stable type:mythicalLibrarian --update is just the quick way of downloading and running mythicalSetup.Code:
cd ~/.mythicalLibrarian/mythicalSetup
sudo ./mythicalSetup.sh
Sweet. Looks like I'm back on track. Thanks again!
- ubuntite - 2010-09-28 22:42
Firstly, I would like to take my hat off to you for the excellent work you have done so far. This project has completely streamlined my MythTV/XBMC experience. That said, I am having a few problems...
1. I am ending up with about half of my shows in the 'Showings' directory. Is this normal? They are show such as 'Late Night With Jimmy Fallon', 'The Amazing Race 17', 'Ultimate Engineering', 'Larry King Live', 'The Colbert Report' and others. What determines whether a show ends up in 'Episodes' and when it ends up in 'Showings'? I have had some tv shows where some of its episodes have ended up in 'Episodes' and some in 'Showings', such as 'Late Night With Jimmy Fallon'.
2. Speaking of 'Jimmy Fallon', I have a couple of episodes that have ended up in 'Episodes', with a season number and episode number, but they did not get added to the library after an update. They look correctly named, but do not get added.
3. I have about eight XBMC installs in my home! Laptops, desktops, Revo and a bunch of XBOXes. I would like to automatically update all of their libraries, but I am having problems. I was able to send notifications to one of my XBMC instances, and then send the Update Library command successfully with a single XBMC IP address in /usr/local/bin/mythicalLibrarian. But when I added a bunch of XBMC IP addresses to /usr/local/bin/mythicalLibrarian, I only get the notification, but not the Update happening.
4. Lastly, if I wanted to completely start over, what do I need to delete? In other words, it would be nice to see a complete listing of all the files that get installed so that one could remove them for a complete uninstall. There seems to be files in /home/USER/.mythicalLibrarian as well as files in /home/mythtv/.mythicalLibrarian. Are the files in /home/USER/.mythicalLibrarian used? I run mythicalLibrarian as a user job from within MythTV, so I assume the version of mythicalLibrarian in /home/mythtv is the one that gets used. If so, do I need to keep the one in /home/USER? What is it for?
Keep up the great work!
- outleradam - 2010-09-29 00:13
ubuntite Wrote:Firstly, I would like to take my hat off to you for the excellent work you have done so far. This project has completely streamlined my MythTV/XBMC experience. That said, I am having a few problems...Thank you. I will try to help resolve the issues
Quote:1. I am ending up with about half of my shows in the 'Showings' directory. Is this normal? They are show such as 'Late Night With Jimmy Fallon', 'The Amazing Race 17', 'Ultimate Engineering', 'Larry King Live', 'The Colbert Report' and others. What determines whether a show ends up in 'Episodes' and when it ends up in 'Showings'? I have had some tv shows where some of its episodes have ended up in 'Episodes' and some in 'Showings', such as 'Late Night With Jimmy Fallon'.When information cannot be obtained from TheTvDb, or if the episode has no identifiable information (no subtitle, or original airdate), it is a showing. mythicalLibrarian makes decisions based on available information. The show ID for generic programming, that which cannot be classified as an episode in any way, comes marked with a showID of SH*****.
If mythicalLibrarian determines that there is suitable information, but it cannot pull the episode or season from TheTvDb, it will mark it as what I call an "epi-show". Epi-shows get put into the --doover que. You can have mythicalLibrarian rerun the doover que by typing mythicalLibrarian --doover. Generic programming is already categorized as best as it can be and will not be rerun
Quote:2. Speaking of 'Jimmy Fallon', I have a couple of episodes that have ended up in 'Episodes', with a season number and episode number, but they did not get added to the library after an update. They look correctly named, but do not get added.Please post the name and path of the episode. I can try to recreate the problem on my end.
Quote:3. I have about eight XBMC installs in my home! Laptops, desktops, Revo and a bunch of XBOXes. I would like to automatically update all of their libraries, but I am having problems. I was able to send notifications to one of my XBMC instances, and then send the Update Library command successfully with a single XBMC IP address in /usr/local/bin/mythicalLibrarian. But when I added a bunch of XBMC IP addresses to /usr/local/bin/mythicalLibrarian, I only get the notification, but not the Update happening.You need to have the source set up on each XBMC installation. If XBMC is receiving communications messages, but there are no library updates, then there is a problem with the source. mythicalLibrarian sends two messages, one says "display a message" the other says "update your sources".
Quote:4. Lastly, if I wanted to completely start over, what do I need to delete? In other words, it would be nice to see a complete listing of all the files that get installed so that one could remove them for a complete uninstall. There seems to be files in /home/USER/.mythicalLibrarian as well as files in /home/mythtv/.mythicalLibrarian. Are the files in /home/USER/.mythicalLibrarian used? I run mythicalLibrarian as a user job from within MythTV, so I assume the version of mythicalLibrarian in /home/mythtv is the one that gets used. If so, do I need to keep the one in /home/USER? What is it for?if you wanted to completely remove mythicalLibrarian, you simply run mythicalLibrarian --undo (reverts all changes), delete the user job from mythtv, delete the ~/.mythicalLibrarian folder, and finally delete the file from /usr/local/bin.
The ~/.mythicalLibrarian folder contains mythicalLibrarian's working files. It is the storage space for mythicalLibrarian's lookup files, the --doover que, --undo que, created folder tracking, and the comskip/NFO file tracking. It is also home to the DailyReport(a log of all files generated) and the output.log file(a detailed account of what happened during processing of each file). You can see what shows were processed each day by looking at the Daily Report folder. If you want to find out more about the episode, you can look at the output.log file. I wouldn't recommend changing anything in the folder, but it is good information.
Quote:Keep up the great work!Thanks, I'm trying. Hopefully we can get everything squared away in time for mythtv .25
- ubuntite - 2010-09-29 01:40
Quote:If mythicalLibrarian determines that there is suitable information, but it cannot pull the episode or season from TheTvDb, it will mark it as what I call an "epi-show". Epi-shows get put into the --doover que. You can have mythicalLibrarian rerun the doover que by typing mythicalLibrarian --doover.
So, the idea behind the doover is that if TheTVdb gets better information about the episode, mythicalLibrarian will rename the epi-show accordingly, reclassify it as an episode, and move it to the 'Episode' folder? If so, that is very cool. Would it be possible to have the doover run every time mythicalLibrarian runs? It would seem that it wouldn't add too much overhead, and the benefits would be better named files and a better library!
Quote:Please post the name and path of the episode. I can try to recreate the problem on my end.
Late Night with Jimmy Fallon/Season 2/Late Night with Jimmy Fallon S02E316 (Amy Poehler).mpg
and
Late Night with Jimmy Fallon/Season 2/Late Night with Jimmy Fallon S02E317 (John Legend).mpg
Quote:You need to have the source set up on each XBMC installation. If XBMC is receiving communications messages, but there are no library updates, then there is a problem with the source. mythicalLibrarian sends two messages, one says "display a message" the other says "update your sources".
Sure, I understand this. Here is what I did. I had a single XBMC IP Address in mythicalLibrarian and the "display a message" and "update sources" worked fine on the XBMC installation. I then added additional XBMC IP Addresses to mythicalLibrarian, and the result is that the original XBMC Installation gets the "display a message", but does not get its library updated. If I update the Library manually, it works just fine. Maybe I have the syntax wrong for multiple IP Addresses. I followed what looked to be the correct format:
XBMCIPs=( '1stIPaddress:Port' '2ndIPaddress:Port' '3rdIPaddress:Port' )
Is this correct?
Quote:The ~/.mythicalLibrarian folder contains mythicalLibrarian's working files. It is the storage space for mythicalLibrarian's lookup files, the --doover que, --undo que, created folder tracking, and the comskip/NFO file tracking. It is also home to the DailyReport(a log of all files generated) and the output.log file(a detailed account of what happened during processing of each file). You can see what shows were processed each day by looking at the Daily Report folder. If you want to find out more about the episode, you can look at the output.log file. I wouldn't recommend changing anything in the folder, but it is good information.
So based on this information, since I am using a MythTV user job, should I only run mythicalLibrarian from the command line as the mythtv user? In other words, if I want to run mythicalLibrariabn --doover or mythicalLibrarian --update, should I only do so as the mythtv user?
- outleradam - 2010-09-29 02:25
ubuntite Wrote:So, the idea behind the doover is that if TheTVdb gets better information about the episode, mythicalLibrarian will rename the epi-show accordingly, reclassify it as an episode, and move it to the 'Episode' folder? If so, that is very cool.Yep. It's very cool!
Code:
Would it be possible to have the doover run every time mythicalLibrarian runs?Quote:Late Night with Jimmy Fallon/Season 2/Late Night with Jimmy Fallon S02E316 (Amy Poehler).mpgIt's not working here either. Maybe you should ask in a new thread in the general help area about this. Possibly XBMC cannot handle "Episode 317"... I don't understand this error.
and
Late Night with Jimmy Fallon/Season 2/Late Night with Jimmy Fallon S02E317 (John Legend).mpg
Quote:XBMCIPs=( '1stIPaddress:Port' '2ndIPaddress:Port' '3rdIPaddress:Port' )Yes. That's correct. Try a manual update. When running scan mode, mythicalLibrarian sends out sequential library update requests. For some reason the first one starts the update and the 2nd one stops it. It is a XBMC issue, but it should be fine after it gets onto a normal schedule of 1 recording at a time.
Is this correct?
Quote:So based on this information, since I am using a MythTV user job, should I only run mythicalLibrarian from the command line as the mythtv user? In other words, if I want to run mythicalLibrariabn --doover or mythicalLibrarian --update, should I only do so as the mythtv user?Yes. Always run as mythtv. This also ensures permissions are correct. If you run as root, then any files created can only be accessed by root. I think i've put a few preventive measures in place to ensure that user mythtv is used.
- ubuntite - 2010-09-29 22:09
Quote:The overhead and absence of the file have stopped me from doing this. mythicalLibrarian basically reverts the file to it's original form and then runs it as new. Some people have a NAS setup where the file gets recorded locally and then gets transferred across the NAS. This can take up to 10 minutes each way. If every 1/2 hour the file is rerun, it takes 10 minutes one way and 10 minutes the other way. Then, on top of that, each file will be redone, so it might be that every 1/2 hour, 10 hours of work are added to the que.Code:
Would it be possible to have the doover run every time mythicalLibrarian runs?
I, too, copy my recordings to a NAS drive. Would it be possible to rethink the --doover process? Could you process the doover files in place (in my case on the NAS), and thus making it feasible to run --doover every time mythicalLibrarian runs?
Quote:Yes. That's correct. Try a manual update. When running scan mode, mythicalLibrarian sends out sequential library update requests. For some reason the first one starts the update and the 2nd one stops it. It is a XBMC issue, but it should be fine after it gets onto a normal schedule of 1 recording at a time.
A manual update always works, but I would like it to be automatic. I don't quite follow what you are saying above. Are you saying that if two files are being processed at the same time, (i.e. two MythTV recordings finish at the same time), that the automatic update library will fail?
- outleradam - 2010-09-30 14:46
^^ For the doover process I made a change last night in the SVN for you. --unmanned_doover provides a way to set up an "at" or "cron" job to perform the doover at a regular interval.
It should go something like this:
Code:
sudo -u mythtv sudo mythicalLibrarian --unmanned_dooverAnother option could be to include an option where if it has been 24 hours (according to TheTvDb). I'm still working out the kinks on this because it requires sudo access. I may be able to come up with something more perminant within the week. I'd say 12-24 hours would be an appropriate timeframe to run the --doover que. It can put a large strain on a server.
Also, yes, if 2 update commands are run at the same time then one will start the update process and the seccond will stop it. Take a moment to post in this thread that you are experienceing this issue http://forum.xbmc.org/showthread.php?tid=82133
- outleradam - 2010-10-01 01:20
Please do not use the SVN right now. It is bork beyond belief. Several variable names are in transition. the following user-job variable names will be changed
originalext = OriginalExt
exx = Exx
sxx = Sxx
absoluteepisodenumber=AbsoluteEpisodeNumber
seriesid=SeriesID
stars=Stars
Also, currently being changed is --doover and --undo will now be interruptable. They will simply be restored the next time mythicalLibrarian is run and will be able to be rerun as if nothing happened.
Again, all of these changes have made the SVN VERY unstable. Add that to the upcomming python bindings, and there's a world of problems to deal with. Please use stable.