mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings

outleradam · 2010-02-07 07:39

I'm working on a configuration script. This script would basically take care of all the user settings from a GUI. This will address many configuration issues

[Image: Screenshot-4.png]

barney_1 · 2010-02-09 03:19

That's awesome. Will the configuration data be stored separately from the main script? I'd love to do upgrades without having to reconfigure.

outleradam · 2010-02-09 03:26

Currently no, but I am working on defaults so that it will first check a file, then use it's own pre-programmed data. It will of course allow the user to select if they want to use a different value. Defaults/preprogrammed will show up in the menus though

outleradam · 2010-02-09 05:59

Added a few features on request tonight

First, SYMLINK=Disabled means move the file and delete the database entries along with associated picture files. Thanks to barney_1

Seccond, custom user jobs can be run on a completed or failed job.
Completed means the file was moved/symlinked.Failed jobs means generic guide data , the tvdb was down, the show was not recognized, or permission errors.

Here is a list of some of the variables which can be used in mythicalLibrarian SucessfulJob or FailedJob as set in the user settings

$ShowName = input show name
$NewShowName = sucessfully resolved show name
$exx = Episode Number or "Movie" in case of a movie
$sxx = Season number or blank in case of movie
$epn = Subtitle
$ChanID = ChannelID
$ProgramID= Zap2it listing
$plot = plot
$stars = stars
$ShowStartTime = begin recording time
$ShowCategory = category like children or sports
$OriginalAirDate = original air date
$XMLTVGrabber = your guide data type
$MovieAirDate = the original year the movie aired
$mythicalLibrarianProgramIDCheck = SH MV or EP
$ProgramIDType= Generic episode with no data, Movie, or Series With Episode Data
$Zap2itSeriesID= Zap2it ID with SH, MV or EP stripped
$seriesid = TheTVDB series ID
$TvDbTime = current tvdb time
$LastUpdated = last updated time (for Episodes only others wil be blank)
$absolouteEpisodeNumber = tvdb order (for Episodes only)
$ShowFileName = name of the file (if sucessful)
$originalext = file's "EXT"ension
$originaldirname = dirname of the file to be moved
$FileBaseName = name of the file to be moved without ext
$MyUserName = name of user running mythicalLibrarian

stratoscape · 2010-04-29 17:26

Tried to follow this thread to its beginnings but got bored trying. I'm thinking all the hoopla is still about recognition which really is not that big of a deal to me so far, sure it would be really cool to one day see "reality" show get properly classified such as "Survivor", or "Who do you think you are" but at the end of the day I am usually just happy that MythicalLibrarian transcoded it at all anyways.

I have been puzzled as to why the tvdb.com always gets it right but mythical still dumps it to unclassified show or something.

whatever, I still am using and digging this with no plans to upgrade from April 4th SVN unknown (cant remember)

regards

Nod

Strato

outleradam · 2010-04-29 19:26

You may want to try to upgrade to the newest version. There's constant development on mythicalLibrarian and the latest version will always add more features and have better recognition. Occasionally things break, but the easy updater makes it eaiser to update to the latest stable version. I constantly run the latest svn on my media center. I verify operations by running the latest svn and stable on my Ubuntu desktop. The update process takes less then a minute and all of your settings get upgraded as well. Please upgrade if you are having any problems. I am not able to identify anything wrong right now.

Also, problem reports should be filed in the mythicalLibrarian thread dedicated to problem reports http://forum.xbmc.org/showthread.php?tid=65644&page=35 Please take the time to send the output.log entry for the offending file. I may be able to come up with a update or work-around if it has not been addressed yet. The mythicalLibrarian database system has been upgraded to the point where if there is a problem with show identifiaction, it's because the tvdb.com has the wrong information.

srandrews · 2010-08-23 10:38

Firstly, let me say this is a fantastic tool and has saved me hours of time trying to sort out my myth library.

I've got a couple of features that I thinnk would be great additions:

1. When searching thetvdb.com, can you search for word variants? ie, I have several episodes where the subtitle contains the word 'and', but the corresponding thetvdb.com entry uses '&' in the subtitle this means the episode isn't found and is put into showings, ie:

Myth TV subtitle: Frogs and Worms and Butterflies
theTVDB.com subtitle: Frogs & Worms & Butterflies

2. Is it possible to balance the files across the two primary and alternative folders? I've managed to fill my NAS whilst my secondary drive is empty. As a quick fix for me, can I simply swap the two folders over in the configuration so that my primary folder becomes the alternative folder and vice versa? (I want to clear the NAS down as it's used by other PCs at home)

Thanks

Simon

outleradam · 2010-08-23 16:52

There are several ways to correct differences in guide data versus TVDB data.
1. If the guide is correct and theTvDb is incorrect, then you can correct the data in theTvDb, or ask for a title change on theTvDb.com forums
2. If the TvDb is correct and the Guide Data is incorrect, then you can contact your guide data provider (schedulesDirect or zap2it), or you can contact your cable company to get the change made.
3. As a workaround, mythicalLibrarian supports "showtranslations" If there is a problem with a show title difference between theTvDb and your guide data, create a file called ~/.mythicalLibrarian/showtranslations

Code:

##############################################################

 #My Guide Show Title = www.TheTvDb.com Show Title            #

 #Battlestar Gallactica = Battlestar Gallactica (2003)        #

 #The Office = The Office (US)                                # 

 #Millionaire = Who Wants To Be A Millionaire                 #

 #Aqua teen Hungerforce = Aqua Teen Hunger Force              #

 ##############################################################

remove the #'s

For the balancing issue, mythTV supports evening out the shows. mythicalLibrarian supports usage of original directory. In mythicalSetup choose "Would you like to use your original recordings folder or would you like to choose your own folder to place recordings? -- Use Original" Let mythTV place the files into the folder which it chooses. mythicalLibrarian in "use original directory" mode will place a Episodes/ Showings/ and Movies/ folder wherever mythtv places it's files.

Let me know if there are any problems.

srandrews · 2010-08-23 17:22

outleradam Wrote:For the balancing issue, mythTV supports evening out the shows. mythicalLibrarian supports usage of original directory. In mythicalSetup choose "Would you like to use your original recordings folder or would you like to choose your own folder to place recordings? -- Use Original" Let mythTV place the files into the folder which it chooses. mythicalLibrarian in "use original directory" mode will place a Episodes/ Showings/ and Movies/ folder wherever mythtv places it's files.

Thanks for the quick response! I should investigate the options first, this is exactly what I want! As I've moved all the data out of the myth folders, is it better for me to do a --undo and start from scratch?

As for the titles being wrong, I'll look into which source is wrong and take it from there.

Cheers

Simon

outleradam · 2010-08-23 17:22

I am wondering if there is interest in a GUI for mythicalLibrarian.

The GUI would allow easy setup of the features of mythicalLibrarian. Currently the options are setable in text form. They are well documented, but there are still problems which may be able to be resolved with a GUI.

Here are the options which possibly could be resolved:

User settings:

Code:

#######################USER SETTINGS##########################

 ###Stand-alone mode values###

 #SYMLINK has 3 modes.  MOVE|LINK|Disabled: Default=MOVE

 #Create symlink in original dir from file after 'MOVE' | Do not move, just create a sym'LINK' | move the file, symlinking is 'Disabled'

 SYMLINK=MOVE

 #MoveDir is the folder which mythicalLibrarian will move the file.  No trailing / is accepted eg. "~/videos"

 MoveDir="/home/mythtv/Episodes"  #<------THIS VALUE MUST BE SET-------

 #AlternateMoveDir will act as a seccondary MoveDir if the primary MoveDir fails.  No trailing / is accepted eg. "~/videos"

 AlternateMoveDir=/home/mythtv/Episodes

 #If UseOriginalDir is Enabled, original dir will override MoveDir.  Useful for multiple recording dirs.

 #UseOriginalDir will separate generic shows from episodes and movies. Enabled|Disabled

 UseOriginalDir=Enabled

 #When Enabled, mythicalLibrarian will move the file to a folder of the same name as the show. This is not affected by UseOriginalDir. Enabled|Disabled

 UseShowNameAsDir=Enabled

 #Internet access Timeout in seconds: Default Timeout=50 (seconds)

 Timeout=50

 #Update database time in secconds, Longer duration means faster processing time and less strain on TheTvDb. Default='84000' (1 day)

 UpdateDatabase=1

 #mythicalLibrarian working file dir: Default=~/mythicalLibrarian (home/username/mythicalLibraian)

 mythicalLibrarian=~/.mythicalLibrarian

 #FailSafe mode will enable symlinks to be formed in FailSafeDir if the move or symlink operation fails. Enabled|Disabled

 FailSafeMode=Enabled

 #FailSafeDir is used when the file cannot be moved to the MoveDir. FailSafe will not create folders. eg. /home/username

 FailSafeDir="/home/mythtv/FailSafe"  #<------THIS VALUE MUST BE SET-------

 #DirTracking will check for and remove the folders created by mythicalLibrarian

 DirTracking=Enabled

 #the following line contains the API key from www.TheTvDb.Com. Default project code: 6DF511BB2A64E0E9

 APIkey=0F3A338F0FCB29A2

 #Language setting

 Language=en

 ###Database settings### 

 #MythTV MYSQL access allows addition of movies, comskip data, and improves accuracy of episode recognition.

 #Database access Enabled|Disabled

 Database=Enabled

 #Database Type Default=MythTV

 DatabaseType=MythTV

 #Guide data type: SchedulesDirect currently covers DataDirect, MC2XML and others.  NoLookup will bypass tvdb scanning

 #Options: SchedulesDirect|NoLookup

 GuideDataType=SchedulesDirect

 #MySQL User name: Default="mythtv"

 MySQLuser="mythtv" 

 #MySQL Password: Default="mythtv"

 MySQLpass="mythtv" #<------THIS VALUE MUST BE SET-------

 #MySQL Myth Database: Default="mythconverg"

 MySQLMythDb=mythconverg

 #Primary Movie Dir. mythicalLibrarian will attempt to move to this dir first. No trailing / is accepted eg. "~/videos"

 PrimaryMovieDir="/home/mythtv/Movies" #<------THIS VALUE MUST BE SET-------

 #AlternateMoveDir will act as a Seccondary move dir if the primary moive dir fails

 AlternateMovieDir="/home/mythtv/Movies"

 #ShowStopper = Enabled prevents generic shows and unrecognized episodes from being processed

 ShowStopper="Enabled"

 #Primary Show Dir. mythicalLibrarian will attempt to move to this dir first. No trailing / is accepted eg. "~/videos"

 PrimaryShowDir="/home/mythtv/Showings" #<------THIS VALUE MUST BE SET-------

 #AlternateMoveDir will act as a Seccondary move dir if the primary moive dir fails

 AlternateShowDir="/home/mythtv/Showings" 

 #CommercialMarkup will generate comskip files for recordings when they are moved. Enabled|Disabled

 CommercialMarkup=Enabled

 #CommercialMarkupCleanup will execute a maintenance routine which will remove comskip files if they are not needed

 CommercialMarkupCleanup=Enabled

 ###Reporting/Communications###

 #Enables debug mode.  This is a verbose mode of logging which should be used for troubleshooting.  Enabled|Disabled

 DEBUGMODE=Enabled

 #DailyReport provides a local log of shows added to your library per day. Enabled|Disabled

 DailyReport=Enabled

 #Notify tells mythicalLibrarian to send a notification to GNOME Desktop upon completion. Enabled|Disabled

 Notify=Enabled

 #If notifications are enabled, NotifyUserName should be the same as the user logged into the GNOME Session. (your username)

 NotifyUserName="MYUSERNAME" #<------THIS VALUE MUST BE SET-------

 #Send a notification to XBMC to Update library upon Successful move job Enabled|Disabled

 XBMCUpdate=Enabled

 #Send a notification to XBMC to cleanup the library upon Successful move job Enabled|Disabled

 XBMCClean=Enabled

 #Send Notifications to XBMC UI when library is updated Enabled|Disabled

 XBMCNotify=Enabled

 #Ip Address and port for XBMC Notifications Eg.XBMCIPs=( "192.168.1.110:8080" "192.168.1.111:8080" "XBOX:8080" )

 XBMCIPs=( "192.168.1.110:8080" "XBOX:8080" ) #<------THIS VALUE MUST BE SET-------

 #maxItems controls the number of items in the RSS. RSS Can be activated by creating a folder in /var/www/mythical-rss.  

 maxItems=8

categoric ignore:

Code:

If you wish to ignore all shows with a speciffic category, use

categoricIgnore

categoricIgnore can be applied by creating a file called:

  ~.mythicalLibrarian/categoricIgnore

##############################################################

#Category to ignore                                          #

#Sports                                                      #

#Sports Talk                                                 #

#College Sports                                              #

#Comedy                                                      #

##############################################################

Title Ignore

Code:

======titleIgnore======

If wish to ignore all shows with a speciffic title, use titleIgnore

titleIgnore can be applied by creating a file called:

~.mythicalLibrarian/titleIgnore

##############################################################

#Show to ignore                                              #

#Battlestar Gallactica                                       #

#The Office                                                  #

#Millionaire                                                 #

#Aqua teen Hungerforce                                       #

##############################################################

ShowTranslations:

Code:

======showTranslations=====

If you are having problems with incorrect guide data such

as improper titling, use showTranslations.

ShowTranslations can be applied by creating a file called:

~/.mythicalLibrarian/showTranslations

##############################################################

#My Guide Show Title = www.TheTvDb.com Show Title            #

#Battlestar Gallactica = Battlestar Gallactica (2003)        #

#The Office = The Office (US)                                # 

#Millionaire = Who Wants To Be A Millionaire                 #

#Aqua teen Hungerforce = Aqua Teen Hunger Force              #

##############################################################

So, let me know what you think. Is this something which should be put into a GUI which would allow the user to see the options, or does mythicalSetup work good enough for mythicalLibrarian?

barney_1 Junior Member Posts: 37 Joined: Mar 2008 Reputation: 2	2010-02-09 03:19 Post: #42 That's awesome. Will the configuration data be stored separately from the main script? I'd love to do upgrades without having to reconfigure.
	find