Kodi Community Forum
mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for Kodi (https://forum.kodi.tv/forumdisplay.php?fid=116)
+--- Thread: mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings (/showthread.php?tid=65644)



- outleradam - 2011-01-10

For now, tell mythicalSetup that you are running 0.23.


- colbert - 2011-01-10

outleradam Wrote:I will try to come up with a python 3 solution.

That would be greatly appreciated if possible!! Cool

outleradam Wrote:For now, tell mythicalSetup that you are running 0.23.

Okay, ran --update again and chose .23:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

--You have entered diagnostic mode
mythicalLibrarian will now conduct a series of tests.
press any key to verify installed packages...

package 'curl' is installed
package 'agrep' or 'tre-agrep' is installed
package 'libnotify-bin' is installed
Installed packages check ***PASSED***
Press any key to perform Desktop Message test...

Performing librarian-notify-send test
This test verifies that the message was sent to the DBUS.
This test does not verify the user has a valid desktop open.
Desktop Notifications test ***PASSED***
Press any key to perform MythTV Database test...

Performing MythTV Python Bindings database test
  File "/usr/local/bin/MythDataGrabber", line 19
    """ % os.path.basename(sys.argv[0])
      ^
SyntaxError: invalid syntax
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named MythDB.MythTV
/usr/local/bin/mythicalLibrarian: line 1778: test: too many arguments
  File "/usr/local/bin/MythDataGrabber", line 19
    """ % os.path.basename(sys.argv[0])
      ^
SyntaxError: invalid syntax
there was a problem connecting to the database, check MythDatabase package
MythTV Database Test ***FAILED***
Press any key to perform XBMC Notification test...

Performing XBMC Notifications test
SENDING REQUESTED COMMANDS TO:192.168.1.101:8080
COMMUNICATIONS NOT ESTABLISHED: 192.168.1.101:8080
XBMC Communications ***FAILED***
Press any key to test file system permissions...

Testing file system permissions
TargetPathIsInputPath is selected. Testing with current folder
USER SETTING     |FLAG|Folder name
MoveDir          |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
AlternateMoveDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
PrimaryMovieDir  |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
AlternateMovieDir|1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
PrimaryShowDir   |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
AlternateShowDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
mythicalLibrarian|1   |/home/bobby2/.mythicalLibrarian
Critical Filesystem checks ***PASSED***
OVERALL FAILURE
press any key to continue on to the final results...

  All tests complete           RESULTS
  MythTV Database Test:      ***FAILED***
  Installed Packages:        ***FAILED***
  Notifications Test:        ***PASSED***
  XBMC Communications:       ***FAILED***
  File System Checks:        ***PASSED***
  mythicalTesting:           COULD NOT COMPLETE
  Overall mythicalReadiness: ***FAILURE***
-----End of diagnostics-----
When interfacing MythTV/0.24, mythicalLibrarian uses MythTV's Python
Bindings.  These must be configured and working for proper access
to data required by mythicalLibrarian.  
Could not connect to the database.  Specify a username and password
XBMC Communications have failed.  Likely causes: Improper IP address,
or XBMC is not equipped to handle external network commands in settings.
mythicalLibrarian will not send messages or library update requests.
mythicalLibrarian has encountered an error.  This may be due to
lack of network connection.   If the problem persists, contact
outleradam here: http://forum.xbmc.org/showthread.php?tid=65644

These issues must be corrected in order for mythicalLibrarian to
perform correctly
chgrp: invalid group: `mythtv'
Please try again.  If problem persists, please post here: http://forum.xbmc.org/showthread.php?tid=65644
ADDING JOB to slot 0
Could not add mythcialLibrarian MythTV UserJob because no slots were available
permissions were set for user: mythtv.
No RSS Feeds will be used on this server. Configure /var/www/mythical-rss to link to web server for access by mythicalLibrarian.
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.



- outleradam - 2011-01-11

I keep looking for the problem. Can you try setup once again?


- colbert - 2011-01-11

Sure thing, but in case I'm doing some stupid little mistakes, here is what I'm putting at each prompt during the setup:

1. mysql username

Code:
mythtv

2. mysql password

Code:
mythtv

3. DB Host IP

Code:
192.168.1.100

4. mysql password

Code:
actual-mysql-root-password

5. XBMC IP:

Code:
'192.168.1.101:8080'

(.100 again being the myth box, and .101 being the XBMC box.)

Output doing --update and using .24:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

--You have entered diagnostic mode
mythicalLibrarian will now conduct a series of tests.
press any key to verify installed packages...

package 'curl' is installed
package 'agrep' or 'tre-agrep' is installed
package 'libnotify-bin' is installed
Installed packages check ***PASSED***
Press any key to perform Desktop Message test...

Performing librarian-notify-send test
This test verifies that the message was sent to the DBUS.
This test does not verify the user has a valid desktop open.
Desktop Notifications test ***PASSED***
Press any key to perform MythTV Database test...

Performing MythTV Python Bindings database test
  File "/usr/local/bin/MythDataGrabber", line 19
    """ % os.path.basename(sys.argv[0])
      ^
SyntaxError: invalid syntax
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named MythDB.MythTV
/usr/local/bin/mythicalLibrarian: line 1778: test: too many arguments
  File "/usr/local/bin/MythDataGrabber", line 19
    """ % os.path.basename(sys.argv[0])
      ^
SyntaxError: invalid syntax
there was a problem connecting to the database, check MythDatabase package
MythTV Database Test ***FAILED***
Press any key to perform XBMC Notification test...

Performing XBMC Notifications test
SENDING REQUESTED COMMANDS TO:192.168.1.101:8080
COMMUNICATIONS NOT ESTABLISHED: 192.168.1.101:8080
XBMC Communications ***FAILED***
Press any key to test file system permissions...

Testing file system permissions
TargetPathIsInputPath is selected. Testing with current folder
USER SETTING     |FLAG|Folder name
MoveDir          |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
AlternateMoveDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
PrimaryMovieDir  |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
AlternateMovieDir|1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
PrimaryShowDir   |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
AlternateShowDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
mythicalLibrarian|1   |/home/bobby2/.mythicalLibrarian
Critical Filesystem checks ***PASSED***
OVERALL FAILURE
press any key to continue on to the final results...

  All tests complete           RESULTS
  MythTV Database Test:      ***FAILED***
  Installed Packages:        ***FAILED***
  Notifications Test:        ***PASSED***
  XBMC Communications:       ***FAILED***
  File System Checks:        ***PASSED***
  mythicalTesting:           COULD NOT COMPLETE
  Overall mythicalReadiness: ***FAILURE***
-----End of diagnostics-----
When interfacing MythTV/0.24, mythicalLibrarian uses MythTV's Python
Bindings.  These must be configured and working for proper access
to data required by mythicalLibrarian.  
Could not connect to the database.  Specify a username and password
XBMC Communications have failed.  Likely causes: Improper IP address,
or XBMC is not equipped to handle external network commands in settings.
mythicalLibrarian will not send messages or library update requests.
mythicalLibrarian has encountered an error.  This may be due to
lack of network connection.   If the problem persists, contact
outleradam here: http://forum.xbmc.org/showthread.php?tid=65644

These issues must be corrected in order for mythicalLibrarian to
perform correctly
chgrp: invalid group: `mythtv'
Please try again.  If problem persists, please post here: http://forum.xbmc.org/showthread.php?tid=65644
ADDING JOB to slot 0
Could not add mythcialLibrarian MythTV UserJob because no slots were available
permissions were set for user: mythtv.
No RSS Feeds will be used on this server. Configure /var/www/mythical-rss to link to web server for access by mythicalLibrarian.
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.



- outleradam - 2011-01-12

Alright, I hit it from both ends of your problem.

1. mysql access would never work because the command was
Code:
if [ "$DatabaseType"="MythTVPythonBindings" ]; then
which basically said "if you can define $DatabaseType as MythTVPythonBindings, then". and it should have been
Code:
if [ "$DatabaseType" = "MythTVPythonBindings" ]; then
which now correctly states "If $Database type equals MythTVPythonBindings, then"

2. MythDataGrabber now specifies runtime environment of Python2.6. Hopefully this does not cause problems in the future. I'm not sure if all distros have a /usr/bin/python2.6 or not...

You should be good to go with 0.24. It's working on my 0.25 machine just fine.


- colbert - 2011-01-12

Damn my distro can be a pain in the butt, I am just a tad bit up as we have python2.7:

Code:
ââ> whereis python
python: /usr/bin/python2.7-config /usr/bin/python /usr/bin/python3.1 /usr/bin/python3.1-config /usr/bin/python2.7 /usr/lib/python3.1 /usr/lib/python2.7 /usr/include/python3.1 /usr/include/python2.7

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

--You have entered diagnostic mode
mythicalLibrarian will now conduct a series of tests.
press any key to verify installed packages...

package 'curl' is installed
package 'agrep' or 'tre-agrep' is installed
package 'libnotify-bin' is installed
Installed packages check ***PASSED***
Press any key to perform Desktop Message test...

Performing librarian-notify-send test
This test verifies that the message was sent to the DBUS.
This test does not verify the user has a valid desktop open.
Desktop Notifications test ***PASSED***
Press any key to perform MythTV Database test...

Performing MythTV Python Bindings database test
/usr/local/bin/mythicalLibrarian: /usr/local/bin/MythDataGrabber: /usr/bin/python2.6: bad interpreter: No such file or directory
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named MythDB.MythTV
/usr/local/bin/mythicalLibrarian: line 1778: test: too many arguments
/usr/local/bin/mythicalLibrarian: /usr/local/bin/MythDataGrabber: /usr/bin/python2.6: bad interpreter: No such file or directory
there was a problem connecting to the database, check MythDatabase package
MythTV Database Test ***FAILED***
Press any key to perform XBMC Notification test...

Performing XBMC Notifications test
SENDING REQUESTED COMMANDS TO:192.168.1.101:8080
COMMUNICATIONS NOT ESTABLISHED: 192.168.1.101:8080
XBMC Communications ***FAILED***
Press any key to test file system permissions...

Testing file system permissions
TargetPathIsInputPath is selected. Testing with current folder
USER SETTING     |FLAG|Folder name
MoveDir          |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
AlternateMoveDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
PrimaryMovieDir  |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
AlternateMovieDir|1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
PrimaryShowDir   |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
AlternateShowDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
mythicalLibrarian|1   |/home/bobby2/.mythicalLibrarian
Critical Filesystem checks ***PASSED***
OVERALL FAILURE
press any key to continue on to the final results...

  All tests complete           RESULTS
  MythTV Database Test:      ***FAILED***
  Installed Packages:        ***FAILED***
  Notifications Test:        ***PASSED***
  XBMC Communications:       ***FAILED***
  File System Checks:        ***PASSED***
  mythicalTesting:           COULD NOT COMPLETE
  Overall mythicalReadiness: ***FAILURE***
-----End of diagnostics-----
When interfacing MythTV/0.24, mythicalLibrarian uses MythTV's Python
Bindings.  These must be configured and working for proper access
to data required by mythicalLibrarian.  
Could not connect to the database.  Specify a username and password
XBMC Communications have failed.  Likely causes: Improper IP address,
or XBMC is not equipped to handle external network commands in settings.
mythicalLibrarian will not send messages or library update requests.
mythicalLibrarian has encountered an error.  This may be due to
lack of network connection.   If the problem persists, contact
outleradam here: http://forum.xbmc.org/showthread.php?tid=65644

These issues must be corrected in order for mythicalLibrarian to
perform correctly
chgrp: invalid group: `mythtv'
Please try again.  If problem persists, please post here: http://forum.xbmc.org/showthread.php?tid=65644
ADDING JOB to slot 0
Could not add mythcialLibrarian MythTV UserJob because no slots were available
permissions were set for user: mythtv.
No RSS Feeds will be used on this server. Configure /var/www/mythical-rss to link to web server for access by mythicalLibrarian.
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.

I can see it looking for python2.6, though I grep'd in the mythicalSetup dir but couldn't find any python2.x/2.6 reference to edit myself.


- outleradam - 2011-01-12

try pacman something something.... I've never used Arch.

Here's a thread where someone has the same problem. https://bbs.archlinux.org/viewtopic.php?id=109124


- colbert - 2011-01-12

Okay I installed that, I got python2.6 going and from the output it looks like it sees it just fine but there's other error:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

--You have entered diagnostic mode
mythicalLibrarian will now conduct a series of tests.
press any key to verify installed packages...

package 'curl' is installed
package 'agrep' or 'tre-agrep' is installed
package 'libnotify-bin' is installed
Installed packages check ***PASSED***
Press any key to perform Desktop Message test...

Performing librarian-notify-send test
This test verifies that the message was sent to the DBUS.
This test does not verify the user has a valid desktop open.
Desktop Notifications test ***PASSED***
Press any key to perform MythTV Database test...

Performing MythTV Python Bindings database test
/usr/bin/python2.6
Python2.6 installed
Establishing database connection
Traceback (most recent call last):
  File "/usr/local/bin/MythDataGrabber", line 167, in <module>
    from MythTV import MythDB
ImportError: No module named MythTV
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named MythDB.MythTV
/usr/local/bin/mythicalLibrarian: line 1783: test: too many arguments
Establishing database connection
Traceback (most recent call last):
  File "/usr/local/bin/MythDataGrabber", line 167, in <module>
    from MythTV import MythDB
ImportError: No module named MythTV
there was a problem connecting to the database, check MythDatabase package
MythTV Database Test ***FAILED***
Press any key to perform XBMC Notification test...

Performing XBMC Notifications test
SENDING REQUESTED COMMANDS TO:192.168.1.101:8080
COMMUNICATIONS NOT ESTABLISHED: 192.168.1.101:8080
XBMC Communications ***FAILED***
Press any key to test file system permissions...

Testing file system permissions
TargetPathIsInputPath is selected. Testing with current folder
USER SETTING     |FLAG|Folder name
MoveDir          |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
AlternateMoveDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
PrimaryMovieDir  |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
AlternateMovieDir|1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
PrimaryShowDir   |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
AlternateShowDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
mythicalLibrarian|1   |/home/bobby2/.mythicalLibrarian
Critical Filesystem checks ***PASSED***
OVERALL FAILURE
press any key to continue on to the final results...

  All tests complete           RESULTS
  MythTV Database Test:      ***FAILED***
  Installed Packages:        ***FAILED***
  Notifications Test:        ***PASSED***
  XBMC Communications:       ***FAILED***
  File System Checks:        ***PASSED***
  mythicalTesting:           COULD NOT COMPLETE
  Overall mythicalReadiness: ***FAILURE***
-----End of diagnostics-----
When interfacing MythTV/0.24, mythicalLibrarian uses MythTV's Python
Bindings.  These must be configured and working for proper access
to data required by mythicalLibrarian.  
Could not connect to the database.  Specify a username and password
XBMC Communications have failed.  Likely causes: Improper IP address,
or XBMC is not equipped to handle external network commands in settings.
mythicalLibrarian will not send messages or library update requests.
mythicalLibrarian has encountered an error.  This may be due to
lack of network connection.   If the problem persists, contact
outleradam here: http://forum.xbmc.org/showthread.php?tid=65644

These issues must be corrected in order for mythicalLibrarian to
perform correctly
chgrp: invalid group: `mythtv'
Please try again.  If problem persists, please post here: http://forum.xbmc.org/showthread.php?tid=65644
ADDING JOB to slot 0
Could not add mythcialLibrarian MythTV UserJob because no slots were available
permissions were set for user: mythtv.
No RSS Feeds will be used on this server. Configure /var/www/mythical-rss to link to web server for access by mythicalLibrarian.
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.



- outleradam - 2011-01-12

Arch is difficult.

Please list the commands you used to install python2.6 and the following so I can add it to the wiki as directions for others to follow. You need the two following packages.. libmyth-python python-lxml They are installed by default on the Ubuntu package.


- colbert - 2011-01-12

outleradam Wrote:Arch is difficult.

Please list the commands you used to install python2.6 and the following so I can add it to the wiki as directions for others to follow.

Yeah Arch can be a pain in some cases lol, for sure.

Okay for python 2.6 on Arch, a fellow Archer can do this:

Code:
wget http://aur.archlinux.org/packages/python26/python26.tar.gz && tar xvf python26.tar.gz
cd python26 && makepkg -s
pacman -U python26-2.6.5-1-i686.pkg.tar.gz

outleradam Wrote:You need the two following packages.. libmyth-python python-lxml They are installed by default on the Ubuntu package.

I was on IRC earlier and one of the devs was helping me, I think he may have emailed/messaged you as well. I was told that libmyth-python is an Ubuntu-only package that solely exists because their devs prefer to break things up into small packages, it simply isn't available/doesn't exist for Myth on Arch. I'll just paste what I was told:

Quote:dev: libmyth-python is just some artificial package that exists because the mythbuntu devs like to break everything up into small bits
dev: it is the python bindings, and should be included in the main mythtv install
dev: beyond that, you must have the python MySQLdb package, and the python lxml package
dev: and they must be installed for whatever 2.x version you are using
dev: further, if python 3.x is specified as the default 'python' binary
dev: you will have to edit the top line of mythdatagrabber to specify the proper 2.7 executable

However I do have python-lxml:

Code:
ââ> yinfo python-lxml
Name           : python-lxml
Version        : 2.2.8-2

And I even installed a boatload of other python and related packages just in case, however I think if I can change the MythDataGrabber script hashbang line to point to a different python location (maybe /usr/bin/env python2.7 or something?), perhaps try a few of the python versions it might work? Just throwing anything out there.

Aside from the libmyth-python package, the issue for me appears to be Arch's eff-up with python. The main python package is actually v3.1.3, and earlier versions are all separate binaries like python2.5/6/7. (I did change the hashbang of MythDataGrabber but I think the script is re-downloaded when I run the mythicalSetup as it was back to 2.6).


- outleradam - 2011-01-12

I changed the MythDataGrabber shebang to specify 2.6. Let me add a check to only download MythPythonGrabber if it is not there.... done.

MythDataGrabber is stable now and does not require update every time you update mythicalLibrarian. It's only about 3 months old, but it works like a charm now and has no issues identified. Edit the shebang to /usr/bin/python2.7 and you should be rockin' and rollin'.

Since you are using 0.24, the 0.23 methods should work just fine for MythTV. It's best to get this ironed out now though. You now should be able to just hit enter all the way through the mythicalSetup and get 0.24 working.

Did you get the XBMC Communication issue corrected? You need to have XBMC>Setup>network>allow other machines selected in XBMC. Your XBMC IP should be 192.168.1.100:8080 or 192.168.1.100:80.... It's the same address as you use for the xbmc remote webpage.


- colbert - 2011-01-13

What was happening is when I edited the /usr/local/bin/MythDataGrabber shebang to 2.7, it kept reverting to 2.6 everytime I ran mythicalSetup, so what I did was run mythicalSetup and soon as it got to the first prompt, I opened new shell and edited the MythDataGrabber to 2.7 now, and then continued with mythicalSetup. Well this time I had success, I think:

Code:
Performing MythTV Python Bindings database test
/usr/bin/python2.6
Python2.6 installed
Establishing database connection
Connected to: mythbox
Db Identified as: sql://mythconverg@localhost:3306/
Diagnostics passed.
MythTV Python Bindings are installed properly
MythTV Database Test ***PASSED***

That's of course what kept failing, the main problem of accessing the MySQLDB/python binding, looks resolved!

Still couldn make contact with my XBMC on the desktop, and I just realized it's because I had user/pass set on the HTTP access from within XBMC: http://i.imgur.com/MoEk3.jpg I just removed the user/pass and now it worked, here's the mythicalLibrarian --update from just now:

Code:
mythicalLibrarian will now conduct mythicalDiagnostics
Press any key to continue to online testing....

--You have entered diagnostic mode
mythicalLibrarian will now conduct a series of tests.
press any key to verify installed packages...

package 'curl' is installed
package 'agrep' or 'tre-agrep' is installed
package 'libnotify-bin' is installed
Installed packages check ***PASSED***
Press any key to perform Desktop Message test...

Performing librarian-notify-send test
This test verifies that the message was sent to the DBUS.
This test does not verify the user has a valid desktop open.
Desktop Notifications test ***PASSED***
Press any key to perform MythTV Database test...

Performing MythTV Python Bindings database test
/usr/bin/python2.6
Python2.6 installed
Establishing database connection
Connected to: mythbox
Db Identified as: sql://mythconverg@localhost:3306/
Diagnostics passed.
MythTV Python Bindings are installed properly
MythTV Database Test ***PASSED***
Press any key to perform XBMC Notification test...

Performing XBMC Notifications test
SENDING REQUESTED COMMANDS TO:192.168.1.101:8080
TESTING:
OK
XBMC Communications ***PASSED***
Press any key to test file system permissions...

Testing file system permissions
TargetPathIsInputPath is selected. Testing with current folder
USER SETTING     |FLAG|Folder name
MoveDir          |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
AlternateMoveDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes
PrimaryMovieDir  |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
AlternateMovieDir|1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Movies
PrimaryShowDir   |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
AlternateShowDir |1   |/home/bobby2/.mythicalLibrarian/mythicalSetup/Showings
mythicalLibrarian|1   |/home/bobby2/.mythicalLibrarian
Critical Filesystem checks ***PASSED***
press any key to test mythicalLibrarian...

Recordings Database is not used for testing.
Performing fuzzy logic lookup on database file.  Please wait.
It may take a moment to build mythical librarian database files
executing mythicalLibrarian testfile.ext 'mister rogers' 'show 1332'
testing for exit status 0
Revision 922 Wed Jan 12 17:52:29 EST 2011
RECSTART: DATE:
PROGRAMID: ShowCategory:
PLOT:
PERFORMING MAINTENANCE ROUTINE...
REMOVING ORPHAN FOLDER:/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes/Mister Rogers Neighborhood/Season 7
SEARCHING: www.TheTvDb.com SHOW NAME: mister rogers EPISODE: show 1332
TESTING FOR ZAP2ITID MATCH:SH002930 Mister Rogers' Neighborhood
FOUND:Mister Rogers' Neighborhood ID#:77750 WITH CONFIDENCE:-2
DATABASE IS MAINTAINED. TIME IS:1294872791 NEXT UPDATE IS:1294942411
AIRDATE FAILED. TITLE MATCH ON ABSOLUTE EPISODE NUMBER:
TOTAL MATCHES:2 TOTAL VERIFIED FUZZY ERRORS:0
EPISODE:Show 1332 EPISODE NUMBER:462 S07E07 WITH CONFIDENCE: -1
CONFIDENCE:-3 LOGIC PATH:  Attempted Match On Zap2itID: Failed; Attemted match on Standard Logic: Failed; Attemted Title match on Fuzzy Logic: Sucessful; Attemped match on OriginalAirDate: Failed; Attemted SubTitle match on Standard logic: Sucessful;
JOB: mythicalLibrarian 'testfile.ext' 'mister rogers' 'show 1332'
TARGET SET:/home/bobby2/.mythicalLibrarian/mythicalSetup/Episodes/Mister Rogers Neighborhood/Season 7/Mister Rogers Neighborhood S07E07 (Show 1332).ext
exited with status 0
press any key to continue on to the final results...

  All tests complete           RESULTS
  MythTV Database Test:      ***PASSED***
  Installed Packages:        ***PASSED***
  Notifications Test:        ***PASSED***
  XBMC Communications:       ***PASSED***
  File System Checks:        ***PASSED***
  mythicalTesting:           ***PASSED***
  Overall mythicalReadiness: ***PASSED***
-----End of diagnostics-----
chgrp: invalid group: `mythtv'
Installation and tests completed successfully.
ADDING JOB to slot 0
Could not add mythcialLibrarian MythTV UserJob because no slots were available
permissions were set for user: mythtv.
No RSS Feeds will be used on this server. Configure /var/www/mythical-rss to link to web server for access by mythicalLibrarian.
mythicalLibrarian is located in /usr/local/bin
mythicalLibrarian's log is located in ~/.mythicalLibrarian/output.log
Renamed video files will be placed in new folders within original.
  ie. /var/lib/mythtv/recordings/Episodes, /Movies and /Showings.
Check the mythicalLibrarian checkbox when setting up recordings.
For more information, type 'mythicalLibrarian --help'
Done.

I also saw a little notification in XBMC saying "mythicalLibrarian test" in the corner so it surely is working.

So now I just went into XBMC > Video > Add Source and put /media/myth (folder of myth recordings mounted here on desktop via NFS), and set the content to TV, am running a scan and it seems to be stuck: http://i.imgur.com/E6Cwq.jpg It hasn't moved from showing that for quite a while, and I don't even have any episodes of Lost & Found, so something is up...

edit: Scan seems to have died out, I hit scan again and it's hanging on "Scanning for new content". Checking xbmc.log here's what keeps happening: http://pastebin.com/kHCZCACr


- outleradam - 2011-01-13

You're processing the MythTV raw data. You need to do a mythicalLibrarian scan now to identify the shows. mythicalLibrarian must process the files to make the valid for XBMC. Normally this is done as a user job automatically, however, for the first run you must do a scan.

login to Myth Box as mythtv
Code:
mythicalLibrarian --scan mpg /var/lib/mythtv/recordings
... change /var/lib/mythtv/recordings to the path of your recordings if they're somewhere else.

It will create
/var/lib/mythtv/recordings/Episodes
/var/lib/mythtv/recordings/Showings
/var/lib/mythtv/recordings/Movies

Those are the XBMC folders. Episodes and Showings should be processed as Episodes. Movies should be processed as Movies. The showings dir is for infomercials, sports, episodes with no information, and everything else which is not an actual quantifiable Episode.

If you want to see how things are working, check ~/.mythicalLibrarian/output.log. It contains more information then the terminal. Let me know if there are any problems.


- colbert - 2011-01-13

Okay, ran the scan several times and it's giving some errors:

Code:
ââ> tail -n50 .mythicalLibrarian/output.log
INTERNET TIMEOUT:50- TVDB API KEY:6DF511BB2A64E0E9- mythicalLibrarian WORKING DIR:/home/bobby2/.mythicalLibrarian-
MOVE DIR:/media/myth/Episodes-
FAILSAFE MODE:Enabled- FAILSAFE DIR:/home/mythtv/FailSafe- ALTERNATE MOVE DIR:/media/myth/Episodes-
USE ORIGINAL DIR:Enabled NOTIFICATIONS:Disabled
INPUT SHOW NAME:Frontline- LOCAL SHOW NAME TRANSLATION:- ShowName:Frontline
DATABASE UPDATED:- TVDB LAST UPDATED:1294883132- CURRENT:-
RESOLVED SERIES ID:76763- RESOVED SHOW NAME:Frontline-
INPUT EPISODE NAME:Behind Taliban Lines- Absolute EPISODE NUMBER:16- RESOLVED EPISODE NAME:Heroes and Villains-
SEASON:S02- EPISODE:E03- SYMLINK MODE:MOVE- FILESIZE: 0kB-
CONFIDENCE:0 LOGIC PATH:  Attempted Match On Zap2itID: Sucessful; Attemped match on OriginalAirDate: Failed; Attemted SubTitle match on Standard logic: Failed; Attemted SubTitle match on Fuzzy logic: Sucessful;  Standard Logic came up with Episode Number Nothing. This does not match 16; Verified with Fuzzy logic;
CREATE AND DELETE FLAGS: ORIGINALDIR:1- FREE:113889872kB- WORKINGDIR:1 FREE:10705244kB-
MOVEDIRWRITABLE:1- FREE:113889872kB- ALTERNATEMOVEDIR:1- FREE:113889872kB-
PRIMARYSHOWDIRWRITABLE:1-  FREE:113889872kB-ALTERNATESHOWDIRWRITABLE:1- FREE:113889872kB-
PRIMARYMOVIEDIRWRITABLE:1- FREE:113889872kB- ALTERNATEMOVIEDIR:1- FREE:113889872kB-
DATABASE TYPE:-
RECSTART:2010-02-23 21:00:00- MOVIE YEAR:- ORIGINAL SERIES DATE:2010-02-23-
PROGRAMID:EP000017620521- CHANNEL ID:1059- CATEGORY:Documentary- GOFORDOOVER:0-
EXTRAPOLATED DATA DETERMINED THIS RECORDING AS A:Series With Episode Data- STARS:0.0 RATING:0
ZAP2IT SERIES ID:1762- MATCHED TVDB SERIES ID:-
PLOT: An Afghan video journalist travels a region that has reverted back to Taliban control; Pakistan's troubled school system.
####################END OF DEBUG LOG#####################
MOVING FILE: '/media/myth/1059_20100223210000.mpg' to '/media/myth/Episodes/Frontline/Season 2/Frontline S02E03 (Heroes and Villains).mpg'
@@@@@@@@@@@@@OPERATION COMPLETE Wed Jan 12 23:15:28 EST 2011 @@@@@@@@@@@@@@@@
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:29 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:31 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:32 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:34 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:36 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:38 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:40 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:42 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
@@@@@@@@@@@NEW SEARCH INITIATED AT Wed Jan 12 23:15:44 EST 2011@@@@@@@@@@@@@@
Revision 922 Wed Jan 12 17:52:29 EST 2011 on Linux
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%

In XBMC I tried a few episodes and they work great. Thing is, in TV Shows I have folders called Episodes and Home Movies and they're way off (Episodes got scanned as a British show for example) so do I just remove those from TV Shows? I'm guessing I go straight to Myth > Episodes/Showings and watch from there, right?

Thanks a ton for all your help!


- outleradam - 2011-01-14

I've noticed the no database information happens sometimes when mythtv tries to delete a file but it does not have permissions to do so. It deletes it's database information but orphans the file. This happens under very specific conditions..eg... say.. User adam runs mythicalLibrarian on file1(owned by mythtv)
This creates a symlink:
"file1Symlink(owned by adam)->/Episodes/file1(owned by mythtv)"
MythTV attempts to delete file1Symlink(owned by adam) and it cannot do so because it does not have group "adam" permissions. It wrongly assumes the file is impossible to manage so it purges database information.

Linux filesystem permissions are very granular. Because of this, it can be difficult to have 2 or more users reading and writing to and from the same file. It may be a MythTV bug, I don't know. I attempted to make it easier by assigning read/write permissions to user/group/all on every file processed and cross-add users running mythicalSetup to the mythtv group and vice versa. I just run mythicalLibrarian as mythtv every time and it works great.

I did notice that you do not have a mythtv group on your system. Who runs mythtv on Arch? my ls -l /var/lib/mythtv/recordings/ results have all permissions set to mythtv:mythtv. I saw in the logs of mythicalSetup that there is no mythtv group. how does that work? Do you notice any wierd permission errors in the terminal when you're running it?