XBMC Community Forum
mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings - Printable Version

+- XBMC Community Forum (http://forum.xbmc.org)
+-- Forum: Help and Support (/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for XBMC (/forumdisplay.php?fid=116)
+--- Thread: mythicalLibrarian - a tool to build Movie and TV Show library from MythTV recordings (/showthread.php?tid=65644)



- outleradam - 2010-02-02 03:22

Code:
CREATE AND DELETE FLAGS: ORIGINALDIR:0- FREE:95568904kB- WORKINGDIR:0 Free:1819352kB-
MOVEDIR:0- FREE:95568904kB- ALTERNATEMOVEDIR:0- FREE:28225008kB-
PRIMARYMOVIEDIRWRITABLE:0- FREE:95568904kB- ALTERNATEMOVIEDIR:0- FREE:28225008kB-
These lines here tell me that mythicalLibrarian said it was not able to "text">>/dir/arbitraryfile.ext && rm /dir/arbitraryfile.ext

Code:
CREATE AND DELETE FLAGS: ORIGINALDIR:1- FREE:33383328kB- WORKINGDIR:1 Free:33383328kB-
MOVEDIR:1- FREE:663965728kB- ALTERNATEMOVEDIR:1- FREE:33383328kB-
PRIMARYMOVIEDIRWRITABLE:1- FREE:663965728kB- ALTERNATEMOVIEDIR:1- FREE:33383328kB-
This shows that mythicalLibrarian was able to "text">>/dir/arbitraryfile.ext && rm /dir/arbitraryfile.ext && filesize<freespace


- watson540 - 2010-02-02 03:23

Code:
Table recorded in database mythconverg
Rows 1 to 25 of 124
Select all. | Invert selection.

    chanid     starttime     endtime     title     subtitle     description     category     hostname     bookmark     editing     cutlist     autoexpire     commflagged     recgroup     recordid     seriesid     programid     lastmodified     filesize     stars     previouslyshown     originalairdate     preserve     findid     deletepending     transcoder     timestretch     recpriority     basename     progstart     progend     playgroup     profile     duplicate     transcoded     watched     storagegroup
    1051     2010-01-27 06:30:00     2010-01-27 07:00:00     Imagination Movers     The Tooth Hurts     Warehouse Mouse hides to avoid a trip to the vet.     Children     myth     0     0     0     9999     1     Deleted     7     114249875     EP010806230002     2010-01-31 04:00:15     1164363776     0     1     2008-09-06     0     0     0     28     1     0     1051_20100127063000.mpg     2010-01-27 06:30:00     2010-01-27 07:00:00     Default     Default     0     0     0     Default
    1002     2010-01-26 02:23:38     2010-01-26 02:24:00     Unknown     
    
    
    31337     0     0     0     10000     0     LiveTV     0     
    
    2010-01-26 02:35:18     1632     0     0     0000-00-00     0     0     1     0     1     0     1002_20100126022338.nuv     2010-01-26 02:23:38     2010-01-26 02:30:00     Default     Default     1     0     0     LiveTV
    1051     2010-01-28 04:30:00     2010-01-28 05:00:00     The Little Mermaid     Calliope Dreams     Ariel's poor performance on the calliope awakens an evil sea monster.     Animated     myth     0     0     0     9999     1     Deleted     52     115238260     EP000390390024     2010-01-29 17:07:09     609257472     0     1     1993-09-25     0     0     0     28     1     0     1051_20100128043000.mpg     2010-01-28 04:30:00     2010-01-28 05:00:00     Default     Default     1     0     0     Default
    1015     2010-01-30 20:00:00     2010-01-30 20:30:00     Family Guy     Patriot Games     At his high school reunion, Peter pretends to be a millionaire, but the truth comes out when he meets Tom Brady and loses all self-control.     Comedy     myth     0     0     0     9999     1     Deleted     54     4163209     EP002960010071     2010-01-30 23:27:29     609634304     0     1     2006-01-29     0     0     0     0     1     0     1015_20100130200000.mpg     2010-01-30 20:00:00     2010-01-30 20:30:00     Default     Default     0     0     0     Default
    1053     2010-01-29 18:00:00     2010-01-29 18:30:00     Chowder     The Apprentice Scouts; The Belgian Waffle Sobber-Barker     
    Animated     myth     0     0     0     9999     1     Deleted     65     167172738     EP000152650060     2010-01-30 23:28:23     596559872     0     1     2009-12-03     0     0     0     0     1     -28     1053_20100129180000.mpg     2010-01-29 18:00:00     2010-01-29 18:30:00     Default     Default     0     0     0     Default
    1054     2010-01-29 17:30:00     2010-01-29 18:00:00     SpongeBob SquarePants     Suctioncup Symphony; Spongicus     SpongeBob and Patrick keep Squidward from concentrating on his music; Plankton builds a coliseum and holds a gladiator show.     Animated     myth     0     0     0     9999     1     Deleted     56     179391763     EP003077660300     2010-01-30 23:26:39     600295424     0     1     2008-04-11     0     0     0     0     1     -75     1054_20100129173000.mpg     2010-01-29 17:30:00     2010-01-29 18:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 05:00:00     2010-01-27 05:30:00     Lilo & Stitch     Shush     Lilo winds up in trouble after an experiment helps her eavesdrop on conversations.     Animated     myth     0     0     0     9999     1     Deleted     4     111810632     EP006022210067     2010-01-31 04:00:23     1170442240     0     1     2005-08-12     0     0     0     28     1     0     1051_20100127050000.mpg     2010-01-27 05:00:00     2010-01-27 05:30:00     Default     Default     0     0     0     Default
    1053     2010-01-29 18:30:00     2010-01-29 19:00:00     Chowder     The Burple Nurple Stand; Schnitzel Makes a Deposit     Chowder unknowingly fills a dish with poison; Shnitzel is forced to take Chowder to the bank.     Animated     myth     0     0     0     9999     1     Deleted     65     167172738     EP000152650001     2010-01-30 23:28:18     597952512     0     1     2007-11-03     0     0     0     0     1     -28     1053_20100129183000.mpg     2010-01-29 18:30:00     2010-01-29 19:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 05:30:00     2010-01-27 06:00:00     Lilo & Stitch     Morpholomew     Lilo enters a skateboarding contest; Jake Long and his grandfather visit the island.     Animated     myth     0     0     0     9999     1     Deleted     5     111810632     EP006022210062     2010-01-31 04:00:20     1164527616     0     1     2005-07-01     0     0     0     28     1     0     1051_20100127053000.mpg     2010-01-27 05:30:00     2010-01-27 06:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 06:00:00     2010-01-27 06:30:00     Phineas and Ferb     Greece Lightning; Leave the Busting to Us     Phineas and Ferb re-create a chariot race; a reality show records the brothers.     Action/Adventure     myth     0     0     0     9999     1     Deleted     6     14284034     EP009488470036     2010-01-31 04:00:18     1164888064     0     1     2008-04-19     0     0     0     28     1     0     1051_20100127060000.mpg     2010-01-27 06:00:00     2010-01-27 06:30:00     Default     Default     0     0     0     Default
    1051     2010-01-27 07:00:00     2010-01-27 07:30:00     Handy Manny     Valentine's Day; Mr. Lopart Moves In     Manny and the tools assemble a Valentine's Day gift; Mr. Lopart moves in when his store floods.     Animated     myth     0     0     0     9999     1     Deleted     8     186515945     EP008560260033     2010-01-31 04:00:12     1165215744     0     1     2008-02-14     0     0     0     28     1     0     1051_20100127070000.mpg     2010-01-27 07:00:00     2010-01-27 07:30:00     Default     Default     0     0     0     Default
    1051     2010-01-31 07:30:00     2010-01-31 07:56:00     Chuggington     Inspector Emery; Bubbly Olwin     
    Children     myth     0     0     0     9999     1     Deleted     62     231543438     EP011228490038     2010-02-01 04:51:50     518391808     0     1     2010-01-09     0     0     0     0     1     -30     1051_20100131073000.mpg     2010-01-31 07:30:00     2010-01-31 07:55:00     Default     Default     1     0     0     Default
    1051     2010-01-27 07:55:00     2010-01-27 08:00:00     Shaun the Sheep     Tidy Up     
    Animated     myth     0     0     0     9999     0     Deleted     10     261736640     EP009135600037     2010-01-31 04:00:09     191956992     0     1     2008-04-13     0     0     0     28     1     0     1051_20100127075500.mpg     2010-01-27 07:55:00     2010-01-27 08:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 08:00:00     2010-01-27 08:25:00     Special Agent Oso     A View to a Book; Diamonds Are For Kites     
    Action/Adventure     myth     0     0     0     9999     1     Deleted     11     91388639     EP011332100004     2010-01-31 04:00:06     972277760     0     1     2009-04-06     0     0     0     28     1     0     1051_20100127080000.mpg     2010-01-27 08:00:00     2010-01-27 08:25:00     Default     Default     0     0     0     Default
    1051     2010-01-27 08:25:00     2010-01-27 08:30:00     Handy Manny's School for Tools     Sneeze Cleans Up     
    Children     myth     0     0     0     9999     0     Deleted     12     263375523     EP012185630006     2010-01-31 04:00:04     190285824     0     0     2010-01-27     0     0     0     28     1     0     1051_20100127082500.mpg     2010-01-27 08:25:00     2010-01-27 08:30:00     Default     Default     0     0     0     Default
    1051     2010-01-27 08:30:00     2010-01-27 08:55:00     Mickey Mouse Clubhouse     Sleeping Minnie     Minnie falls into a 100-year-long sleep after picking a magic rose.     Animated     myth     0     0     0     9999     1     Deleted     13     114862437     EP008274620020     2010-01-31 04:00:01     973637632     0     1     2006-11-17     0     0     0     28     1     -80     1051_20100127083000.mpg     2010-01-27 08:30:00     2010-01-27 08:55:00     Default     Default     0     0     0     Default
    1051     2010-01-27 09:00:00     2010-01-27 09:25:00     Handy Manny     Arbor Day; Flicker Speaks English     
    Animated     myth     0     0     0     9999     1     Deleted     15     186515945     EP008560260058     2010-01-31 03:59:55     972032000     0     1     2009-04-18     0     0     0     28     1     0     1051_20100127090000.mpg     2010-01-27 09:00:00     2010-01-27 09:25:00     Default     Default     0     0     0     Default
    1051     2010-01-27 08:55:00     2010-01-27 09:00:00     Handy Manny's School for Tools     A Place for Everything     
    Children     myth     0     0     0     9999     0     Deleted     14     263375523     EP012185630004     2010-01-31 03:59:58     192169984     0     0     2010-01-25     0     0     0     28     1     0     1051_20100127085500.mpg     2010-01-27 08:55:00     2010-01-27 09:00:00     Default     Default     0     0     0     Default
    1054     2010-01-27 12:30:00     2010-01-27 13:00:00     Dora the Explorer     The Backpack Parade     Dora and her friends travel to a parade where Backpack will sing her signature song.     Animated     myth     0     0     0     9999     1     Deleted     25     144208946     EP003849750174     2010-01-31 03:59:27     1170147328     0     1     2008-09-15     0     0     0     28     1     0     1054_20100127123000.mpg     2010-01-27 12:30:00     2010-01-27 13:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 09:55:00     2010-01-27 10:00:00     Handy Manny     Staying Healthy     
    Children     myth     0     0     0     9999     0     Deleted     18     186515945     EP008560260079     2010-01-31 03:59:45     192268288     0     1     2009-12-11     0     0     0     28     1     0     1051_20100127095500.mpg     2010-01-27 09:55:00     2010-01-27 10:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 09:25:00     2010-01-27 09:30:00     Handy Manny's School for Tools     Let There Be Light     
    Children     myth     0     0     0     9999     0     Deleted     16     263375523     EP012185630005     2010-01-31 03:59:52     192268288     0     0     2010-01-26     0     0     0     28     1     0     1051_20100127092500.mpg     2010-01-27 09:25:00     2010-01-27 09:30:00     Default     Default     0     0     0     Default
    1054     2010-01-29 14:30:00     2010-01-29 15:01:00     SpongeBob SquarePants     Not Normal; Gone     SpongeBob makes it his mission to become normal; SpongeBob wakes to find that everyone in Bikini Bottom is gone.     Animated     myth     0     0     0     9999     1     Deleted     56     179391763     EP003077660298     2010-01-29 17:06:19     607356928     0     1     2008-03-05     0     0     0     0     1     -75     1054_20100129143000.mpg     2010-01-29 14:30:00     2010-01-29 15:00:00     Default     Default     1     0     0     Default
    1051     2010-01-27 10:55:00     2010-01-27 11:00:00     Handy Manny's School for Tools     Bolt of Us     
    Children     myth     0     0     0     9999     1     Deleted     20     263375523     EP012185630001     2010-01-31 03:59:39     191580160     0     0     2010-01-25     0     0     0     28     1     0     1051_20100127105500.mpg     2010-01-27 10:55:00     2010-01-27 11:00:00     Default     Default     0     0     0     Default
    1051     2010-01-27 10:00:00     2010-01-27 10:25:00     Jungle Junction     Bungo the Magnificent; Thingums     Bungo tells Zooter a story about his past; Carla sells socks.     Animated     myth     0     0     0     9999     1     Deleted     19     11045566     EP011875490019     2010-01-31 03:59:42     971835392     0     0     2010-01-18     0     0     0     28     1     0     1051_20100127100000.mpg     2010-01-27 10:00:00     2010-01-27 10:25:00     Default     Default     0     0     0     Default



- watson540 - 2010-02-02 03:25

Code:
    chanid     starttime     endtime     title     subtitle     description     category     seriesid     programid     findid     recordid     station     rectype     duplicate     recstatus     reactivate     generic
    1054     2010-01-27 17:30:00     2010-01-27 18:00:00     SpongeBob SquarePants     Survival of the Idiots; Dumped     SpongeBob and Patrick sneak into the Treedome; Gary follows Patrick around, and SpongeBob becomes jealous.     Animated     179391763     EP003077660048     0     35     54NIK     1     0     -3     0     0
    1155     2010-01-27 18:00:00     2010-01-27 18:30:00     Family Guy     Barely Legal     Meg cannot find a date for the junior prom, so Brian goes with her.     Comedy     4163209     EP002960010090     0     54     155WM     4     0     7     0     0
    1011     2010-01-27 18:00:00     2010-01-27 18:30:00     The Simpsons     Catch 'Em if You Can     When Homer and Marge get caught having a rendezvous in Miami, Bart, Lisa and Grampa Simpson take off on a cross-country journey to foil their romantic getaway.     Comedy     199881155     EP000186930353     0     36     11WXI     1     0     -3     0     0
    1051     2010-01-27 05:00:00     2010-01-27 05:30:00     Lilo & Stitch     Shush     Lilo winds up in trouble after an experiment helps her eavesdrop on conversations.     Animated     111810632     EP006022210067     0     4     51DIS     1     0     -3     0     0
    1051     2010-01-27 05:30:00     2010-01-27 06:00:00     Lilo & Stitch     Morpholomew     Lilo enters a skateboarding contest; Jake Long and his grandfather visit the island.     Animated     111810632     EP006022210062     0     5     51DIS     1     0     -3     0     0
    1051     2010-01-27 06:00:00     2010-01-27 06:30:00     Phineas and Ferb     Greece Lightning; Leave the Busting to Us     Phineas and Ferb re-create a chariot race; a reality show records the brothers.     Action/Adventure     14284034     EP009488470036     0     6     51DIS     1     0     -3     0     0
    1051     2010-01-27 06:30:00     2010-01-27 07:00:00     Imagination Movers     The Tooth Hurts     Warehouse Mouse hides to avoid a trip to the vet.     Children     114249875     EP010806230002     0     7     51DIS     1     0     -3     0     0
    1015     2010-01-31 03:12:00     2010-01-31 05:12:00     Dickie Roberts: Former Child Star     
    Hoping to make a comeback, a man (David Spade) stays with a suburban family to prepare for the lead role in a Rob Reiner film.     Comedy     230816178     MV001389110000     0     70     15TBS     1     1     -3     0     0
    1051     2010-01-27 07:00:00     2010-01-27 07:30:00     Handy Manny     Valentine's Day; Mr. Lopart Moves In     Manny and the tools assemble a Valentine's Day gift; Mr. Lopart moves in when his store floods.     Animated     186515945     EP008560260033     0     8     51DIS     1     0     -3     0     0
    1051     2010-01-27 07:30:00     2010-01-27 07:55:00     Mickey Mouse Clubhouse     Goofy Baby     Goofy turns into a baby.     Animated     114862437     EP008274620030     0     9     51DIS     1     1     -3     0     0
    1051     2010-01-27 07:55:00     2010-01-27 08:00:00     Shaun the Sheep     Tidy Up     
    Animated     261736640     EP009135600037     0     10     51DIS     1     0     -3     0     0
    1051     2010-01-27 08:00:00     2010-01-27 08:25:00     Special Agent Oso     A View to a Book; Diamonds Are For Kites     
    Action/Adventure     91388639     EP011332100004     0     11     51DIS     1     0     -3     0     0
    1051     2010-01-27 08:25:00     2010-01-27 08:30:00     Handy Manny's School for Tools     Sneeze Cleans Up     
    Children     263375523     EP012185630006     0     12     51DIS     1     0     -3     0     0
    1051     2010-01-27 08:30:00     2010-01-27 08:55:00     Mickey Mouse Clubhouse     Sleeping Minnie     Minnie falls into a 100-year-long sleep after picking a magic rose.     Animated     114862437     EP008274620020     0     13     51DIS     1     0     -3     0     0
    1051     2010-01-27 08:55:00     2010-01-27 09:00:00     Handy Manny's School for Tools     A Place for Everything     
    Children     263375523     EP012185630004     0     14     51DIS     1     0     -3     0     0
    1051     2010-01-27 09:00:00     2010-01-27 09:25:00     Handy Manny     Arbor Day; Flicker Speaks English     
    Animated     186515945     EP008560260058     0     15     51DIS     1     0     -3     0     0
    1051     2010-01-27 09:25:00     2010-01-27 09:30:00     Handy Manny's School for Tools     Let There Be Light     
    Children     263375523     EP012185630005     0     16     51DIS     1     0     -3     0     0
    1051     2010-01-27 09:30:00     2010-01-27 09:55:00     Imagination Movers     The Un-Party     A surprise party for Knit Knots goes awry.     Children     114249875     EP010806230010     0     17     51DIS     1     0     -3     0     0
    1051     2010-01-27 09:55:00     2010-01-27 10:00:00     Handy Manny     Staying Healthy     
    Children     186515945     EP008560260079     0     18     51DIS     1     0     -3     0     0
    1054     2010-01-27 17:00:00     2010-01-27 17:30:00     SpongeBob SquarePants     Goo Goo Gas; Le Big Switch     Plankton creates a gas that turns everyone at the Krusty Krab into babies; SpongeBob trades places with a French chef from a fancy restaurant.     Animated     179391763     EP003077660379     0     34     54NIK     1     0     -3     0     0
    1006     2010-01-27 16:00:00     2010-01-27 16:30:00     Judge Judy     3350     An uninvited partygoer says another guest punched him in the face during a brawl.     Episodic     225574937     EP001887103887     0     32     6WRTV     1     1     -3     0     0
    1006     2010-01-27 16:30:00     2010-01-27 17:00:00     Judge Judy     3298     A woman is sued for damages after she hears her friend screaming for help but does not call the police; former friends argue over a professional photo shoot, slander and harassment.     Episodic     225574937     EP001887103801     0     33     6WRTV     1     1     -3     0     0
    1051     2010-01-27 10:30:00     2010-01-27 10:55:00     Chuggington     Helpful Hodge; Wilson's Wacky Tour     
    Children     231543438     EP011228490034     0     21     51DIS     1     1     -3     0     0
    1051     2010-01-27 10:55:00     2010-01-27 11:00:00     Handy Manny's School for Tools     Bolt of Us     
    Children     263375523     EP012185630001     0     20     51DIS     1     0     -3     0     0
    1051     2010-01-27 11:00:00     2010-01-27 11:25:00     My Friends Tigger & Pooh     Darby's Prickly Predicament; Piglet's Monster Under the Bed     The Super Sleuths help Roo with a lost toy and Piglet with a monster under his bed.     Animated     58151624     EP009207000057     0     22     51DIS     1     0     -3     0     0



- watson540 - 2010-02-02 03:26

i can keep going
tell me what you need
watson540@unsubstantiated.info
i can also export anything from the database as a .csv if that helps


- watson540 - 2010-02-02 03:38

outleradam Wrote:
Code:
CREATE AND DELETE FLAGS: ORIGINALDIR:0- FREE:95568904kB- WORKINGDIR:0 Free:1819352kB-
MOVEDIR:0- FREE:95568904kB- ALTERNATEMOVEDIR:0- FREE:28225008kB-
PRIMARYMOVIEDIRWRITABLE:0- FREE:95568904kB- ALTERNATEMOVIEDIR:0- FREE:28225008kB-
These lines here tell me that mythicalLibrarian said it was not able to "text">>/dir/arbitraryfile.ext && rm /dir/arbitraryfile.ext

Code:
CREATE AND DELETE FLAGS: ORIGINALDIR:1- FREE:33383328kB- WORKINGDIR:1 Free:33383328kB-
MOVEDIR:1- FREE:663965728kB- ALTERNATEMOVEDIR:1- FREE:33383328kB-
PRIMARYMOVIEDIRWRITABLE:1- FREE:663965728kB- ALTERNATEMOVIEDIR:1- FREE:33383328kB-
This shows that mythicalLibrarian was able to "text">>/dir/arbitraryfile.ext && rm /dir/arbitraryfile.ext && filesize<freespace

Code:
watson540@myth ~/Downloads $ echo "text">>/mnt/ntfs/arbitraryfile.ext && rm /mnt/ntfs/arbitraryfile.ext
watson540@myth ~/Downloads $

i dont understand your 2nd example..filesize is not a binary on my box


- outleradam - 2010-02-02 03:41

imagination movers:
mc2x programid: EP010806230002
thetvdb Zap2itid: EP01080623

dora
mc2xprogramid:EP003849750174
thetvdb Zap2itid: SH384975

I'm seeing patterns. I think it could increase episode recognition if I were able to remove leading EP/SH + leading 0's from ALL data received from different sources.

Removing the last 4 digits from mc2x programid would be the way to go for it.

Any idea about shows? Do you have any news shows recorded or one of the 3-4 daily spongebob's on NIK without data? I also need a movie of some sort.


- watson540 - 2010-02-02 03:50

yeah i replied but accidentally on your other thread
http://forum.xbmc.org/showthread.php?tid=65769&page=4

i posted the contents of the database here
http://pastebin.org/85238


- outleradam - 2010-02-02 03:52

watson540 Wrote:
Code:
watson540@myth ~/Downloads $ echo "text">>/mnt/ntfs/arbitraryfile.ext && rm /mnt/ntfs/arbitraryfile.ext
watson540@myth ~/Downloads $
i dont understand your 2nd example..filesize is not a binary on my box
the checks for filesize are as follows:

$1= move filesize, $2 = movedir free space $3 = movedir name
depending on the check, like, originaldir and working dir, reasonable filesize values are set, 1k file size for originaldir 5M file size for workingdir.
Code:
checkpermissions () {
TMoveDirWritable=0
if [ ! -z $2 ] && [ ! -z "$1" ] && [ $1 -lt $2 ]; then
     echo "Testing write permission on $3">$3/arbitraryfile.ext
     if [ -f "$3/arbitraryfile.ext" -a -s "$3/arbitraryfile.ext" ]; then
         rm -f "$3/arbitraryfile.ext"
         test ! -f "$3/arbitraryfile.ext" && TMoveDirWritable=1 || TMoveDirWritable=0
     else
         TMoveDirWritable=0
         echo "CHECK PERMISSIONS ON $MoveDir"
     fi
elif [ -z "$2" ] || [ $1 -ge $2 ]; then
     TMoveDirWritable=0
     echo "UNUSABLE SPACE-CHECK:$3"
fi
}
it's pretty straight forward.

you did change your configuration in the mythicalLibrarian.sh file correct? Did you add quotes?

certain folders will not allow the mythtv user to run scripts. /var/ for example. It's part of linux security. If you mount folders in /home/ you will always be fine.

hrm.. does your filesystem support the rm -f setting?

Code:
adam@adam-desktop:~$ rm --version
rm (GNU coreutils) 7.4



- watson540 - 2010-02-02 04:09

outleradam Wrote:the checks for filesize are as follows:

$1= move filesize, $2 = movedir free space $3 = movedir name
depending on the check, like, originaldir and working dir, reasonable filesize values are set, 1k file size for originaldir 5M file size for workingdir.
Code:
checkpermissions () {
TMoveDirWritable=0
if [ ! -z $2 ] && [ ! -z "$1" ] && [ $1 -lt $2 ]; then
     echo "Testing write permission on $3">$3/arbitraryfile.ext
     if [ -f "$3/arbitraryfile.ext" -a -s "$3/arbitraryfile.ext" ]; then
         rm -f "$3/arbitraryfile.ext"
         test ! -f "$3/arbitraryfile.ext" && TMoveDirWritable=1 || TMoveDirWritable=0
     else
         TMoveDirWritable=0
         echo "CHECK PERMISSIONS ON $MoveDir"
     fi
elif [ -z "$2" ] || [ $1 -ge $2 ]; then
     TMoveDirWritable=0
     echo "UNUSABLE SPACE-CHECK:$3"
fi
}
it's pretty straight forward.

you did change your configuration in the mythicalLibrarian.sh file correct? Did you add quotes?

certain folders will not allow the mythtv user to run scripts. /var/ for example. It's part of linux security. If you mount folders in /home/ you will always be fine.

hrm.. does your filesystem support the rm -f setting?

Code:
adam@adam-desktop:~$ rm --version
rm (GNU coreutils) 7.4

yes everything is set right..you may not believe me, but i didnt get these permission errors till i upgraded the script..coincidence..i dunno

you see the proof in the pudding.i showed you free space on every drive and I was able to "touch" a file in each and every folder i have set. i have already proven that what more could you want here? how can it STILL be my fault when ive gone through at least 3 times and made sure the owner was mythtv (where possible.not posssible on ntfs but I still have no problems writing to it)
also set chmod -R 0777 to every freakin folder in use just now and no change


- watson540 - 2010-02-02 04:21

mythtv@myth ~/mythicalLibrarian $ rm --version
rm (GNU coreutils) 7.4
Copyright © 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Paul Rubin, David MacKenzie, Richard M. Stallman,
and Jim Meyering.



i use rm -rf all the time to remove directories


- outleradam - 2010-02-02 05:02

well, that's the function in question. what is your command line output like?


- watson540 - 2010-02-02 05:48

Code:
mythtv@myth ~/mythicalLibrarian $ cat check
checkpermissions () {
TMoveDirWritable=0
$1=2048
$2=2048
$3="/mnt/ntfs/tv"
if [ ! -z $2 ] && [ ! -z "$1" ] && [ $1 -lt $2 ]; then
     echo "Testing write permission on $3">$3/arbitraryfile.ext
     if [ -f "$3/arbitraryfile.ext" -a -s "$3/arbitraryfile.ext" ]; then
         rm -f "$3/arbitraryfile.ext"
         test ! -f "$3/arbitraryfile.ext" && TMoveDirWritable=1 || TMoveDirWritable=0
     else
         TMoveDirWritable=0
         echo "CHECK PERMISSIONS ON $MoveDir"
     fi
elif [ -z "$2" ] || [ $1 -ge $2 ]; then
     TMoveDirWritable=0
     echo "UNUSABLE SPACE-CHECK:$3"
fi
}
mythtv@myth ~/mythicalLibrarian $ ./check
mythtv@myth ~/mythicalLibrarian $
Code:
mythtv@myth ~/mythicalLibrarian $ ./mythicalLibrarian.sh "Family Guy" "Da Boom" "/mnt/ntfs/myth/1015_20100201220000.mpg"
Accessing MythTV DataBase:
COMMERCIAL DATA START:9649 STOP:14341
COMMERCIAL DATA START:24246 STOP:30292
COMMERCIAL DATA START:42080 STOP:46625
0
RECSTART:2010-02-01 22:00:00 MOVIEYEAR:1999 SERIESDATE:1999-12-26
PROGRAMID:EP002960010012 ShowCategory:Comedy STARS:0 RATING:0
PLOT: Paranoid about Y2K, Peter herds the family into the basement for protection.
TESTING FOR ZAP2IT SERIES ID MATCH:Family Guy
DATABASE IS MAINTAINED. TIME IS:1265083063 NEXT UPDATE IS:1265160381
No direct Zap2it match found. Please update TheTvDb.com
USING FUZZY LOGIC FOR EPISODE RECOGNITION
Family Guy
FUZZY LOGIC SHOW NAME: Family Guy ID: 75978
./mythicalLibrarian.sh: line 425: [: : integer expression expected
./mythicalLibrarian.sh: line 467: [: : integer expression expected
FUZZY Exx NUMBER:35
EPISODE:Da Boom ABSOLUTE NUMBER:35 S02E03
FILE SIZE:584738kB
MOVEDIR FREE SPACE: 91065912kB- WRITABLE:0
ALTMOVEDIR FREE SPACE: 28225008kB- WRITABLE:0
MOVIEDIR FREE SPACE: 91065848kB- WRITABLE:0
ALTMOVIEDIR FREE SPACE: 28225008kB- WRITABLE:0
PLOT: Paranoid about Y2K, Peter herds the family into the basement for protection.
FAILSAFE FLAG WAS SET

I also exported $MOVEDIR as an environment variable. 'export MOVEDIR="/mnt/ntfs/tv"' ..just for running ./check

looks to me like $TvDbTime is not being set


- outleradam - 2010-02-02 07:16

I can't get past this without an error
$1=2048
$2=2048
$3="/mnt/ntfs/tv"
Code:
adam@adam-desktop:~$  $1=2048
=2048: command not found
adam@adam-desktop:~$  $2=2048
=2048: command not found
adam@adam-desktop:~$  $3="/mnt/ntfs/tv"
bash: =/mnt/ntfs/tv: No such file or directory
Basically, the checkpermissions function is called 6 separate times, from within the sanity checks portion of the script. For some reason, those dirs are being called bad and it's not free space. Those flags are only set in one portion of the program. The only way the workingdir can be set as bad is if you can't >>/workingdir/arbitraryfile.ext

Is there an arbitraryfile.ext somewhere?

How old is the version that you are working with? The code I'm looking at on code.google.com shows that the terminal will either display flags of 1 or an error message of some type. Every step along hte way it has a choice, it either sets a bad flag and exits from the checkpermissions () or it sets the writable flag after it deletes the arbitraryfile.ext.

I don't see how it's even possible for us to be running the same script and be seeing this.

Does fidora define datatypes for variables?

that would be a function of the
Code:
bash --version
GNU bash, version 4.0.33(1)-release (i486-pc-linux-gnu)



- watson540 - 2010-02-02 07:18

for the record..i ran this as root..still the same permissions error.. I think this rules out any error on my part
Code:
myth mythicalLibrarian #  ./mythicalLibrarian.sh "Family Guy" "Da Boom" "/mnt/ntfs/myth/1015_20100201220000.mpg"
Accessing MythTV DataBase:
COMMERCIAL DATA START:9649 STOP:14341
COMMERCIAL DATA START:24246 STOP:30292
COMMERCIAL DATA START:42080 STOP:46625
0
RECSTART:2010-02-01 22:00:00 MOVIEYEAR:1999 SERIESDATE:1999-12-26
PROGRAMID:EP002960010012 ShowCategory:Comedy STARS:0 RATING:0
PLOT: Paranoid about Y2K, Peter herds the family into the basement for protection.
TESTING FOR ZAP2IT SERIES ID MATCH:Family Guy
DATABASE IS MAINTAINED. TIME IS:1265088203 NEXT UPDATE IS:1265160381
No direct Zap2it match found. Please update TheTvDb.com
USING FUZZY LOGIC FOR EPISODE RECOGNITION
Family Guy
FUZZY LOGIC SHOW NAME: Family Guy ID: 75978
DATABASE IS MAINTAINED. TIME IS:1265088204 NEXT UPDATE IS:1265160381
FUZZY Exx NUMBER:35
EPISODE:Da Boom ABSOLUTE NUMBER:35 S02E03
FILE SIZE:584738kB
MOVEDIR FREE SPACE: 89730136kB- WRITABLE:0
ALTMOVEDIR FREE SPACE: 28225008kB- WRITABLE:0
MOVIEDIR FREE SPACE: 89730136kB- WRITABLE:0
ALTMOVIEDIR FREE SPACE: 28225008kB- WRITABLE:0
PLOT: Paranoid about Y2K, Peter herds the family into the basement for protection.
FAILSAFE FLAG WAS SET
myth mythicalLibrarian # cat output.log
@@@@@@@@@@@NEW SEARCH INITIATED AT Tue Feb  2 00:17:48 EST 2010@@@@@@@@@@@@@
%%%NO DATABASE INFORMATION. CHECK LOGIN/PASS OR FILE %%%%%
SEARCHING: www.TheTvDb.com SHOW NAME: Family Guy EPISODE: Da Boom
FILE NAME: /mnt/ntfs/myth/1015_20100201220000.mpg
SEARCH FOUND:Family Guy ID#: 75978
USING FUZZY LOGIC FOR EPISODE RECOGNITION
No direct Zap2it match found. Please update TheTvDb.com
SEARCH FOUND:Family Guy ID#: 75978
DEFINED ABSOLOUTE EPISODE NUMBER: 35
###################DEBUG MODE ENABLED####################
LISTING INTERNAL VARIABLES USED BY mythicalLibrarian.
INTERNET TIMEOUT:50- TVDB API KEY:6DF511BB2A64E0E9- mythicalLibrarian WORKING DIR:/home/mythtv/mythicalLibrarian-
MOVE DIR:/mnt/ntfs/tv- USING SHOWNAME AS FOLDER:Enabled-
FAILSAFE MODE:Disabled- FAILSAFE DIR:/home/mythtv- ALTERNATE MOVE DIR:/mnt/extra/tv-
USE ORIGINAL DIR:Disabled NOTIFICATIONS:Disabled DEBUG MODE:Enabled-
INPUT SHOW NAME:Family Guy- LOCAL SHOW NAME TRANSLATION:- ShowName:Family Guy
SENT TVDB SHOW NAME:Family%20Guy-
RESOLVED SERIES ID:75978- RESOVED SHOW NAME:Family Guy-
INPUT EPISODE NAME:Da Boom- ABSOLOUTE EPISODE NUMBER:35- RESOLVED EPISODE NAME:Da Boom-
SEASON:S02- EPISODE:E03- SYMLINK MODE:LINK- FILESIZE: 584738'kB'
CREATE AND DELETE FLAGS: ORIGINALDIR:0- FREE:89730136kB- WORKINGDIR:0 Free:1802764kB-
MOVEDIR:0- FREE:89730136kB- ALTERNATEMOVEDIR:0- FREE:28225008kB-
PRIMARYMOVIEDIRWRITABLE:0- FREE:89730136kB- ALTERNATEMOVIEDIR:0- FREE:28225008kB-
DATABASE INFORMATION
RECSTART:2010-02-01 22:00:00- MOVIE YEAR:1999- ORIGINAL SERIES DATE:1999-12-26-
PROGRAMID:EP002960010012- CHANNEL ID:1015- CATEGORY:Comedy-
EXTRAPOLATED DATA DETERMINED THIS RECORDING AS A:Series With Episode Data- STARS:0 RATING:0
ZAP2IT SERIES ID:4163209- MATCHED TVDB SERIES ID:-
####################END OF DEBUG LOG#####################
FAILSAFE FLAG WAS SET CHECK PERMISSIONS AND FOLDERS

i dunno about the check script i tried to make with your function..setting the variables in the interactive shells gives me error to..the script gave no error..but im no bash scripter, i just thought thats how you defined things in a script..as a matter of fact ..i cannot export ANYTHING for $1 and etc..i dont think those are declarable

I ran this script in bash debig mode..if you're interested it'll be up on pastebin
http://pastebin.org/85299


- watson540 - 2010-02-02 07:28

the version is the latest from sourceforge..confiurmed by " ############Adept personel only beyond this point###############" the first time i saw this..it said something else in older versions

everything has been cleaned out of all working folders including recordings more than once..about once per day actually which is why its so frustrating to me