XBMC MAL Updater Plugin

enabled

import xbmc
xbmc.log("### [%s] - %s" % ("XBMAL",str(response.status) + ": " + str(response_content)), level=xbmc.LOGERROR)

only showed this extra part in log
ERROR: ### [XBMAL] - 401: Authorization Required


So I am going to try waiting a while with the rapid succession in mind ( with manually added in usr / pass )

as I noticed MAL tries to log in when XBMC first starts up ( at the time it will be blank password )
also as soon as MAL kicks in PC starts grinding away and I have to close XBMC so I can try and do things

http://xbmclogs.com/show.php?id=3121


and yes its running as root cause it the only clean profile / sql data base running

*edit*

still no luck for me

I did not notice it bringing up auth failed on XBMC startup with manually added usr / pass ( neither saw it in the log )

I then waited 10 mins before clicking on setup .. auth still failed

http://xbmclogs.com/show.php?id=3122

skipping on the setup process with manually added usr/pass

the MAL updater seems to try updating but assuming no season episode support
( just caved in and left absolute numbering due to regex issues and now just renaming all my anime files via symlinking )
can not see any thing about failed auth in logs .. but i am yet to be able to get setup working with out auth failing

http://xbmclogs.com/show.php?id=3124


after adding some anime into XBMC and adding a few into myanimelist for testing the script finally allowed me to run setup

http://xbmclogs.com/show.php?id=3125

I also noticed it tried updating even files played from browsed folders ( shame it keeps going 0 updated tho )

also XBMC uses 100% CPU when not playing back a file

Meh, being root shouldn't matter, other than it being a mildly dangerous decision to run anything as root (which I'm sure you already know).

It's designed to attempt a login when it first starts up, and if it fails to keep trying until it succeeds, once every 5 minutes, a maximum of 6 times. If that works, then great! it'll go about it's merry way. If it doesn't, then meh, it'll stop trying and quit.

I did notice, though, that it's much more complex than it seems to get the add-on running as it is now, so I need to re-think a few things. Most notably, the setup script. Here's the step-by-step guide, which I'll throw on the wiki page eventually:

Step 1) Download and install the add-on.
Step 2) Configure your username and password. Don't run setup just yet.
Step 3) Restart XBMC.
Step 4) Now go in and run setup.
Step 5) It should work now.(Let's see if strikeout code works! See edit below...)

Ideally, what I should do is error out /and stop trying/ if no username and password is found on startup, or if it's invalid, requiring the user to go into the configuration screen and edit their user and password. Then I need to move the setup script somewhere other than the configuration screen so that the new user and pass are saved by hitting OK before the setup script runs. Then, after the setup script runs, it needs to check to see if xbmal is already running, and if not, start it. That would probably work best.

Looks like I'm working on 0.4 tonight. Incidently, I just committed version 0.3.3 to the xbmal repository, and will post the zip in the repo in a few minutes. Thanks for helping me out with this.

UPDATE!

Well, version 0.4 is out and in the repository. You might need to force an update for the repository to see it, otherwise it should update on it's own. I would recommend uninstalling and reinstalling, though, as the new version changes things up a little bit. Most notably, the convoluted setup procedure is now fixed, to some extent! To setup xbmal now:
1) Install from the zip or the repository (use the repo if you want automatic updates)
2) Configure your username and password.
3) Run the addon like you would any other - by finding it in the appropriate menu (in Alaska Revisited, it's under Apps). This will run the setup script and generate the XML file.
You're done! Once you exit the setup script, XBMAL will automatically start listening. In addition, it will automatically start listening every time xbmc is started.

If you still notice any issues (particularly with logging in), let me know. Also, I'm not sure why xbmc was running so hard for you with xbmal running. I don't notice anything, but it might just be me.

Finally, it seems I forgot to mention it earlier, but the 401 error code we were receiving was what I was looking for, it indicates a bad username or password from MAL (with a 503 being a rate-limiting issue). However, it may have been trying to submit a blank user and password, which would obviously fail. Hopefully the blank-string checks added in 0.3.3 will help.

Ah! I didn't notice your updates, so I didn't refer to them in my previous post. I'm posting again just so it pings you and so when you reply it pings me

Anyway, I don't know what could be causing the 100% CPU issue. Have you tried running xbmc without xbmal (but with everything else) to be sure it's the problem? I'm not sure how it would be, as when a video isn't playing, all it does is sit there in a wait loop, doing literally nothing but sleeping, until XBMC fires an 'OnVideoStarted' or 'OnPlaybackStopped' or 'OnPlaybackEnded' event. You might try updating to 0.4 and deleting your /userdata/addon_settings/xbmal.script/settings.xml file and checking CPU usage before and after running the setup script, just to rule it out. I don't want to go on a wild goose chase ^_^

Since the MAL Updater uses calls to the XBMC library, it assumes all of your shows are indexed in that library. It can only update what the xbmc library sees. When you run the setup script, it should report back all of your xbmc shows, and it's best guesses to a mapped MAL show. The guess is almost guaranteed to be wrong for each show (well, 50%, anyway), and that's my next major fix goal. It'll only update shows in your 'watching' and 'plan to watch' list, based on stats that are only available in the xbmc library (that is, I can't read them from the file alone), and right now it only works for the tv library (I imagine the video library will be a future release, way down the line). So basically, unless you populate the xbmc library, this addon is sadly useless, due to (understandable) limitations in the way xbmc stores it's database.

Just to test to be sure I didn't just say complete idiocy to you because I misunderstood, could you run https://github.com/kuruoujou/XBMal/blob/...pisodes.py (outside of XBMC, just a simple python script) which will get a list of all the episodes recognized by the XBMC library in exactly the same format as the script? You can post the output to xbmclogs.com, if you think it's too long. Also, if the result is not empty, could you post your /userdata/addon_data/script.xbmal/config.xml file? DON'T post settings.xml, that contains some sensitive info and I really don't need it, as it's generated by XBMC anyway and there's not much I can do with it.

Thank you, sir!

I will give it ago in 12 hrs time when I get back from work

but what has got me is I have not changed my password and now its trying to work ...


could you give an example of Anime / file names that are working for you ? s1e22 1x22 do not seem to be working for me .. yet ..
I will keep trying with single season ones until I see this working how ever , just a matter of getting all the correct options ticked I guess

any how I will make another fresh start tonight

thanks for all your work

where's your donation link

That is odd. Perhaps there was a stray bug in there that got fixed during one of the updates, or maybe when you were messing around with settings? Who knows. If it crops up again, I'll definitely need to look into it.

All of my shows are automatically named by my computer based on some really simple heuristics (I got really, really bored one day, and indexing it seemed tedious). Everything is in one of two /TV Shows/ folders, with each show in a separate sub folder that's named after it's title on the tvdb, and each season (labeled Season 0, Season 1, etc.) in a subfolder beneath that (even if it's only one season). The shows themselves are fairly loosely named, so long as 'S01E22', in your example, show up in them.

Using Lucky Star as an example, Season 1 Episode 22 is in "~/TV Shows/Lucky Star/Season 01/Lucky Star - S01E22.mkv". The way XBMC requires the directory structure to be is very specific, and I've also added some specific regexes in my advancedsettings.xml file, though I don't know how much use they're actually getting: http://xbmclogs.com/show.php?id=3127

Good luck, and as always just post here with your problems (and successes!). I hope we can get you running with this soon!

It's my pleasure! After all, I needed it too!

As for a donation link...I should probably make one, shouldn't I? Hahaha. I'll look into it, maybe I'll have one up somewhere this weekend! Although I'm not expecting anything, of course. ^_^

it does not seem to be actually using the episode details for updating MAL

for example my naruto was last updated around ep 220

I played season 13 ep 4 and it changed it to a 1

I played season 13 ep 3 and it changed it to 2

I played season 11 ep 14 and nothing changed ??

Naruto Shippuuden - S13E04 - Secrets of the Reanimation Jutsu [2012-05-24].tbn
Naruto Shippuuden - S13E04 - Secrets of the Reanimation Jutsu [2012-05-24].nfo
Naruto Shippuuden - S13E04 - Secrets of the Reanimation Jutsu [2012-05-24].mkv

is how my stuff is Organized

during setup i told each and every naruto season 1 - 13 to map to naruto shippuuden

I thought when I deinstalled MAL plugin it wiped out its folder I swear I saw it disappear in the plugin folder
I guess i was wrong as it remembered my username / pass in the morning I will do a fresh .xbmc folder for tinkering with

when ever I finished a video it said updating x amount of shows ( even tho only 1x show was watched .. and it was a random amount of shows

I could not see anything in the logs to tell me what MAL tried doing

Ah, ok. I didn't log as much as I maybe should have, but it should make a note every time it updates something on MAL. But I can see where the confusion is coming from here.

MAL just lists number of episodes watched - not the specific episode. So, if you only watch one episode in the middle of the season of something, it'll only update to a 1, so in your example, it won't update to a 4 because that's the last episode number watched, not number of episodes watched. It is kind of silly, but I understand their reasoning - it would be much more unwieldy to have a user mark each individual episode as watched like XBMC does.

With Season 11 episode 14, assuming it's in your library (if it isn't then mal can't see it), I would assume that you didn't go far enough in to have XBMC mark it as watched. Although, I notice that you mapped all 13 seasons of naruto in xbmc to a single show in mal. This is another limitation I'm trying to figure out (I had forgotten about it, though) that I noticed with Eureka Seven. MAL maps E7 as a 50 episode show in one season, but the TVDB, and by extension XBMC, maps E7 as 4 separate seasons. XBMAL resets the count for each season, which means that only the season with the greatest number of watched episodes will get counted. I'm not sure how to fix this yet.

Your organization looks perfectly fine and shouldn't cause any problems. The fact that XBMAL is updating at least proves that it can see the XBMC library.

Finally, the settings for username/password and the config file are stored in /userdata/addon_data/script.xbmal, and that particular folder is not removed when you uninstall the addon (this is true of all addons that use that folder or store settings in some way). You don't have to make a fresh .xbmc folder, you just need to remove that addon_data folder. I would backup the config.xml file first though, particularly if you have a lot of shows (mine lists 206 items, which is a real pain to update).

The number of shows it says it's updating is the number that it sees in xbmc as incomplete. Most of the time they won't change on MAL, but it still attempts to change them. In my case, it's listing 17 (maybe it's 16 now that I've finished katanagatari, I haven't paid attention...) because it sees that I've started watching 17 shows in XBMC but haven't finished them. It updates them, regardless of if they need updated, because xbmal doesn't keep track of what the last number updated was from either mal or xbmc, because it's possible the mal number will change outside of xbmc (if you watch it at a friend's place, for example).

All that said, though, you should see XBMAL make a note in the log each time it marks a show as completed, plan to watch, or watching in MAL.

EDIT:

I should correct myself on the second to last paragraph. It uses the MAL status first to determine if it should try to update the show or not - if the status is 'watching' or 'plan to watch', and the number of episodes watched isn't 0, it'll update, or if it can't find a status for the show in MAL (indicating you haven't yet added it to mal), it'll add it for you with the appropriate status. If you add and immediately watch something like Pale Cocoon, for example, it'll add it to MAL for you and immediately mark it as completed, but if add something else and don't watch it immediately and watch something else instead, it'll add it to MAL and add it to plan to watch. It won't touch anything in any other category.

now all that is really needed is this plugin to automatically add the series that you are watching to MAL


how would you do Anime like Natsume Yuujinchou
( your plugin detects them just fine i just have no idea how to get them into XBMC as seasons )
would you have a main Folder called Natsume Yuujinchou then inside have Natsume Yuujinchou Shi / Natsume Yuujinchou San etc
just trying to work out how to add them as seasons


I think I see my ep problem

I gave Shiki a go last night and only played the last ep

it does not update any other eps now

so I guess no choice but to update them in order ( still trying to work out how to add its specials )

how ever why would it have dropped my naruto from 220 ish to 1 ?

normally you would only watch the show's in order so it should do fine

so I take it your not going to make any option for it to update the MAL number using the file number being played?

ie to help those keep their MAL up to date with those 5 yr old series ie one piece

*edit*

it just made a lair out of me
cleared XBMC folder and started fresh

I watched Shiki ep 1 2 3 in order they updated i watched ep 7 and 8 it updated to 5 eps then watched ep 4 it updated to 6

so unsure why when I watched ep 24 it never updated any of the eps watched

also I did not have any password issues with v4

reason for using root is for clean db I can just delete the .xbmc folder and start tinkering with out effecting MYSQL data base

I haven't actually tried it out of order, that's just what should happen. I'll look into why that happened with Shiki.

As for specials, XBMAL doesn't support them right now, and may not. XBMC lists all specials in season 0, and combines what are multiple special "seasons" on MAL into that single "season", which makes it effectively impossible for XBMAL to understand what's going on. I might be able to make it work, though, if I can figure out the multiple seasons in TVDB to single season on MAL problem, though. Either way, it's still a long shot.

I don't know why it would have dropped naruto's count - it shouldn't have. That's a bug that I'll look into as soon as I can. Basically, it should say "What's the number in mal? What's the number in xbmc? Which is greater?" and use the number that is greater. So if XBMC's watch list has more watched, it'll assume that you haven't marked them in mal yet, and if mal's watchlist is greater, than it'll assume you watched episodes outside of xbmc. That's what's supposed to happen, anyway.

EDIT: Forgot to answer your first question -_-. Higurashi is similar with Kai and Rei, and what I do there is simply number the seasons like they are on the TVDB. Here's the page for Natsume Yuujinchou (called Natsume's Book of Friends there): http://thetvdb.com/?tab=seasonall&id=82788&lid=7, so what I would have is just Natsume's Book of Friends/Season 01/... and Natsume's Book of Friends/Season 02/.... I let the filenames themselves describe if the season has a specific name. For example, in Kore wa Zombie Desu Ka, Season 1 is just Kore Wa Zombie Desu Ka, but Season 2 is Kore Wa Zombie Desu Ka Of The Dead. However, in XBMC it's just Is This A Zombie/Season 01 and Is This A Zombie/Season 02 (incidently, Is This a Zombie is the english name and the name that shows up in the tvdb). Hopefully that answers your question.

Also, glad to hear the counting is working as expected, it may have been a one-off bug (which I'll have to track down anyway, but I'm not going to concern myself too much with it unless it keeps getting reports). I understand your reasoning for using root, though I have to advise against it I'm not going to tell you not to do it. It's doubtful that xbmal will screw anything up in your system, though I can't say the same for xbmc xD. Also good to hear you have no password issues with v0.4. I think I might push onto beta once I get the messed up "which is greater?" thing working and have one or two other people test it.

Quick update, another edit just because I don't want to make yet another new post (although I should): 0.4.1 is up and should fix the "which is greater?" bug. I had mistakenly thought one field I was pulling from MAL was the "number watched", but it was actually the number of episodes in the show, so it caused a bit of an error. That's fixed now. It's also up on the repo, so you should be able just to update from the menu, assuming you've been installing from the repo. If you don't see an update, try forcing a refresh.

Seems to be still Broken now it does not update something Manually done in MAL ?

been testing setting Naruto / bleach at 200


cheers I didn't think of Natsume's Book of Friends as tvdb did not return anything for natsume

which is what really bothers me thetvdb gets some and anidb get others .. neither seem to get it all