newest nightly build - 3 new BUGS

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
mselley Offline
Junior Member
Posts: 28
Joined: Oct 2011
Reputation: 0
Post: #31
Hi,

Adding to my post above.

Just been looking abit more and is it not possible to just query the TMDB api using the IMDB ID from the database to get the new list of urls and just put that directly into the database?

http://api.themoviedb.org/2.1/methods/Movie.getImages

Maybe there could be a maintenance option in the settings which could be to refresh all urls? as links may become stale again in the future.

Thanks,
Mark
find quote
vicbitter Offline
Donor
Posts: 253
Joined: Jan 2011
Reputation: 3
Post: #32
(2012-05-16 01:23)jmarshall Wrote:  As long as you clean out all the content, then yes, the rescan will trigger everything to be cached - it may well take a while ofcourse - it will keep going after the scanning has completed most likely. Wink

Thanks, is there anyway of gathering performance metrics? The thumbnails seem to be loading considerably slower than on Eden. I have removed path substitution for thumbnails and completely refreshed the local cache.

The behavior that I am experiencing is wherever I am in the list of my Movies the thumbnails appear to be being refreshed from the first movie (in my Library). I'll give a couple of examples:
a) if I go into a set (of Movies) and I come back out the thumbnails (appear to) refresh from the start (of my Library) rather than from the first movie on the screen..
b) if I go into my Movies and go to the end of the Movies (in my Library) it takes 10s of seconds to display the thumbnails.

This results in a long lags (on the thumbnails being displayed) depending where I am in my Movie list and I don't experience this on Eden.

Debug Log of above examples
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,689
Joined: Oct 2003
Reputation: 169
Post: #33
@vicbitter: yes, the thumbloader is currently completely unoptimised. It will depend on how many movies you have and how much art they have (as hitting the disk for art takes longer than hitting the db). I'll be optimising this over the next few days. See this thread for more: http://forum.xbmc.org/showthread.php?tid=131624

@mselley: our scrapers currently don't support fetching just the images, so until that's added, refreshing the items themselves is the only option. We could, however, ignore the bad themoviedb URLs and grab the next image (if there is one) but I suspect everyone will want things to be refreshed anyway. So yes, until the scraper API can include only grabbing images, there's not a lot we can do here (I'd be completely supportive of that move).

Cheers,
Jonathan

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
vicbitter Offline
Donor
Posts: 253
Joined: Jan 2011
Reputation: 3
Post: #34
(2012-05-17 00:41)jmarshall Wrote:  @vicbitter: yes, the thumbloader is currently completely unoptimised. It will depend on how many movies you have and how much art they have (as hitting the disk for art takes longer than hitting the db). I'll be optimising this over the next few days. See this thread for more: http://forum.xbmc.org/showthread.php?tid=131624

@mselley: our scrapers currently don't support fetching just the images, so until that's added, refreshing the items themselves is the only option. We could, however, ignore the bad themoviedb URLs and grab the next image (if there is one) but I suspect everyone will want things to be refreshed anyway. So yes, until the scraper API can include only grabbing images, there's not a lot we can do here (I'd be completely supportive of that move).

Cheers,
Jonathan


Don't want to sound ungrateful BUT you have been pretty disparaging about using "path substitution" and yet the new solution is MUCH MUCH slower... I have an 800+ library.. Let me know what "you need" and I will CONTRIBUTE anyway you want!

Your approach is great... But let us (the community) help you make it better!!!
(This post was last modified: 2012-05-17 01:02 by vicbitter.)
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,689
Joined: Oct 2003
Reputation: 169
Post: #35
Ofcourse - feel free to help test out as per that other thread - will have a patch up to try shortly.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
vicbitter Offline
Donor
Posts: 253
Joined: Jan 2011
Reputation: 3
Post: #36
(2012-05-17 01:07)jmarshall Wrote:  Ofcourse - feel free to help test out as per that other thread - will have a patch up to try shortly.

What do need from us (humble testers) to do? Yell out about use cases, etc...

On a side note, I am a (very old) coder from many years ago, so I would be happy to help out however I can...
(This post was last modified: 2012-05-17 01:53 by vicbitter.)
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,689
Joined: Oct 2003
Reputation: 169
Post: #37
The tests I gave in the other thread are a good start. As soon as I have finished hunting the bugs on my list I'll push up a patch to github for you to try as well - will do that in the other thread.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
vicbitter Offline
Donor
Posts: 253
Joined: Jan 2011
Reputation: 3
Post: #38
Cool, I'll jump over to the other thread...

Thanks
find quote
vicbitter Offline
Donor
Posts: 253
Joined: Jan 2011
Reputation: 3
Post: #39
The patch has improved the speed considerably... It is now usable. Smile

Thanks!
find quote
mselley Offline
Junior Member
Posts: 28
Joined: Oct 2011
Reputation: 0
Post: #40
Hi,

I made a standalone .net app that refreshes all the thumbs for the movies in my mysql database and everything seems to be good now Smile
If i get round to tidying up the source i may post it somewhere for people to use.

I have also noticed that it does not look like it is using the movie thumbs preview? its using the full size thumb so the images just look really pixelated when they show.

Thanks,
Mark
find quote
mselley Offline
Junior Member
Posts: 28
Joined: Oct 2011
Reputation: 0
Post: #41
Hi Jonathan

I have just been applying this across my home as i have moved all my media to my home server now and thought it was the best options to syncing thumbs across the network.

I used to have a scheduled copy moving thumbs to other systems but this is awesome instant thumb updating across the network.

Main reason for moving so early is that i would have to rehash all my thumbs. which i wrote some code for but decided it wasnt worth doing.

One thing i have come across is that i think its essential that there should be a option in the video setting to cache all thumbs as i am currently having to scroll through the movie library to cache them all which is a bit of a hastle.

Thanks,
Mark
find quote
mselley Offline
Junior Member
Posts: 28
Joined: Oct 2011
Reputation: 0
Post: #42
Hi Jonathan,

i was just scrolling through my movies and xbmc crashed.

Here is the error log seems to be todo with the thumbs not loading properly.

Code:
20:46:53 T:6236 WARNING: JpegIO: Error 53: Not a JPEG file: starts with 0x%02x 0x%02x
20:47:26 T:5620   ERROR: dll_fgets emulated function failed
20:48:17 T:5992   ERROR: Previous line repeats 1 times.
20:48:17 T:5992   ERROR: CJobWorker::Process error processing job
20:48:18 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:19 T:5620   ERROR: Previous line repeats 25 times.
20:48:19 T:5620   ERROR: CJobWorker::Process error processing job
20:48:19 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:19 T:5992   ERROR: Previous line repeats 57 times.
20:48:19 T:5992   ERROR: CJobWorker::Process error processing job
20:48:19 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:19 T:6236   ERROR: Previous line repeats 223 times.
20:48:19 T:6236   ERROR: CJobWorker::Process error processing job
20:48:19 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:22 T:4336   ERROR: Previous line repeats 854 times.
20:48:22 T:4336   ERROR: CJobWorker::Process error processing job
20:48:22 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:57 T:3056   ERROR: Previous line repeats 13594 times.
20:48:57 T:3056  NOTICE: Thread Jobworker start, auto delete: true
20:48:57 T:3056   ERROR: CJobWorker::Process error processing job
20:48:57 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:48:57 T:5828   ERROR: Previous line repeats 179 times.
20:48:57 T:5828  NOTICE: Thread Jobworker start, auto delete: true
20:48:57 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:00 T:5828   ERROR: Previous line repeats 830 times.
20:49:00 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/wjaifhJRyN33uP7uqQPqancqGBL.jpg
20:49:00 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:00 T:5828   ERROR: Previous line repeats 217 times.
20:49:00 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/2JK9IllXGo7V2PZzLmclkB5Cf8k.jpg
20:49:00 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:00 T:5828   ERROR: Previous line repeats 107 times.
20:49:00 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/fTyi9APVtF6i0QqoLKQd7Bs0BNA.jpg
20:49:00 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:00 T:5828   ERROR: Previous line repeats 29 times.
20:49:00 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/iYQcFgHg4aWzozfVtqqrn6preRx.jpg
20:49:00 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:01 T:5828   ERROR: Previous line repeats 275 times.
20:49:01 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/iYQcFgHg4aWzozfVtqqrn6preRx.jpg
20:49:01 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C
20:49:01 T:5828   ERROR: Previous line repeats 47 times.
20:49:01 T:5828 WARNING: XFILE::CFileFactory::CreateLoader - Unsupported protocol(http) in http://cf2.imgobject.com/t/p/original/xwdGyVw5ELdfGMwpmN6D5Bk4THH.jpg
20:49:01 T:2240   ERROR: CD3DTexture::Create - failed 0x8876017C

any idea?

Thanks,
Mark
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,689
Joined: Oct 2003
Reputation: 169
Post: #43
You're out of GPU memory. No idea why it happens or why it crashes, but there's a ticket on trac - please add your details to that.

Cheers,
Jonathan

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
mselley Offline
Junior Member
Posts: 28
Joined: Oct 2011
Reputation: 0
Post: #44
Hi,

Ok I will do that.

Any ideas on the questions I posted in the two posts before that?

Thanks,
Mark
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 25,689
Joined: Oct 2003
Reputation: 169
Post: #45
The thumbs only cache as they're needed, yes - I don't see a problem with that to be honest. After all, you don't actually need to see them until, um, you see them.

Still, it'd be easy enough for an addon to be done up that could queue everything up I should think - it would require a little exposing of the texture cache, ofcourse, but that wouldn't be a problem (in some respects it would be useful for addons to queue up images before they'll be displayed for example).

Cheers,
Jonathan

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote