Posts: 16,946
Joined: Feb 2011
Reputation:
256
Well that stale thingy is nothing special to nfs. If you use smb and kill the server during update it will nuke most of your items too i guess (nothing special in the nfs case here).
The thing with double added entries is interesting indeed (you could check the path on 2 identical entries in the movie info dialog and verify that it is equal ... remember nfs://ip:2049/foo != nfs://ip/foo - so even if those urls are equal based on what they connect too - they are not equal to our library). But also on that one i tend to think its a generic issue and not only related to nfs. *guessing*
AppleTV4/iPhone/iPod/iPad: HowTo find debug logs and everything else which the devs like so much:
click here
HowTo setup NFS for Kodi:
NFS (wiki)
HowTo configure avahi (zeroconf):
Avahi_Zeroconf (wiki)
READ THE IOS FAQ!:
iOS FAQ (wiki)
Posts: 148
Joined: Oct 2010
Reputation:
9
2014-03-26, 23:02
(This post was last modified: 2014-03-26, 23:17 by garretn.)
Did, the file entry isn't duplicated -- only the library entry in the movie table (which itself doesn't have path information). Both entries link to the same idFile in the files table. Setting the content type back to none and selecting to remove all library items in that path does clear them out, and scanning them back in after that gets rid of the duplicates.
-- And I agree, duplicates probably aren't related, however... --
Regarding NFS -- thats what I was implying. I wanted to see if I could reproduce the symptoms with a scenario that didn't really indicate an actual bug with libnfs itself (I wouldn't consider a stale NFS mount a bug with libnfs, it's really more of a hazard of using NFSv3 in general (where its not exactly uncommon)). There are certainly things that could be done to try and mitigate the issue, but that's not quite the same problem.
Discounting the reports from the downgraded libnfs (like mine, and some others), I've only come across two (if anyone has more, I'd appreciate a link!) reports of the original issue -- one of which doesn't actually provide any information, so it's difficult to for-certain associate it with the issue.
At the moment I suspect something in bossanova808's setup is producing a stale-mount-like case, or perhaps it really is just stale-mounts. I'd really like to see if he can reproduce it using the other NFS server software, since I can't reproduce the issue.
Posts: 3,588
Joined: Sep 2009
Reputation:
112
It initially happened with Frodo 12.3 on my master, wired HTPC. I did not try it for long on that as it killed my library so pretty low WAF on that!! But it definitely happened wired as well (stable as hell gigabit ethernet).
Since then pretty much all testing was laptop, wireless.
It probably is something like that indeed - bit it affects wired clients as well. If they go back to 1.6.3 they will have users losing libraries. If they stay with current they will have users without artwork. The first is probably worse...anyone without a library backup (I do mine daily via mysqldump)...will be very unhappy.
I don't think it's going to be a simple tweaking scenario....
Addons I wrote &/or maintain:
OzWeather (Australian BOM weather) | Check Previous Episode | Playback Resumer | Unpause Jumpback | XSqueezeDisplay | (Legacy - XSqueeze & XZen)
Sorry, no help w/out a
*full debug log*.
Posts: 3,588
Joined: Sep 2009
Reputation:
112
Yes the artwork issues do appear to be some new thing on top. At least I didn't notice it with any testing with the libnfs 1.3 back in until Beta2 came along.
Addons I wrote &/or maintain:
OzWeather (Australian BOM weather) | Check Previous Episode | Playback Resumer | Unpause Jumpback | XSqueezeDisplay | (Legacy - XSqueeze & XZen)
Sorry, no help w/out a
*full debug log*.
Posts: 148
Joined: Oct 2010
Reputation:
9
Sorry brazen1, the artwork comments and some details on this issue were/are split with another thread -- this was my fault.
Basically the issue as it stands is in Beta 1, libnfs was upgraded to version 1.6.1. With this version came the problems of randomly removing items (up to the entire library) on NFS shares, along with double entries when adding back items that were removed as a result of this issue. As a result of these problems, in builds newer then Beta2 libnfs was downgraded (for windows only!) back to the previous version which fixed the removed+duplicate items issues, but introduced the artwork issue.
For artwork, there is actually rhyme and reason to what's missing -- basically, any artwork that XBMC has to pull from an NFS share would be missing, and anything that was either already cached -- remembering that it only pulls this stuff *the first time* from the actual NFS share (with some exceptions that aren't terribly relevant) -- or simply not pulled from the NFS shares (remote images from online scrapers) will show fine.
The issue we're working on is the original issue, with libnfs 1.6.1 and the library problems. The artwork issue is a transient problem caused by a broken fix, so will simply go away once we resolve the original problem. The reports seem to indicate that the 1.6.1 problem is primarily an issue with windows-based NFS servers, however we've only two reported cases of that. I also use the windows XBMC build, but use a linux server on the back-end -- which so far hasn't shown any issues cleaning the library. Likewise, it's simply possible that I just haven't run into the issue yet. Bossanova808 did some testing that seems to indicate its not just Hanewin also, but afaik, still Windows.
I'd *really* like to know if anyone has the problem with a linux server as the backend.
Posts: 148
Joined: Oct 2010
Reputation:
9
boassanova808, did you ever get a chance to try 1.6.1 with allegro?
Posts: 1,550
Joined: Jan 2012
Reputation:
9
It seems like SMB is probably best atm for Windows environments. I am fully sold on OpenElec thanks to a fellow XBMC forum user and NFS works perfectly, in fact a lot better, than SMB. Unless you really need Windows on your htpc, possibly consider OE or XBMC on Ubuntu.
Server: Synology Diskstation 1511+ with 8x WD Red NAS 3TB drives, DSM 5.2
Main HTPC: Home Built i3, 8GB RAM, Corsair 128GB SSD, nVidia 630GTX, Harmony Home Control, Pioneer VSX-53, Panasonic VT30 65" 3D TV, Windows 10, Isengard
Bedroom HTPC: Zotac-ID 41 8GB RAM, 128GB SSD, Rii micro keyboard remote, Samsung HW-E550, Sony 32" Google TV, OpenElec 6.0 beta 4
Posts: 2,510
Joined: Dec 2012
Reputation:
216
Switching O/S to accommodate NFS isn't an option for many of us imo. Personally I use Windows on 1 PC to do EVERYTHING and I mean EVERYTHING including being an HTPC and a common everyday computer tasking many functions besides multimedia home theatre entertainment. I have added an AVR and some USB peripherals. There is nothing a NAS, standalone, or Linux/Unix/OpenElec, etc O/S is going to do more efficient, with ease of use, functionality, economically or popularity than my little ol' W7 PC aside from this XBMC NFS Windows issue and I can back that statement up.
SMB was ok for DVD material in the past. Not anymore. Streaming Blu-Ray WiFi with the best of routers and adapters is still impossible. Using AC1900 right now. Some titles work without buffering, some don't. NFS helps a bunch. Powerline adapters are also finicky. Wired there is no problems but many of us cannot add Ethernet cable throughout our homes so we depend on WiFi and that Wifi depends on NFS now and that NFS depends on Windows. Well, Microsoft gave up on NFS. It isn't even included in Windows anymore. So, we go to a 3rd party (Hanewin). I've been using it long enough to know it works better than SMB, it's simple, and I like it.
The point is, switching O/S from Windows to something more easily compatible with NFS is out of the question for users like me. I will use the broken functionality of libnfs and or an XBMC backward version before I would ever change my O/S or add a standalone device. It would be a step backward, not forward. Please pursue this issue and don't give up on it. I don't write code and I am not as techy as others here but I can follow directions and offer help where I can.
Posts: 148
Joined: Oct 2010
Reputation:
9
Lets give him the benefit of the doubt, he probably just meant SMB is your best bet *in Gotham* if we can't get this worked out.
I've no intention of giving up on it at the moment, being still early diving into the issue if that makes anyone feel better. However I've still not managed to reproduce the issue in the same way it's been reported, so it might fall on you guys that do have the issue to do some testing. At the moment it'd help with diagnosing the problem if it can be reproduced on either linux, or on windows using the allegro nfs server.
So far the only testing I've seen (unless I misread somewhere) with Allegro was in regards to the Art issue, and not the original problem, with the original problem being reported with Hanewin in both cases. If we can narrow it down, we should have better luck reproducing the problem, so it can actually be fixed.
Posts: 944
Joined: Oct 2011
Reputation:
64
gibxxi
Posting Freak
Posts: 944
garretn, I doubtless am not alone in hoping you get to the bottom of this. I'm a hardware-leaning sort of PC geek, but 99.5% of my knowledge/experience is with Windows (Right back to about '92-'93). I know very little about Linux. I know enough to do basic maintenance of my ReadyNAS devices over SSH, but that's my limit.
To the point... I've been using NFS on Frodo for the past 12 months. I switched over to it at that time, as back them I was using a Wireless adapter with my HTPC and access latency / overall throughput was a bit lacking (Wireless-G back then). I've since dabbled with Powerline, Powerline AV-500, a Wired connection to a Netgear WNCE4004 Wireless Acces Point/Bridge and now a D-Link DAP1522/B Wireless-N (300) Access Point / Bridge. The router is a WNDR3200 (Also Wireless-N 300 AFAIK).
I've not 'seen' issues with library files going AWOL as far as i've noticed, what I have witnessed on Frodo is problems with cdART Manager sometimes not saving files it downloads back to the NAS (CD artwork, folder.jpgs, fanart / etc) evidenced by blank areas when it shows you downloaded art at the end of a run. At the time I put this down to permissions on some of the folders on the NAS not being set properly by some of the apps in use outside of XBMC <cough!>Headphones</cough!> so put that issue down to this. The thing being when I did get a blank image post cdART Manager run, on that system, usually it was 1-2 images, tops.
Likewise in Beta 1 (albeit for the limited amount of time I was playing around with it before Beta 2) I was getting multiple entries for the same album, like has been mentioned in this thread, but again I put that down to some albums having tracks that were extras, or that release I have not having been uploaded to MusicBrainz. Corrected two entries for two CD's I own just this week to correct issues like this.
But Since Beta 2, no artwork over 300*300px (approx) for the Music Library would load. About 80% of the entire library had no artwork. But, some of it was working. Funny thing is, all the backdrops / thumbnails, and poster art for Movies was working fine. But then again, having done a clean install, this may well have been because of Artwork Downloader / tinyMediaManager is/was using remote links for artwork in the nfo files for Movies / TV rather than the local files. I didn't think to check. Now i'm back on SMB since it looked like NFS being a long-term breakage. That's been the sum total of my experiences up till this point.
I will point out that I was using a MySQL Db also running on the NAS through the Eden-Frodo period. But the additions to Gotham make library scraping so terminally slow over MySQL, i've disabled this too now. The convienience of not having to update 3+ installs manually was being severely offset by the length of time required for a single scan to complete (12 hours+ for 25,000 track library or thereabouts). Movies are/were still as swift as they've always been with local nfo files, and not really too shabby (even with MySQL) using remote info.
Posts: 944
Joined: Oct 2011
Reputation:
64
gibxxi
Posting Freak
Posts: 944
2014-03-28, 01:02
(This post was last modified: 2014-03-28, 01:03 by gibxxi.)
One thing I am somewhat confused by In Gotham is the fact that cdART Manager seems to be matching very few of my artists with the MusicBrainz server, even though my collection has recently been pushed through Picard for the first time. So now I'm getting only about 6 artist matches with a better organized library than I was getting on Frodo with a reasonable (but typically not MusicBrainz compliant) library. I'm mentioning this because I'm sure I read a post somewhere about some of the network time-outs people are commenting about, not being limited to NFS alone, but also SMB for Windows users.
I'm going to do another read-through of the cdART Manager thread before I lay the blame for this side-issue at Gotham OR cdART Manager though.