[ijourneaux]

Guys

I am not sure where to post this but it appears that the downloading of Trailers from HD-Trailers.net is causing problems for the HD-Trailers web site.

http://blog.hd-trailers.net/2010/12/31/f...et+Blog%29

It looks like it might be coming from the IMDB or TMDB trailer scrapers that come use HD-Trailers.net to download scrapers.

Here are the comments from the HD-Trailer.Net group ( I reached out to them as I thought the problem might be coming from the HD-Trailers.NET Downloader appliction)

----

Thanks for getting in touch with us. When you say the HD Trailer Downloader, are you referring to this application?
http://hdtrailersdler.codeplex.com/
I understand how that application works by using our RSS feed. Our RSS Feed is actually hosted by Feedburner, so if that's the case, it shouldn't really affect us.

From our logs, I am seeing something very different:

203.219.133.254 - - [02/Jan/2011:19:27:13 -0800] "GET
/?s=\"Twilight%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520 "http://www.hd-trailers.net/blog/?s=\"Twilight%20%28Theatrical%20Trailer%29%
22" "XBMC/10.0 r35648 (Mac OS X; 8.8.2 i386; http://www.xbmc.org)"
75.152.97.115 - - [02/Jan/2011:19:27:14 -0800] "GET
/?s=\"How%20to%20Train%20Your%20Dragon%20%28Theatrical%20Trailer%29%22
HTTP/1.1" 403 520
"http://www.hd-trailers.net/blog/?s=\"How%20to%20Train%20Your%20Dragon%20%28
Theatrical%20Trailer%29%22" "XBMC/10.0 r35648 (Mac OS X; 10.5.0 i386; http://www.xbmc.org)"
173.64.144.192 - - [02/Jan/2011:19:27:14 -0800] "GET
/?s=\"The%20Take%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520
"http://www.hd-trailers.net/blog/?s=\"The%20Take%20%28Theatrical%20Trailer%2
9%22" "XBMC/10.0-rc2 r35566 (Windows; Windows 7, 64-bit (WoW) build 7600; http://www.xbmc.org)"
68.109.67.129 - - [02/Jan/2011:19:27:14 -0800] "GET /?s=\"The%20Lord%20of%20the%20Rings%20%2d%20The%20Two%20Towers%20%28Theatric
al%20Trailer%29%22 HTTP/1.1" 403 520
"http://www.hd-trailers.net/blog/?s=\"The%20Lord%20of%20the%20Rings%20%2d%20
The%20Two%20Towers%20%28Theatrical%20Trailer%29%22" "XBMC/10.0 r35648 (Mac OS X; 10.5.0 i386; http://www.xbmc.org)"
173.162.190.78 - - [02/Jan/2011:19:27:14 -0800] "GET
/?s=\"Snatch%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520
"http://www.hd-trailers.net/blog/?s=\"Snatch%20%28Theatrical%20Trailer%29%22
" "XBMC/10.0 r35647 (Windows; Windows Vista, 32-bit Service Pack 1 build 6001; http://www.xbmc.org)"
99.18.91.93 - - [02/Jan/2011:19:27:14 -0800] "GET
/?s=\"Timeline%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520 "http://www.hd-trailers.net/blog/?s=\"Timeline%20%28Theatrical%20Trailer%29%
22" "XBMC/10.0 r35648 (Linux; Ubuntu 10.10; 2.6.35-24-generic-pae i686; http://www.xbmc.org)"
213.65.93.82 - - [02/Jan/2011:19:27:14 -0800] "GET
/?s=\"Good%20Luck%20Chuck%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520 "http://www.hd-trailers.net/blog/?s=\"Good%20Luck%20Chuck%20%28Theatrical%20
Trailer%29%22" "XBMC/10.0 r35648 (Linux; Ubuntu 10.04.1 LTS - XBMCLive Dharma; 2.6.32-26-generic i686; http://www.xbmc.org)"
99.241.221.109 - - [02/Jan/2011:19:27:15 -0800] "GET
/?s=\"Havoc%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520 "http://www.hd-trailers.net/blog/?s=\"Havoc%20%28Theatrical%20Trailer%29%22"
"XBMC/10.0 r35647 (Windows; Windows 7, 64-bit (WoW) build 7600; http://www.xbmc.org)"
69.90.55.31 - - [02/Jan/2011:19:27:15 -0800] "GET
/?s=\"The%20Terminator%20%28Theatrical%20Trailer%29%22 HTTP/1.1" 403 520 "http://www.hd-trailers.net/blog/?s=\"The%20Terminator%20%28Theatrical%20Tra
iler%29%22" "XBMC/10.0 r35647 (Windows; Windows 7, 64-bit (WoW) build 7600; http://www.xbmc.org)"

Out of the last 10 request just now, 9 of them are from XBMC/10.0 clients and all of them are making search requests for post titles for trailers that are both new and old.
My guess is there must be some other mechanism involved in getting HD trailers for older movies off our blog, and somehow that ends up with by doing searches.
The funny thing is that it's searching off of post titles, and not movie titles [e.g. The Terminator (Theatrical Trailer) vs The Terminator]. I'm not even quite sure where it's getting the post titles from.
I have already created a mirror of blog.hd-trailer.net which I can provide for future XBMC clients once we have an actionable plan.

If you or someone who is actively working on this area can investigate to see who or what is making those search requests and see if there's a better way to get the same information, we'd be glad to offer any help.

Thanks!

//Toland (^_^x)
HD-Trailers.net

[spiff]

hi,

yes, part of our movie scraper procedure is fetching trailer links from your page. we do this through fetching

Code:

http://www.hd-trailers.net/blog/?s=<query>%20%28Theatrical%20Trailer%29%22

i guess one way to reduce your traffic would be a better form that only returns some simple xml (or even flat text would work fine for us) without all the html fluff.

thanks for contacting us instead of blocking us directly.

[ijourneaux]

Spiff

I will PM you with their contact email. Personally, I am not associated with HD-Trailers.Net. I just noticed that they were having a problem with XBMC.

[Baswazz]

Spiff check http://forum.xbmc.org/showpost.php?p=678...stcount=35

[VeNoMouSNZ]

This may be a stupid question,but why arn't you using the trailers posted on tmdb, most of them are youtube or apple trailers... and youtube is a hell of a lot faster then hd-trailers

[spiff]

because those aren't video links, they are links to a web page (that happens to embed a video). big difference.