reverse proxy server testing

Announcements about the database, website, and plugins.
netbrain
Posts: 7
Joined: Sun Mar 27, 2011 7:01 am

Re: reverse proxy server testing

Postby netbrain » Wed Apr 06, 2011 7:16 am

szsori wrote:
netbrain wrote:Why on earth are you guys using squid?!


I tried installing Photoshop as our proxy and for some reason it didn't work. (har?)

I believe Varnish only works on Windows using Cygwin. I'm guessing that probably decreases performance. If I'm wrong or if there's a better Windows based solution we can use, let us know and we'll look into it. Whatever we go with needs to work in both Windows and Linux, and needs to be able to easily installed and configured using information provided by us. Our long term goal is to allow people to run their own reverse proxies that are dynamically added/removed from our round-robin pool.


Well i can tell you this, varnish greatly improves caching, a large newspaper in my country substituted 12 squid proxies with 1 varnish installation. 1!!!

So how hard can it be to get a linux box to serve with varnish as reverse proxy? And why on earth are you dependent on a windows environment?

In addition, varnish is easy! varnish is open source, and it works brilliantly.... Go ahead and read some case studies.

MattS
Posts: 218
Joined: Sat Mar 27, 2010 12:17 am
Contact:

Re: reverse proxy server testing

Postby MattS » Wed Apr 06, 2011 9:43 am

netbrain wrote:
Well i can tell you this, varnish greatly improves caching, a large newspaper in my country substituted 12 squid proxies with 1 varnish installation. 1!!!

So how hard can it be to get a linux box to serve with varnish as reverse proxy? And why on earth are you dependent on a windows environment?

In addition, varnish is easy! varnish is open source, and it works brilliantly.... Go ahead and read some case studies.


Varnish doesn't have any peering capabilities which is a feature we plan to make use of. Eventually we'll have more than just the one proxy and peering means less work for the backend servers, kind of a roll-your-own cdn network if you will. Nothing against varnish (haven't used it myself but hear great things), it just doesn't have the features we want right now.

netbrain
Posts: 7
Joined: Sun Mar 27, 2011 7:01 am

Re: reverse proxy server testing

Postby netbrain » Wed Apr 06, 2011 11:04 am

Finally a descent explanation, thats all i wanted to hear :) Good luck with your cdn/caching solution.

billyboingo
Posts: 4
Joined: Tue Apr 12, 2011 1:22 pm

Re: reverse proxy server testing

Postby billyboingo » Tue Apr 12, 2011 1:25 pm

Any idea when this might be fixed? No love since the 7th of April :(

curl -L -v http://thetvdb.com/api/<apiKey>/series/83602/all
* About to connect() to thetvdb.com port 80 (#0)
* Trying 67.152.32.114... connected
* Connected to thetvdb.com (67.152.32.114) port 80 (#0)
> GET /api/<apiKey>/series/83602/all HTTP/1.1
> User-Agent: curl/7.19.7 (universal-apple-darwin10.0) libcurl/7.19.7 OpenSSL/0.9.8l zlib/1.2.3
> Host: thetvdb.com
> Accept: */*
>
< HTTP/1.1 302 Moved Temporarily
< Server: nginx
< Date: Tue, 12 Apr 2011 18:20:02 GMT
< Content-Type: text/html
< Content-Length: 154
< Connection: keep-alive
< Location: http://cache.thetvdb.com/api/<apiKey>/series/83602/all
<
* Ignoring the response-body
* Connection #0 to host thetvdb.com left intact
* Issue another request to this URL: 'http://cache.thetvdb.com/api/<apiKey>/series/83602/all'
* About to connect() to cache.thetvdb.com port 80 (#1)
* Trying 67.152.32.104... connected
* Connected to cache.thetvdb.com (67.152.32.104) port 80 (#1)
> GET /api/<apiKey>/series/83602/all HTTP/1.1
> User-Agent: curl/7.19.7 (universal-apple-darwin10.0) libcurl/7.19.7 OpenSSL/0.9.8l zlib/1.2.3
> Host: cache.thetvdb.com
> Accept: */*
>
* HTTP 1.0, assume close after body
< HTTP/1.0 301 Moved Permanently
< Server: nginx
< Date: Tue, 12 Apr 2011 07:34:57 GMT
< Content-Type: text/html; charset=iso-8859-1
< Location: http://cache.thetvdb.com:8080/data/series/83602/all/
< Vary: Accept-Encoding
< Content-Length: 260
< Age: 38706
< X-Cache: HIT from "TDB-lxProxy02"
< X-Cache-Lookup: HIT from "TDB-lxProxy02":80
< Via: 1.0 "TDB-lxProxy02" (squid/3.1.6)
< Connection: close
<
* Closing connection #1
* Issue another request to this URL: 'http://cache.thetvdb.com:8080/data/series/83602/all/'
* About to connect() to cache.thetvdb.com port 8080 (#1)
* Trying 67.152.32.104... Operation timed out
* Trying 66.148.124.30... Operation timed out
* couldn't connect to host
* Closing connection #1
curl: (7) couldn't connect to host
* Closing connection #0


Thanks!

crzykidd
Site Admin
Posts: 418
Joined: Sat Feb 16, 2008 4:48 pm

Re: reverse proxy server testing

Postby crzykidd » Tue Apr 12, 2011 4:10 pm

Where are you getting port 8080 from?

I don't believe we are handing that out anywhere..
thetvdb.com Site Admin

crzykidd
Site Admin
Posts: 418
Joined: Sat Feb 16, 2008 4:48 pm

Re: reverse proxy server testing

Postby crzykidd » Tue Apr 12, 2011 4:12 pm

Well actually. I don't believe we support going to /all/ No directory browsing allowed... however nginx seems to be mucking up the redirect. I will have to have Matt S. look at it. With that said directory browsing isn't allowed to pull down data. Use the API and get a direct link to the file you want.
thetvdb.com Site Admin

billyboingo
Posts: 4
Joined: Tue Apr 12, 2011 1:22 pm

Re: reverse proxy server testing

Postby billyboingo » Tue Apr 12, 2011 4:45 pm

According to the wiki it is supported...and worked right up until about a week ago...

<mirrorpath>/api/<apikey>/
|---- mirrors.xml
|---- languages.xml
|
|---- series/
| |---- <seriesid>/
| |---- <language>.xml (Base Series Record)
| |---- banners.xml (All banners related to this series)
| |
| |---- all/
| | |---- <language>.xml (Full Series Record)

BTW, I'm not adding the 8080, you will notice that comes through the redirects being followed...

billyboingo
Posts: 4
Joined: Tue Apr 12, 2011 1:22 pm

Re: reverse proxy server testing

Postby billyboingo » Tue Apr 12, 2011 4:46 pm

Just a bit more info, this url used to return a full xml listing for the specified series, not a directory listing.

billyboingo
Posts: 4
Joined: Tue Apr 12, 2011 1:22 pm

Re: reverse proxy server testing

Postby billyboingo » Tue Apr 12, 2011 4:48 pm

nvm...working now? lol

crzykidd
Site Admin
Posts: 418
Joined: Sat Feb 16, 2008 4:48 pm

Re: reverse proxy server testing

Postby crzykidd » Tue Apr 12, 2011 10:45 pm

Ahh I missed your <APIKEY> in the original request. I am guessing Matt S. fixed it.

There was a problem with the redirect if you didn't terminate the request with /

Sorry about the confusion.

Thanks,
thetvdb.com Site Admin