Pages: [1] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 1 post(s) |
Messenger Of Truth
Butlerian Crusade
3
|
Posted - 2015.04.08 13:24:55 -
[1] - Quote
Every now and then I get a connection failure like this when I am connecting via CREST:
{'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Wed, 08 Apr 2015 10:44:57 GMT', 'content-type': 'application/json; charset=utf-8'} Gateway error communicating with EVE proxy
Is this a server error? Or is the server objecting to something I'm doing? |
Pete Butcher
KarmaFleet Goonswarm Federation
286
|
Posted - 2015.04.08 15:11:21 -
[2] - Quote
It may have something in common with https://forums.eveonline.com/default.aspx?g=posts&t=411697
http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool + Trade Advisor
|
Messenger Of Truth
Butlerian Crusade
3
|
Posted - 2015.04.09 07:28:32 -
[3] - Quote
I didn't get another one for quite a long time, but sure enough it did eventually come:
{'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Thu, 09 Apr 2015 00:05:09 GMT', 'content-type': 'application/json; charset=utf-8'} Gateway error communicating with EVE proxy
|
Pete Butcher
KarmaFleet Goonswarm Federation
286
|
Posted - 2015.04.09 07:48:16 -
[4] - Quote
Messenger Of Truth wrote:I didn't get another one for quite a long time, but sure enough it did eventually come: {'status': '502', 'x-cache-status': 'BYPASS', 'transfer-encoding': 'chunked', 'server': 'nginx/1.2.0', 'connection': 'keep-alive', 'date': 'Thu, 09 Apr 2015 00:05:09 GMT', 'content-type': 'application/json; charset=utf-8'} Gateway error communicating with EVE proxy
As stated in that topic, you might be overloading the proxy.
http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool + Trade Advisor
|
Messenger Of Truth
Butlerian Crusade
3
|
Posted - 2015.04.09 14:53:49 -
[5] - Quote
I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it. |
Pete Butcher
KarmaFleet Goonswarm Federation
286
|
Posted - 2015.04.09 15:17:06 -
[6] - Quote
Messenger Of Truth wrote:I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it.
That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows.
http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool + Trade Advisor
|
|
CCP FoxFour
C C P C C P Alliance
3972
|
Posted - 2015.04.09 15:47:20 -
[7] - Quote
Pete Butcher wrote:Messenger Of Truth wrote:I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it. That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows.
Could be unlucky and land on a proxy that another market scraper is hitting
@CCP_FoxFour // Technical Designer // Team Size Matters
Third-party developer? Check out the official developers site for dev blogs, resources, and more.
|
|
Pete Butcher
KarmaFleet Goonswarm Federation
286
|
Posted - 2015.04.09 16:02:33 -
[8] - Quote
CCP FoxFour wrote:Pete Butcher wrote:Messenger Of Truth wrote:I'm only using a single thread to do market data queries though - not even multiple threads. Foxfour says in that thread that the rate limit is ridiculously high so I would guess I'm not exceeding it. That theoretical limit is indeed high (for the time being), but the real limit is orders of magnitude lower (because of proxy), as explained later in that topic. Although it seems unlikely you reach it with a single thread, but who knows. Could be unlucky and land on a proxy that another market scraper is hitting
That's more likely. There's a ton of CREST apps out there nowadays.
http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool + Trade Advisor
|
Messenger Of Truth
Butlerian Crusade
3
|
Posted - 2015.04.10 10:22:03 -
[9] - Quote
Ah so this rate limit applies to the whole proxy then, rather than to individual clients? So regardless of the rate at which I pull data, I may run into this issue?
If that is the case then it seems like this is a standard behaviour that needs to be coded around (perhaps by pausing for some time then retrying). |
Ortho Loess
Pentag Blade Curatores Veritatis Alliance
56
|
Posted - 2015.04.19 14:42:49 -
[10] - Quote
Messenger Of Truth wrote:Ah so this rate limit applies to the whole proxy then, rather than to individual clients? So regardless of the rate at which I pull data, I may run into this issue?
If that is the case then it seems like this is a standard behaviour that needs to be coded around (perhaps by pausing for some time then retrying).
It's changing soon to have properly defined rate limits, which should kick in before the proxy gets overloaded.
In general, you'll want to get market data from public crest after then chage, not authed (no proxy to break, so slightly higher limit). Rate limit will be 150 req/s (should be able to get a whole region in around 3 minutes) |
|
|
|
|
Pages: [1] :: one page |
First page | Previous page | Next page | Last page |