seo/sqlinsight-pro
1
0
Fork 0
Code Issues Pull requests Projects Releases 11 Packages Wiki Activity Actions

forum configure.py: survive nginx's 429 without a JSON body
Some checks are pending
CI / Integration (mcr.microsoft.com/mssql/server:2025-latest) (push) Blocked by required conditions
Details
CI / Integration (mcr.microsoft.com/mssql/server:2017-latest) (push) Blocked by required conditions
Details
CI / Integration (mcr.microsoft.com/mssql/server:2019-latest) (push) Blocked by required conditions
Details
CI / Integration (mcr.microsoft.com/mssql/server:2022-latest) (push) Blocked by required conditions
Details
CI / Build og unit tests (push) Successful in 1m1s
Details
CI / MSI-installer (push) Successful in 39s
Details

Browse source 
The nginx rate limiter in front of Discourse (web.ratelimited) answers 429
with an HTML page, so reading wait_seconds as JSON crashed the script
halfway through creating categories. Fall back to Retry-After or 10 s.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Søren Eggert Lundsteen Olsen 2026-09-30 10:44:35 +02:00
parent ce49866d2b
commit bffb17cc63
1 changed files with 7 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
deploy/forum/configure.py
View file

@ -89,8 +89,13 @@ def call(method, path, data=None):
return json.loads(text) if text else {} return json.loads(text) if text else {}
except urllib.error.HTTPError as error: except urllib.error.HTTPError as error:
body = error.read().decode() body = error.read().decode()
if error.code == 429: # Discourse rate limit: wait as told, then try again if error.code == 429: # rate limit: wait as told, then try again
time.sleep(json.loads(body).get("extras", {}).get("wait_seconds", 10) + 1) # Rails answers with JSON; the nginx limiter in front (web.ratelimited) with an HTML page.
try:
wait = json.loads(body).get("extras", {}).get("wait_seconds", 10)
except ValueError:
wait = int(error.headers.get("Retry-After") or 10)
time.sleep(wait + 1)
continue continue
sys.exit(f"{method} {path}: {error.code} {body[:300]}") sys.exit(f"{method} {path}: {error.code} {body[:300]}")
sys.exit(f"{method} {path}: stadig begrænset efter flere forsøg") sys.exit(f"{method} {path}: stadig begrænset efter flere forsøg")