Code

Rate Limiting with Redis#83

Code

Merged

jurmy24 merged 22 commits intodevelopmentTanzania-AI-Community/twiga:developmentfrom feature/rate-limitingTanzania-AI-Community/twiga:feature/rate-limitingCopy head branch name to clipboardJan 30, 2025

+373-97

Commits

Commits on Jan 25, 2025

• feat (WIP) : in memory rate limiting (user daily message limit, app daily limit)

  Show description for 11871e5
  fredygerman

  committed
  11871e5

  Copy full SHA for 11871e5

• feat : rate limiting using redis

  fredygerman

  committed
  b457bcb

  Copy full SHA for b457bcb

• feat : scheduler for reseting rate limits

  fredygerman

  committed
  f476156

  Copy full SHA for f476156

• misc : logging

  fredygerman

  committed
  5ebc539

  Copy full SHA for 5ebc539

• feat : getting rate limiting & scheduler variables from env

  fredygerman

  committed
  74f5200

  Copy full SHA for 74f5200

• feat : cli command to reset redis on rate limits

  fredygerman

  committed
  9113280

  Copy full SHA for 9113280

• feat : getting redis url from env

  fredygerman

  committed
  a1de7fd

  Copy full SHA for a1de7fd

• feat : log limits data before reseting

  fredygerman

  committed
  2b40201

  Copy full SHA for 2b40201

• feat : capturing token usage for daily limits

  fredygerman

  committed
  c5b5d81

  Copy full SHA for c5b5d81

• misc : logging

  fredygerman

  committed
  65dbeb3

  Copy full SHA for 65dbeb3

• fix : cli for reseting usage errors

  fredygerman

  committed
  29665fb

  Copy full SHA for 29665fb

• feat : added redis on docker compose

  fredygerman

  committed
  6b86319

  Copy full SHA for 6b86319

Commits on Jan 26, 2025

• fix : redis default address

  fredygerman

  committed
  04c89f1

  Copy full SHA for 04c89f1

Commits on Jan 28, 2025

• feat : server health check, updated db health check

  fredygerman

  committed
  647d038

  Copy full SHA for 647d038

• misc : rate limiting clean up, improved variables naming

  fredygerman

  committed
  bad7a65

  Copy full SHA for bad7a65

Commits on Jan 29, 2025

• misc: remove unused test_query and redis from docker-compose

  jurmy24

  committed
  8dde8ce

  Copy full SHA for 8dde8ce

• feat: rebuild config for rate limiting and different environments

  jurmy24

  committed
  11c257d

  Copy full SHA for 11c257d

• feat: modify rate limiting to time to live with a 24 hr sliding window instead of a cron job

  jurmy24

  committed
  f9dbdd9

  Copy full SHA for f9dbdd9

• misc: remove cron job stuff from cli

  jurmy24

  committed
  17252c0

  Copy full SHA for 17252c0

• fix: relocate redis keys and update config to hide precious rate limit info

  jurmy24

  committed
  6bcc5d7

  Copy full SHA for 6bcc5d7

• refactor: move cli to scripts folder where it belongs

  jurmy24

  committed
  20d66d6

  Copy full SHA for 20d66d6

Commits on Jan 30, 2025

• fix: remove token code from llm_service as it isn't used

  jurmy24

  committed
  d9f6d17

  Copy full SHA for d9f6d17