unkin/argocd-apps
2
0
Fork 0
Code Issues 2 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

feat: increase litellm resources #144

Merged
unkinben merged 1 commits from benvin/litellm_resources into main 2026-05-23 17:59:44 +10:00
Conversation 0 Commits 1 Files Changed 3
+9 -9

1 Commits

Author SHA1 Message Date
unkinben a5e6f12003 feat: increase litellm resources
ci/woodpecker/pr/pre-commit Pipeline was successful
Details
ci/woodpecker/pr/kubeconform Pipeline was successful
Details 
finding litellm performance has dropped, crashed in multiple cases, and
then it had scaled to the maximum level using the majority of memory in
cluster.

- reduce the rate at which litellm autoscales
- increase the requests/limits to match usage
 2026-05-23 16:39:33 +10:00