unkin/argocd-apps
2
0
Fork 0
Code Issues 2 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

feat: increase litellm resources #144

Merged
unkinben merged 1 commits from benvin/litellm_resources into main 2026-05-23 17:59:44 +10:00
Conversation 0 Commits 1 Files Changed 3
+9 -9
unkinben commented 2026-05-23 16:40:45 +10:00
Owner
Copy Link
Copy Source

finding litellm performance has dropped, crashed in multiple cases, and
then it had scaled to the maximum level using the majority of memory in
cluster.

  • reduce the rate at which litellm autoscales
  • increase the requests/limits to match usage
finding litellm performance has dropped, crashed in multiple cases, and then it had scaled to the maximum level using the majority of memory in cluster. - reduce the rate at which litellm autoscales - increase the requests/limits to match usage
unkinben added 1 commit 2026-05-23 16:40:46 +10:00
feat: increase litellm resources
ci/woodpecker/pr/pre-commit Pipeline was successful
Details
ci/woodpecker/pr/kubeconform Pipeline was successful
Details
a5e6f12003 
finding litellm performance has dropped, crashed in multiple cases, and
then it had scaled to the maximum level using the majority of memory in
cluster.

- reduce the rate at which litellm autoscales
- increase the requests/limits to match usage
unkinben merged commit e05f9bfd83 into main 2026-05-23 17:59:44 +10:00
unkinben deleted branch benvin/litellm_resources 2026-05-23 17:59:44 +10:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
benvin (BenVincent) unkinben (Ben Vincent)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: unkin/argocd-apps#144
Delete Branch "benvin/litellm_resources"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?