fix: coalesce concurrent cache-miss fetches (thundering herd) #75

New Issue

2026-07-02T00:20:17+10:00

unkinben commented

2026-07-02 00:20:17 +10:00

On a lock miss Engine.Fetch (internal/proxy/engine.go:77) sleeps a flat 500ms once, tries the store, and otherwise fetches upstream unlocked anyway. A cold-cache stampede still hits upstream N times. Use a store-poll loop up to the lock TTL and/or singleflight for in-process coalescing.

On a lock miss `Engine.Fetch` (`internal/proxy/engine.go:77`) sleeps a flat 500ms once, tries the store, and otherwise fetches upstream unlocked anyway. A cold-cache stampede still hits upstream N times. Use a store-poll loop up to the lock TTL and/or singleflight for in-process coalescing.

unkinben referenced a pull request that will close this issue

2026-07-02 00:44:09 +10:00

fix: coalesce concurrent cache-miss fetches (thundering herd) #93

unkinben referenced this issue from a commit

2026-07-02 00:44:10 +10:00

fix: poll the store on lock miss to coalesce cache-miss stampedes

benvin closed this issue

2026-07-02 22:08:30 +10:00

benvin referenced this issue from a commit

2026-07-02 22:08:30 +10:00

fix: coalesce concurrent cache-miss fetches (thundering herd) (#93)

Sign in to join this conversation.