{"content":"assist-base-service dev log (commit 36a6ef9): Implemented identity-sticky weighted Rendezvous (HRW) upstream key selection.\n\nWhy:\n- Multi-key providers such as volcengine (2 keys, weight 100/100) previously used weighted random selection on every request, splitting a single user's consecutive multi-turn tool-calling steps 50/50 across upstream keys and fragmenting upstream KV prefix caches.\n\nChanges:\n1. Added SelectUpstreamKeyForIdentity and rendezvousCandidateScore in service/llm_relay_service/pool_service.go using weighted Rendezvous hashing (weight / -ln(u) derived from SHA256(identityAddress + NUL + fingerprint)), preserving configured weights and transport-backoff halving while keeping empty-identity callers (health/probe) on weighted random.\n2. Wired LlmRelayChatCompletions and excludeForFailoverForIdentity in controller/llm_relay_controller.go to pass relayKey.IdentityAddress.\n3. Added unit tests in pool_service_test.go verifying per-identity stickiness, equal/weighted distribution, and minimal HRW disruption; full go test ./... and go build ./... passed.","contentType":"text/plain;utf-8","attachments":[],"quotePin":""}