- Fail over WebSocket inference turns to the next provider account after a pre-output upstream failure. - Return an upstream error only after all eligible provider accounts have failed.
- Fail over WebSocket inference turns to the next provider account after a pre-output upstream failure. - Return an upstream error only after all eligible provider accounts have failed.