Explore if it makes sense to support SSE and possibly WS.
SSE Is used a lot in generative ai apis. And in most cases its relatively simple to create an abstraction over it and do the map of incoming stream but it adds a level on complexity that needs to be explored.
Explore if it makes sense to support SSE and possibly WS.
SSE Is used a lot in generative ai apis. And in most cases its relatively simple to create an abstraction over it and do the map of incoming stream but it adds a level on complexity that needs to be explored.