Hi,
Are there plans to add FastAPI as a server that is officially supported? For fetching chat responses it works totally fine, but I did not manage to get streaming to work with FastAPI's StreamingResponse class. Has anyone managed to do this or are there some inherent problems with this?
Best,
Vinzenz
Pay now to fund the work behind this issue.
Get updates on progress being made.
Maintainer is rewarded once the issue is completed.
You're funding impactful open source efforts
You want to contribute to this effort
You want to get funding like this too