FastAPI OpenAI compatible inference ?

[neowisard]

Should we expect FastAPI interface for inference like Kokoro , XTTSv2 ?
They can be used to replace OpenAI without additional programming in many products such as voice assistants, HomeAssistant etc.
Thank you for the work you have done.

[nshmyrev]

One day for sure. For now we are in R&D mode, working on the core architecture. Once done, it can be extended to various interfaces and languages. Expect an update soon!

[mitrokun]

If you are not afraid, you can try this solution
https://github.com/mitrokun/vosk_tts_hass