Add T/$ as indicator to measure the cost efficiency #401
Description
What would you like to be added:
Add Token/$ to gateway to measure the cost efficiency, indispensable for benchmarkings. Have no idea whether Envoy AI gateway supports this or not.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
- Design doc
- API change
- Docs update
The artifacts should be linked in subsequent comments.