Streaming

Set "stream": true. To receive token usage at the end of the stream, set "stream_options": {"include_usage": true}. If you close the connection early, you pay for the prompt and the output already sent to you.