Skip to content

Don't expose token usage in streamed responses #6501

Discussion options

You must be logged in to vote

You can pass sendUsage to false

https://ai-sdk.dev/docs/reference/ai-sdk-core/stream-text#merge-into-data-stream.data-stream-options.send-usage

import { convertToCoreMessages, streamText, UIMessage } from "ai";
import { google } from "@ai-sdk/google";

export const maxDuration = 60;

export async function POST(req: Request) {
  const {
    messages,
  }: { messages: UIMessage[] } = await req.json();

  const result = streamText({
    model: google("gemini-2.0-flash"),
    system: "You are a helpful assistant.",
    messages: convertToCoreMessages(messages)
  });

  return result.toDataStreamResponse({ sendUsage: false });
}

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@Edwin-Luijten
Comment options

Answer selected by Edwin-Luijten
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Help
Labels
None yet
2 participants