Black lacquered cabinet with an open drawer of identical gold stencil cards and a small stack of saved gold coins on marble

Quick answer

Prompt caching cuts AI API costs by charging much less for the part of your prompt that repeats between requests. Put the fixed parts (instructions, examples, reference documents) at the start and keep them identical every time, then add the changing part (the new question or customer message) at the end. With OpenAI’s GPT-6.2 Astra, cached input costs $0.40 per million tokens instead of $8.

Key takeaways

  • Caching rewards repeated prompt starts. The matching part has to be exactly the same.
  • Fixed first, changing last: system instructions, examples and documents at the top; the new request at the bottom.
  • For chats, append new instructions to the conversation rather than editing earlier messages.
  • Small edits at the top, such as a timestamp or a changing name, can break the cache for everything after them.
  • Check your usage data for cached tokens to confirm it is working.

This guide supports our main article, GPT-6.2 Astra review: cheaper and efficient, but is it worth switching? When OpenAI launched GPT-6.2 Astra and Sol, it cut the cached input price by 60% compared with the previous Astra and recommended keeping prompt beginnings unchanged. If you run AI automations, chatbots or content tools through an API, this is one of the simplest ways to lower your bill.

📘 Main article: For Astra’s full pricing, benchmarks and tester reactions, read our GPT-6.2 Astra review.

What is prompt caching?

Every time you send a request to an AI model through its API, you pay for the input tokens (your prompt) and the output tokens (the answer). Many automations send the same long instructions every time, such as a 2,000-word style guide or a product catalogue, with only a short new question at the end.

Prompt caching means the provider remembers the start of a prompt it has seen recently. When the next request starts with exactly the same text, that repeated part is billed at a much lower cached input rate. Providers such as OpenAI, Anthropic and Google all offer a form of this, though the details and discounts differ.

How much can prompt caching save?

Here are OpenAI’s published GPT-6.2 rates per million tokens:

ModelNormal inputCached inputOutput
GPT-6.2 Astra$8$0.40$40
GPT-6.2 Sol$2$0.10$10

A simple illustration with made-up numbers: an automation sends a 10,000-token fixed brief plus a 500-token question, 1,000 times a month on Astra. The fixed brief alone is 10 million input tokens. Uncached, that part costs about $80. If it is cached, it costs about $4. Your real saving depends on how often the cache is hit and on output costs, which caching does not reduce.

💡 Tip: Output tokens are often the bigger cost. Pair caching with clear length limits on answers to keep both sides of the bill down.

How do I use prompt caching to cut AI API costs?

  1. List what repeats. Write down the parts of your prompt that are the same every time: role and rules, tone of voice, examples, reference text.
  2. Put the fixed parts first. Order your prompt as: instructions → examples → reference documents → the new request.
  3. Freeze the fixed text. Store it in one file or template and do not tweak it per request. Even changing a space or a date can break the match.
  4. Put changing details last. Customer names, today’s date, the new question and any per-request data go at the end.
  5. Append in conversations. In multi-turn chats, add new instructions as a new message instead of rewriting earlier ones, as OpenAI recommends for GPT-6.2.
  6. Batch similar jobs together. Caches usually expire after a period of inactivity, so running similar requests close together helps.
  7. Check the provider’s docs for minimum prompt lengths and how long caches last, because these vary.

What breaks the cache?

MistakeWhy it breaks cachingFix
Date or time at the top of the promptThe start changes every requestMove it to the end
Customer name in the system instructionsEvery customer gets a different prefixPut personal details in the final message
Editing the instructions oftenEach version is a new prefixVersion your template and change it deliberately
Shuffling examples or documentsOrder matters for an exact matchKeep a fixed order
Rewriting earlier chat messagesThe conversation start no longer matchesAppend new instructions instead

⚠️ Warning: Do not put private customer data in the fixed, cached part of a prompt just to save money. Keep personal details in the changing section and follow your provider’s data policies.

How do I check caching is working?

Most APIs report cached tokens in each response’s usage details and in the billing dashboard. Run the same prompt twice within a few minutes and compare: the second request should show a large number of cached input tokens. If it shows none, look for anything changing near the top of your prompt.

If you are also choosing between models, our main article on GPT-6.2 Astra shows why cost per task matters more than price per token, and our guide to comparing AI models on token cost helps you work it out.

Frequently asked questions

Does prompt caching change the answers?

No. It only changes how the repeated input is billed and how quickly it is processed. The model still reads the full prompt.

Do I need to switch it on?

It depends on the provider. Some apply caching automatically for long enough prompts; others need you to mark which parts to cache. Check your provider’s documentation.

Does caching work in the ChatGPT app?

Caching discounts apply to API billing. In the ChatGPT app you pay a subscription, though efficient prompts can still help your usage limits.

How much is cached input on GPT-6.2 Astra?

OpenAI lists $0.40 per million cached input tokens for Astra, against $8 for normal input. GPT-6.2 Sol is $0.10 against $2.

author avatar
Garry Knight
I'm Garry Knight, the person behind Prodify Digital. I write about email list building, email marketing, SEO, AI search and the tools that connect them. My aim is to make online marketing easier to understand, so creators and small business owners can make informed decisions about building an audience and keeping people engaged. Here you'll find straightforward guides and product reviews that explain what something does, where it fits and which limitations matter. The focus is on clear explanations and useful next steps—not hype, shortcuts or promises of easy earnings.

Leave a Reply