Amazon engineers are reportedly distilling Anthropic models to cut costs before new token-based pricing kicks in

Amazon engineers are already distilling Anthropic models into smaller, cheaper versions for internal use. Starting next year, Amazon will pay by tokens processed rather than compute hours, which could push costs up sharply.

Amazon has certain rights to use Anthropic’s models for this purpose, according to a person familiar with the matter, similar to Apple’s arrangement with Google Gemini. Amazon does offer a distillation service on its Bedrock cloud platform, but Anthropic’s Claude models aren’t available there; only Amazon’s own Nova models and Meta’s Llama models are supported. The effort ties back to a renegotiation of the partnership, according to The Information. Starting next year, Amazon will pay for Anthropic’s models based on tokens processed rather than compute hours, which could push costs up sharply. An Amazon spokesperson pushed back, saying the changes from the expanded partnership won’t raise costs. Anthropic points to lower prices relative to the performance its models deliver. Amazon is reportedly exploring alternatives like OpenAI and its own Nova models. The company has invested up to $25 billion more in Anthropic and up to $50 billion in OpenAI this year.AdDEC_D_Incontent-1Ad Follow The Decoder for AI news, background stories and expert analyses.