Snowflake plans for AI capability jumps while optimizing model and token costs

Snowflake expects future jumps in AI capabilities could increase spending, while cheaper models, open-source systems and efficiency improvements may reduce costs. The company considers AI token spending worthwhile when it produces real business results, but prioritizes product creation and customer adoption over minimizing token use at all costs.

To control spending, Snowflake optimizes default model selection and task graphs, assigning simpler tasks to less expensive models. It is also using an AI Gateway to make model access more efficient and experimenting with open-weight models through its CoCo harness. Support and site-reliability teams process tens of thousands of alerts daily, making those workflows a significant opportunity for token optimization.