An iceberg image. The tip above the water has traditional IT server icons or be labeled "Predictable Cloud Costs." The massive, hidden portion underwater is made of glowing, interconnected nodes (representing a neural network) to symbolize the unseen, massive "Inference Costs."

The Cost of Inference

Artificial Intelligence, Economics of AI

How would you react if your AI costs went up an order of magnitude next month? AI promises productivity improvements in areas such as software code generation, but at what economic cost? Software budgets in large enterprises have traditionally been heavily skewed towards support and maintenance, with 60% or more of software budgets allocated to…