OpenAI, the company behind the well-known AI chatbot ChatGPT, has achieved a significant internal improvement. Its engineers were able to reduce the cost of operating existing AI models by over 50 percent. This means the costs for processing requests have fallen sharply. This is comparable to a large baker suddenly having to pay only half for flour.
This cost reduction is more than just an internal note. It changes the distribution of power and money across the entire AI industry. Whoever can operate their models so much more cheaply has more room for price reductions. The company can also offer more features or achieve higher profits. This puts pressure on competitors who are still working with more expensive systems.
According to a media report by heise online, OpenAI engineers have found ways to significantly reduce the operating costs of their large AI models. This concerns the so-called inference costs. These are the costs incurred when a user sends a request to the AI model and it calculates a response. These costs could be reduced by more than half. Such improvements often happen in the background but are very important for profitability.
For you as a regular user, this could have several consequences. Your ChatGPT subscription could theoretically become cheaper. Or you could get more requests for the same money. It is also possible that OpenAI will invest the saved money in even faster and better models. This would mean that your AI assistants work even more smoothly and powerfully.
Companies that already use OpenAI models or develop their own AI solutions benefit directly. Their costs for AI services decrease. This relieves budgets and makes the use of AI in new areas cheaper. At the same time, this step increases pressure on the competition. Companies that are still working with more expensive models must follow suit. Otherwise, they will fall behind and lose their share of profits.
The biggest opportunity lies in making AI accessible to more people. If the use of AI becomes cheaper, more startups and smaller companies can access advanced models. This fosters new ideas and enables new applications that were previously too expensive. The development of specialized AI agents, which independently perform tasks like clever interns, also becomes truly attractive due to lower operating costs.
