LLM Token Economy & Optimization

Prompt engineering’s hidden costs

Figure 1: Beam Search, Kantoria

Democratizing LLM and foundation models is probably one of the greatest achievements in the last few years. It means that for many use cases, LLM token economy & optimization will be imperative for the success of prompt engineering, similar to how SQL optimization was imperative for optimizing query run time and size.