Large Language Models (LLMs) have rapidly taken the spotlight in a wide range of fields over the past few years. At Pruna, the focus has been clear: make these models smaller, faster, cheaper, and greener. To make this possible, the team has explored and provided different optimization techniques, from caching and model compilation to advanced...