Scaleway Blog Distributed ML model inference

Let's explore the challenges and solutions associated with the use of large language models (LLMs) in 2024, in particular the costs associated with inferring these models.