DataChef has always relied on public cloud services to develop its data projects. However, the rapid growth in the use of AI models such as LLM (Large Language Model) and generative AI, brought new challenges to the training process of the models, it became necessary to access high-performance computing resources that allow shorter development cycles and faster results.

To validate their beliefs and solidify their partnership, DataChef and decided to embark on a joint pilot project. The main objective was to test an LLM (Large Language Model) in an HPC environment, aiming to achieve results beyond what can be accomplished in public clouds.

The project involved deploying an app that utilizes the power of LLM embeddings to perform semantic searches on Wikipedia’s English content. By specializing in semantic research, DataChef aimed to enhance the accuracy and efficiency of its data analysis.

LuxProvid provided a Kubernetes cluster instance within their Cloud module. Additionally, GPU (Graphic Processing Unit) allocation was facilitated through the GPU accelerator module, enabling DataChef to leverage powerful computing capabilities.

In conclusion, combining LuxProvide’s HPC and data expertise with DataChef’s knowledge in data science has revolutionized their approach to AI projects. They have achieved exceptional results and experienced the reliability, security, and scalability that LuxProvide’s infrastructure provides.