The field of Artificial Intelligence is rapidly advancing, with Major Language Models (LLMs) at the forefront of this progress. However, scaling these models presents significant challenges in terms of {computepower, storage, and setup. To address these hurdles, a robust framework for effectively managing LLM deployment is crucial. This framework s