Oobabooga's text-generation-webui is the most popular open-source interface for running large language models locally on consumer hardware. It supports Llama Mistral Falcon and hundreds of other models with an intuitive chat interface and API. Essential tool for developers and researchers running private local LLMs.