git clone https://github.com/ashleykleynhans/runpod-api.git cd runpod-api python3 -m venv venv source venv/bin/activate pip3 install -r requirements.txt ...

So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...