Lab Session IV: Local running of LLM
Section outline
-
May 13th, Tuesday (16:30-18:30)
Local running of LLM
- Ollama
- OpenWebUI
- Infrastructure issues
- Computational resources
- Exercise: Connecting to LLM via REST API in Python
- Discussion