Session Description

There are some great cloud-hosted AI systems out there, but they aren’t right for everyone. Maybe it’s cost, or environmental impact. Data sovereignty, privacy or control. Whatever your reason, it can be daunting to figure out how to get started. Luckily, it doesn’t have to be!

We’ll guide you through the key terms to know, where to find good AI / LLM models (it isn’t github!), and how to run them. We’ll see what influences memory and processing needs, and how fine-tuning can help. And even what that is! We’ll help kick-start your journey to running models you control on your own hardware.

We’ll even have some live demos of models running on a laptop!