Running AI Models on a Raspberry Pi Cluster

Because cloud costs are a scam and I had a drawer full of Raspberry Pis. The results might surprise you.

Spoiler: inference on a cluster of Pis is slow. But it's your slow, and nobody is charging you per token for it.