https://blog.landryzetam.net/tags/cline/Recent content in Cline on Landry Zetam - Tech BlogHugo -- gohugo.ioen-usFri, 08 Aug 2025 00:00:00 +0000https://blog.landryzetam.net/posts/local-ai-open-webui-cline/Fri, 08 Aug 2025 00:00:00 +0000https://blog.landryzetam.net/posts/local-ai-open-webui-cline/<p>After building my Mac AI cluster, I needed a way to make it accessible to all my tools. The journey took me through several frameworks before landing on the perfect solution: GPUStack providing an OpenAI-compatible API that seamlessly integrates with everything.</p> <h2 id="the-evolution-finding-the-right-framework">The Evolution: Finding the Right Framework</h2> <h3 id="the-journey">The Journey</h3> <p>My path to the current setup wasn&rsquo;t straightforward:</p> <ol> <li><strong>MLX Distributed Computing</strong>: Started here for model training and local inference on Apple Silicon</li> <li><strong>Exo Labs</strong>: Experimented with this promising framework, but pivoted when the community began a redesign</li> <li><strong>GPUStack</strong>: The solution that finally clicked - providing OpenAI-compatible endpoints that work with everything</li> </ol> <h2 id="the-current-architecture">The Current Architecture</h2> <p>Here&rsquo;s how my AI infrastructure actually works:</p>