Premise:
I come from the computer assembly world - https://stealthmachines.com - and in this world we utilized a concept of manufacturing called “just in time.” The same, it would seem, for code. Local AI is finally competing with cloud ai “just in time.” And per the video, it really is coming online “just in time.” Gone is the golden era of supplemented (read: getting more than you pay for) cloud-based ai assist. And to replace is a world where subscription fees don’t exist, only electricity cost and hardware.
As you might have seen me complaining around here about energy companies and what with that which everyone knows with respect to data centers, energy costs are going up under certain “black hat” scenarios. So we will need to leapfrog towards affordable, clean energy soon too. But, it is already much cleaner than cloud ai, that being local ai, in winter as the bot of your home will help to heat your home.
Any case, ours is not the only RAG agentic bot out there, there are many to choose from, and that’s mostly a good thing.
You’ve heard “if you don’t hold the keys it’s not yours,” now comes “if you don’t own the hardware, it isn’t yours” either. And finally, if you don’t see the local-only code, you can guess it’s not likely your privacy.
2nd Premise (which is really 1st)
The entire reason I’ve been on this bent since, well, years - I’ve known about the tremendous privacy problems of ANYTHING ai which connects to the internet - cloud ai, copilot, anything and everything that shares your process with the mothership is a huge privacy vulnerability. So our repo will migrate the more away from anything which is not privacy first.
My code isn’t yet better than much anyone else’s. In fact, this harness is quite clunky as of this writing. But, what I do have going for me is an emphasis on privacy. Privacy, privacy, privacy. And we’re not there yet, but we are more private than much everything else out there. Can’t wait to ditch ollama completely. And of course the point of this software is how customizable it is - not in the traditional sense, but because our bot is self-modifiable. Prompt-based customization. Cool! Stay tuned.
