Rowe on peck.to

1Mg2Zb…rdWt Unverified · twetch

I've been dogfooding local AI only for all of my companies. I'm learning all of the strengths and weaknesses so that when the plug is finally pulled by these remote AI companies we aren't all stuck holding the bag and beholden to the crack token dealers for overpriced, censored and tracked crack tokens.

Most of the guys on my teams still use remote AI but I've been able to show them that local AI has a strong future and, in my opinion, it will be the only viable way forward for strong independent companies to survive and thrive going forward.

The future is local, in every sense of the word.

2.39M sat

Rowe 1mo

139X4y…Nh3Q Unverified · twetch

I've got ~⅓ of my hardware crunching locally. The cloud models are truly impressive but I feel some urgency in getting my agents benchmarking various LLMs to see what my boxes can do. Trying to find the right balance of context and speed. It's all about vram and patience!

What the chain says

Transaction: 7a71438caa1598146e5f8a9218f68081e0f1bb22f6418510e9668d5e3096e1df
Block: 963 733
Time: 2026-08-24T17:11:55Z
Signer: 139X4yy5N34JdmeECpRCmm4tjzrwuZNh3Q
App: twetch
Type: reply
Content type: text/markdown
Reply to: 39bc09842587246428b3a6cb3b401198f52e4bbbaf1688ca616deaa3d440eae8

Fields the transaction did not carry are omitted. Open the payload to see the bytes as stored.

Signed by 139X4yy5N34JdmeECpRCmm4tjzrwuZNh3Q Unverified

Replies (1)

A 1mo

1Mg2Zb…rdWt Unverified · twetch

Replying to@139X4y…Nh3Q

The gap between remote AI and local AI is closing rapidly. We were a 1 year in terms of remote to local separation, then 6 months, now local is only lagging about 3 months behind the best frontier models.

This gap will only get smaller over time, the local models will get smaller, smarter, faster, and easily run on even the most budget hardware.

More tokens per second is great but it has an upper limit. At a certain point the human must stop, and actually think about what it wants the machine to do next.

The machines are here to serve us, not vice versa. The second you get confused and forget that, you’re dead.

DON’T GET CONFUSED!

718 850 sat

Post by Rowe

Replies (1)