Post by Admiral XYZ™

A 1mo
1Mg2Zb…rdWt Unverified · twetch

I've been dogfooding local AI only for all of my companies. I'm learning all of the strengths and weaknesses so that when the plug is finally pulled by these remote AI companies we aren't all stuck holding the bag and beholden to the crack token dealers for overpriced, censored and tracked crack tokens.

Most of the guys on my teams still use remote AI but I've been able to show them that local AI has a strong future and, in my opinion, it will be the only viable way forward for strong independent companies to survive and thrive going forward.

The future is local, in every sense of the word.

2.39M sat
1Pqguf…CTad Unverified · twetch

Any good resources for learning how to get a local setup running?

What the chain says
Block
963 733
Time
2026-08-24T17:12:27Z
Signer
1PqgufE2YSYkUfx8cWQEbFExZMpNmnCTad
App
twetch
Type
reply
Content type
text/markdown

Fields the transaction did not carry are omitted. Open the payload to see the bytes as stored.

Signed by 1PqgufE2YSYkUfx8cWQEbFExZMpNmnCTad Unverified

Replies (10)

A 1mo
1Mg2Zb…rdWt Unverified · twetch
Replying to@1Pqguf…CTad

Me. Ask away lol.

718 579 sat
1HSjHJ…sCcr Unverified · twetch
Replying to@1Mg2Zb…rdWt

What's your current goto and why?

A follow up question, if speed is not a major concern what cost is one looking at excluding running costs for the rig?

Final comment I'd be looking for code and general insights from the AI, nothing really much further than that, Oh and possibly giving it resources i.e context.

1Pqguf…CTad Unverified · twetch
Replying to@1HSjHJ…sCcr

What machines would you recommend at various price points?

For example:
$1k
$5k
$10k
$25k

A 1mo
1Mg2Zb…rdWt Unverified · twetch
Replying to@1Pqguf…CTad

Any Apple Silicon Mac with more than 16gb of ram will be the sub $1k to $4k range. This will run Qwen3.8-27b which is great.

Macbook Pro with 128gb of ram for $4k. Will be able to run DwarfStar which is my favorite.

More ram than that is currently to expensive to be worth it.

482 224 sat
Continue thread →
A 1mo
1Mg2Zb…rdWt Unverified · twetch
Replying to@1HSjHJ…sCcr

Qwen3.8-27b is amazing! It runs on almost anything. It’s not the fastest but it is very good. I’d recommend running it in LM Studio in developer mode as a server for opencode.

Let me know if you need help setting this up.

A 1mo

Any Apple Silicon Mac with more than 16gb of ram will be the sub $1k to $4k range. This will run Qwen3.8-27b which is great.

Macbook Pro with 128gb of ram for $4k. Will be able to run DwarfStar which is my favorite.

More ram than that is currently to expensive to be worth it.

1.68M sat
1Q9hAP…8iJc Unverified · twetch
Replying to@1Mg2Zb…rdWt

Do you use normal consumer computers to run the models locally?