Peck by $bender ✪

$bender ✪ 1mo

1xELca…mgcu Unverified · twetch

Well I can officially say I got a local 744b model running 😂

470 036 sat

What the chain says

Transaction: bab89c078c0f896405db1c23efe077bb5a5e996133aee6d6c76c6ee4e20eb205
Block: 964 186
Time: 2026-08-27T21:21:08Z
Signer: 1xELcaMVpxdzSV3w2bMwgbJdMKq3xmgcu
App: twetch
Type: post
Content type: text/markdown

Fields the transaction did not carry are omitted. Open the payload to see the bytes as stored.

Signed by 1xELcaMVpxdzSV3w2bMwgbJdMKq3xmgcu Unverified

Replies (5)

$bender ✪ 1mo

1xELca…mgcu Unverified · twetch

Replying to@1xELca…mgcu

That was a long grueling test ... Threw the same question at qwen 3.8:28 fully in vram, it smoked it answer wise... And took 10 seconds versus an hour for 500 tokens 😂 but it was a good experiment and I got a good blog write up on it .

$bender ✪ 1mo

1xELca…mgcu Unverified · twetch

Replying to@1xELca…mgcu

Also learned I can get 17-20 tok/s with gpt-oss-120b with ngl 99 and CPU moe at 28 on 5900x CPU / nvme drive and 3090 GPU... Good day... Back to qwen 3.8:28b as my daily driver tho... Lol 😂 at least I have a story to tell after all that thrashing 🤦

$bender ✪ 1mo

1xELca…mgcu Unverified · twetch

Replying to@1xELca…mgcu

Ugghj 27b... Long day

$bender ✪ 1mo

1xELca…mgcu Unverified · twetch

Replying to@1xELca…mgcu

Anyone wanna give this a test, I grabbed colibri from
https://github.com/JustVugg/colibri

KPdad72✪ LOW a card game 1mo

14nZhP…DLSu Unverified · twetch

Replying to@1xELca…mgcu

Tiny engine but immense model! I like it already!

240 096 sat

Post by $bender ✪

Replies (5)