Qwen3.5-35B-A3B-heretic-Q4_K_M is very good, and less than 24 GB.
80 t/s on a 3090, 35 t/s on an apple m4
ynniv
npub12a…x6fdh
2026-02-27 15:54:19 UTC
Author Public Key
npub12akj8hpakgzk6gygf9rzlm343nulpue3pgkx8jmvyeayh86cfrus4x6fdhSeen on
wss://nos.lolPublished at
2026-02-27 15:54:19 UTCEvent JSON
{
"id": "0817b8b7eefd6f09f24f215717b838b675052db97f39d56488ca25c15a5f7f6b",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1772207659,
"kind": 1,
"tags": [
[
"r",
"wss://relay.damus.io/"
],
[
"r",
"wss://nostr.wine/"
],
[
"r",
"wss://nostr.bitcoiner.social/"
],
[
"r",
"wss://nostr-pub.wellorder.net/"
],
[
"r",
"wss://nos.lol/"
],
[
"r",
"wss://relay.mostr.pub/"
],
[
"r",
"wss://relay.primal.net/"
],
[
"r",
"wss://eden.nostr.land/"
],
[
"r",
"wss://relay.ynniv.com/"
],
[
"r",
"wss://relay.snort.social/"
],
[
"r",
"wss://nostr.land/"
]
],
"content": "Qwen3.5-35B-A3B-heretic-Q4_K_M is very good, and less than 24 GB. \n\n80 t/s on a 3090, 35 t/s on an apple m4",
"sig": "50d42ee32730b468de5c5daf7caf5c984f7dbb7736498ead12344ed77c1ed31f8c2721c39734567df0472b80ca6670fe7c66dff4d0f54e922dbf98b98fe4ce00"
}