Quantising is the equivalent of stuffing way too much into a bin then jumping up and down on it repeatedly to make the lid stay down :)
Qwen-8b can fit in vRam if you make it fit :)
Raison d'État
npub1mt…3ueyt
2026-02-06 10:46:26 UTC
in reply to nevent1q…w4tr
Author Public Key
npub1mts2l7rsvgpqxdc8sk39e50fpntw0p7eamq8pp3kek5h6k7qemzq83ueytSeen on
wss://nostr.momPublished at
2026-02-06 10:46:26 UTCEvent JSON
{
"id": "68b5aad970ae6269bedeaf6af5d9b19a0537d112c2c4e77008b51493dad39b51",
"pubkey": "dae0aff870620203370785a25cd1e90cd6e787d9eec0708636cda97d5bc0cec4",
"created_at": 1770374786,
"kind": 1,
"tags": [
[
"alt",
"A short note: Quantising is the equivalent of stuffing way too m..."
],
[
"e",
"43da09c0f9fef299bdb4044087d00273e01b1e1c524b33551c87e65d7095ce22",
"wss://nos.lol/",
"root",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170"
],
[
"e",
"b015339761252a78228e6f0f6396d12bde4ea859229c3f369a7136e60da22939",
"wss://nos.lol/",
"",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736"
],
[
"e",
"dc104ef9d9d73b1302a2da4a7dfd234abc9c47c710bb9321af7d1a90d648c94c",
"wss://nos.lol/",
"",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170"
],
[
"e",
"1a4964060a9666cb6ed45b3984014a2bc64c4e02dd6be68c7ec485f95f3ca834",
"wss://nos.lol/",
"",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736"
],
[
"e",
"31ad0f43522b64e10aad92e65732ddf7599ecb3e1493e0f71bd7d29a7a7c5c46",
"wss://nos.lol/",
"",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170"
],
[
"e",
"516c54189728e75e8002b64372e8bfe294b445b74c3017ed5b8109bf408d9cdd",
"wss://nos.lol/",
"",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736"
],
[
"e",
"165c7919aca19fcea5d29dad83ab14058d39ebdb8befc399aa1851fd494f754f",
"wss://nos.lol/",
"",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170"
],
[
"e",
"7170a2e92c47c33ac4e4bfff40aee8fd702b26133f578a2ca7f527abaca55c7e",
"wss://nos.lol/",
"",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736"
],
[
"e",
"d0d9a07bebecd929db91690d300c30fde6ecc340adf141808919830f488a73f5",
"wss://nos.lol/",
"",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170"
],
[
"e",
"b97e4a64726270c7f2e39a2c145ca2a60f9be6de1f062e455dc1b0fec96a4a30",
"wss://nos.lol/",
"reply",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736"
],
[
"p",
"c21b1a6cdb247ccbd938dcb16b15a4fa382d00ffd7b12d5cbbad172a0cd4d170",
"wss://relay.nostr.band/"
],
[
"p",
"c7fe92f80c516c0c54b15e8d256ac07281036d934ea1ff39fb0cd8a0fd677736",
"wss://nos.lol/"
]
],
"content": "Quantising is the equivalent of stuffing way too much into a bin then jumping up and down on it repeatedly to make the lid stay down :)\n\nQwen-8b can fit in vRam if you make it fit :)",
"sig": "41045b2f05b95ea7f9ecfbd73e0c0aba61ac5fffba0f72310e339690b0274351f0eac0e5ac43a3f34231de638eecb26b7567aee7284c50f7680c511b1554910c"
}