Michael Ross Tech news on Nostr: Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, ...
Published at
2026-02-10 08:49:40 UTCEvent JSON
{
"id": "f2c9f4c3d0b477d16ae66620d73bd9a2ae42d57dcbfd9380272bf71e72390bbd",
"pubkey": "77e630fc4bcf66c012cae2a96c58be0c2f1e63fa3979ddf440df56381ab98b39",
"created_at": 1770713380,
"kind": 1,
"tags": [
[
"proxy",
"https://social.linux.pizza/users/MichaelRoss/statuses/116045472133107394",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc\n\nhttps://github.com/mostlygeek/llama-swap",
"sig": "da36c7e8e4202b3a8eec843dfe7e81e281f7aac74c00b93dc6911819241278ebfc612c2b43f9e15f2128f96360b41278c70c8a77d633932c503394d4a2f8bfe2"
}