Using a Mac Mini for AI inference is kind of a hack though and the software stack is pretty wonky, whereas these things are purpose-built x86 devices with warranties and support and whatnot.
Regardless, the math for self-hosting currently doesn't add up when compared to heavily-subsidized monthly offerings from OpenAI and Anthropic unless you absolutely can't have the data you're working with go across a wire (privacy, trade secrets, etc).
npub1mq…89t2u
2026-07-22 00:36:51 CEST
in reply to nevent1q…qv07
Author Public Key
npub1mq0yhecjvkafckuex2vq3fwp32vuy6u2e7jy5f0hc3mqsdu0sucqc89t2uPublished at
2026-07-22 00:36:51 CESTEvent JSON
{
"id": "ae0ab44a224975ab7ab944999dc9ba8890ea2a6bf88b352fca5a7b8241113a2e",
"pubkey": "d81e4be71265ba9c5b99329808a5c18a99c26b8acfa44a25f7c47608378f8730",
"created_at": 1784673411,
"kind": 1,
"tags": [
[
"e",
"2032653c4b2bcf983700ed13ec32d4fe1617bb894e08d612333ef5761dac33bd",
"",
"reply"
],
[
"p",
"18cb31d888053549b357e472aa1032fb1129ba66dbb01f059ee14501bece5cfd"
],
[
"p",
"61e039c81e13bc72c6a22519d27653ffc97479c88cc153e059c8a798f6e2e3be"
],
[
"p",
"e680d54294e8f8446b780d6c3d7e79d161ddf2e21b13018e6ee050fc8d23d765"
],
[
"p",
"8edd4dbd9ccebee34d3ae60cb08a5ca10aa788388808fcad3ee90adeb9a8f491"
],
[
"p",
"627b834d4ec8760473858afb609cd473faa68e5fe0183b18e1af2be6b2bad8bb"
],
[
"fedibridge",
"https://caekis.love/users/caekislove"
],
[
"proxy",
"https://caekis.love/objects/caf07798-1c60-4111-81d9-1197d56a9d76",
"activitypub"
],
[
"nofederate"
]
],
"content": "Using a Mac Mini for AI inference is kind of a hack though and the software stack is pretty wonky, whereas these things are purpose-built x86 devices with warranties and support and whatnot.\n\nRegardless, the math for self-hosting currently doesn't add up when compared to heavily-subsidized monthly offerings from OpenAI and Anthropic unless you absolutely can't have the data you're working with go across a wire (privacy, trade secrets, etc).",
"sig": "f5d76c8230de86a468ee39b92f97c133a39511d7f031360d6da43a05e279ea73b3822435da51dddb4d932d1aa99d0e9370c9692d2ff17d4df86aeeafd61a8386"
}