{"type":"rich","version":"1.0","author_name":"npub1mq0yhecjvkafckuex2vq3fwp32vuy6u2e7jy5f0hc3mqsdu0sucqc89t2u","author_url":"https://nostr.ae/npub1mq0yhecjvkafckuex2vq3fwp32vuy6u2e7jy5f0hc3mqsdu0sucqc89t2u","provider_name":"njump","provider_url":"https://nostr.ae","html":"Using a Mac Mini for AI inference is kind of a hack though and the software stack is pretty wonky, whereas these things are purpose-built x86 devices with warranties and support and whatnot.\n\nRegardless, the math for self-hosting currently doesn't add up when compared to heavily-subsidized monthly offerings from OpenAI and Anthropic unless you absolutely can't have the data you're working with go across a wire (privacy, trade secrets, etc)."}