Depends alot on the machine specs, VRAM, RAM, CPU, GPU etc.
You can check model VRAM usage here:
https://apxml.com/tools/vram-calculator
Also people mostly run already trained models locally, since training a model from scratch requires far too much resources. You can however use tools like OpenWebUI to create a chat frontend for Ollama and then add knowledge base to the chat to help direct the conversation with additional data.
Ape Mithrandir
npub16d…kh6vy
2026-01-12 04:45:02 UTC
in reply to nevent1q…2m5s
Author Public Key
npub16dsu2ghu9yd363utyw7dejqc8rgx5ps7r4hxddrvx2x64dh73p7qqkh6vySeen on
wss://relay.damus.ioPublished at
2026-01-12 04:45:02 UTCEvent JSON
{
"id": "dacd42437a92b04fc13f3d02124d5e8c7a29304ea42c71a4065e501dadffa9e9",
"pubkey": "d361c522fc291b1d478b23bcdcc81838d06a061e1d6e66b46c328daab6fe887c",
"created_at": 1768193102,
"kind": 1,
"tags": [
[
"alt",
"A short note: Depends alot on the machine specs, VRAM, RAM, CPU,..."
],
[
"e",
"da1a97ebd76a6780ae75ba2128b7af40135111237ec9cbdd8f2c4dae816eeb72",
"wss://relay.damus.io/",
"root",
"0958a105df51f0f471ec1ab330c7ee6ad8a2c30e0e4109adf34012f8b17f2192"
],
[
"p",
"0958a105df51f0f471ec1ab330c7ee6ad8a2c30e0e4109adf34012f8b17f2192",
"wss://lockbox.fiatjaf.com/"
],
[
"r",
"https://apxml.com/tools/vram-calculator"
]
],
"content": "Depends alot on the machine specs, VRAM, RAM, CPU, GPU etc.\nYou can check model VRAM usage here:\nhttps://apxml.com/tools/vram-calculator\n\nAlso people mostly run already trained models locally, since training a model from scratch requires far too much resources. You can however use tools like OpenWebUI to create a chat frontend for Ollama and then add knowledge base to the chat to help direct the conversation with additional data. ",
"sig": "7601c6aa8cb1426165bde6161c9a230ee500f3067d7ff8c1d1c571d1c358dade8abd1cf8f4cf48d453818fda093474556abbfcf272980b7fe372cebac1e4b8e3"
}