realcaseyrollins ✝️ on Nostr: So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and ...
So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.
Published at
2026-06-27 04:59:53 CESTEvent JSON
{
"id": "563f377b313c9f9cdeceab5bb1365075fa4c639d75ae921270c24d109efeb617",
"pubkey": "01e77c1ba759449b3f48401c17607aa8a763326e5a9c8101ab474aa7a234a06a",
"created_at": 1782529193,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"gpu"
],
[
"t",
"huggingface"
],
[
"t",
"janai"
],
[
"t",
"llm"
],
[
"proxy",
"https://social.teci.world/objects/f56dc3c2-2e2f-4272-bed4-a80250d5c23d",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.",
"sig": "2f84ad156d4eabfd990a8cb01d72a9cb628f92127790a2cb6f8d820e5ccadd1e15cab9debfbf027afe561ae903c8f5ad60785a8f1a0d55c7c55fd37c98c63abc"
}
