Thanks for taking the time.
So I’m not using a CLI. I’ve got the intelanalytics/ipex-llm-inference-cpp-xpu image running and hosting LLMs to be used by a separate open-webui container. I originally set it up with Deepseek-R1:latest per the tutorial to get the results above. This was straight out of the box with no tweaks.
The interface offers some controls settings (below screenshot). Is that what you’re talking about?
Those aren’t for sharpening. They’re for honing the blade. A sharp edge is thin enough to get bent out of shape during normal use, so the honing tip serves to straighten the edge, not sharpen it.
Mouse? I thought that was a koala all these times.
Well, not off to a great start.
To be clear, I think getting an LLM to run locally at all is super cool, but saying “go self hosted” sort of gloms over the fact that getting a local LLM to do anything close to what ChatGPT can do is a very expensive hobby.
Since half of everything is fake today, this is real.
Don’t worry. Her husband died in like 1985, and she lived off his government pension for 35 years.
My incredibly racist late grandmother asked me in 2020 if I was voting for “the other guy.”
Any suggestions on how to get these to gguf format? I found a GitHub project that claims to convert, but wondering if there’s a more direct way.
GO self-hosted,
So yours and another comment I saw today got me to dust off an old docker container I was playing with a few months ago to run deepseek-r1:8b on my server’s Intel A750 GPU with 8gb of VRAM. Not exactly top-of-the-line, but not bad.
I knew it would be slow and not as good as ChatGPT or whatever which I guess I can live with. I did ask it to write some example Rust code today which I hadn’t even thought to try and it worked.
But I also asked it to describe the characters in a popular TV show, and it got a ton of details wrong.
8b is the highest number of parameters I can run on my card. How do you propose someone in my situation run an LLM locally? Can you suggest some better models?
It was.
So was the episode of Silicon Valley that the above image is from. https://www.cracked.com/article_49720_kid-rocks-cameo-on-silicon-valley-is-going-viral-for-obvious-reasons.html
Nope. Mirrors show you what you looked like when you were 3-4 nanoseconds younger.
I thinks this would have been funnier if they showed the phone at the end.
That’s not even close to the worst of it.
You didn’t come into this world. You came out of it.
But a cattery couldn’t be used in a circuit. It only has a cathode.
Not sure if this is intentional or if the author doesn’t understand the source they’re parodying, but putting multiple brackets around a word (in this case "job”) in a conspiracy/political context can be interpreted as a antisemitic dogwhistle.
Edit: I hope you’ll read my careful wording in that I did not imply the author meant anything by this. I was simply bringing it up in case it was unintentional. I’ve since learned that some people use <<>> instead of quotes.
So we’re saying the plane crash vid is real too?
Jesus we’re cooked.
It was an especially interesting case because there was a question of whether the photographer lied about who actually took the picture. So he could either claim the monkey took it an lose the copyright or claim he took it and have it lose all value.