Skip to main content

Posts

Featured

The I in LLM is for intelligence

  I've finally got DeepSeek running on my Nvidia 4070 and working through VS Code. Yea, yea, the cloud platforms are way faster and much better that trying to do this with a locally hosted model but. I have a i9-11900KB with an RTX 4070 as a daily driver but can't afford Yet Another Subscription. Originally, I planned to host Ollama and spent hours in vain trying to get that to live inside VS Code. Bottom line is that VS Code would never execute the tooling regardless of which plugin installed. I'd been running LM Studio on my laptop (Ultra 9 185H w/ 64G) and it worked.... v... e... r... r... y... s... l... o... w... l... y... So I tried that with the RTX 4070. This combination is workable. with a few gotchas. Of course, CoPilot will stupidly refuse to work with anything 'not cloud' hosted no matter what tweaks you try out. I get the feeling this is a design choice and not an oversight. There is always one critical piece missing or in the way (in the name of securit...

Latest Posts

Niyah - our first failure

Meet Jojo and Crash

Basel & Jodi

More Kittens?

Did someone say kittens?

Eclipse Pin-hole camera

When Will Google Home Have a Web Browser Option to View Nest Cams? (Update, it's there now)

Goodbye

AIRDROID (AKA MRS SHINY) part 2

AirDroid (aka Mrs Shiny)