- cross-posted to:
- technology@lemmy.zip
- cross-posted to:
- technology@lemmy.zip
You must log in or # to comment.
During that time, you can easily install Ollama on an old computer.
With a client like Oatmeal, you can save your session/ reload/delete as you wish; so your model remembers what you want.
I am running llama3.1:8b, it’s good enough for the day-to-day operations.
- Need for a spyware: 0
- Need to take screenshots of my desktop: 0
- Need to buy another computer for the hype chipset: 0
- Need of Microsoft bullshit: 0
My old computer is apparently “not good enough” for windows 11, but it’s surely good enough for my personal AI running on Linux though!
I tried llama3.1:8b and it’s absolutely horrible.
Interesting. A few questions, if I may.
Are you running ollama in the same system as the one consuming it ? If yes does it always run in background ? Does it impact performance of other applications when it runs in background?
No, Ollama is running on an old PC with a GeForce 1060 and 16gig of ram…
Yes, it’s a “webserver” running in the background exposing an API.
However, if I “top” my system, without chatting, it sits at 0% usage; it’s only when asking that the system peeks at around 55-70% CPU.
You have to understand there is 2 things here: the server and the model. The server is always running, but requires next to nothing in terms of resources.
The model is what computing your questions, this is the heavy part. It’s started on use, then after a delay, it’s closing.
TL;DR To answer your real question, you could use Ollama on the same system that you are using.
Regular windows user: uses PC
‘Roommate’ standing behind them: takes photo of screen
User: dude…
Roommate: what?
User: what the fuck?
Roommate: is ok… it’s so you can scan through them later and see what you’ve been doing
User:
Roommate:
User:
Roommate: takes photo of screen
User: the… fuck? that’s… that’s my credit card #
Roommate: oh…uhh…I was going to delete that
User: did you even notice it was there?!
Roommate: yes! I mean no! I mean…err
User:
Roommate:
User:
Roommate: takes photo
User: grabs baseball bat
Lawyers: “Generating music using a machine learning model trained using real artists’ music (without permission) does not violate those artists copyright!”
Therefore
Big Data: “Generating a black box replication of your identity trained on your private personal information and activity (without permission) does not violate your privacy!”
Noppeee. Very happy I switched to Linux. Despite how annoying all the hounding about it was, it’s galaxies better than the shitshow Windows 11 is becoming.
The nice thing IMO about Linux is that it’s “learn and forget”, you only need to learn things once (like sudo, apt-get or whete is the home dir and what is it), it won’t be randomly changed in an upcoming forced update.
And when shit is gonna change, you can downgrade to the older version, but even then, the changes always ends up being warned for a long ass time that “hey, X thing will change soon!”
The malicious thing about recall is, it doesn’t matter how much you protect yourself, every one you interact with has to protect themselves too, or your private chats are gonna land there anyway
Ah, surprised I didn’t think of that. Fuckin hell. There’s no good way to have a private conversation these days.
No seriously, I’m really trying to find a legit scenario where such tool is actually needed and I honestly can’t think on any.
There are plenty of tools out there to help you track your work so no need for any of this bullshit.
legit scenario where such a tool is actually needed
The “legit” reason has nothing to do with user experience and everything to do with Microsoft & their 874,289,532 advertising partners.
Regardless of the marketing spin they’re putting on it now - Recall will be used for mass data collection and training MS’s LLM. They’ll wait for enough adoption of Win11 & Recall before putting the “release of information” clause into their T&Cs.
Recall isn’t for users. It’s for Microsoft.
I don’t understand how businesses that use windows for employee laptops are not throwing a fucking tantrum. I would be.
They already said it will be off by default for all Enterprise editions of windows. They’re protecting their corporate buddies but normal users get fucked, as always.
Off by default. For now…
One step. The corps know it. It’s been happening for years. One step, then soon after you just accept that’s how it is. Then another step. And another. And another…
I think you misunderstand the relationship Microsoft has with corporations. If they turn on something like this after the fact while promising to do the opposite previously they will get thoroughly railed in court and then no one will ever buy their products ever again.
The reason that companies use Windows rather than running everything on Linux is the absolutely enormous support base that Windows has. The moment it becomes more problematic to use Windows than to just deal with the support issues of a Linux OS is the moment that everyone will switch to Linux.
Work in the space, I don’t misunderstand. Corps are one thing, what about the rest of civilization? Also some corps might even embrace as a means to spy on their employees work habits or something dystopian like that.
nope
