- cross-posted to:
- technology@lemmy.zip
- cross-posted to:
- technology@lemmy.zip
You must log in or # to comment.
During that time, you can easily install Ollama on an old computer.
With a client like Oatmeal, you can save your session/ reload/delete as you wish; so your model remembers what you want.
I am running llama3.1:8b, it’s good enough for the day-to-day operations.
- Need for a spyware: 0
- Need to take screenshots of my desktop: 0
- Need to buy another computer for the hype chipset: 0
- Need of Microsoft bullshit: 0
My old computer is apparently “not good enough” for windows 11, but it’s surely good enough for my personal AI running on Linux though!
I tried llama3.1:8b and it’s absolutely horrible.
Interesting. A few questions, if I may.
Are you running ollama in the same system as the one consuming it ? If yes does it always run in background ? Does it impact performance of other applications when it runs in background?
No, Ollama is running on an old PC with a GeForce 1060 and 16gig of ram…
Yes, it’s a “webserver” running in the background exposing an API.
However, if I “top” my system, without chatting, it sits at 0% usage; it’s only when asking that the system peeks at around 55-70% CPU.
You have to understand there is 2 things here: the server and the model. The server is always running, but requires next to nothing in terms of resources.
The model is what computing your questions, this is the heavy part. It’s started on use, then after a delay, it’s closing.
TL;DR To answer your real question, you could use Ollama on the same system that you are using.
Regular windows user: uses PC
‘Roommate’ standing behind them: takes photo of screen
User: dude…
Roommate: what?
User: what the fuck?
Roommate: is ok… it’s so you can scan through them later and see what you’ve been doing
User:
Roommate:
User:
Roommate: takes photo of screen
User: the… fuck? that’s… that’s my credit card #
Roommate: oh…uhh…I was going to delete that
User: did you even notice it was there?!
Roommate: yes! I mean no! I mean…err
User:
Roommate:
User:
Roommate: takes photo
User: grabs baseball bat
Lawyers: “Generating music using a machine learning model trained using real artists’ music (without permission) does not violate those artists copyright!”
Therefore
Big Data: “Generating a black box replication of your identity trained on your private personal information and activity (without permission) does not violate your privacy!”
Noppeee. Very happy I switched to Linux. Despite how annoying all the hounding about it was, it’s galaxies better than the shitshow Windows 11 is becoming.
The nice thing IMO about Linux is that it’s “learn and forget”, you only need to learn things once (like sudo, apt-get or whete is the home dir and what is it), it won’t be randomly changed in an upcoming forced update.
And when shit is gonna change, you can downgrade to the older version, but even then, the changes always ends up being warned for a long ass time that “hey, X thing will change soon!”
The malicious thing about recall is, it doesn’t matter how much you protect yourself, every one you interact with has to protect themselves too, or your private chats are gonna land there anyway
Ah, surprised I didn’t think of that. Fuckin hell. There’s no good way to have a private conversation these days.
Ahh yes, I like to start my Saturday morning with a little horrors beyond human comprehension.
No seriously, I’m really trying to find a legit scenario where such tool is actually needed and I honestly can’t think on any.
There are plenty of tools out there to help you track your work so no need for any of this bullshit.
legit scenario where such a tool is actually needed
The “legit” reason has nothing to do with user experience and everything to do with Microsoft & their 874,289,532 advertising partners.
Regardless of the marketing spin they’re putting on it now - Recall will be used for mass data collection and training MS’s LLM. They’ll wait for enough adoption of Win11 & Recall before putting the “release of information” clause into their T&Cs.
Recall isn’t for users. It’s for Microsoft.
I don’t understand how businesses that use windows for employee laptops are not throwing a fucking tantrum. I would be.
They already said it will be off by default for all Enterprise editions of windows. They’re protecting their corporate buddies but normal users get fucked, as always.
Off by default. For now…
One step. The corps know it. It’s been happening for years. One step, then soon after you just accept that’s how it is. Then another step. And another. And another…
I think you misunderstand the relationship Microsoft has with corporations. If they turn on something like this after the fact while promising to do the opposite previously they will get thoroughly railed in court and then no one will ever buy their products ever again.
The reason that companies use Windows rather than running everything on Linux is the absolutely enormous support base that Windows has. The moment it becomes more problematic to use Windows than to just deal with the support issues of a Linux OS is the moment that everyone will switch to Linux.
Work in the space, I don’t misunderstand. Corps are one thing, what about the rest of civilization? Also some corps might even embrace as a means to spy on their employees work habits or something dystopian like that.
I actually really doubt it’d ever go on by default for enterprise installations. One tiny slipup in GPO and IT departments could end up with the most massive explicit data leak in history, many many companies and governments working with very sensitive data would drop all Microsoft products in a heartbeat. Microsoft knows that is an impossible sell and really not worth the squeeze vs just shoving a larger dildo up the private consumer’s ass.
Not every business uses enterprise. I suspect quite a few use pro.
I checked my work laptop running W11. Recall was installed and enabled. No copilot+. IT had no idea. Disabled it right away.
Ours is. Last I heard, our Client Management team is already looking for different ways to disable it and make triple sure it stays off.
(inb4 “Switch to Linux”: several thousand users, specialised software and a technologically conservative company would already make that a non-starter)
I don’t disagree that it would be tough, but they had to start from nothing when choosing Windows originally. It all had to be learned and built up at some point. It can again, and hopefully on an open platform that won’t fuck them over in the future. (I know, there’s no chance, but there should be.)
Everyone always complains that whatever they want isn’t on Linux. Well, it wasn’t on Windows at some point either. Make a user-base for it on Linux or make it yourself. Someone did it in the past. It can be done again.
Inertia is a hell of a thing to try and overcome. It’s a big deal for most companies to change out an important piece of software, let alone an entire OS and everything that comes with it. It could happen one day, I just don’t expect to see it.
nope
Oh good.
