“The real benchmark is: the world growing at 10 percent,” he added. “Suddenly productivity goes up and the economy is growing at a faster rate. When that happens, we’ll be fine as an industry.”
Needless to say, we haven’t seen anything like that yet. OpenAI’s top AI agent — the tech that people like OpenAI CEO Sam Altman say is poised to upend the economy — still moves at a snail’s pace and requires constant supervision.
That is not at all what he said. He said that creating some arbitrary benchmark on the level or quality of the AI, (e.g.: as it’s as smarter than a 5th grader or as intelligent as an adult) is meaningless. That the real measure is if there is value created and out out into the real world. He also mentions that global growth is up by 10%. He doesn’t provide data that correlates the grow with the use of AI and I doubt that such data exists yet. Let’s not just twist what he said to be “Microsoft CEO says AI provides no value” when that is not what he said.
I think that’s pretty clear to people who get past the clickbait. Oddly enough though, if you read through what he actually said, the takeaway is basically a tacit admission, interpreted as him trying to establish a level-set on expectations from AI without directly admitting the strategy of massively investing in LLM’s is going bust and delivering no measurable value, so he can deflect with “BUT HEY CHECK OUT QUANTUM”.
AI is the immigrants of the left.
Of course he didn’t say this. The media want you to think he did.
“They’re taking your jobs”
Correction, LLMs being used to automate shit doesn’t generate any value. The underlying AI technology is generating tons of value.
AlphaFold 2 has advanced biochemistry research in protein folding by multiple decades in just a couple years, taking us from 150,000 known protein structures to 200 Million in a year.
Well sure, but you’re forgetting that the federal government has pulled the rug out from under health research and therefore had made it so there is no economic value in biochemistry.
How is that a qualification on anything they said? If our knowledge of protein folding has gone up by multiples, then it has gone up by multiples, regardless of whatever funding shenanigans Trump is pulling or what effects those might eventually have. None of that detracts from the value that has already been delivered, so I don’t see how they are “forgetting” anything. At best, it’s a circumstance that may play in economically but doesn’t say anything about AI’s intrinsic value.
Was it just a facetious complaint?
OK yeah but… we can’t have nice things soooo
Yeah tbh, AI has been an insane helpful tool in my analysis and writing. Never would I have been able to do thoroughly investigate appropriate statisticall tests on my own. After following the sources and double checking ofcourse, but still, super helpful.
Thanks. So the underlying architecture that powers LLMs has application in things besides language generation like protein folding and DNA sequencing.
alphafold is not an LLM, so no, not really
You are correct that AlphaFold is not an LLM, but they are both possible because of the same breakthrough in deep learning, the transformer and so do share similar architecture components.
And all that would not have been possible without linear algebra and calculus, and so on and so forth… Come on, the work on transformers is clearly separable from deep learning.
deleted by creator
LLMs in non-specialized application areas basically reproduce search. In specialized fields, most do the work that automation, data analytics, pattern recognition, purpose built algorithms and brute force did before. And yet the companies charge nx the amount for what is essentially these very conventional approaches, plus statistics. Not surprising at all. Just in awe of how come the parallels to snake oil weren’t immediately obvious.
I think AI is generating negative value … the huge power usage is akin to speculative blockchain currencies. Barring some biochemistry and other very, very specialized uses it hasn’t given anything other than, as you’ve said, plain-language search (with bonus hallucination bullshit, yay!) … snake oil, indeed.
He probably saw that softbank and masayoshi son were heavily investing in it and figured it was dead.
That’s because they want to use AI in a server scenario where clients login. That translated to American English and spoken with honesty means that they are spying on you. Anything you do on your computer is subject to automatic spying. Like you could be totally under the radar, but as soon as you say the magic words together bam!..I’d love a sling thong for my wife…bam! Here’s 20 ads, just click to purchase since they already stole your wife’s boob size and body measurements and preferred lingerie styles. And if you’re on McMaster… Hmm I need a 1/2 pipe and a cap…Better get two caps in case you cross thread on…ding dong! FBI! We know you’re in there! Come out with your hands up!
The only thing stopping me from switching to Linux is some college software (Won’t need it when I’m done) and 1 game (which no longer gets updates and thus is on the path to a slow sad demise)
So I’m on the verge of going Penguin.
What software / game is that? it could still run in Wine or Bottle.
Plants vs. Zombies garden Warfare 2. It used to run on Linux but then they added Easy anti-cheat which broke compatibility.
They don’t update the game anymore and they’ve essentially abandoned the franchise after the flop that was battle for neighborville so I’m not too sad leaving it behind. Was a very fun game though.
You’re really forcing it at that point. Wine can’t run most of what I need to use for work. I’m excited for the day I can ditch Windows, but it’s not any time soon unfortunately. I’ll have to live with WSL.
But… i am still curious… what are you trying to run 😆
Not the same person with the program. Just another person making an excuse.
Yeah use Windows in a VM and your game probably just works too, I was surprised that all games I have on Steam now just work on Linux.
Years ago when I switched from OSX to Linux I just stopped gaming because of that but I started testing my old games and suddenly no problems with them anymore.
Just run Windows in a VM on Linux. You can use VirtualBox.
I’ve been working on an internal project for my job - a quarterly report on the most bleeding edge use cases of AI, and the stuff achieved is genuinely really impressive.
So why is the AI at the top end amazing yet everything we use is a piece of literal shit?
The answer is the chatbot. If you have the technical nous to program machine learning tools it can accomplish truly stunning processes at speeds not seen before.
If you don’t know how to do - for eg - a Fourier transform - you lack the skills to use the tools effectively. That’s no one’s fault, not everyone needs that knowledge, but it does explain the gap between promise and delivery. It can only help you do what you already know how to do faster.
Same for coding, if you understand what your code does, it’s a helpful tool for unsticking part of a problem, it can’t write the whole thing from scratch
So why is the AI at the top end amazing yet everything we use is a piece of literal shit?
Just that you call an LLM “AI” shows how unqualified you are to comment on the “successes”.
What are you talking about? I read the papers published in mathematical and scientific journals and summarize the results in a newsletter. As long as you know equivalent undergrad statistics, calculus and algebra anyone can read them, you don’t need a qualification, you could just Google each term you’re unfamiliar with.
While I understand your objection to the nomenclature, in this particular context all major AI-production houses including those only using them as internal tools to achieve other outcomes (e.g. NVIDIA) count LLMs as part of their AI collateral.
The mechanism of machine learning based on training data as used by LLMs is at its core statistics without contextual understanding, the output is therefore only statistically predictable but not reliable. Labeling this as “AI” is misleading at best, directly undermining democracy and freedom in practice, because the impressively intelligent looking output leads naive people to believe the software knows what it is talking about.
People who condone the use of the term “AI” for this kind of statistical approach are naive at best, snake oil vendors or straightout enemies of humanity.
Can you name a company who has produced an LLM that doesn’t refer to it generally as part of “AI”?
can you name a company who produces AI tools that doesn’t have an LLM as part of its “AI” suite of tools?
How do those examples not fall into the category “snake oil vendor”?
what would they have to produce to not be snake oil?
Wrong question. “What would they have to market it as?” -> LLMs / machine learning / pattern recognition
Not this again… LLM is a subset of ML which is a subset of AI.
AI is very very broad and all of ML fits into it.
This is the issue with current public discourse though. AI has become shorthand for the current GenAI hypecycle, meaning for many AI has become a subset of ML.
For coding it’s also useful for doing the menial grunt work that’s easy but just takes time.
You’re not going to replace a senior dev with it, of course, but it’s a great tool.
My previous employer was using AI for intelligent document processing, and the results were absolutely amazing. They did sink a few million dollars into getting the LLM fine tuned properly, though.
And crashing the markets in the process… At the same time they came out with a bunch of mambo jumbo and scifi babble about having a million qbit quantum chip… 😂
Very bold move, in a tech climate in which CEOs declare generative AI to be the answer to everything, and in which shareholders expect line to go up faster…
I half expect to next read an article about his ouster.
My theory is it’s only a matter of time until the firing sprees generate enough backlog of actual work that isn’t being realised by the minor productivity gains from AI until the investors start asking hard questions.
Maybe this is the start of the bubble bursting.
Is he saying it’s just LLMs that are generating no value?
I wish reporters could be more specific with their terminology. They just add to the confusion.
Edit: he’s talking about generative AI, of which LLMs are a subset.
microsoft rn:
✋ AI
👉 quantum
can’t wait to have to explain the difference between asymmetric-key and symmetric-key cryptography to my friends!
Forgive my ignorance. Is there no known quantum-safe symmetric-key encryption algorithm?
i’m not an expert by any means, but from what i understand, most symmetric key and hashing cryptography will probably be fine, but asymmetric-key cryptography will be where the problems are. lots of stuff uses asymmetric-key cryptography, like https for example.
R&D is always a money sink
It isn’t R&D anymore if you’re actively marketing it.
Uh… Used to be, and should be. But the entire industry has embraced treating production as test now. We sell alpha release games as mainstream releases. Microsoft fired QC long ago. They push out world breaking updates every other month.
And people have forked over their money with smiles.
Microsoft fired QC long ago.
I can’t wait until my cousin learns about this, he’ll be so surprised.
I’d tell him but he’s at work. At Microsoft, in quality control.
Make sure to also tell him he’s doing a shit job!
He’s probably been fired long ago, but due to non-existant QC, he was never notified.
Especially when the product is garbage lmao
AI is burning a shit ton of energy and researchers’ time though!
That’s not the worst. It is burning billions for the companies with no signs of them ever becoming close to profitable.
You say this like it’s a bad thing?
That’s standard for emerging technologies. They tend to be loss leaders for quite a long period in the early years.
It’s really weird that so many people gravitate to anything even remotely critical of AI, regardless of context or even accuracy. I don’t really understand the aggressive need for so many people to see it fail.
For me personally, it’s because it’s been so aggressively shoved in my face in every context. I never asked for it, and I can’t escape it. It actively gets in my way at work (github copilot) and has already re-enabled itself at least once. I’d be much happier to just let it exist if it would do the same for me.
I just can’t see AI tools like ChatGPT ever being profitable. It’s a neat little thing that has flaws but generally works well, but I’m just putzing around in the free version. There’s no dollar amount that could be ascribed to the service that it provides that I would be willing to pay, and I think OpenAI has their sights set way too high with the talk of $200/month subscriptions for their top of the line product.
This summarizes it well: https://www.wheresyoured.at/wheres-the-money/
Wouldn’t call that a “summary”, but interesting read all the same. Thanks for the link.
It is fun to generate some stupid images a few times, but you can’t trust that “AI” crap with anything serious.
I was just talking about this with someone the other day. While it’s truly remarkable what AI can do, its margin for error is just too big for most if not all of the use cases companies want to use it for.
For example, I use the Hoarder app which is a site bookmarking program, and when I save any given site, it feeds the text into a local Ollama model which summarizes it, conjures up some tags, and applies the tags to it. This is useful for me, and if it generates a few extra tags that aren’t useful, it doesn’t really disrupt my workflow at all. So this is a net benefit for me, but this use case will not be earning these corps any amount of profit.
On the other end, you have Googles Gemini that now gives you an AI generated answer to your queries. The point of this is to aggregate data from several sources within the search results and return it to you, saving you the time of having to look through several search results yourself. And like 90% of the time it actually does a great job. The problem with this is the goal, which is to save you from having to check individual sources, and its reliability rate. If I google 100 things and Gemini correctly answers 99 of those things accurate abut completely hallucinates the 100th, then that means that all 100 times I have to check its sources and verify that what it said was correct. Which means I’m now back to just… you know… looking through the search results one by one like I would have anyway without the AI.
So while AI is far from useless, it can’t now and never will be able to be relied on for anything important, and that’s where the money to be made is.
Even your manual search results may have you find incorrect sources, selection bias for what you want to see, heck even AI generated slop, so the AI generated results will just be another layer on top. Link aggregating search engines are slowly becoming useless at this rate.
While that’s true, the thing that stuck out to me is not even that the AI was mislead by itself finding AI slop, or even somebody falsely asserting something. I googled something with a particular yea or no answer. “Does X technology use Y protocol”. The AI came back with “Yes it does, and here’s how it uses it”, and upon visiting the reference page for that answer, it was documentation for that technology where it explained very clearly that x technology does NOT use Y protocol, and then went into detail on why it doesn’t. So even when everything lines up and the answer is clear and unambiguous, the AI can give you an entirely fabricated answer.
What’s really awful is that it seems like they’ve trained these LLMs to be “helpful”, which means to say “yes” as much as possible. But, that’s the case even when the true answer is “no”.
I was searching for something recently. Most people with similar searches were trying to do X, I was trying to do Y which was different in subtle but important differences. There are tons of resources out there showing how to do X, but none showing how to do Y. The “AI” answer gave me directions for doing Y by showing me the procedure for doing X, with certain parts changed so that they match Y instead. It doesn’t work like that.
Like, imagine a recipe that not just uses sugar but that relies on key properties of sugar to work, something like caramel. Search for “how do I make caramel with stevia instead of sugar” and the AI gives you the recipe for making caramel with sugar, just with “stevia” replacing every mention of “sugar” in the original recipe. Absolutely useless, right? The correct answer would be “You can’t do that, the properties are just too different.” But, an LLM knows nothing, so it is happy just to substitute words in a recipe and be “helpful”.
