

Current AIs often suffer from what’s sometimes called “the strawberry problem” and can be easily confused into doing mathematics incorrectly. There’s also the human element of “if it comes out of a computer it must be right”, forgetting the “garbage in = garbage out” principle.
The strawberry problem is a colourful name for the fact that LLMs turn sentences into something else internally and can’t then go back and re-examine the input to make checks and comparisons. Thus if you ask an LLM how many 'r’s are in the word “strawberry”, it often gives the wrong answer, unless it has been explicitly told what the right answer is. And now you have no idea what else it has and hasn’t been told is right and wrong.
As for mathematics, they have to be explicitly programmed to be able to use a proper calculator if they’re to do mathematics correctly. Otherwise you’ll get something that looks good enough to fool someone who doesn’t know any better.
LLMs are basically lossy compressions of knowledge. At a high level of abstraction, the creation of an LLM is fairly similar to how a raw image is turned into a JPEG*. There’s a necessary, deliberate bottleneck in the creation process that keeps the size down, and that’s going to show up in the output if you look closely.
Using the output of an LLM is a bit like editing the JPEG rather than the raw image. Some of the things you do will invariably enhance those artefacts.
For a JPEG that’ll do nothing worse than make an image “deep-fried” or otherwise ugly. Put an LLM in charge of people’s lives and it’ll do the same to them.
* JPEG has a lossless encoding variant, but that’s not the right analogy here.
Maximise profits and minimise losses. My guess is that someone important at Microsoft thinks that this will do just that, and if not that, will make them, personally, a lot of money. That person has no-one who will dare challenge their authority and so we go down this road.
They (that individual or Microsoft as a whole) almost certainly have a stake in the companies that provide newer hardware, and if they didn’t before this decision, they will have by now.
It theoretically makes Micosoft’s job easier too. A huge chunk of backwards compatibility maintenance goes out of the window, if you’ll pardon the pun.
“Oh you have 5 year old hardware? We don’t support that.”
Sounds fairly similar to Apple’s business model if you think about it that way.