Ok, this is a bit more than what the title implies. This isn’t just outputting the code in text, but rather the ability to verify its own answers before responding to the user asking questions using code.

Claude could attempt these tasks before. But, because it lacked a mechanism to mathematically verify the results, the answers weren’t always incredibly accurate.

So now if you ask it a math question or for it to create some visual bar chart, it will actually do the work to verify that what it’s saying is valid.

I’m sure there will still be ways to trip it up, but this is a good step forward.

good! so maybe soon they will be on the level of a junior.