@ZachWeinersmith@mastodon.social I've seen LLMs make basic math mistakes many times, in direct interaction. I would never trust them with anything important. LLMs fundamentally cannot think or do math, they just make Bayesian bets and what might make user happy, but will make claims with perfect confidence that has a brazen error in it somewhere. thankfully most of modern math seems trivial and useless haha, and the truly useful parts are already solved and have software libraries or apps for calcs. my impression to date