JF Puget
JF Puget
@jfpuget.bsky.social
Competitive Machine Learning director at NVIDIA, 3x Kaggle Grandmaster CPMP, ENS ULM alumni. Kaggle profile: https://www.kaggle.com/cpmpml
This involves more than removing the thinking part.

The prompt has to specify delimiters to be used. For instance, add this to the prompt:

"Just output the result as a python list of strings."

Then extract with :

response = '[' + response.split('[')[-1].split(']')[0] + ']'
March 4, 2025 at 8:58 AM
The thread was motivated by results on testing SOTA models:

x.com/mbalunovic/s...
x.com
x.com
February 8, 2025 at 11:38 AM
It is also interesting to note that AI math benchmarks only care about the final number. If that number was accidentally found via a flawed mathematical proof, then it is still considered a success.
February 8, 2025 at 11:36 AM
There is no wonder AI focuses on number finding math problems. It is because checking the result is simple.

Tackling the full spectrum of math requires a much more complex result checking machinery (formal proof checker)
February 8, 2025 at 11:36 AM
This is to say that getting good at computing numbers specified by some mathematical setting is not the same as getting good at math in general. It is definitely part of math, but only a tiny part of math.
February 8, 2025 at 11:36 AM
I was trained a a mathematician in France. And I almost never had to solve a problem of that kind. All the math work was about proving mathematical properties of mathematical objects. For instance, prove that a given group is isomorphic to another given group.
February 8, 2025 at 11:36 AM
It could be that the problem is part of R1 or DeepSeek v3 training data as it is available online.
January 30, 2025 at 6:25 PM
NVIDIA

Not sure why you did not see it yourselves. But now you know.
January 25, 2025 at 8:40 PM
I'm not offended, dont' worry. I was suprised to see something that looked like an apology when there is nothing to apologize for.

I hope TESLA sales will go to zero in Germany (and in Europe in general0. That's the only language he'll understand.
January 24, 2025 at 10:48 AM
Are you saying you are sorry for having to leave X?

To me?

Why is that? I am not a defender of X.

Personally I find it to be a great source of AI/ML info.

To your point, the rest is painful.
January 22, 2025 at 10:29 PM
Applicants must be a full-time faculty member at an accredited academic institution that awards research degrees to PhD students.
Up to 32K A100 40GB hours can be requested.
Award decisions expected in June.
For more information, please see FAQs: www.nvidia.com/en-us/indust...
NVIDIA Academic Grant Program​ for Researchers
Submit your research proposal.
www.nvidia.com
January 13, 2025 at 5:18 PM