Sometimes gcc will opt to use a randomized model to guess branch probabilities, when none are available from either profiling feedback (-fprofile-arcs) or __builtin_expect.
I’m willing to bet many people are not even aware that modern compiler optimizations use prng. Not to mention incorrect usage of the term “determinism” when referring to CS concepts. This is exactly what Linus is talking about when he cited lack of understanding of compiler behavior. I do believe there are notable differences between AI and compiler, but a lot of the reasons people give against AI are reactionary and not well thought out.
I’m done. This is a pointless exercise. You’re refusing to engage on the core point and keep dancing around on semantics. None of this makes an LLM like a compiler.
The compiler can use rng too. From the gcc docs:
More info here: https://stackoverflow.com/questions/52974259/what-are-some-examples-of-non-determinism-in-the-c-compiler
I’m willing to bet many people are not even aware that modern compiler optimizations use prng. Not to mention incorrect usage of the term “determinism” when referring to CS concepts. This is exactly what Linus is talking about when he cited lack of understanding of compiler behavior. I do believe there are notable differences between AI and compiler, but a lot of the reasons people give against AI are reactionary and not well thought out.
I’m done. This is a pointless exercise. You’re refusing to engage on the core point and keep dancing around on semantics. None of this makes an LLM like a compiler.