Not if your scheduler causes accumulation in a different order.

Are you talking about a DAG of FP calculations, where parallel steps might finish in different order across different executions? That's getting out of my area of knowledge, but I'd believe it's possible

Well a very simple example would be if you run a parallel reduce using atomics the result will depend on which workers acquire the accumulator first.