While we are at crazy ideas: Has anyone ever thought about using an aproach similar to RAID for this kind of collective operation fault tolerance? I mean, specifying some kind of data redundancy and data striping, such that the collecitve operation can return as soon as there are just enough responses from other (potentially not all) MPI processes involved in the operation?