Correct. This should not be a problem, the DNS infrastructure is robust and can handle it.
Each server will then query every other server to decide which records to publish. This operation will take some time, so a failover interval of 1s won't be feasible. But the same would apply with an external probing solution