While the usual "rich character out of touch with reality" gag of assuming Axel and Doug are drivers or chauffeurs to be dismissed is expected, it isn't actually reasonable for the Astor's butler to think Leland is accompanied by two chauffeurs, it only takes one to drive. This is an unrealistic leap in logic, especially given that they got out of the car along with Leland without opening his door.