My MAILER_URL=smtp://mysmtp.example.com:25

How should I configure this so that Kimai does not even try to do TLS?

Here it suggests to look at Symfony mailer documentation. There it tells me to add ?auto_tls=false. But that does not help.