What is allowing telnet to connect is the Azure SQL Public Gateway not the Azure SQL Database itself. This is an expected behavior in Azure Database. Port 1433 is required to provide a variety of Azure services, and this is by design.
So, telnet is reaching a public gateway that is open for everyone and is not reaching the actual database, Read here about the gateway