If the multiplayer connection itself is not working, check the anti-virus program. anti-virus program often block the Steam Game Network connection and may not be able to connect.
Steam Documentation Notes
https://support.steampowered.com/kb_article.php?ref=4361-MVDP-3638&l&l=english