Man, oh man, do I remember that sound and how excited I got when I heard it!
Here is a very cool breakdown (from 2012) of what the handshake sound looked like and what exactly it was doing:
http://www.windytan.com/2012/11/the-sound-of-dialup-pictured.html