Minecraft Server Failed to Bind Port

If you see the following message when starting your server,

**** FAILED TO BIND PORT!
The exception was: java.net.BindException: Address already in use
Perhaps a server is already running on that port?