You can download a previously saved private key at your convenience.  These downloadable keys will be indicated in the "Private Key Saved" column from the Key Pairs view.  

When you initiate a download request, you will be prompted for a local file system location onto which to save your private key.