YES it will go away if you don't maintain your E-mail Forwarding for Life (EMFL) delivery mailbox. If mail starts to bounce, your EMFL service may be disabled. Once it is disabled, any mail sent to the email address will be rejected.
Login to PassPort (https://passport.gatech.edu) to specify a new delivery destination to start email delivery again.
For more information on Email Forwarding for Life please click here.