I tried to do it and they always seemed to disappear. I did not, however, save a file where the custom color was used. I would assume, it would be saved with that file.
If you can't do anything else, write down the numbers for your color so you can get it back quickly.