Download to your computer.
Have an external hard drive as your computer's backup (making a clone of your computer).

I have way too many emails in my inbox, and many of them I would rather keep than trash. What device should I use and if this isn't clear, what should I base this answer on? External hard drive, thumb drive, or desk top hard drive?

Thanks for any help!