I keep my magnet on the top shelf of my china hutch (which I use as a bookshelf). That way it can't accidentally get near my iPod, computer, credit cards or anything else it might damage.
I never would have thought that a strong-ish magnet would be such a dangerous thing to have around, but it can wreak havoc in the digital age.