I'm definitely not a technophobe, but when you're out in the hills, I need to be able to rely on my method of navigation, and I don't believe that an electronic device is foolproof.
Before anyone says '... but your compass could break ...', I always carry two, as well as having a Suunto watch that has a compass function. In addition, my walking colleague also carries a compass. Finally, I also know how to use an analogue wristwatch as a backup compass. Not particularly accurate but could get you out of trouble.
My secondary reason for not using a GPS is the speed with which they eat batteries. I know they've improved, but my old Garmin used 4 AA batteries a day, which if you're on a 7 day trek means you need to carry 28 batteries, which is a considerable weight (and expense!) when you're trying to travel light. My GPS cost me around £150, and I'm not so flush that I'm going to throw it away just because the latest model uses less battery power, so mine will remain just a backup where one set of batteries should last the entire trip.
S.