Many years ago I had a girlfriend who bought a pair of walking boots in a dodgy shade of green. She asked me about socks and I said that Bridgedale did a pair of light hikers in green, so she duly went out and bought a pair. When she came back she was appalled to note that they just didn't match.
My response was that she was going to be wearing these items on the hills where no-one was too worried about what you looked like, and not on a catwalk.
My feeling is that bright colours aren't necessarily a bad thing, as they could save your life if something happened. If you blend in too nicely, then perhaps the rescue services simply wouldn't see you.
Now I know I'm a bloke and blokes apparently have no clothes/colour sense, but do you really want to do this?
S.