I do a bit of both, nearly always have MP3 player with me, to listen to music. But will often not actually use it so I can listen to nature. Parts of my circular walks are often on public roads, so listening to music helps cancel some of that noise.
After a pleasant walk along the riverbank, just listening to nature, the sound of the main road I then have to walk on, almost seems deafening.