Me too. I used to go for walks with a Benbo Trekker tripod sticking out of my rucksack, along with dslr, an assortment of filters, and a macro lens just in case.
Eventually I narrowed it down to just the camera with a 18-200mm "travel lens", but even that became too much of a faff, with putting my walking poles to one side when I wanted to take a picture, removing and opening my rucksack, extracting the camera, and doing everything in reverse order when I had taken the shots.
Now I carry just a tiny Sony compact in a pocket or waist pouch. The quality of the photos is not as good and the composition is less precise as those from the dslr, but I enjoy my walks more with less interruption to my progress, while the simplicity of taking the compact out has meant I am taking about three times as many pictures as I used to with my dslr, which is now my choice for just holidays, special occasions and photography at home.