It's a lovely walk, and that sounds a very comfortable timescale.
Skiddaw House is a great place to stay, but remember you need to take some food in. As I remember, they will sell you a bottle of beer though, and provide some breakfast if you ask in advance. There's a farm, I think it's just before you head down the hill towards Little Langdale, we went wrong there, and missed the sharp turn right towards Elterwater. I can't remember whether it is that farm or the next one, but it does a wonderful tea and scone.