Shorter than planned because I still couldn't find the path.
I had exactly the same problem the first time I was there too, Lee. There was (is?) a little sign saying that the patch of lawn in front of the cottages is private land and there was a group of people sitting there in the sun having a drink, presumably residents, and I found both of these a bit off-putting so I did what you did and went up to the main road.
The second time I was there I stayed on that side of the water. I followed the riverbank around the edge of that lawn around and then the path uphill was clear.
It could certainly be signposted more clearly. I don't know if the idea is to put people off but I'm sure people would pass by more quickly and less obtrusively if it wasn't so confusing.