Truthfully, they feel they shouldn't leave him with how shaky he was after the last time. They have a less pride-wounding reason, though, and feel reluctance to end this whole thing on a sour note.

They respond after taking another careful once-over over the surroundings. (Greenhorn takes a look around too from somewhere around Lemm's shoulder, a bit less carefully.)

I plan on passing through the Resting Grounds after, and it's nearby the City, so I'll be going at least that far.
If you're amenable, I'd like to save any planning for a different trip for another time.