Riddle

[Gravy]

I've heard this before, but can't remember the answer. So here it goes!!

He asks the guy on the right, "Are you the one who'd tell me this is the way to town?" Using town as his destination. If the guy is the one telling the truth, he answers "Yes", or "No" to telling the truth, and to the destination. This works in my mind, but it might not work on paper.

I'll see if i'm right before i spend a while explaining how i got my answer.