It seems that "up arrow" is overloaded. If I understand it correctly, it is used for "climb" when close to a thing you can climb, and "go there" for certain signposts. Unfortunately, when a thing you can climb is close to a signpost, "up arrow" does something arbitrary, or at least unexpected.
I vote for "up arrow" meaning "climb" absolutely everywhere.