I used an Essence of Rubeweed, summoned the Rube, (Was experimenting to get an 100% chance to get Dolls) and he said "Too rich for my blood" because the only items I had was the only items known to be traded for Dolls.
But, why would he offer a Grand Ol' Grinder for a Doll, but not for me? o.0