I'm assuming there's a default for new players "causing" this. Couldn't there at least be a finite number of random possibilities?
I wouldn't use the word difficult, but it took some attention for the quest to give to new players when there were 6 of the "same guy" wandering the same street at the same time.