If Rooks come in and destroy streets that are underused / underloved, I think they should do the same to houses. If you don't play enough (up to TS to decide this) you come in and everything has died, and maybe half of your stuff is missing.
Yeah, yeah, I like this idea!