I think Tower is a bit wider than a Tree, not 100% sure, but you can place a Tower between the signpost and your house.
If the tree is already dead, just use a Hatchet/Axe, then remove the patch.
To clear any cultivated resource, pour Wine of the Dead on it.