Do you mean get back the imagination spent on creating the garden? If so then the answer is no.
However you can pour Wine of the Dead* on the herb garden plot to remove it from your public street so you can then replace it with a crop garden plot.
*You can get this from dying and finding the bar tender in hell or you can buy it from the auctions or join trade chat and ask if anyone has it for sale in a tower)