I went AFK in my backyard, and when came back to the game continued gardening.
Since I didn't move my avatar I assumed it still thought I'm AFK, the gardening succeeded but between gardening actions the avatar went back to sleep :-) only when I made the avatar move right or left it "woke up".