Is gardening a sign of age?

Pottering in the mud, moving around plants, removing weeds and finally planting a new rose bush. Far away from my normal occupation. Can't help thinking that gardening is a sign of age. Similar to learning to drink coffee when you are fifteen to finally get used to it at the age of eighteen, gardening becomes appealing close to the age of old maid. Scary thought.