What if you planted a botanical garden? As an aristocrat, in the late 19th century, he acquired land, hired a gardener and set out in search of the best plants