Stone is a necessary resource for building all kinds of structures. In order to acquire some stone you'd have to build a Mine. Mine can only be placed in the mountains, but be careful - building it too close to the citizens' houses might make them unhappy.