A steam-generating boiler in which its cylindrical shell is arranged with the axis vertical.

Boilers without such a shell aren't usually termed "vertical", even when tall and thin.

Wikimedia Commons has media related to Vertical boilers.