I don't think it's normally shown except in fullscreen or by hovering over it which can be done on desktop. Not sure about mobile.

There's also the brand new alt tag indicator which currently just shows you if an image has an alt text or not, unlike mastodon where it can actually be used to show it. But there's a PR in progress which changes that so it CAN be shown there, like mastodon.