When you select the shipyard, you'll get icons of all ships stationed.

Click the one you want (or use CTRL+click to select multiple) and then right click a hex just outside the shipyard. It took my awhile to figure this out as there's no documentation