Answer
Go to the Object Connections screen for the relevant logical unit and add the ApprovalRouting tag/connection — that's what makes the Approval Routings section appear in the Attachment Panel for that screen. If it still doesn't show up immediately, log out and back in (or do a security/server cache refresh) before concluding it hasn't worked.