Answer
Yes — the database itself needs to be restarted (not just the middleware/application server) for UTL_HTTP-based outbound calls to pick up an updated Oracle Wallet, since that HTTP call is made directly by the database process, independent of the middle tier. Restarting only the middleware server won't refresh the database's own wallet-backed trust store.