Answer
Use the right-click Cleanup function in the Custom Fields window's header (rather than just deleting the field from the UI) — this actually purges the field's definition from the database, whereas removing it just through the normal field-deletion action in the UI can leave the underlying column/definition behind even though it no longer shows in the interface.