Answer
Delete the Information Source itself first (from the Information Source window) — doing so returns the underlying QIS back to Drafted status, where it becomes editable/deletable again. Only a QIS that's actually in Drafted state can be deleted directly; once an Information Source has been created from it, you have to remove that Information Source first before the QIS itself becomes modifiable again.