Answer
In Page Designer, on the list bound to your custom entity set, add a CRUD Action Override for the Duplicate action. When creating the override you first need to tick Enabled (even though your goal is to disable it) to be allowed to confirm the override — only after it's created can you go back and untick Enabled to actually disable the Duplicate button on that list. The same override mechanism works for New, Edit, and Delete.