Does Duplicate Invoices delete the second copy?

No. A duplicate is shown with what it duplicates — the other copy, its company and its state — and nothing on the page removes either. The fix happens in Xero: void an open copy, or raise a supplier credit note for a settled one (on the sales side, a refund or credit to the customer). The page records the ruling.