Per a ticket with MS support, duplicate detection rules don't trigger when a record is being created from a sub-grid. For example, on a sub-grid of contacts related to an account, creating a new contact from this sub-grid does not trigger duplicate detection check. Duplicate detection should always be run when creating new records when duplicate detection has been configured