While posting invoice, system is checking if the address is active.

Error message : While processing the state Customer order invoiced, generic exception encountered in retail statement ST1033-000000584 in the controller: Posting Posting Sales order: 205580964 Item: 1002534 Delivery or invoice is not allowed to this address

It could have ignored if the delivery address was active or not at the time of posting the invoice as at that point it should already be delivered which is why it is being invoiced.