Currently users in Dynamics 365 must delete and create a new pending vendor invoice if a purchase agreement (that is setup as direct invoice) has been assigned on an invoice. This is currently a bad user experience and should be resolved. This idea shouldn't be necessary as its a defect in the product.