I have been working with Power Fx Formula Columns in Dataverse and as of now it is not possible to use the ^ operator. My customer has a mathematical formula where the operator needs to be used. With this limitation we need to create a plugin instead of just using a powerFX field.

Link to documentation: Work with Dataverse formula columns - Power Apps | Microsoft Learn