-
Improve the management of the audit space per environment
I am reaching out to discuss the challenges our organization faces with Dataverse space consumption tracking and deletion job progress monitoring. Our inability to reliably track audit space consumption across environments impacts our ability to manage several terabytes of data effectively, particularly in an organization with thousands of users.
Furthermore, the deletion jobs' progress currently lacks informative metrics, such as percentage completed and estimated time of completion. This lack of visibility can hamper our operational efficiency and decision-making processes. Lastly, the execution time for these jobs is a concern, with some taking several days to complete, which is far from ideal. The execution time is not predictable at all. My suggestion is that you publish in your public documentation how this works in the backends, and what is the expected execution time (considering the size of the audit log), so we as administrators can plan when/how to run these jobs.
Addressing these issues is crucial for maintaining our system's performance and ensuring the efficient use of our Dataverse space. I believe improvements in these areas will significantly benefit our organizational workflow and data management practices.