33
P

Batch job to clean up the staging data in data management

Praveena Mardambail on 3/27/2018 4:51:20 AM
Recurring jobs in the data management leaves lot of unwanted data in the staging tables. There is only manual way of cleaning up the staging data by selecting either the entity or the data project. There is no way that it can be scheduled as a batch. This task becomes important when there are recurring jobs and unwanted data in the staging slows down the process.

A new batch job for staging cleanup with below options would be great.
1. Enable on selective entities
2. Delete data based on beyond date
Category: Data Management
STATUS DETAILS
Completed
Ideas Administrator

Sunil Garg (administrator)

The job history clean up is a new feature in PU29. Pls try that out and let us know your feedback on this functionality.

Thanks.

Comments

P

P

RE: Batch job to clean up the staging data in data management

Muralikrishna Sunku on 10/15/2019 8:51:52 AM

Batch job history cleanup job only deletes the records of Batch job and history table records. It is not for DMF staging cleanup

Category: Data Management

P

P

RE: Batch job to clean up the staging data in data management

Istvan Molnar on 6/27/2019 4:17:18 PM

Hi,

I have created a periodic function for this problem. It helps to clean up periodically records from stage table which are older then defined in filtering parameter.
Please have a look on following repository where you can find both the source code and the deployable package:
https://github.com/istvan2molnar/D365FO-Extensions

Feel free to use it and I hope it helps.

Category: Data Management

P

P

RE: Batch job to clean up the staging data in data management

Mahak Mehta on 5/19/2019 12:39:46 PM

We have 30-40 bathes running plus now talent live in system we run CDS batches very often and we cannot control 'skip staging' option because these are automated batches, cleanup batch will be really helpful and improve performance of CDS batches specially
Thanks

Category: Data Management

P

P

RE: Batch job to clean up the staging data in data management

Susan Fischer on 2/4/2019 5:50:34 AM

We have integration jobs that run every few minutes. The ability to schedule auto cleanup similar to the batch history functionality would be very useful.

Category: Data Management