Reading Time: < 1 mins

Workflows or How I Power the DataEngine

Authored by
Learn more about the Marini Integration Platform in an online demo and discover the benefits.
2021-03-18-DataEngine-Usage-Monitoring

While monitoring the DataEngine instances, we noticed unusually high disk and CPU activity. Our investigation then revealed that improperly configured workflows were the cause.

Here is the initial situation we found:

2021-03-18-DataEngine-Usage-Monitoring

The upper diagram shows a CPU utilization of around 40%, combined with high read activities to the hard disks (middle and lower diagram – green line).

This workflow was responsible for this:

2021-03-18-DataEngine-Usage-View

What we see here is a workflow that runs not only in the scheduler (i.e. every minute), but also when saving. (1) Furthermore, we have not set any conditions, so that this workflow is applied to all records in the CDP Contact module every minute. (2) What is not visible here is that the action updates the record itself, which in turn triggers an “on-save” event and thus this workflow again. (3)

So a recursive loop was built, which only exits when there is a saving error. Changing the same record, without a corresponding condition and calling the same workflow at the same time is deadly. Here, the instance was barely usable during execution.

Conclusion:

If you want to repeatedly update the same records via a workflow, you have to set appropriate conditions that prevent you from setting up recursive loops here. If several actions are executed one after the other (with a change of the calling record), the condition for the execution of the workflow should be set right at the beginning. Then a new call is prevented.

Learn more about the Marini Integration Platform in an online demo and discover the benefits.
and
Topics:
DataEngineKristian WereliusProcess Automation

Related Articles

RevOps ohne Datenintegration: Warum Revenue Operations im Mittelstand an Excel scheitert

RevOps Without Data Integration: Why Revenue Operations Fails on Excel in Mid-Market Companies

Reading Time: 6 mins

Revenue operations should control marketing, sales, and finance. In the mid-market, the RevOps team builds Excel reports. Why this happens and how it can be different.

Bosch hat 400 Tochtergesellschaften: Hierarchische Account-Strukturen im CRM abbilden

Bosch has 400 subsidiaries: Mapping hierarchical account structures in CRM

Reading Time: 8 mins

Corporate clients with hundreds of sites: How machinery manufacturers map hierarchical account structures in CRM, aggregate and bidirectionally synchronize with ERP.

KI-gestütztes Lead Scoring im Maschinenbau: Mehr als nur Firmographics

AI-Powered Lead Scoring in Mechanical Engineering: More Than Just Firmographics

Reading Time: 6 mins

Classic lead scoring fails in mechanical engineering. AI models combine economic data, web crawling, and sales history for better prioritization.