The Apache Airflow workflow management platform orchestrates a large number of systems in the corporate context. Many interfaces can be conveniently controlled via operators in the workflow, only the connection to SAP systems cannot be realized without further ado.
SAP Business Warehouse (BW), on the other hand, lacks the ability to use open-source libraries and to freely choose the programming language for data manipulation. Through a two-way integration, the obstacles are overcome and the strengths of both systems can be combined in operational use cases. Thus the organization of the data processes gains flexibility regarding development language, linking possibilities and usable libraries.
The Nextlytics Apache Airflow - BW connector enables plug-and-play integration between the Apache Airflow workflow management platform and SAP BW.
The trigger process optionally sends the system ID during the API call. In Airflow, the system ID is used to recognize whether the process chain came from the development or the production system.
Additional transfer parameters can be passed on specifically for an individual workflow run. These can be, for example, file locations, target system abbreviations or temporary table names.
After a workflow is started in Apache Airflow, the process chain can either proceed with the execution of subsequent process steps (asynchronous) or the process chain waits for the workflow to complete (synchronous).
The integrated connection test improves error handling. Connection errors due to incorrect access data are thus determined before the first execution.
In the case of synchronous execution, the process chain can react differently to the incorrect execution of a workflow in Airflow than in the case of success.
The connection data for SAP BW is encrypted in the Airflow backend during integration and is therefore not visible in the program code.
The connector can be added to the workflow in a modular way as a user-defined operator. Accordingly, it can be placed at the desired position in any workflow.
The NextLytics Airflow-BW connector is provided by BW as a transport and by Airflow as a custom operator. A detailed installation guide is available for the setup, which will help you to prepare both systems for the two-way integration in 10 minutes.
NextLytics is always at your side as an experienced project partner. We help you to effectively solve your data problems from data integration to the use of machine learning models. Use the form below to ask your question and we will get back to you as soon as possible.
We look forward to hearing from you!