Qlik Cloud Data Integration (QCDI)
Qlik Cloud Data Integration helps you deliver, transform, and unify enterprise data in real-time to any cloud platform. QCDI enables you to seamlessly replicate data from on-premises or cloud sources into Qlik Cloud and other leading cloud data platforms and turn raw transaction records into consumption-ready data, without the need to write complex code.
Cloud Data Integration Use Cases
QCDI can help address these common use cases:
- Query Offloading: Moving data from mainframes to other less costly databases for reporting purposes (typical in the financial services industry)
- Data Warehouse/Data Lake automation: Moving data from a source system to a relational database to enable an analytics ready data warehouse or data lake
- Data streaming: Real-time streaming of data from a source to a target (typically involves solutions like Kafka)
- Alternative to Qlik Data Transfer: A cost-free method of replicating data in near real-time from sources into Qlik Cloud for providing QVDs to the Qlik Analytics Apps.
Real-time data movement
Qlik Cloud Data Integration can seamlessly replicate data from on-premises or cloud sources into Qlik Cloud and other leading cloud data platforms. QCDI can ingest data, on a real-time basis, without the need for a schedule or complex scripting. Data is continuously updated allowing an end user to gain insights from – and take action on – important business moments.
QCDI offers:
- Real-time movement from all enterprise sources including relational databases, SAP, mainframe and SaaS applications
- Support for major leading cloud data platforms targets such as Snowflake, Azure Synapse, Google Big Query and Databricks
- Point-and-click data pipeline configuration for rapid deployment.
Data transformation
With Qlik Cloud Data Integration, your users can transform raw transaction records into consumption-ready data via auto-generated, push-down SQL. The no-code interface delivers reusable transformation pipelines that intelligently conform data to dimensional models or custom formats.
Transformation within QCDI, delivers:
- Simple transformations: A no code interface to add table-based transformation rules such as column renaming, data filtering and standardisation
- Advanced transformations: Through the use of the modelling interface, users can automatically generate star schema data marts in your target data warehouse of choice
- Custom SQL: QCDI offers the capability to supplement UI driven transformations, by adding your own custom SQL transformations to the pipeline when custom transformations are required
- Third-party data transformation: Transform data ingested by third-party tools or shared within a data warehouse or data lake.
Catalog and Lineage
Qlik Catalog and Data Lineage supplement Qlik Cloud Data Integration within the Qlik Cloud platform. They can help you gain a full overview and understanding of your data, and actively monitor its lifecycle, regardless of source or your end-user analytics environment. This means you can confidently expand data and analytics access, and gain greater confidence in the resulting metrics & KPIs, and in turn accelerate your journey to Qlik Cloud based analytics.
With Qlik Catalog and Lineage, you can:
- Track lineage and the journey of each dataset, allowing your users to understand its origin, evolution, and meaning, and impact of any changes to these datasets further down the pipeline
- Generate field-level profile statistics, as well as apply personalised tags, properties, and business metadata for greater utilisation
- Deliver a simple to use search, find, preview capability, allowing users to select business-ready data, apps and other Qlik objects.
Superior data architecture
The Qlik Cloud Data Integration platform provides several scalability, security and maintenance advantages when compared to traditional integration solutions and contemporary iPaaS offerings.
Benefits:
- Secure point-to-point data transfer: A secure point-to-point replication architecture ensures low data latency and maximum data availability via Live Views
- Agentless data gateway: An architecture that ensures that no extra overhead or security attack vector is added to your production data systems unlike agent-based approaches
- Data architecture agnostic: Create pipelines that can be seamlessly integrated into any data architecture such as hub, fabric or mesh.
Qlik Application Automation
Through Qlik Application Automation (QAA) users can easily create workflows with a no-code visual editor that streamlines and optimizes your data and analytics processes. Quickly integrate automated flows that span market leading SaaS applications to trigger alerts and invoke downstream processes that react to changes in your business. Consequently, reducing the time taken in programming back-office tasks that drive automated actions, leaving more time for data analysis. For example, a Marketing Agency captures a new lead or contact in Marketo, which automatically can trigger the delivery of whitepapers or relevant material to that new contact. The relevant Account Manager can also be informed of that new lead creation via platforms such as Slack or Teams.
Benefits of QAA include:
- The ability to drive insights to action by embedding integrations to other applications directly in a Qlik Sense application and trigger context aware downstream processes
- Simplify SaaS integrations without the need to understand their low-level APIs through drag and drop of smart blocks to build powerful workflow logic
- Increase analytics DevOps productivity by orchestrating both your tenant administration and Qlik Sense app development tasks with ease.
Demo, free trial, or price information?
Do you want more information about QCDI?
Fill in the form below and we will get back to you within one working day.
Ready to get started with Qlik Cloud Data Integration?
Get in touch and we can work through your options!
Tim Wensink
BI Consultant & Training Manager
tim.wensink@climber.nl
+31 6 57 49 78 55
Jordy Wegman
BI Manager
jordy.wegman@climber.nl
+31 6 11 62 68 58