Cloud data integration specialist Talend announces Pipeline Designer-- a web-based tool for the creation of end-to-end data pipelines for the Talend Cloud integration Platform as-a-Service (iPaaS).
As Talend puts it, the graphical designer allows customers to preview live data and transform it easily. A single interface provides means for data engineers and developers to seamlessly design data pipelines across batch and streaming use cases able to scale with the latest hybrid and multi-cloud technologies.
Talend decouples the processing and computing layer from the data pipeline design, meaning companies can scale with the cloud and/or on-premises technologies at any time. Thus, Pipeline Designer acts as a single seamless environment to transform and move data, be it on-premises or cloud, batch or streaming into cloud data lakes or data warehouse. It integrates with both structured and unstructured data sources, including Salesforce, Amazon Sr, Redshift and Kinesis, Azure SQL Database, Snowflake and Apache Kafka. Customers design pipelines in the cloud, before running them on-premises, in AWS EMR or virtual private cloud.
“The requirements for modern data engineering are very different today compared to only a couple years ago. Most teams are not ready or equipped to process or analyse data in real time-- yet, to remain viable, companies need to respond faster to opportunities and threats,” Talend says. “With Pipeline Designer’s new user-friendly UI, customers will be able to easily ingest and transform batch and streaming data."
Pipeline Designer is available now as part of the Spring 2019 Talend Cloud release.