Data Pipeline Tool

Browse 31 websites in this category • Page 1 of 2

Sites where Data Pipeline Tool is a core feature are shown first, marked with a Core badge.

Promotion
ibm.com favicon

Create and manage real-time data pipelines

IBM StreamSets helps you build reliable, intelligent streaming data pipelines for real-time data integration and improved organizational decision-making.

elastic.co favicon

Collect and transform data from any source

Logstash lets you collect, parse, and transform data from any source, helping you streamline log management and data integration with ease.

airflow.apache.org favicon

Automate and monitor complex workflows easily

Apache Airflow lets you build, schedule, and monitor workflows. Easily automate complex processes and manage data pipelines at scale.

flume.apache.org favicon

Move and manage large volumes of log data easily

Apache Flume helps you collect, aggregate, and move large amounts of log data reliably with a flexible, fault-tolerant streaming architecture.

nifi.apache.org favicon

Automate and manage data flows visually

Apache NiFi lets you automate, process, and move data between systems with an easy-to-use interface for building secure and reliable data pipelines.

rivery.io favicon

Automate and manage cloud data pipelines

Rivery is a cloud-based platform for automating, integrating, and managing data pipelines, making it easy to move and transform data across systems.

stitchdata.com favicon

Automate data pipelines from 140+ sources

Move data from over 140 sources to your database or warehouse in minutes with Stitch—no coding needed, fully automated, and cloud-based.

luigi.readthedocs.io favicon

Automate and manage batch workflows in Python

Luigi is a Python toolkit for building and managing complex batch pipelines, offering workflow automation, dependency handling, and clear documentation.

tez.apache.org favicon

Streamline big data processing workflows

Apache Tez is an open-source framework for building complex data processing workflows on Hadoop, enabling efficient and flexible data pipelines.

astronomer.io favicon

Build and manage data pipelines in one place

Astronomer is a cloud platform for building, running, and monitoring data pipelines with Apache Airflow, making data workflows simple and reliable.

storm.apache.org favicon

Process real-time data streams with ease

Apache Storm lets you process unbounded streams of data in real time. It's open source, supports any programming language, and is free to use.

prefect.io favicon

Automate and monitor Python data workflows

Prefect helps you automate, monitor, and scale Python data workflows with easy orchestration, dynamic scaling, and built-in observability tools.

dagster.io favicon

Orchestrate and manage data pipelines easily

Dagster helps data engineers build, run, and manage data pipelines with modern orchestration tools for reliable and scalable data platforms.

pgsync.com favicon

Sync Postgres data to Elasticsearch easily

PGSync lets you sync data from Postgres to Elasticsearch or OpenSearch, making it easy to keep your databases connected and up to date.

integrate.io favicon

Build low-code data pipelines with ease

Integrate.io lets you build and manage low-code data pipelines to unify, transform, and sync data across sources for analytics and business insights.

snowplow.io favicon

Own and activate your customer behavioral data

Snowplow helps organizations collect, manage, and use customer behavioral data to power AI, analytics, marketing, and digital experiences.

ascend.io favicon

Build and automate data pipelines with AI agents

Ascend.io helps you build and manage data pipelines with integrated AI agents, enabling faster data workflows, collaboration, and automation for teams.

abinitio.com favicon

Build and manage complex data pipelines easily

Ab Initio offers powerful tools for building, managing, and integrating data pipelines, helping businesses process and analyze data efficiently.

vector.dev favicon

Build flexible observability pipelines fast

Vector lets you collect, process, and route observability data quickly and easily. Build flexible data pipelines for logs and metrics across any platform.

beam.incubator.apache.org favicon

Build data pipelines across clouds and engines

Apache Beam lets you build and run unified data processing pipelines for both batch and streaming data, supporting multiple programming languages and cloud platforms.