Most businesses have data stored in a variety of locations, from in-house databases to SaaS platforms. To get a full picture of their finances and operations, they pull data from all those sources into a data warehouse or data lake and run analytics against it. But they don't want to build and maintain their own data pipelines.

Fortunately, it’s not necessary to build everything in-house. We put together this ETL tool comparison guide to help you choose the product that’s the best fit for your business.

Overview

StreamSets, Google Cloud Dataflow, and Stitch are all popular platforms. Here's a side-by-side look at how they stack up against each other.

Focus ETL, transformations, data prep Stream and batch processing Data ingestion, ELT
Database replication Full replication or change data capture Full table; incremental replication via custom SELECT statements Full table; incremental via change data capture or SELECT/replication keys
SaaS sources Only Salesforce None More than 100
Ability for customers to add new data sources Yes Yes Yes
Connects to data warehouses? Data lakes? Yes / Yes Yes / Yes Yes / Yes
Transparent pricing No Yes Yes
G2 customer satisfaction Not rated 4.1/5 4.8/5
Support SLAs Available Yes Available
Purchase process Requires a conversation with sales Self-service Options for self-service or talking with sales. Also available from the AWS store.
Compliance, governance, and security certifications HIPAA, GDPR HIPAA HIPAA, GDPR, SOC 2
Data sharing No Yes Yes, through Talend Data Fabric
Vendor lock-in Annual contracts. StreamSets Data Collector is open source, other parts of the platform are proprietary. Month to month Month to month or annual contracts. Open source integrations
Developer tools Several APIs Cloud Dataflow REST API, SDKs for Java and Python Import API, Stitch Connect API for integrating Stitch with other platforms, Singer open source project

Let's dive into some of the details of each platform.

Transformations

StreamSets

StreamSets comes with more than 50 pre-load transformation processors, which users can drag and drop onto a graphical workspace. Processors can look up, remove, convert, parse, and aggregate data from various sources. Developers can write their own custom processors in Java, Java Expression Language (EL), JavaScript, Jython, Groovy, and Scala.

Google Cloud Dataflow

Cloud Dataflow provides a serverless architecture that can shard and process large batch datasets or high-volume data streams. The software supports any kind of transformation via Java and Python APIs with the Apache Beam SDK.

Stitch

Stitch is an ELT product. Within the pipeline, Stitch does only transformations that are required for compatibility with the destination, such as translating data types or denesting data when relevant. Stitch is part of Talend, which also provides tools for transforming data either within the data warehouse or via external processing engines such as Spark and MapReduce. Transformations can be defined in SQL, Python, Java, or via graphical user interface.

Try Stitch for free for 14 days

  • Unlimited data volume during trial
  • Set up in minutes

No credit card required

Connectors: Data sources and destinations

Each of these tools supports a variety of data sources and destinations.

StreamSets

StreamSets Data Collector (SDC) supports more than 40 storage and database sources, plus Kafka Streams and MapR Streams; no SaaS integrations are available other than Salesforce. Destinations include Google BigQuery, Snowflake, Amazon S3, Microsoft Azure SQL Data Lake, and more than 30 other database, storage, and streaming platforms.

Google Cloud Dataflow

Cloud Dataflow supports both batch and streaming ingestion. For batch, it can access both GCP-hosted and on-premises databases. For streaming, it uses PubSub. Cloud Dataflow doesn't support any SaaS data sources. It can write data to Google Cloud Storage or BigQuery.

Stitch

Stitch supports more than 100 database and SaaS integrations as data sources, and eight data warehouse and data lake destinations. Customers can contract with Stitch to build new sources, and anyone can add a new source to Stitch by developing it according to the standards laid out in Singer, an open source toolkit for writing scripts that move data. Singer integrations can be run independently, regardless of whether the user is a Stitch customer. Running Singer integrations on Stitch’s platform allows users to take advantage of Stitch's monitoring, scheduling, credential management, and autoscaling features.

Support, documentation, and training

Data integration tools can be complex, so vendors offer several ways to help their customers. Online documentation is the first resource users often turn to, and support teams can answer questions that aren't covered in the docs. Vendors of the more complicated tools may also offer training services.

StreamSets

StreamSets provides support through a Zendesk ticketing system. Documentation is comprehensive. Digital training materials are available.

Google Cloud Dataflow

Google provides several support plans for Google Cloud Platform, which Cloud Dataflow is part of. Documentation is comprehensive. Google offers both digital and in-person training.

Stitch

Stitch provides in-app chat support to all customers, and phone support is available for Enterprise customers. Support SLAs are available. Documentation is comprehensive and is open source — anyone can contribute additions and improvements or repurpose the content. Stitch does not provide training services.

Pricing

StreamSets

StreamSets provides a 30-day free trial. Pricing isn't disclosed.

Google Cloud Dataflow

Cloud Dataflow is priced per second for CPU, memory, and storage resources.

Stitch

Stitch has pricing that scales to fit a wide range of budgets and company sizes. All new users get an unlimited 14-day trial. After the trial, there's a free plan for smaller organizations and nonproduction workloads. Standard plans range from $100 to $1,250 per month depending on scale, with discounts for paying annually. Enterprise plans for larger organizations and mission-critical use cases can include custom features, data volumes, and service levels, and are priced individually.

Get started now

Which tool is best overall? That's something every organization has to decide based on its unique requirements, but we can help you get started. Sign up now for a free trial of Stitch.