Stitch makes it easy to integrate with any data source, because it's based on the Singer open source project. You can submit Singer integrations – called taps – to Stitch to have them integrated in the platform, and gain all the benefits of a modern ETL platform: built-in reliability, scalability, authentication, logging, alerting, and more. Sometimes, though, you don't need the full power of Stitch. That was often the case with data.world users who were still evaluating our product and required only a rudimentary pipeline or one-time data replication. Singer was ideal for those users, except for the complexity related to configuring and running Singer on their own machine. We (the data.world team) created KNOTS to make Singer easier to configure and use.
KNOTS is an intuitive visual desktop application for Singer that lets you replicate data quickly and easily. KNOTS can import data from a growing number of supported sources on an ad-hoc basis, or you can run KNOTS from your job scheduler of choice. With KNOTS' intuitive visual interface, you can configure data replication processes in minutes and bring your data together without any coding.
I also envision KNOTS as a great tool for developers who choose to implement Singer taps and targets and don't intend to release them to the public – those that extract data from homegrown systems, for example. Those developers will soon be able to extend KNOTS and offer an intuitive UI to their users as well.
By the way, in case you're wondering where the name came from, it's partly a play on words – KNOTS is "not Stitch" – and partly, a knot is a more primitive stitch.
To use KNOTS, install it according to the instructions in the project's README file. KNOTS runs on macOS and Windows.
Running KNOTS is a four-step process:
First, choose a tap. KNOTS currently supports seven data sources:
- Google Ads (AdWords)
- Amazon S3
- Facebook Ads
- Amazon Redshift
Enter the authentication information for your chosen tap and choose the tables or streams you want to replicate.
Next, select a target – either data.world or Stitch.
Enter credentials for your chosen target, then click Save and Run.
KNOTS will display logging information from the extraction and load phases. If all goes well, your data will be replicated.
Sounds easy, yes? Download KNOTS, give it a try, and let us know what you think.