The Grouparoo Blog
As Data Engineering keeps evolving, more traditional Software Engineering practices continue to be incorporated into the field. The development workflow for reverse ETL allows you to check configuration-as-code into a git repository, using the workflow you already know and love: create a pull request with your changes, have a team member review the code, and merge it in when it’s ready.
We’ve continued to make this workflow better, introducing tools like our Config UI, which makes it easy to configure Grouparoo through a visual interface, in context with your data, while still outputting declarative configuration in the form of JSON files.
Now that everything is in a git repository, it's time to deploy. Building upon these features, we’re now making deploying and managing Grouparoo even easier with Grouparoo Cloud, bringing continuous integration and deployment to your Grouparoo project.
Here's a quick look at how it works:
Integrating a new or existing GitHub repository with Grouparoo Cloud is as simple as installing a single GitHub action. Check out a full example by visiting the app-example-cloud project, or watch the video above for a more guided tour.
As you change your groups or send your users to new Destinations, create pull requests with your changes and get automatic validation of your Grouparoo configuration. This adds confidence that the configuration you’ll deploy is working and ready to go.
Want to go even deeper? You can take it one step further by writing snapshot tests to ensure that the application is producing the records and groups you expect.
When you're ready to deploy, just merge your changes into the
main branch and Grouparoo Cloud will deploy your latest configuration into production. This means that the code in your git repository will always match what's deployed to production.
Because Grouparoo Cloud was designed with hosting Grouparoo in mind, it runs optimized infrastructure for your instance. In addition, set sensitive connection details as secrets, view your latest logs, browse your history of applied configurations, and more.
Tagged in Product Engineering
See all of Pedro S Lopez's posts.
Pedro is a full-stack Software Engineer working on Grouparoo, an open source data framework that easily connects your data to business tools. He's a tinkerer that enjoys reverse engineering, automation and technology in general. When he's not programming, Pedro spends his time playing and listening to music.
Learn more about Pedro @ https://pedroslopez.me/