Introducing: Revision history via Git

Secoda can now be synced with a Git repository, letting you customize how you develop and deploy Secoda and help your team adhere to application development lifecycle best practices. Sync Secoda to a Git repository, so you can manage Secoda workspace as code.

Data teams have been speaking about managing data as code and treating data as a product. Lots of conversations in 2021 circulated around bringing software development best practices into data. With this new feature, we allow data teams to manage their data catalogue the same way software engineering teams manage products. Although this is a V1 of the feature, we think it's a monumental improvement in the workflow in Secoda. In the future, we'll be building the ability to integrate with GitHub's branching features to bring the best practices for version control and knowledge management to your data knowledge.

With this approach, data engineers can manage version history of Secoda as well as manage their own data in their own instance. Teams can start monitoring the changes across Secoda and retract any changes before they impact the master branch. In the future, this will allow data teams to run tests & perform QA on the staging instance while end-users can access the application on the production instance.

The Git integration mainly solves two problems

1. Version control - you can use the generated snapshot of your Secoda data to rollback unwanted changes or accidental data loss
2. Extensibility - you can use the git repo data to build new interfaces, dashboards, APIs, etc. on top of the data you have curated inside Secoda

The Git integration requires an enterprise plan on Secoda, which you can upgrade to after speaking to our sales team. If you're interested in trying out the Git integration, you can send us a message over email or in our Slack community

There are three steps to getting started using Git with Secoda

1. Create an empty Git repository for Secoda to push data to.
2. Prepare your Git credentials
3. Connect Git to Secoda

The following guide contains screenshots and links from Github but Secoda’s Git integration works with every other Git host as well.

Create an Empty Git Repository

Navigate to this url to create a new repo. Please ensure you set your repo to be private, otherwise you risk exposing your company’s private data to the public.

Once the repo is created. Please note the HTTPs URL of the repo.

Prepare Your Git Credentials

Your git username password are the same as your Git hosting credentials. However, If you have enabled 2FA on your account, you will have to generate a new personal token.

1. Open this link on Github
2. Click on “Generate new Token” at the top right
3. Name your token “Secoda Git Integration” or any other name you see fit
4. Set the expiration to “No Expiration”
5. Check the “repo” checkbox
6. Scroll to the bottom and click on “Generate Token”
7. Please note the generated token for the next step.

Connect Git to Secoda

1. Open your Secoda settings.
2. Navigate to the “Git” tab on the left
3. Input your repo https web address from the first step into “Repository Origin”
4. Input your Git credentials from step 2 for “Git Username” and “Git Password”

1. Click on add repo to save the integration.
2. Once integration is created, click on “Push to Git” to run your first extraction

Once the git extraction finishes running, you will receive an email indicating the extraction has been completed.

Video Walkthrough

Watch a quick introduction to this feature by one of our engineers.

This is a V1 of the feature but we're hoping to evolve it into what a tool that can give teams the ability to create full Dev/Staging/Production Secoda states that they can use to merge changes into the master branch.

Try Secoda for Free

Users of the modern data stack should consider trying Secoda for free due to its array of valuable features. Secoda offers a user-friendly platform that promotes data accessibility, empowering individuals across different teams to explore and analyze data without relying on technical specialists. By centralizing data assets into a comprehensive catalog, Secoda simplifies data discovery and enhances productivity. Moreover, its collaborative environment enables real-time collaboration, fostering effective communication and knowledge sharing among team members. Secoda's query versioning and reusability capabilities facilitate efficient analysis replication and troubleshooting, saving time and effort. Additionally, the integrated knowledge base empowers users to document and share insights, leading to better decision-making and increased efficiency. Overall, trying Secoda for free can unlock the potential for improved data analytics workflows, enhanced collaboration, and optimized decision-making within the modern data stack.