Managing pipelines across multiple instances can be a daunting task. Manually deploying, migrating, validating, or testing pipelines across instances is a painstaking process and can be very time-consuming.
Allows you to connect to multiple instances simultaneously, so that you can manage pipelines across instances regardless if they are in private or public clouds. Copying pipelines from one environment onto another, or from one namespace into another namespace on the same instance becomes effortless.
Leveraging Git for version control allows teams to work more efficiently, and now you can extend this practice to pipeline management as well.
You can export pipelines from any environment, inclusive of all namespaces, as a single compressed archive containing all pipelines for all namespaces, or export pipelines only for a given namespace, or individually as desired.
Exported artifacts are structured in a hierarchical fashion composed of folders matching the namespace name that containscontain the pipelines for that namespace. Use your standard Git tooling and practices to incorporate those artifacts into a repository and manage artifact promotion with CI/CD. So, no more excuses! Check your pipelines into Git and get started.
Uploading pipelines to any environment is just as easy. You can upload artifacts of an entire environment, by namespace, or individual pipelines. Auto-upgrade detection is also included. Incorporating a Git workflow into your CDAP and Cloud Data Fusion ecosystem will allow you to automate much of the manual and mundane tasks so you can focus on building great applications.
Scale up your operations with AdaptiveScale. Take control of your development, testing, and production environments with the right set of tools and services for data integration. AdaptiveScale software empowers individuals and enterprises to focus on building great applications by removing barriers for managing multiple environments.
CDAP and Cloud Data Fusion provide a solid foundation for data governance and lineage for data processed through the platform. Leveraging the platform’s underlying metadata opens many new possibilities for data governance at scale.
Go beyond data integration by incorporating Data Governance and Data Cataloging & Tagging for relational database systems. AdaptiveScale allows you to unify your private and public cloud operations with enhanced controls for data governance and lineage. Easily find the data you need regardless if it resides on-prem in an RDBMS or on a data warehouse in the cloud. Apply processing rules based on tags for securely handling sensitive and PII data.Learn more