Cloud Ecosystem of Managed Services
Data Management
Data Management capabilities refers to platform components to manage and track data access and sharing; data availability; data storage; data transformation; and notifications. In addtion this provides capabilities for developing and managing the ETL (extract, transform, and load) services with good data quality.
Description
The Scheduling and Orchestration Service provides the ability to set up recurring executions of data pipelines/processes based on time parameters or conditions. This service reduces the need for manual intervention and can be used in conjunction with infrastructure provisioning capabilities.
Key Capabilities Include:
- Time-based Schedule Creation - Configuration of recurring job executions based on time conditions, (e.g. time of day, day of week, 1st day of the month, etc.)
- Condition-based Schedule Creation - Configuration of recurring job executions based on specific conditions being true. This could include dependency on another job, a specific file being delivered or a notification from another system.
- Job Execution Retry - In the event that a job does not complete successfully, automatically restarting the job
- Point-of-Failure Restartability - In the event of a process failure, the ability to restart the job from the point that the failure occurred vs. restarting the entire process over.
- Job Branching and Merging - Complex orchestration that allows jobs to initiate other jobs, wait for other jobs to complete before execution and feed processing details into subsequent jobs.
Maturity:
FCS is exploring the capabilities in this area. Currently only a proof of concept deployment is occuring with a single customer/tenant or with a handful. Use of the capability is still ad hoc and has yet to be baselined or have cost estimates established.
Technology
None
Additional Documentation
Description
The Data Model service provides a means to manage and map key organizational data and relationships between that data and represent those relationships graphically. This is key for supporting data governance, management, and design activities. Integration of the Data Modeling solution and Data Catalog is key to ensure consistent data management.
Key Capabilities Include:
- Model Creation - Define a model including key entities/tables, attributes/fields, and relationships.
- Attribute Management - Configuration of attributes including defining business and technical metadata
- Relationship Management - Define how different entities are related based on the attributes that each entity contains
- Constraint Management - Establish rules for attributes, (e.g. key values, valid values, nullability, format, etc.)
- Data Definition Language Generation - Creation of scripts from the data model that can be used to create/modify database objects.
- Reverse Engineering - Generating a data model based on a database DDL
Maturity:
FCS is exploring the capabilities in this area. It is is currently in as a proof of concept phase and not ready for broad consumption.
Technology
None
Additional Documentation
Description
The Data Sharing service provides systematic means for data owners to expose data to interested parties through controlled interfaces.
Key Capabilities Include:
- Direct Access - Providing data consumer direct access to the data storage layer through defined access controls based on the sensitivity of the data and the permission of the user.
- Data Abstraction - Creation of a semantic layer to manage data access and provide a managed view of the data to the data consumer where the consumer does not have direct access to the underlying data.
Maturity:
FCS is exploring the capabilities in this area. It is is currently in as a proof of concept phase and not ready for broad consumption.
Technology
None
Additional Documentation
Description
The Data Exchange service provides a means to deliver authoritative copies of data to downstream users/systems to support local application processing and/or analytics.
Key Capabilities Include:
- Bulk Data Transfer - Creation of an authoritative copy of data that can be delivered to the consumer for reuse. This is done through the creation of batch files delivered to a specified location or through the creation of database replicas for one-time or ongoing (change data capture) data transfer.
- Application Programming Interface (API) - Brokered real-time synchronous interface between data owner and consumer based on a request/response paradigm whereby the consumer makes a specific request for data to the data owner based on a predefined data specification.
- Event Publication - Brokered real-time asynchronous interface where the data owner publishes notifications of changes in state or the actual state change of data to a centralized queue where consumers can monitor the queue for data of interest and consume and process the data as the events occur.
Maturity:
FCS is exploring the capabilities in this area. Currently only a proof of concept deployment is occuring with a single customer/tenant or with a handful. Use of the capability is still ad hoc and has yet to be baselined or have cost estimates established.
Technology
Additional Documentation
Description
The Data Processing service enables integration, standardization, organization, and data derivation to make data easier to consume/use downstream. It supports data integration to manipulate and consolidate data from disparate sources into a useful form. This allows users to have easy access and reliable means to meet the information needs of all applications, users, and business processes. It helps to produce a unified view to be able to glean actionable information from it.
Key Capabilities Include:
- Extract Transform Load (ETL) - Access and pull data from sources, apply transformations, refine and publish data for downstream consumption.
- Extract Load Transform (ELT) - Access and pull data from sources, persist a copy of the source data for additional refinement, apply transformations, refine and publish data for downstream consumption
Maturity:
FCS believes this capability has reached a level of maturity in FCS where it can be used and deployed in a limited capacity or upon special request from a customer/tenant.
Technology
Additional Documentation
Description
The Data Storage service provides the ability to store, manage, and expose data for data consumers to access, query, explore, analyze, and use that data to generate new insights and reports.
Key Capabilities Include:
- Unstructured Data Storage - Capturing and persisting data in a scalable manner to enable centralized storage of cross-domain data for further downstream processing and consumption. Unstructured data storage can handle any file/object type and store it in a cost-effective manner with easy ingestion and access methods.
- Structured Data Storage - Capturing and persisting conformed data organized in a business context to support ease of data exploration, analytics and reporting. Structured data storage enforces data design specifications such as schema to improve quality and usability of the data.
- Data Access - Query/interact with data through standard interfaces based on user roles and data protection policies.
- Data Protection - Encrypt data to further protect it from unnecessary exposure/access
Maturity:
FCS believes this capability has reached a level of maturity in FCS where it can be used and deployed in a limited capacity or upon special request from a customer/tenant.