|
Metadata is a larger subject. Here we are addressing metadata only in context of Data Warehouse. Please refer Metadata for more details on this concept.
Source Specifications Metadata
Please refer to 'Source Systems', which lists all different type of possible source system. - Source Name
- Source Schema
- Source Location
- Source Purpose
- Source Description
- Source purpose
- Source Owner- Business
- Source Owner – Information technology
- Access methods and rights
Extraction Information
Metadata
- Source system and table-wise Extraction mapping to destination tables and fields in the staging area.
- Extract destination schema
- Extract Routine and scripts scheduling, mode of running
- Extract routine version and location
- Automated extract tool settings, if applicable
- Extract quality reconciliation and control routines
Dimension Table Management Metadata
- Dimensional Model – All Matrix and tables as shared in 'Data Warehouse Dimensional Modeling Process'
- Dimension Model – Physical Schema
- Slowly changing dimension policies for each incoming descriptive attribute
- Surrogate key assignment rule and counters.
Transformation and Metadata
- Business Specifications of the Transformation rules
- 'Source to destination' mapping
- Location of the Transformation Scripts
- Staging Area Schema
- Load scripts, Schedule and location
Metadata for Job Control and Audit Logs, and Documentation
- Data lineage and audit records (where exactly did this record come from and when?)
- Data Extraction, transform, Loading run time logs, success summaries, and time stamps
- Data transform software version numbers
- Security settings for extract files, extract software, and extract metadata
- Security settings for data transmission (i.e., passwords, certificates)
- Data staging area archive logs and recovery procedures
- Data staging archive security settings
DBMS Metadata - DBMS system table contents
- Partition settings
- Indexes
- DBMS-level security privileges and grants
- View definitions
- Stored procedures and SQL administrative scripts
- Backup procedures, and backup security
Front Room Metadata - Business names and descriptions for columns, tables, groupings, and so on
- Canned query and report definitions
- Default join specification tool settings
- Pretty print tool specifications (for re-labeling fields in readable ways)
- End user documentation and training aids (both vendor supplied and IT supplied)
- Network security user privilege profiles
- Network security authentication certificates
- Network security usage statistics, including logon attempts, access attempts, and user id by location reports
- Individual user profiles, with link to human resources to track promotions, transfers, and resignations that affect access rights
- Link to contractor and partner tracking, where access rights are affected
- Usage and access maps for data elements, tables, views, and reports
- Resource charge-back statistics
Most of the BI vendors have the metadata tools as part of their overall offerings. |
