Sales Management Customer Relationship Human Resources Business Performance BI & Data Quality IT Tools & Vendors

Sign-in   Register
Establishing 'Making it Happen' as a 'Formal & Predictable' Discipline
Principles and Rules Listing Page

Handling Sparse Dimensional tables

In case you have a dimensional tables where significant proportion of instances have majority of the fields as null data in the records, one should look at creating a snowflake to save diskspace, incase the database system is a fixed field records (where null fields also occupy disk space).
 
This page of 'Principles and Rules' is linked to:  Data Warehousing, Data Analysis/OLAP, BI platform Tools Evaluation, BI business intelligence end-to-end view,

Let's assume that as an organization, you are having wide variety of products, ranging from very simple products (needing say 5 attributes) to complex products (needing 50 attributes). If you are selling mostly simple products (say 90% by volume), the product dimension table will be a sparse table, with most of the cells as Null. As long as you have a variable field database (like Oracle), it's OK. However for a fixed field database, you will need to have a way to reduce the storage space over-head. The best way to handle it is to have snow-flake whereby the common fields (which are populated for simple as well as the complex products) are in the main dimension table and the ones which are specific to the complex products are in the snow-flake table linked to the main dimensional table.


Quick Feedback- Was this information helpful ?
Relevant Links to this page
TOPIC - Data Mart Business Theme Matrix in Data Warehouse Dimensional Model → Principles & Rules → Dimensional model has to be aligned to the Entity-Relationship → Principles & Rules → Always Use Conformed Dimensions → Principles & Rules → You may not be a able to have a perfect ETL → Practice Techniques → Handling Sparse Dimensional tables → Principles & Rules → Do not separate the parent and child line item data → Practice Techniques → Managing time-stamps across multiple time-zones → Practice Techniques → Recording events in multiple currencies → Practice Techniques → Handle different units of measure in the same fact table → Principles & Rules → Handling of Null foreign Keys in fact tables → Principles & Rules → Dimension Attributes as NULL → Principles & Rules → Don't rely too much on Meta Data Tools to enforce Business Intelligence → Principles & Rules → Don't wait for universal models for Data Marting → Principles & Rules → Add extra buffer for ETL phase → Principles & Rules → Homework before interviews is must (Business Requirements Phase in Data Warehouse) → Principles & Rules → Excel is the competition, which should be challenged → Principles & Rules → Avoid Pure MOLAP → Practice Techniques → Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Consolidate Data-Marts → Practice Techniques → Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Licensing & Maintenance Contracts → Practice Techniques → Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Governance & Standards → Practice Techniques → Field Tips Series- Streamlining & reducing cost of Business Intelligence- Evaluate Open Source → Principles & Rules → Master Data Management- Making a Right Start → Practice Techniques → How to integrate stand-alone BI environments- Gradual Approach → Principles & Rules → Business owned applications are a reality- Manage it → Principles & Rules → New Data Standards- What about existing data and applications? → Principles & Rules → Handle Each Time-stamp in the Fact Table as a separate dimension → Principles & Rules → Keep Aggregates and Details data in different Fact tables → Principles & Rules → Some considerations for Infrastructure in Data Warehouse → Principles & Rules → For Core BI platform go for a single, established and robust player → Principles & Rules → Don't be guided only by the business requirements for your Business Intelligence → Practice Techniques → Using Synonyms and Views → 
 
Back
 
Relevant links to this page
Data Mart Business Theme Matrix in DW
Dimensional model has to be aligned to the Entity-Relationship
Always Use Conformed Dimensions
You may not be a able to have a perfect ETL
Handling Sparse Dimensional tables
Do not separate the parent and child line item data
Managing time-stamps across multiple time-zones
Recording events in multiple currencies
Handle different units of measure in the same fact table
Handling of Null foreign Keys in fact tables
Dimension Attributes as NULL
Don't rely too much on Meta Data Tools to enforce Business Intelligence
Don't wait for universal models for Data Marting
Add extra buffer for ETL phase
Homework before interviews is must (Business Requirements Phase in Data Warehouse)
Excel is the competition, which should be challenged
Avoid Pure MOLAP
Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Consolidate Data-Marts
Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Licensing & Maintenance Contracts
Field Tips Series- Streamlining & Cost-Reduction in Business Intelligence- Governance & Standards
Field Tips Series- Streamlining & reducing cost of Business Intelligence- Evaluate Open Source
Master Data Management- Making a Right Start
How to integrate stand-alone BI environments- Gradual Approach
Business owned applications are a reality- Manage it
New Data Standards- What about existing data and applications?
Handle Each Time-stamp in the Fact Table as a separate dimension
Keep Aggregates and Details data in different Fact tables
Some considerations for Infrastructure in Data Warehouse
For Core BI platform go for a single, established and robust player
Don't be guided only by the business requirements for your Business Intelligence
Using Synonyms and Views
Additional Channels
Principles & Rules
Free Templates
Glossary
Key Performance Indicators

Most Popular Zones with list of pages crossing 25000 hits  →→→ 
Maximising Sales Performance
Sales ticket Size Mix
Sales Channel Retention, Support and Engagement
Sales Channel Management System
Sales force Training and Development
Sales Material logistics and Distribution
Read more...
  Customer Relationship Management
Customer Service and Support Overview
Customer Knowledge and Organizational Knowledge
Customer Value and Profitability- BI
Customer-Centric product-service management
Customer Value and Profitability Tips and Actions
Read more...
  Human Resources & Leadership
Be straight and blunt, till you team gets used to it
Feedback does not mean only negative feedback
Deliver Results
Develop Self and Others
Fitting leadership dimension in employee performance
Read more...
 
 
Business Performance & Planning
Strategic Planning Business Themes
Creating Strategy Blueprint
strategy blueprint Rationalize Align and Publish
Scorecards need manual finish
Strategy Map Objectives Measures and Initiatives
Read more...
  Business Intelligence & Data Quality
Dimensional vs relational storage
BI Competency Centre- A preface
Data Filtration Analysis
OLAP in Business Intelligence- What is OLAP?
Business Intelligence organization roles
Read more...
  IT Vendors & Tools Management
Data Quality through Data Integration Tools
OLAP Security
Delivery Evaluation Matrix
End User Reporting Features
Data Integration- Migration, Synch, Federation
Read more...