Building Making It Happen
Building Making It Happen
  Sign-in         Register
    
Ask a question Listing Page
Refresh frequency of a Data Warehouse
What should be the refresh frequency of a Data warehouse?
 
This page of 'Ask a question' is linked to:  Data Warehousing, BI business intelligence end-to-end view, Data Analysis/OLAP, BI platform Tools Evaluation,


This purely depends on the business need. However, in most of the cases, the Data Warehouse is to be refreshed on the daily basis. The reasons are:

  • System becoming consistent only after EOD batch-runs: Data warehouse integrated the data from multiple systems. Many of these systems achieve consistency of data across them after the end of the day batches. For example sales compensation system applying commission calculations, after receiving the sales activity details from sales management system, at the end of the day.
  • Avoiding Extraction load during OLTP operations: Data Warehouse, as they do extraction can place a significant load on the source systems, thereby slowing them down. There are smart ways to get around this issue is to have partition based extractions, with data not linked across the partitions.
  • Simpler and Manageable: It is easy to related to and simpler to manage. Anything less than daily updates can create complexities like tracking the more frequently refreshed data separately from the daily refreshed data.

There can be business requirements on more frequent refresh. However, one has to do it only when there is a very compelling business case. The business requirements is more to do with the operational needs, and not for managerial or strategic needs. You may also like to look at our views on Data Federation.

   Access more details on this page   

Quick Feedback- Was this information helpful ?
Relevant Links to this page
Expert's Answers → Entry criteria to start DW project → Expert's Answers → Online data feed to Data Warehouse. → Expert's Answers → Data Warehouse- Big Bang or Incremental → Expert's Answers → Dimensional model vs Relational model → Expert's Answers → Interview sequence for DW business requirements → Expert's Answers → Pre-configured reports- Do they work? → Expert's Answers → Business Intelligence vs Business Performance → Expert's Answers → Integrating Data Marts to Data Warehouse → Expert's Answers → EAI vs Data Warehouse → Expert's Answers → Operational Data Store vs Data Warehouse → Expert's Answers → Source of Enterprise Reporting → Expert's Answers → Data Warehouse Source System approach → Expert's Answers → ROI of Data Warehouse → Expert's Answers → Partial Customer Information → Expert's Answers → Source system re-writing in parallel to Data Warehouse → Expert's Answers → Alignment between Source Systems and Data Warehouse → Expert's Answers → Maximizing usage of Data Warehouse → Expert's Answers → Simultaneous launch of source system and Data Warehouse → Expert's Answers → Security Matrix of a Data Warehouse → Expert's Answers → ETL phase taking too long → Expert's Answers → Should Data Warehouse wait for Meta-Data initiative → Expert's Answers → Mismatch in Source vs Data Warehouse reporting. → Expert's Answers → Data Warehouse vs Data Mart vs Data Mining → 
 
Back
Featured Pages
MDM Tools- Entity Management
BI platform and system quality
Metadata Architecture Scenarios
Data Warehouse Project Readiness

Make 'Executable' Strategy
Maximize Results
Maximize People
Manage Execution

Featured Pages
Individual Impact and Usage of BI
Parallel Dimensional Hierarchy
Customer Data Challenges
Data Model Entity Relationship Analysis