Sales Management Customer Relationship Human Resources Business Performance BI & Data Quality IT Tools & Vendors

Sign-in   Register
Establishing 'Making it Happen' as a 'Formal & Predictable' Discipline
   Business Rules Definition Business Process Controls  

ENCYCLOPEDIA→   Enterprise Intelligence  →   -  Data Quality  →   -  Data Quality Assurance and monitoring  → 

Batch-Processing controls

With tons of data getting processed in the night, a robust flow sequence and pre processing-wip-post processing batch processing controls are must.

These controls are inherent in any batch-processing environment. Most of the organizations having stable system environment should have these controls.

Roll Backs and Commits

A transaction should commit itself (write onto the database), once all the processing to bring the database into a state of consistency is completed. If there is a failure anywhere, it should rollback itself. For example – Writing down the complete voucher details (including all Debits and Credits) before committing.

Today’s databases have sophisticated methods to drive these commits, and rollback options. Apart from consistency, the commit and rollbacks are also used for managing large processing jobs, for better performance management.

For large batches, the commit and roll back spans become bigger. This reduces the commit overhead, so to avoid doing commit after every transaction.

Batch Cut-offs

These controls assure that the batches do not start OR end before OR after the prescribed time limit. There are many reasons.

For example the Credit Card billing cycle batch to start by 9.00 P.M. (after most of the transactions are done), post which the card statement generation process to begin by 2.00 A.M. so that the spool files can be sent to the card statement printing batch by 5.00 so that the collation and stamping etc. is done by 8.00 A.M. to be picked up by the postage and shipping company.

Pre and Post batch-processing - Sequential controls

Every batch process has to have defined 'start criteria' and 'end criteria'. You would not like to run you month-end valuation batch, till the month end business transaction accounting batch has run.

Batch Failure Response Rules

These rules define the response of a system, as a failure or a defect is detected during the batch run. The rules could include:

  • Skipping the record at which the failure happens and place it in the error log.
  • Stopping at the record, where the failure happens, roll-back to the previous committ point, and wait for the problem to be resolved.
  • Place a default value in the record, where the failure happened, so that processing can proceed. These default values to be corrected in the next processing cycle.
  • Cancel the batch and roll-back to the start point of the batch and wait for the problem to be corrected.

In all the above we assume that a log is maintained around the errors encountered and action taken.

 

   Business Rules Definition Business Process Controls  
 
 

Was this page helpful?
 
Content Additions
 
 
More on DQ Assurance & monitoring
Data Interface Exchange Controls
Data Entry Input Form Controls
Data Domain and Data Standards Controls
Data Model Entity Relationship Controls
Business Rules Definition
Business Process Controls
Business Partner Interface Controls
Data Quality Monitoring
BUY BI & Data Management Vendors & Tools Evaluation Kit
Read more...
BUY largest on-line Data-Quality Management Kit
Read more...
Additional Channels
Principles & Rules
Free Templates
Glossary
Key Performance Indicators



Most Popular Zones with list of pages crossing 25000 hits  →→→ 
Maximising Sales Performance
Sales Leads Generation through advertising
Sales Cost and Profitability Overview
Sales Compensation Analysis
Sales geographic expansion
Sales Channel SWOT
Read more...
  Customer Relationship Management
Customer Value and Profitability-Overview
Customer Service and Support - Strategic Role
Supply Chain for Customer Service and Support
Exit barriers for Customer Retention
Customer Value and Profitability Tips and Actions
Read more...
  Human Resources & Leadership
Deliver Results
Customer Focus
Lead Change
Leadership Development- Setting the Context
What is Leadership?
Read more...
 
 
Business Performance & Planning
Stakeholder test for Scorecard
A KPI should be simple -but it depends
Financial Business Plan
Internal Info Assessment Report
SWOT Assessment Report
Read more...
  Business Intelligence & Data Quality
Data Quality Definition- What is Data Quality?
OLAP what if Analysis
Data Quality Program Proposal
Data Quality Assurance Checklist
Data Warehouse sharing and browsing
Read more...
  IT Vendors & Tools Management
OLAP Server write backs
Load, Log and Cache Management for Reports
Data Integration- Migration, Synch, Federation
OLAP Performance Management
Vendor Commercial Evaluation- Billing structure
Read more...