Building Making It Happen
Establishing Making-it-Happen as ‘Formal & Measurable’ Business Discipline
  Sign-in         Register
    
   Business Rules Definition Business Process Controls  

Execution-MiH Encyclopedia  →   Enterprise Intelligence  →  SECTION -  Data Quality  →  CHAPTER -  Data Quality Assurance and monitoring  → 

Batch-Processing controls

With tons of data getting processed in the night, a robust flow sequence and pre processing-wip-post processing batch processing controls are must.

These controls are inherent in any batch-processing environment. Most of the organizations having stable system environment should have these controls.

Roll Backs and Commits

A transaction should commit itself (write onto the database), once all the processing to bring the database into a state of consistency is completed. If there is a failure anywhere, it should rollback itself. For example – Writing down the complete voucher details (including all Debits and Credits) before committing.

Today’s databases have sophisticated methods to drive these commits, and rollback options. Apart from consistency, the commit and rollbacks are also used for managing large processing jobs, for better performance management.

For large batches, the commit and roll back spans become bigger. This reduces the commit overhead, so to avoid doing commit after every transaction.

Batch Cut-offs

These controls assure that the batches do not start OR end before OR after the prescribed time limit. There are many reasons.

For example the Credit Card billing cycle batch to start by 9.00 P.M. (after most of the transactions are done), post which the card statement generation process to begin by 2.00 A.M. so that the spool files can be sent to the card statement printing batch by 5.00 so that the collation and stamping etc. is done by 8.00 A.M. to be picked up by the postage and shipping company.

Pre and Post batch-processing - Sequential controls

Every batch process has to have defined 'start criteria' and 'end criteria'. You would not like to run you month-end valuation batch, till the month end business transaction accounting batch has run.

Batch Failure Response Rules

These rules define the response of a system, as a failure or a defect is detected during the batch run. The rules could include:

  • Skipping the record at which the failure happens and place it in the error log.
  • Stopping at the record, where the failure happens, roll-back to the previous committ point, and wait for the problem to be resolved.
  • Place a default value in the record, where the failure happened, so that processing can proceed. These default values to be corrected in the next processing cycle.
  • Cancel the batch and roll-back to the start point of the batch and wait for the problem to be corrected.

In all the above we assume that a log is maintained around the errors encountered and action taken.

 

   Business Rules Definition Business Process Controls  
 
All Topics in: "Data Quality Assurance and monitoring" Chapter
 Data Interface Exchange Controls →  Data Entry Input Form Controls →  Data Domain and Data Standards Controls →  Data Model Entity Relationship Controls →  Business Rules Definition →  Batch-Processing controls →  Business Process Controls →  Business Partner Interface Controls →  Data Quality Monitoring → 
 

Was this page helpful?
If you like it ? share it !
Digg
Digg
Reddit
Reddit
Del.icio.us
Delicious
Google
Google
Live
Live
Facebook
Facebook
Slashdot
Slashdot
Netscape
Netscape
Technorati
Technorati
Stumbleupon
Stumbleupon
Spurl
Spurl
Furl
Furl
Blogmarks
Blogmarks
Yahoo
Yahoo
Plugim
Plugim
Squidoo
Squidoo
BlinkBits
BlinkBits
 
Content Additions
 
CONTENT ZONE
Data Quality

Featured Pages
Data Quality Proposal & Agreement
BI Performance Management- Setting the Context
Universal names and definitions
Customer Data Quality Impacts

Make 'Executable' Strategy
Maximize Results
Maximize People
Manage Execution

Featured Pages
Data-Warehouse Requirement Interview
Integrate stand-alone BI
Business Ownership of Data Quality
Customer Data Searching and Matching