Incorporating your own range of functions in DQ batch processes

The Uniserv software, DQ Batch Suite, offers a large number of functions for the validation and improvement of the data quality in batch processes. In view of the diverse conditions under which the DQ Batch Suite is used, it is not feasible to consider all the demands which could arise in practical use in the standard software.

Instead it makes sense to offer the users a means to implement any functions they require which extend beyond the scope of the standard software. The script function comes into play here, as it allows them to integrate their own functions within the framework of the DQ Batch Suite.

At runtime, script executes the user-defined function for each record to be processed. This could be e.g. user-defined validation rules or data enhancement or data correction functions.

The underlying programming language, Perl, is integrated in the DQ Batch Suite and places no limits on the possibilities. Its particular strength lies in the manipulation of character strings and the use of standard expressions. As a result, highly efficient user-defined functions can be implemented for the parsing, validation and standardization of field contents.

Complex cross-field validations also present no problems as a result of the control structures which Perl provides. In addition to this, Perl has an extensive, freely accessible collection of additional functions for addressing Web Services or accessing relational databases. The services of third parties or functions for data enhancement can therefore be incorporated in DQ Batch Suite processing operations without any problems.

The script function is fully integrated in the framework of the DQ Batch Suite. Processing steps implemented by users by means of this function can

• be used in processing definitions
• change or add result fields of the processing operation
• provide attributes for self-defined reports
• be executed by the process engine of the DQ Batch Suite
• (manually, automatically, via API)
• be incorporated in the role and security concept

on an equal footing with the data quality functions provided by Uniserv.

Processing modules configured with the script function can be centrally stored via the template management of the DQ Batch Suite and reused in different processing definitions.

Sitemap | Webmaster | Privacy Policy | Imprint | © 2010 Uniserv GmbH