The Goals of Test Data Management

 Test data management is the generation of non-production test data sets which reliably simulate organization's actual data set to enable software and systems developers to perform accurate and robust system tests. This test data management service is typically provided by system integrators who work hand in hand with software development teams to generate, manage and facilitate test data management needs. This data is generated from a variety of sources such as customer and user database, desktop, client server and internet application testing.

Agile methodologies demand that software developers to create test data management solutions that are coupled with quality improvement processes. This ensures that software development efforts are not disrupted due to lack of test data management. Additionally Agile methodologies encourage refactoring, minimizing the risk of code re-use and improving code reliability. This helps the overall efficiency of the software development life-cycle.

Continuous improvement processes include collection of test data, validating the test data, analyzing test data and suggesting improvements. This activity can be subdivided into various activities such as bug-tracking and feedback; refactoring; testing; and maintenance or tuning. The collection of test data involves collection of a large amount of data (e.g., database records) during the process of developing a software application. This test data may comprise diagnostic test data, usage and performance test data, and/or end-user test data. These test data may need to be stored in an offline or online repository; and they will need to be accessible over a period of time (e.g., on a periodic basis).

This test data management method is based on the principle that any piece of information should be made accessible only to those who need it. In other words, information that is sensitive is supposed to be protected. Therefore, test management tools work to enforce policies which deal with the storage, transfer, and use of sensitive data.

A test data management system must be flexible enough to accommodate changes in the system during the course of the software development. It is designed to allow a testing team to search through data requirements and revise the requirements as requirements become known. It is used so that changes in the system can be implemented before a software application is released for final testing.

Another important objective of test data management systems is to reduce the time spent searching for and comparing data sets. They are designed to collect test cases and generate test data without requiring the testers and developers to rewrite source codes. Instead, these systems provide a mechanism for storing test data that consists of source code, test cases, and data masks. The test data management system stores test data in a number of different types.