See discussions, stats, and author profiles for this publication at: https://www.researchgate.
net/publication/290045918
Data Warehouse Testing (Poster)
Poster · January 2013
DOI: 10.13140/RG.2.1.3948.0409
CITATIONS READS
0 477
1 author:
Neveen Elgamal
Cairo University
14 PUBLICATIONS 37 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
DeepMotions View project
SimilarMove View project
All content following this page was uploaded by Neveen Elgamal on 12 January 2016.
The user has requested enhancement of the downloaded file.
Data Warehouse Testing
Neveen ElGamal
Department of Information Systems, Faculty of Computers and Information, Cairo University
Introduction Related Works Rationale
Data Warehousing involves data DW available testing approaches misses:
Tanuška, Moravčík, et al. 2009
transformation, integration, structuring,
Cooper and Arbuckle 2002
• A generic testing approach that
Golfarelli and Rizzi 2009
cleansing, and grouping leading to
Brahmkshatriya 2007
Test
works with all DW architectures
the possibility of unintentional data • A complete DW testing approach
Theobald 2007
Bateman 2002
Rainardi 2008
Munshi 2003
Mathen 2010
corruption and/or manipulation. that tests all levels and components.
Bhat 2007
Therefore, Data Warehouse (DW) DS-->ODS • A DW Testing Life Cycle
testing is a very critical stage. • Inter-Test Dependencies
Schema Requirement testing
DW differs from traditional User Requirements coverage
• Label tests according to Importance
transactional system and computer ODS Logical Model
• Test Automation or automated
Field Mapping
applications in many different aspects: Data type constraints assistance Tests.
Global Data Warehouse Architecture
• Ad-hock queries Vs Pre-defined Transformation rules
Correct Data Selection
queries In My PhD I will not take into
• Data Centric Vs Code centric Data Integrity Constraints
consideration:
• Huge data volumes Parent-child relationship
Record counts
1. Test routines that targets
• Huge test-data volumes Duplicate Detection
unconventional DWs like temporal
• Unlimited number of test cases Threshold Test
Data Boundaries DWs, active DWs, Spatial DWs,
• Testing sustains after system Data profiling
DW2.0, etc...
Random record comparison
delivery Surrogate keys 2. Test routines that targets the User
• System-triggered scenarios Vs Interface (UI) layer.
Operation Review job procedures
User triggered Scenarios Error Messaging 3. Test routines checking the data
• Different test types Processing time
quality of the data sources
Integration testing
Therefore, Data Warehousing requires Rejected record
more a tailored testing approach. Data access
Investigating Existing Trials for DW Testing Sample of the Comparison and Evaluation
Matrix of Existing Approaches
Proposed DW Testing Framework
Fill the gaps of existing approaches Recover existing drawbacks Benefit from previous work achievements
Repository
Business Expert
System User
Validation
Detailed Test Plan
DW Architecture Test Manager
DW Development State Preliminary Test Plan
Analyzer Recommender Verification Automated Test Results
Test Manager Test
Manager Manager
DB Admin
Test Test Case Test Data
Dependency Test Automation
Generator Generator Tools
Graph System Tester(s)
Work in
Expected Results progress
Challenges in Exploring Available Comparison and DW Testing Building the DW Testing Framework Testing Tool
Data Warehouse DW Testing Evaluation of Existing Framework Test Dependency Verification Validation and
Testing Approaches Approaches Architecture Graph Manager Manager Experimentation
References About the Author
1. Batemn, C. Where are the Articles on Data Warehouse Testing and Validation Strategy? Information Management, 2002.
2. Bhat, S. Data Warehouse Testing - Practical Stick Minds, 2007. •Bachelor of Computer Science, Cairo University (May 2002)
•M.Sc. Information Systems, Cairo University (March 2006)
3. Brahmkshatriya, K. Data Warehouse Testing Stick Minds, 2007.
•PhD. Student in Data Warehouse Testing
4. Golfarelli, M. and Rizzi, S. A Comprehensive Approach to Data Warehouse Testing ACM 12th international workshop on Data •Occupation: Assistant Lecturer, Faculty of Computers and Information, Cairo University
warehousing and OLAP (DOLAP '09), Hong Kong, China, 2009. •Publications:
5. Golfarelli, M. and Rizzi, S. Data Warehouse Testing: A prototype-based methodology. Information and Software Technology, 53 1. ElGamal, N., El-Bastawissy, A., Galal-Edeen, G. Towards a Generic Conceptual Model
(11). 1183-1198. for Data Warehouses . In 5th International Business Information Management
6. Mathen, M.P. Data Warehouse Testing InfoSys, 2010. Association (IBIMA), Cairo, Egypt, 2005
7. Munshi, A. Testing a Data Warehouse Application Wipro Technologies, 2003. 2. ElGamal, N. Data Warehouse Conceptual Modeling Approaches. In 37th
International Conference on Computers and Industrial Engineering (CIE37),
8. Rainardi, V. Testing your Data Warehouse. in Building a Data Warehouse with Examples in SQL Server, Apress, 2008.
Alexandria, Egypt, 2007
9. Tanuška, P., Moravčík, O., Važan, P. and Miksa, F., The Proposal of Data Warehouse Testing Activities. in 20th Central European 3. ElGamal N., El-Bastawissy A., and Galal-Edeen, G. Towards a Data Warehouse Testing
conference on Information and Intelligent Systems, (Varaždin, Croatia, 2009), 7-11. Framework. In 9th International Conference on ICT and Knowledge Engineering (IEEE
10. Tanuška, P., Moravčík, O., Važan, P. and Miksa, F., The Proposal of the Essential Strategies of Data Warehouse Testing. in 19th ICT&KE), Bangkok, Thailand, 2011
Central European Conference on Information and Intelligent Systems (CECIIS), (2008), 63-67. 4. ElGamal N., Data Warehouse Testing. In Joint EDBT/ICDT Ph.D. Workshop, Genoa,
11. Tanuška, P., Verschelde, W. and Kopček, M., The proposal of Data Warehouse Test Scenario. in European conference on the use of Italy 2013
Modern Information and Communication Technologies (ECUMICT), (Gent, Belgium, 2008).
Email: n.elgamal@fci-cu.edu.eg
12. Theobald, J. Strategies for Testing Data Warehouse Applications Information Management, 2007.
View publication stats