Scheduling of Extract, Transform, and Load (ETL) Procedures with Genetic Algorithm

Vedran Vrbanić and Damir Kalpić
Additional contact information
Vedran Vrbanić: Faculty of Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia
Damir Kalpić: Faculty of Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia

International Journal of Business Analytics (IJBAN), 2015, vol. 2, issue 3, 33-46

Abstract: A number of ETL procedures are used in the process of loading data to data warehouse systems. Some procedures can be executed concurrently in parallel mode, while for the others there are precedence constraints. Thus, the problem in scheduling procedures for execution is similar to the problem of scheduling of jobs in multiprocessor systems. The solution to this problem has been proposed in the optimum schedule of jobs minimizing the total execution time. When optimizing the schedule for ETL procedures, minimization of the total execution time is not the primary goal. Namely, the ETL procedures provide data required for reports aimed for business users and such reports need to be prepared until the user-defined deadlines. If the deadlines are not breached, the solution is satisfactory, regardless of the total execution time. Also, one cannot assume that all ETL processes are of the same importance – some have higher priorities than the others. That is the reason why prioritization and introduction of explicit bounds to completion time for individual ETL processes is attempted with genetic algorithm (GA). This paper encompasses implementation of the algorithm, experiments with different parameters and testing the quality of obtained solutions.

Date: 2015
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/IJBAN.2015070103 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jban00:v:2:y:2015:i:3:p:33-46

Access Statistics for this article

International Journal of Business Analytics (IJBAN) is currently edited by John Wang

More articles in International Journal of Business Analytics (IJBAN) from IGI Global
Bibliographic data for series maintained by Journal Editor ().