ETL Logs Under a Pattern-Oriented Approach

Bruno Oliveira, Óscar Oliveira and Orlando Belo
Additional contact information
Bruno Oliveira: CIICESI, ESTG, Politécnico do Porto, Portugal
Óscar Oliveira: CIICESI, School of Management and Technology, Porto Polytechnic, Portugal
Orlando Belo: ALGORITMI R&D Centre, University of Minho, Portugal

International Journal of Data Warehousing and Mining (IJDWM), 2021, vol. 17, issue 4, 29-47

Abstract: Considering extract-transform-load (ETL) as a complex and evolutionary process, development teams must conscientiously and rigorously create log strategies for retrieving the most value of the information that can be gathered from the events that occur through the ETL workflow. Efficient logging strategies must be structured so that metrics, logs, and alerts can, beyond their troubleshooting capabilities, provide insights about the system. This paper presents a configurable and flexible ETL component for creating logging mechanisms in ETL workflows. A pattern-oriented approach is followed as a way to abstract ETL activities and enable its mapping to physical primitives that can be interpreted by ETL commercial tools.

Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/IJDWM.2021100102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jdwm00:v:17:y:2021:i:4:p:29-47

Access Statistics for this article

International Journal of Data Warehousing and Mining (IJDWM) is currently edited by Eric Pardede

More articles in International Journal of Data Warehousing and Mining (IJDWM) from IGI Global
Bibliographic data for series maintained by Journal Editor ().