PARQIT: Stata module to provide a grammar of data manipulation for Parquet files on an embedded DuckDB engine

Miguel Portela ()
Additional contact information
Miguel Portela: Universidade do Minho

Statistical Software Components from Boston College Department of Economics

Abstract: parqit reads, writes, joins and manipulates columnar Parquet data with ordinary Stata verbs -- keep, drop, gen, replace, collapse, pivot, merge, append, sort, reshape -- that run out-of-core on an embedded DuckDB engine and materialise one result table at a time into Stata's memory, or write it straight back to Parquet without loading the result into Stata's current dataset. Variable labels, value labels, notes, display formats and characteristics survive a parqit save / parqit use round-trip through standard Parquet key-value metadata, while files remain plain Parquet for Python (pandas, polars), R, Spark and other tools. SQL is available as an escape hatch (parqit sql), and parqit show prints the generated query.

Language: Stata
Requires: Stata version 16
Keywords: Parquet; DuckDB; out-of-core; big data; data management (search for similar items in EconPapers)
Date: 2026-08-25, Revised 2026-08-28
Note: This module should be installed from within Stata by typing "ssc install parqit". The module is made available under terms of the MIT license (https://opensource.org/licenses/MIT).
References: Add references at CitEc
Citations:

Downloads: (external link)
http://fmwww.bc.edu/repec/bocode/p/parqit.ado program code (text/plain)
http://fmwww.bc.edu/repec/bocode/p/pqrqit.sthlp help file (text/plain)
http://fmwww.bc.edu/repec/bocode/p/parqit_combine.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_explore.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_filter.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_gen.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_linux64.plugin
http://fmwww.bc.edu/repec/bocode/p/parqit_macarm64.plugin
http://fmwww.bc.edu/repec/bocode/p/parqit_macintel64.plugin
http://fmwww.bc.edu/repec/bocode/p/parqit_pivot.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_read.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_stats.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_vars.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_views.dlg
http://fmwww.bc.edu/repec/bocode/p/parqit_win64.plugin
http://fmwww.bc.edu/repec/bocode/p/parqit_basics.do
http://fmwww.bc.edu/repec/bocode/p/parqit_tour.do
http://fmwww.bc.edu/repec/bocode/p/parqit_write.dlg

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:bocode:s459873

Ordering information: This software item can be ordered from
http://repec.org/docs/ssc.php

Access Statistics for this software item

More software in Statistical Software Components from Boston College Department of Economics Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().