Interpretable and leakage-aware prediction of shipment delays in global supply chains: a Random Forest–SHAP workflow with multi-model benchmarking on the DataCo dataset

Divyansh Saini, Harman Singh and Bhavya Agarwal

Modern Supply Chain Research and Applications, 2026, vol. 8, issue 3, 419-433

Abstract: PurposeThis study develops a leakage-aware evaluation workflow for predicting shipment dispatch delays at the time of order, auditing when each predictor becomes available and quantifying how much apparent accuracy on the DataCo dataset derives from post-outcome information.Design/methodology/approachOn 172,765 completed DataCo shipments, a point-in-time audit identifies 21 order-time features and excludes post-outcome fields, including Late_delivery_risk. Five identically tuned models are compared over 15 order-grouped resamples with Nadeau–Bengio corrected t-tests (Holm-adjusted), cluster-bootstrap intervals, a chronological split, and exact SHapley Additive exPlanations (SHAP).FindingsThe leakage-free Random Forest attains R2 = 0.2719 (95% confidence interval 0.2569–0.2864). Restoring post-outcome fields raises R2 to 0.7589: a leakage inflation of ΔR2 = +0.4870 (same model, with versus without post-outcome inputs). A distinct diagnostic, the leaky model’s margin over a flag-threshold rule (ΔR2 = +0.0951), is meaningful only conditional on the leak. All five honest models lie within 0.0084 R2; SHAP indicates that order-time delay risk is structural, driven by mode, lane, and category base rates.Research limitations/implicationsFindings derive from one public dataset whose target is dispatch (not delivery) delay; generalisability claims are correspondingly modest.Practical implicationsDelay largely reflects infeasible service-level promises; the managerial levers are promise recalibration and base-rate triage, with measured detection rates (precision 0.864, recall 0.553) separated from assumed costs.Originality/valueA feature-level point-in-time audit, a quantification of leakage inflation on a widely used benchmark, and a replicable leakage-audit protocol including a target-permutation canary.

Keywords: Shipment delay prediction; Data leakage; Point-in-time prediction; Random forest regression; SHAP interpretability; Logistics analytics (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.emerald.com/mscra/article/8/3/419/1394 ... -aware-prediction-of (text/html)
https://www.emerald.com/mscra/article-pdf/8/3/419/ ... a-04-2026-0035en.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eme:mscrap:mscra-04-2026-0035

DOI: 10.1108/MSCRA-04-2026-0035

Access Statistics for this article

Modern Supply Chain Research and Applications is currently edited by YU Yugang

More articles in Modern Supply Chain Research and Applications from Emerald Group Publishing Limited
Bibliographic data for series maintained by Emerald Support ().