REVIEW 3 major objections 5 minor 1 cited by
Foundation Models for Credit Risk Prediction: A Game Changer?
T0 review · 3 major / 5 minor · reviewed 2026-08-02 · deepseek-v4-flash
Pith's one-line read Pretrained tabular foundation models, used with zero task-specific training, match or beat tuned gradient-boosting and deep-learning rivals on both probability-of-default and loss-given-default benchmarks, and their relative advantage grows
desk verdict Solid first credit-risk benchmark of tabular foundation models; the average-performance claim holds, but the headline small-data advantage is not statistically established. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the prior-data fitted network (PFN): a transformer pretrained on large numbers of synthetic tabular datasets sampled from priors over data-generating processes, so that inference on a new dataset is a single forward pass over labeled and unlabeled rows—no gradient updates, no tuning. The paper also relies on TabPFNv2's regression variant, which discretizes the continuous LGD target into an ordinal piecewise-constant distribution, a design well suited to the zero-one-inflated, bimodal loss distributions in the data. The evaluation machinery is a standardized cross-validation protocol with hyperparameter optimization for all non-PFN baselines, plus PAMA win rates,
What would settle it
A controlled subsampling experiment on one large retail default dataset: take the same portfolio, draw training sets of 500, 1,000, 2,000, 5,000, and 10,000 observations, and compare TabICL/TabPFNv2 against tuned boosting baselines. If the tuned baselines match or exceed the foundation models at small sizes once dimensionality, default rate, and feature semantics are held fixed, the paper's small-data claim is refuted. For LGD, the same test should include at least two or three zero-shot regressors, since the paper evaluates only one.
Extended reading notes
Core claim
The paper's central claim is empirical: in a five-fold cross-validation benchmark spanning 14 PD and 7 LGD datasets, tabular foundation models generally outperform state-of-the-art alternatives even when used out-of-the-box with no hyperparameter tuning. TabICL achieves the highest average AUC (0.7517) and the best fold-level win rate (25.7%) for PD, with foundation models collectively top in 44.3% of folds; TabPFNv2 achieves the highest average R² (0.4455) and wins 45.7% of folds for LGD. A global non-parametric ranking test rejects the null of equal performance, though pairwise post-hoc significance is limited—especially for LGD, where only seven datasets make multiple-comparison-corrected
Load-bearing premise
The small-data conclusion stands only if dataset size itself, not some correlated property of the small datasets (different loan products, feature counts, or default rates), is what drives the foundation models' relative advantage.
Editorial extensions
If this is right
- For probability-of-default modeling, a zero-shot model (TabICL) can match or beat tuned gradient boosting on discrimination, so a lender could ship a competitive scorecard without per-portfolio hyperparameter search.
- For loss-given-default, TabPFNv2 shows that framing regression as discretized ordinal classification can handle the bimodal, zero-one-inflated loss distribution better than tuned tree ensembles and deep regressors on these data.
- In small-data settings—SME lending, low-default portfolios, new products—the relative advantage of foundation models is largest, suggesting they are most useful where conventional models have the least signal.
- Operationally, removing tuning and retraining cuts time-to-model and compute, and allows one consistent model family across PD and LGD, which could simplify validation and monitoring.
- The global statistical test rejects equal performance among the 29 PD / 22 LGD methods, but pairwise significance is scarce; the practical ranking of the top methods should be treated as suggestive rather than definitive per-pair proof.
Reading between the lines
- Editorial extension: because the LGD leg rests on a single foundation model (TabPFNv2), the strongest testable extension is to run additional zero-shot regressors and standard LGD econometric baselines (e.g., two-part and beta models) on the same seven datasets; if the lead survives, the regression-side claim is much firmer.
- Editorial extension: the paper's own learning curves show TabPFNv2's R² declining as training rows pass about 8,000, with the authors unsure why; a focused study of whether the pretrained prior becomes a liability on larger in-domain samples, and whether ensembling a PFN with a GBM recovers the loss, would sharpen the small-data thesis.
- Editorial extension: a broader reading is that if zero-shot tabular models keep improving, the default workflow could shift from tuning a GBM per portfolio to validating a foundation model out of the box—but calibration, feature attribution, and stability under economic regime shifts would need dedicated study before that shift is safe.
- Editorial extension: the small-data result could be tested more cleanly by holding dataset origin constant—subsampling a single large retail portfolio to many sizes and comparing methods—which would separate the size effect from confounds like default rate and dimensionality.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper benchmarks tabular foundation models (TFMs) against a broad panel of classical, tree-based, and deep learning methods for two credit-risk tasks: probability of default (PD) classification and loss given default (LGD) regression. Using 14 PD and 7 LGD datasets, five-fold cross-validation, and a wide range of metrics, it reports that TabICL achieves the highest average AUC and the highest PD fold-level win rate (PAMA 25.7%), while TabPFNv2 achieves the highest average R² and wins 45.7% of LGD folds. Friedman tests reject global equivalence of methods, but only 22/406 PD and 0/231 LGD pairwise comparisons are significant after Holm correction. The paper further claims that TFMs offer particularly large gains in small-data settings, based on Spearman correlations between method rank and dataset size and on learning curves obtained by subsampling large datasets. The conclusion is that TFMs generally outperform state-of-the-art alternatives and are especially attractive for small credit portfolios.
Significance. The study is a broad, mostly self-contained empirical benchmark in an area where independent evidence is scarce. Its strengths include the use of a unified preprocessing/evaluation framework (TALENT), out-of-the-box evaluation of TFMs against tuned baselines, multiple performance metrics, and standard statistical procedures (Friedman, Holm-corrected Wilcoxon, PAMA). If the headline claims held, the paper would be a valuable reference for credit-risk modelers and would lend support to the 'foundation models are a game changer' narrative. As it stands, the two central claims—'generally perform best' and 'significant improvement as dataset size shrinks'—outrun the evidence: pairwise significance is weak, especially for LGD, and the small-data analysis is confounded. With appropriate revisions and more cautious wording, the paper could still make a useful contribution.
major comments (3)
- [§5.4, Figs. 8–11; Abstract] The headline claim that TFMs 'offer significant improvement in predictive performance when the size of the dataset ... grows smaller' is not established. The Spearman correlations in Figs. 8–9 are computed across heterogeneous datasets without adjusting for confounds: e.g., small PD datasets (PD8, PD10) have 20/14 features and high default rates, whereas the large PD14 has 2,986 features; among LGD datasets, the small Base Model/Base Modelisation have 202/256 features while the large HELOC has 8. The learning-curve experiment removes between-dataset confounds only by random row subsampling, which preserves feature spaces and default incidence; it does not reproduce the structure of SME/low-default portfolios. Moreover, Fig. 10 appears to compare TFMs mainly against XGBoost and logistic regression, not the strongest GBM baselines named in the text (CatBoost, LightGBM), and Fig. 11 shows a
- [§5.3; Tables 4–5; Abstract] The conclusion that TFMs 'generally perform best across datasets and tasks' is based on average metrics and PAMA, but the pairwise statistical evidence is weak: only 22/406 PD comparisons and 0/231 LGD comparisons are significant after Holm correction. PAMA is descriptive, and the Friedman test only establishes that some global differences exist, not that the top method is significantly better than the runner-up. Given that the best TFM and the best GBM differ by about 0.0023 AUC in PD and 0.0054 R² in LGD, the word 'best' is an overstatement. Please report effect sizes/confidence intervals for the top pairs and either temper the claim to 'competitive on average' or provide a more powerful analysis, especially for LGD where no pairwise difference survives correction.
- [§5.2, Table 5] The LGD component of the benchmark evaluates only one foundation model (TabPFNv2), yet the paper's abstract and conclusion speak of 'tabular foundation models generally perform best' across tasks. A single model is a thin basis for the 'paradigm shift' claim in regression. The average R² gap is also very small (0.4455 vs. 0.4401 for CatBoost), so the practical significance is unclear without per-dataset breakdowns. Please either add more regression-capable TFMs or restrict the generalizing claim to the particular model evaluated.
minor comments (5)
- [Figures 2–7] In the supplied manuscript, these figures appear as unreadable sequences of '/uni...' glyphs. If this is a rendering artifact, the final version must show actual axes, labels, and legends; otherwise the visual evidence cannot be inspected.
- [§5.4, Figs. 10–11 captions] The text says the learning curves include CatBoost, FTT, LightGBM, and XGBoost, but the figure captions list only TabICL/TabPFN/Logistic Regression/XGBoost and TabPFNv2/Linear Regression/XGBoost. Please clarify which curves are actually plotted and why the strongest GBM baselines are absent.
- [§4.3] The abstract emphasizes that TFMs are used 'out-of-the-box, without hyperparameter tuning', while §4.3 describes hyperparameter optimization for the benchmarked methods. Please clarify explicitly that HPO applies only to non-TFM baselines, so readers do not infer an asymmetric protocol.
- [General] No code or data availability statement is included. For a benchmark paper of this scope, a reproducibility appendix or repository link would substantially increase its value.
- [References] Several references are duplicated (e.g., Shwartz-Ziv and Armon 2022; Hurlin et al. 2018) and some entries have inconsistent formatting. A careful reference cleanup is needed.
Circularity Check
No circularity: benchmark results are read directly from held-out metrics against externally pretrained TFMs; the size correlation in §5.4 is correlational, not forced by construction.
full rationale
This paper is an empirical benchmark, not a derivation chain: it computes AUC/R2 of out-of-the-box tabular foundation models (TabPFN, TabPFNv2, TabICL, MITRA, TabPFN-Real) against tuned baselines on 14 PD and 7 LGD datasets under 5-fold CV. The TFMs were pretrained by external groups (Hollmann, Müller, Hutter et al.; Qu et al.), and the baselines are independently tuned via Optuna; none of the present authors' prior work justifies the central comparison. The two headline claims ('tabular foundation models generally perform best across datasets and tasks'; 'they offer significant improvement in predictive performance when the size of the dataset ... grows smaller') are read directly off held-out test metrics (Tables 4–5, Figures 8–11, PAMA analysis), with no fitted parameter that is later renamed a prediction and no equation that reduces the output to an input. The §5.4 small-data claim rests on a Spearman correlation across heterogeneous datasets and on learning curves obtained by row-subsampling; both are descriptive statistics with identifiable confounders (dimensionality, default rate, data origin), so the causal size interpretation is a validity risk, not a circularity. The paper itself flags the fragility of the LGD learning-curve evidence ('It is unclear why TabPFNv2’s performance declines at this point'), and §5.3 honestly reports that no LGD pairwise comparison survives Holm correction. Self-citations (Lessmann et al. 2015, Gunnarsson et al. 2021, Loterman et al. 2012, Óskarsdóttir & Bravo 2021, etc.) are confined to the literature review and one dataset source (PD14); none is load-bearing for the benchmark result, and no uniqueness theorem or ansatz is imported from the authors' own work. The paper even disclaims methodological novelty ('we do not advance deep tabular data learning methodology'). The strongest critique—that the size effect is correlational rather than causal—is an external-validity concern, which belongs under correctness risk, not circularity.
Assumptions & free parameters
free parameters (3)
- HPO budget =
20 Optuna trials per fold
- F1-optimal decision threshold =
per fold, on validation
- Learning-curve sample sizes =
500 to 15,000 observations
assumptions (5)
- domain assumption The 14 PD and 7 LGD datasets are representative of credit risk modeling portfolios
- domain assumption Spearman correlation between method rank and dataset size isolates the effect of sample size
- domain assumption Subsampling large datasets to 500–15,000 rows simulates genuine small-data portfolios
- domain assumption Standard metrics (AUC, R², MSE, etc.) capture what matters for credit risk decisions
- standard math TALENT framework and Optuna implementations are correct and leak-free
Cite this review
Pith. "Pith review of Foundation Models for Credit Risk Prediction: A Game Changer?." pith.science (2026). https://pith.science/paper/CTSB7GAT
@misc{pith2026260518147,
author = {Pith},
title = {Pith review of: Foundation Models for Credit Risk Prediction: A Game Changer?},
year = {2026},
howpublished = {\url{https://pith.science/paper/CTSB7GAT}},
note = {Machine review of arXiv:2605.18147}
}
read the original abstract
Predictive models play a pivotal role in credit risk management, guiding critical decisions through accurate estimation of default probabilities and losses. Extensive research has introduced new modeling techniques, complemented by large-scale benchmarking studies consolidating the state-of-the-art. Today, quasi-standards such as gradient-boosting models paired with SHAP explainers have emerged, yet continuous improvement of risk models remains a top priority. Concurrently, rapid advancements in AI, most notably large language models, have disrupted predictive modeling paradigms. Foundation models, pretrained on extensive datasets from diverse domains, have demonstrated remarkable performance by leveraging prior knowledge. While prevalent in natural language processing and computer vision, foundation models for tabular data have only recently emerged. We conjecture that pretraining on out-of-domain data is particularly beneficial in small-data settings, such as SME lending or specialized corporate portfolios, and may help address longstanding challenges including low default portfolios and class imbalance. This paper benchmarks recently proposed tabular foundation models against a broad set of competitors, including established and advanced machine learning techniques, across two core tasks: PD and LGD modeling. Our evaluation encompasses various datasets, performance indicators, and experimental conditions. We find that tabular foundation models generally perform best across datasets and tasks. Moreover, they offer significant improvement in predictive performance as dataset size shrinks. These results are remarkable given that the models are tested out-of-the-box, without hyperparameter tuning, ensuring ease of use and mitigating computational costs.
Figures
Figures from the paper (8 more)
Forward citations
Cited by 1 Pith paper
-
Is TabPFN the Silver Bullet for Insurance Pricing?
TabPFN does not consistently outperform GLM or XGBoost for motor insurance pricing, shows longer inference times, and is sensitive to in-context set size.
Reference graph
Works this paper leans on
-
[1]
Foundation models: A new paradigm for artificial intelligence
Johannes Schneider, Christian Meske, and Pauline Kuss. Foundation models: A new paradigm for artificial intelligence. Business & Information Systems Engineering, 66 0 (2): 0 221--231, 2024
2024
-
[2]
Sparks of artificial general intelligence: Early experiments with gpt-4
S \'e bastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712, 2023
arXiv 2023
-
[3]
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748--8763. PmLR, 2021
2021
-
[4]
Foundation models defining a new era in vision: a survey and outlook
Muhammad Awais, Muzammal Naseer, Salman Khan, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak Shah, Ming-Hsuan Yang, and Fahad Shahbaz Khan. Foundation models defining a new era in vision: a survey and outlook. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
2025
-
[5]
Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research
Stefan Lessmann, Bart Baesens, Hsin-Vonn Seow, and Lyn C Thomas. Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research. European journal of operational research, 247 0 (1): 0 124--136, 2015
2015
-
[6]
Deep learning for credit scoring: Do or don’t? European Journal of Operational Research, 295 0 (1): 0 292--305, 2021
Bj \"o rn Rafn Gunnarsson, Seppe Vanden Broucke, Bart Baesens, Mar \' a \'O skarsd \'o ttir, and Wilfried Lemahieu. Deep learning for credit scoring: Do or don’t? European Journal of Operational Research, 295 0 (1): 0 292--305, 2021
2021
-
[7]
Tabular data: Deep learning is not all you need
Ravid Shwartz-Ziv and Amitai Armon. Tabular data: Deep learning is not all you need. Information Fusion, 81: 0 84--90, 2022 a
2022
-
[8]
Transformers can do bayesian inference
Samuel M \"u ller, Noah Hollmann, Sebastian Pineda Arango, Josif Grabocka, and Frank Hutter. Transformers can do bayesian inference. arXiv preprint arXiv:2112.10510, 2021
arXiv 2021
Show all 107 references
-
[9]
u ller, Lennart Purucker, Arjun Krishnakumar, Max K \
Noah Hollmann, Samuel M \"u ller, Lennart Purucker, Arjun Krishnakumar, Max K \"o rfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. Accurate predictions on small data with a tabular foundation model. Nature, 637 0 (8045): 0 319--326, 2025 a
2025
-
[10]
The value of big data for credit scoring: Enhancing financial inclusion using mobile phone data and social network analytics
Mar \' a \'O skarsd \'o ttir, Cristi \'a n Bravo, Carlos Sarraute, Jan Vanthienen, and Bart Baesens. The value of big data for credit scoring: Enhancing financial inclusion using mobile phone data and social network analytics. Applied Soft Computing, 74: 0 26--39, 2019
2019
-
[11]
Fairness in credit scoring: Assessment, implementation and profit implications
Nikita Kozodoi, Johannes Jacob, and Stefan Lessmann. Fairness in credit scoring: Assessment, implementation and profit implications. European Journal of Operational Research, 297 0 (3): 0 1083--1094, 2022
2022
-
[12]
Algorithmic decision making methods for fair credit scoring
Darie Moldovan. Algorithmic decision making methods for fair credit scoring. IEEE Access, 11: 0 59729--59743, 2023
2023
-
[13]
Credit risk analytics: Measurement techniques, applications, and examples in SAS
Bart Baesens, Daniel Roesch, and Harald Scheule. Credit risk analytics: Measurement techniques, applications, and examples in SAS. John Wiley & Sons, 2016
2016
-
[14]
Benchmarking state-of-the-art classification algorithms for credit scoring
Bart Baesens, Tony Van Gestel, Stijn Viaene, Maria Stepanova, Johan Suykens, and Jan Vanthienen. Benchmarking state-of-the-art classification algorithms for credit scoring. Journal of the operational research society, 54 0 (6): 0 627--635, 2003
2003
-
[15]
Benchmarking regression algorithms for loss given default modeling
Gert Loterman, Iain Brown, David Martens, Christophe Mues, and Bart Baesens. Benchmarking regression algorithms for loss given default modeling. International Journal of Forecasting, 28 0 (1): 0 161--170, 2012
2012
-
[16]
Bastos and Sara M
João A. Bastos and Sara M. Matos. Explainable models of credit losses. European Journal of Operational Research, 301 0 (1): 0 386–394, 2022. ISSN 0377-2217. doi:10.1016/j.ejor.2021.11.009
2022 doi
-
[17]
An experimental comparison of classification algorithms for imbalanced credit scoring data sets
Iain Brown and Christophe Mues. An experimental comparison of classification algorithms for imbalanced credit scoring data sets. Expert systems with applications, 39 0 (3): 0 3446--3453, 2012
2012
-
[18]
On the suitability of resampling techniques for the class imbalance problem in credit scoring
Ana Isabel Marqu \'e s, Vicente Garc \' a, and Jos \'e Salvador S \'a nchez. On the suitability of resampling techniques for the class imbalance problem in credit scoring. Journal of the Operational Research Society, 64 0 (7): 0 1060--1070, 2013
2013
-
[19]
A secure cross-silo collaborative method for imbalanced credit scoring
Zhongyi Wang, Yuhang Tian, Sihan Li, and Jin Xiao. A secure cross-silo collaborative method for imbalanced credit scoring. European Journal of Operational Research, 326 0 (2): 0 357–373, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2025.04.020
2025 doi
-
[20]
Conditional wasserstein gan-based oversampling of tabular data for imbalanced learning
Justin Engelmann and Stefan Lessmann. Conditional wasserstein gan-based oversampling of tabular data for imbalanced learning. Expert Systems with Applications, 174: 0 114582, 2021. doi:10.1016/j.eswa.2021.114582
2021
-
[21]
Reject inference, augmentation, and sample selection
John Banasik and Jonathan Crook. Reject inference, augmentation, and sample selection. European Journal of Operational Research, 183 0 (3): 0 1582--1594, 2007
2007
-
[22]
Fighting sampling bias: A framework for training and evaluating credit scoring models
Nikita Kozodoi, Stefan Lessmann, Morteza Alamgir, Luis Moreira-Matias, and Konstantinos Papakonstantinou. Fighting sampling bias: A framework for training and evaluating credit scoring models. European Journal of Operational Research, 324 0 (2): 0 616--628, 2025
2025
-
[23]
Loss given default models incorporating macroeconomic variables for credit cards
Tony Bellotti and Jonathan Crook. Loss given default models incorporating macroeconomic variables for credit cards. International Journal of Forecasting, 28 0 (1): 0 171--182, 2012
2012
-
[24]
The devil in the details: Dynamic prediction of loan portfolio profitability with macroeconomic drivers through multi-state modelling
Viani B Djeundje, Jonathan Crook, and Galina Andreeva. The devil in the details: Dynamic prediction of loan portfolio profitability with macroeconomic drivers through multi-state modelling. European Journal of Operational Research, 2025
2025
-
[25]
Business cycle and realized losses in the consumer credit industry
Walter Distaso, Francesco Roccazzella, and Frédéric Vrins. Business cycle and realized losses in the consumer credit industry. European Journal of Operational Research, 323 0 (3): 0 1024–1039, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2024.12.026
2025 doi
-
[26]
Macro-economic factors in credit risk calculations: Including time-varying covariates in mixture cure models
Lore Dirick, Tony Bellotti, Gerda Claeskens, and Bart Baesens. Macro-economic factors in credit risk calculations: Including time-varying covariates in mixture cure models. Journal of Business and Economic Statistics, 37 0 (1): 0 40–53, 2019. ISSN 0735-0015. doi:10.1080/073500...
2019
-
[27]
A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers
Lyn C Thomas. A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers. International journal of forecasting, 16 0 (2): 0 149--172, 2000
2000
-
[28]
Linear and nonlinear credit scoring by combining logistic regression and support vector machines
Tony Van Gestel, Bart Baesens, Peter Van Dijcke, Johan Suykens, Joao Garcia, and Thomas Alderweireld. Linear and nonlinear credit scoring by combining logistic regression and support vector machines. Journal of credit Risk, 1 0 (4), 2005
2005
-
[29]
Support vector regression for loss given default modelling
Xiao Yao, Jonathan Crook, and Galina Andreeva. Support vector regression for loss given default modelling. European Journal of Operational Research, 240 0 (2): 0 528–538, 2015. ISSN 0377-2217. doi:http://dx.doi.org/10.1016/j.ejor.2014.06.043
2015 doi
-
[30]
Multi-view locally weighted regression for loss given default forecasting
Hui Cheng, Cuiqing Jiang, Zhao Wang, and Xiaoya Ni. Multi-view locally weighted regression for loss given default forecasting. International Journal of Forecasting, 41 0 (1): 0 290–306, 2025. ISSN 0169-2070. doi:10.1016/j.ijforecast.2024.05.006
2025 doi
-
[32]
Modelling spatial dependence for loss given default in peer-to-peer lending
Raffaella Calabrese and Luca Zanin. Modelling spatial dependence for loss given default in peer-to-peer lending. Expert Systems with Applications, 192: 0 116295, 2022. ISSN 0957-4174. doi:10.1016/j.eswa.2021.116295
2022
-
[33]
P2p network lending, loss given default and credit risks
Guangyou Zhou, Yijia Zhang, and Sumei Luo. P2p network lending, loss given default and credit risks. Sustainability, 10 0 (4): 0 1010, 2018. ISSN 2071-1050
2018
-
[34]
S. D. Tomarchio and A. Punzo. Modelling the loss given default distribution via a family of zero-and-one inflated mixture models. Journal of the Royal Statistical Society. Series A: Statistics in Society, 182 0 (4): 0 1247–1266, 2019. doi:10.1111/rssa.12466
2019 doi
-
[35]
Loss given default decomposition using mixture distributions of in-default events
Wojciech Starosta. Loss given default decomposition using mixture distributions of in-default events. European Journal of Operational Research, 292 0 (3): 0 1187–1199, 2021. ISSN 0377-2217. doi:10.1016/j.ejor.2020.11.034
2021 doi
-
[36]
Two-stage consumer credit risk modelling using heterogeneous ensemble learning
Monika Papouskova and Petr Hajek. Two-stage consumer credit risk modelling using heterogeneous ensemble learning. Decision Support Systems, 118: 0 33–45, 2019. ISSN 0167-9236. doi:10.1016/j.dss.2019.01.002
2019 doi
-
[37]
Thomas, Anna Matuszyk, Mee Chi So, Christophe Mues, and Angela Moore
Lyn C. Thomas, Anna Matuszyk, Mee Chi So, Christophe Mues, and Angela Moore. Modelling repayment patterns in the collections process for unsecured consumer debt: A case study. European Journal of Operational Research, 249 0 (2): 0 476–486, 2016. ISSN 0377-2217. doi:http://dx.d...
2016 doi
-
[38]
Morne Joubert, Tanja Verster, Helgard Raubenheimer, and Willem D. Schutte. Adapting the default weighted survival analysis modelling approach to model ifrs 9 lgd. Risks, 9 0 (6): 0 103, 2021. ISSN 2227-9091. doi:10.3390/risks9060103
2021 doi
-
[39]
Benchmarking state-of-the-art imbalanced data learning approaches for credit scoring
Cuiqing Jiang, Wang Lu, Zhao Wang, and Yong Ding. Benchmarking state-of-the-art imbalanced data learning approaches for credit scoring. Expert Systems with Applications, 213: 0 118878, 2023. ISSN 0957-4174. doi:10.1016/j.eswa.2022.118878
2023
-
[40]
Forecasting recovery rates on non-performing loans with machine learning
Anthony Bellotti, Damiano Brigo, Paolo Gambetti, and Frédéric Vrins. Forecasting recovery rates on non-performing loans with machine learning. International Journal of Forecasting, 37 0 (1): 0 428–444, 2021. ISSN 0169-2070. doi:10.1016/j.ijforecast.2020.06.009
2021 doi
-
[41]
Development and application of consumer credit scoring models using profit-based classification measures
Thomas Verbraken, Cristián Bravo, Richard Weber, and Bart Baesens. Development and application of consumer credit scoring models using profit-based classification measures. European Journal of Operational Research, 238 0 (2): 0 505–513, 2014. ISSN 0377-2217. doi:10.1016/j.ejor...
2014 doi
-
[42]
A novel financial performance metric to minimize misclassification costs in model selection
John Martin, Mali Abdollahian, Sona Taheri, and David Akman. A novel financial performance metric to minimize misclassification costs in model selection. Annals of Operations Research, 2025. ISSN 1572-9338. doi:10.1007/s10479-025-06514-x
2025 doi
-
[43]
A robust profit measure for binary classification model evaluation
Franco Garrido, Wouter Verbeke, and Cristián Bravo. A robust profit measure for binary classification model evaluation. Expert Systems with Applications, 92: 0 154–160, 2018. ISSN 0957-4174. doi:10.1016/j.eswa.2017.09.045
2018 doi
-
[44]
Loss functions for loss given default model comparison
Christophe Hurlin, Jérémy Leymarie, and Antoine Patin. Loss functions for loss given default model comparison. European Journal of Operational Research, 268 0 (1): 0 348–360, 2018 b . ISSN 0377-2217. doi:10.1016/j.ejor.2018.01.020
2018 doi
-
[45]
Example-dependent cost-sensitive decision trees
Alejandro Correa Bahnsen, Djamila Aouada, and Björn Ottersten. Example-dependent cost-sensitive decision trees. Expert Systems with Applications, 42 0 (19): 0 6609–6619, 2015. ISSN 0957-4174. doi:10.1016/j.eswa.2015.04.042
2015 doi
-
[46]
Credit scoring for profitability objectives
Steven Finlay. Credit scoring for profitability objectives. European Journal of Operational Research, 202 0 (2): 0 528–537, 2010
2010
-
[47]
The use of profit scoring as an alternative to credit scoring systems in peer-to-peer (p2p) lending
Carlos Serrano-Cinca and Begoña Gutiérrez-Nieto. The use of profit scoring as an alternative to credit scoring systems in peer-to-peer (p2p) lending. Decision Support Systems, 89: 0 113–122, 2016. ISSN 0167-9236. doi:http://dx.doi.org/10.1016/j.dss.2016.06.014
2016 doi
-
[48]
Profit-based uncertainty estimation with application to credit scoring
Yong Xu, Gang Kou, and Daji Ergu. Profit-based uncertainty estimation with application to credit scoring. European Journal of Operational Research, 325 0 (2): 0 303–316, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2025.03.007
2025 doi
-
[49]
Sendova, and Cristián Bravo
Sherly Alfonso-Sánchez, Jesús Solano, Alejandro Correa-Bahnsen, Kristina P. Sendova, and Cristián Bravo. Optimizing credit limit adjustments under adversarial goals using reinforcement learning. European Journal of Operational Research, 315 0 (2): 0 802–817, 2024. ISSN 0377-22...
2024 doi
-
[50]
Integrated framework for profit-based feature selection and svm classification in credit scoring
Sebastián Maldonado, Cristián Bravo, Julio López, and Juan Pérez. Integrated framework for profit-based feature selection and svm classification in credit scoring. Decision Support Systems, 104: 0 113–121, 2017. ISSN 0167-9236. doi:10.1016/j.dss.2017.10.007
2017 doi
-
[51]
A multi-objective approach for profit-driven feature selection in credit scoring
Nikita Kozodoi, Stefan Lessmann, Konstantinos Papakonstantinou, Yiannis Gatsoulis, and Bart Baesens. A multi-objective approach for profit-driven feature selection in credit scoring. Decision Support Systems, 120: 0 106–117, 2019. doi:10.1016/j.dss.2019.03.011
2019 doi
-
[52]
Joint model for longitudinal and spatio-temporal survival data
Victor Medina-Olivares, Finn Lindgren, Raffaella Calabrese, and Jonathan Crook. Joint model for longitudinal and spatio-temporal survival data. European Journal of Operational Research, 327 0 (3): 0 892–904, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2025.07.060
2025 doi
-
[53]
Spatial contagion in mortgage defaults: A spatial dynamic survival model with time and space varying coefficients
Raffaella Calabrese and Jonathan Crook. Spatial contagion in mortgage defaults: A spatial dynamic survival model with time and space varying coefficients. European Journal of Operational Research, 287 0 (2): 0 749–761, 2020. ISSN 0377-2217. doi:10.1016/j.ejor.2020.04.031
2020 doi
-
[54]
Multilayer network analysis for improved credit risk prediction
María Óskarsdóttir and Cristián Bravo. Multilayer network analysis for improved credit risk prediction. Omega, 105: 0 102520, 2021. ISSN 0305-0483. doi:10.1016/j.omega.2021.102520
2021
-
[55]
Attention-based dynamic multilayer graph neural networks for loan default prediction
Sahab Zandi, Kamesh Korangi, María Óskarsdóttir, Christophe Mues, and Cristián Bravo. Attention-based dynamic multilayer graph neural networks for loan default prediction. European Journal of Operational Research, 321 0 (2): 0 586–599, 2025. ISSN 0377-2217. doi:10.1016/j.ejor....
2025 doi
-
[56]
Improved credit risk prediction based on an integrated graph representation learning approach with graph transformation
Yong Shi, Yi Qu, Zhensong Chen, Yunlong Mi, and Yunong Wang. Improved credit risk prediction based on an integrated graph representation learning approach with graph transformation. European Journal of Operational Research, 315 0 (2): 0 786–801, 2024. ISSN 0377-2217. doi:10.10...
2024 doi
-
[57]
What does your facebook profile reveal about your creditworthiness? using alternative data for microfinance
Sofie De Cnudde, Julie Moeyersoms, Marija Stankova, Ellen Tobback, Vinayak Javaly, and David Martens. What does your facebook profile reveal about your creditworthiness? using alternative data for microfinance. Journal of the Operational Research Society, page 1–11, 2018. ISSN...
2018
-
[58]
Djeundje, Jonathan Crook, Raffaella Calabrese, and Mona Hamid
Viani B. Djeundje, Jonathan Crook, Raffaella Calabrese, and Mona Hamid. Enhancing credit scoring with alternative data. Expert Systems with Applications, 163: 0 113766, 2021. ISSN 0957-4174. doi:10.1016/j.eswa.2020.113766
2021
-
[59]
Unleashing the power of text for credit default prediction: Comparing human-written and generative ai-refined texts
Zongxiao Wu, Yizhe Dong, Yaoyiran Li, and Baofeng Shi. Unleashing the power of text for credit default prediction: Comparing human-written and generative ai-refined texts. European Journal of Operational Research, 326 0 (3): 0 691–706, 2025. ISSN 0377-2217. doi:10.1016/j.ejor....
2025 doi
-
[60]
The value of text for small business default prediction: A deep learning approach
Matthew Stevenson, Christophe Mues, and Cristián Bravo. The value of text for small business default prediction: A deep learning approach. European Journal of Operational Research, 295 0 (2): 0 758–771, 2021. ISSN 0377-2217. doi:10.1016/j.ejor.2021.03.008
2021 doi
-
[61]
Credit default prediction from user-generated text in peer-to-peer lending using deep learning
Johannes Kriebel and Lennart Stitz. Credit default prediction from user-generated text in peer-to-peer lending using deep learning. European Journal of Operational Research, 302 0 (1): 0 309–323, 2022. ISSN 0377-2217. doi:10.1016/j.ejor.2021.12.024
2022 doi
-
[62]
De Bock, Kristof Coussement, Arno De Caigny, Roman Słowiński, Bart Baesens, Robert N
Koen W. De Bock, Kristof Coussement, Arno De Caigny, Roman Słowiński, Bart Baesens, Robert N. Boute, Tsan-Ming Choi, Dursun Delen, Mathias Kraus, Stefan Lessmann, Sebastián Maldonado, David Martens, María Óskarsdóttir, Carla Vairetti, Wouter Verbeke, and Richard Weber. Explain...
2024 doi
-
[63]
Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai
Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gil-Lopez, Daniel Molina, Richard Benjamins, Raja Chatila, and Francisco Herrera. Explainable artificial intelligence (xai): Concepts, taxo...
2020 doi
-
[64]
Matteo Ballegeer, Matthias Bogaert, and Dries F. Benoit. Evaluating the stability of model explanations in instance-dependent cost-sensitive credit scoring. European Journal of Operational Research, 326 0 (3): 0 630–640, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2025.05.039
2025 doi
-
[65]
Interpretable machine learning for imbalanced credit scoring datasets
Yujia Chen, Raffaella Calabrese, and Belen Martin-Barragan. Interpretable machine learning for imbalanced credit scoring datasets. European Journal of Operational Research, 312 0 (1): 0 357–372, 2024. ISSN 0377-2217. doi:10.1016/j.ejor.2023.06.036
2024 doi
-
[66]
Shapley values as an interpretability technique in credit scoring
Hendrik Andries du Toit, Willem Dani \ A , Helgard Raubenheimer, et al. Shapley values as an interpretability technique in credit scoring. Journal of Risk Model Validation, 2023
2023
-
[67]
The many shapley values for explainable artificial intelligence: A sensitivity analysis perspective
Emanuele Borgonovo, Elmar Plischke, and Giovanni Rabitti. The many shapley values for explainable artificial intelligence: A sensitivity analysis perspective. European Journal of Operational Research, 318 0 (3): 0 911–926, 2024. ISSN 0377-2217. doi:10.1016/j.ejor.2024.06.023
2024 doi
-
[68]
Measuring the driving forces of predictive performance: Application to credit scoring
Sullivan Hué, Christophe Hurlin, Christophe Pérignon, and Sébastien Saurin. Measuring the driving forces of predictive performance: Application to credit scoring. ArXiv preprint, arXiv:2212.05866v4, 2025. doi:10.48550/arXiv.2212.05866
-
[69]
On enhancing the explainability and fairness of tree ensembles
Emilio Carrizosa, Kseniia Kurishchenko, and Dolores Romero Morales. On enhancing the explainability and fairness of tree ensembles. European Journal of Operational Research, 323 0 (2): 0 599–608, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2025.01.008
2025 doi
-
[70]
Arno De Caigny, Kristof Coussement, and Koen W. De Bock. A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees. European Journal of Operational Research, 269 0 (2): 0 760–772, 2018. ISSN 0377-2217. doi:10.1016/j.ejo...
2018 doi
-
[71]
Interpretable generalized additive neural networks
Mathias Kraus, Daniel Tschernutter, Sven Weinzierl, and Patrick Zschech. Interpretable generalized additive neural networks. European Journal of Operational Research, 317 0 (2): 0 303–316, 2024. ISSN 0377-2217. doi:10.1016/j.ejor.2023.06.032
2024 doi
-
[72]
The deep promotion time cure model
Victor Medina-Olivares, Stefan Lessmann, and Nadja Klein. The deep promotion time cure model. IEEE Transactions on Neural Networks and Learning Systems, 35 0 (12): 0 18848 – 18858, 2024. ISSN 2162-2388. doi:10.1109/TNNLS.2024.3398559
2024
-
[73]
Industry return prediction via interpretable deep learning
Lazaros Zografopoulos, Maria Chiara Iannino, Ioannis Psaradellis, and Georgios Sermpinis. Industry return prediction via interpretable deep learning. European Journal of Operational Research, 321 0 (1): 0 257–268, 2025. ISSN 0377-2217. doi:10.1016/j.ejor.2024.08.032
2025 doi
-
[74]
Crowds, lending, machine, and bias
Runshan Fu, Yan Huang, and Param Vir Singh. Crowds, lending, machine, and bias. Information Systems Research, 2021. ISSN 1047-7047. doi:10.1287/isre.2020.0990
2021
-
[75]
Predictably unequal? the effects of machine learning on credit markets
Andreas Fuster, Paul Goldsmith-Pinkham, Tarun Ramadorai, and Ansgar Walther. Predictably unequal? the effects of machine learning on credit markets. The Journal of Finance, 77 0 (1): 0 5–47, 2022. ISSN 0022-1082. doi:10.1111/jofi.13090
2022 doi
-
[76]
The fairness of credit scoring models
Christophe Hurlin, Christophe Pérignon, and Sébastien Saurin. The fairness of credit scoring models. Management Science, 2025. doi:10.1287/mnsc.2022.03888
2025
-
[77]
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. Nature, 521 0 (7553): 0 436–444, 2015. ISSN 0028-0836. doi:10.1038/nature14539
2015 doi
-
[78]
Deep learning for time series forecasting: Tutorial and literature survey
Konstantinos Benidis, Syama Sundar Rangapuram, Valentin Flunkert, Yuyang Wang, Danielle Maddix, Caner Turkmen, Jan Gasthaus, Michael Bohlke-Schneider, David Salinas, Lorenzo Stella, François-Xavier Aubet, Laurent Callot, and Tim Januschowski. Deep learning for time series fore...
2022 doi
-
[79]
Tabular data: Deep learning is not all you need
Ravid Shwartz-Ziv and Amitai Armon. Tabular data: Deep learning is not all you need. Information Fusion, 81: 0 84–90, 2022 b . doi:10.1016/j.inffus.2021.11.011
2022 doi
-
[80]
Why do tree-based models still outperform deep learning on typical tabular data? In Advances in Neural Information Processing Systems, 2022
Léo Grinsztajn, Edouard Oyallon, and Gaël Varoquaux. Why do tree-based models still outperform deep learning on typical tabular data? In Advances in Neural Information Processing Systems, 2022
2022
-
[81]
A comprehensive benchmark of machine and deep learning models on structured data for regression and classification
Assaf Shmuel, Oren Glickman, and Teddy Lazebnik. A comprehensive benchmark of machine and deep learning models on structured data for regression and classification. Neurocomputing, 655: 0 131337, 2025. ISSN 0925-2312. doi:10.1016/j.neucom.2025.131337
2025
-
[82]
Deep Learning in Banking: Integrating Artificial Intelligence for Next-Generation Financial Services
Cristian Bravo, Sebastian Maldonado, and Maria Oskarsdottir. Deep Learning in Banking: Integrating Artificial Intelligence for Next-Generation Financial Services. John Wiley & Sons, 2026
2026
-
[83]
A transformer-based model for default prediction in mid-cap corporate markets
Kamesh Korangi, Christophe Mues, and Cristián Bravo. A transformer-based model for default prediction in mid-cap corporate markets. European Journal of Operational Research, 308 0 (1): 0 306–320, 2023. ISSN 0377-2217. doi:10.1016/j.ejor.2022.10.032
2023 doi
-
[84]
Revisiting deep learning models for tabular data
Yury Gorishniy, Ivan Rubachev, Valentin Khrulkov, and Artem Babenko. Revisiting deep learning models for tabular data. Advances in neural information processing systems, 34: 0 18932--18943, 2021
2021
-
[85]
A closer look at deep learning on tabular data
Han-Jia Ye, Si-Yang Liu, Hao-Run Cai, Qi-Le Zhou, and De-Chuan Zhan. A closer look at deep learning on tabular data. arXiv preprint arXiv:2407.00956, 2024
2024
- [86]
-
[87]
Tabnet: Attentive interpretable tabular learning
Sercan Ö Arik and Tomas Pfister. Tabnet: Attentive interpretable tabular learning. Proceedings of the AAAI Conference on Artificial Intelligence, 35 0 (8): 0 6679–6687, 2021. doi:10.1609/aaai.v35i8.16826
2021 doi
-
[88]
Tabtransformer: Tabular data modeling using contextual embeddings
Xin Huang, Ashish Khetan, Milan Cvitkovic, and Zohar Karnin. Tabtransformer: Tabular data modeling using contextual embeddings. In arXiv preprint arXiv:2012.06678, 2020. URL https://arxiv.org/abs/2012.06678
2012 arXiv
-
[89]
VIME: extending the success of self- and semi-supervised learning to tabular domain
Jinsung Yoon, Yao Zhang, James Jordon, and Mihaela van der Schaar. VIME: extending the success of self- and semi-supervised learning to tabular domain. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria - Florina Balcan, and Hsuan - Tien Lin, editors, Advances in Ne...
2020
-
[90]
Subtab: Subsetting features of tabular data for self-supervised representation learning
Talip Ucar, Ehsan Hajiramezanali, and Lindsay Edwards. Subtab: Subsetting features of tabular data for self-supervised representation learning. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural I...
2021
-
[91]
Bayan Bruss, and Tom Goldstein
Gowthami Somepalli, Micah Goldblum, Avi Schwarzschild, C. Bayan Bruss, and Tom Goldstein. SAINT: improved neural networks for tabular data via row attention and contrastive pre-training. CoRR, abs/2106.01342, 2021. URL https://arxiv.org/abs/2106.01342
2021 arXiv
-
[92]
Stefan Hegselmann, Alejandro Buendia, Hunter Lang, Monica Agrawal, Xiaoyi Jiang, and David A. Sontag. Tabllm: Few-shot classification of tabular data with large language models. In Francisco J. R. Ruiz, Jennifer G. Dy, and Jan - Willem van de Meent, editors, International Conf...
2023
-
[93]
Tabpfn: A transformer that solves small tabular classification problems in a second
Noah Hollmann, Samuel M \" u ller, Katharina Eggensperger, and Frank Hutter. Tabpfn: A transformer that solves small tabular classification problems in a second. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023 . Op...
2023
-
[94]
Transformers can do bayesian inference
Samuel M \" u ller, Noah Hollmann, Sebastian Pineda - Arango, Josif Grabocka, and Frank Hutter. Transformers can do bayesian inference. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . OpenReview.net, 2022. URL ht...
2022
-
[95]
Accurate predictions on small data with a tabular foundation model
Noah Hollmann, Samuel Müller, Lennart Purucker, Arjun Krishnakumar, Max Körfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. Accurate predictions on small data with a tabular foundation model. Nature, 637 0 (8045): 0 319–326, 2025 b . ISSN 1476-4687. doi:10.1038/s...
2025 doi
- [96]
-
[97]
Tabpfn-2.5: Advancing the state of the art in tabular foundation models
Léo Grinsztajn, Klemens Flöge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Benjamin Jäger, Dominik Safaric, Simone Alessi, Adrian Hayler, Mihir Manium, Rosen Yu, Felix Jablonski, Shi Bin Hoo, Anurag Garg, Jake Robertson, Magnus Bühler, Vladyslav Moroshan, Lennart Puru...
-
[98]
Foundation models for tabular data within systemic contexts need grounding
Tassilo Klein and Johannes Hoffart. Foundation models for tabular data within systemic contexts need grounding. ArXiv preprint, arXiv:2505.19825, 2025. doi:10.48550/arXiv.2505.19825
2025 doi
-
[99]
Thomas, David B
Lyn C. Thomas, David B. Edelman, and Jonathan N. Crook. Credit Scoring and its Applications. Siam, Philadelphia, 2002
2002
-
[100]
Talent: A tabular analytics and learning toolbox
Si-Yang Liu, Hao-Run Cai, Qi-Le Zhou, and Han-Jia Ye. Talent: A tabular analytics and learning toolbox. arXiv preprint arXiv:2407.04057, 2024
2024 arXiv
-
[101]
Optuna: A next-generation hyperparameter optimization framework
Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, and Masanori Koyama. Optuna: A next-generation hyperparameter optimization framework. In Ankur Teredesai, Vipin Kumar, Ying Li, R \' o mer Rosales, Evimaria Terzi, and George Karypis, editors, Proceedings of the 25th A...
2019
-
[102]
Statistical comparisons of classifiers over multiple data sets
Janez Demšar. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7: 0 1–30, 2006
2006
-
[103]
Individual comparisons by ranking methods
Frank Wilcoxon. Individual comparisons by ranking methods. Biometrics bulletin, 1 0 (6): 0 80--83, 1945
1945
-
[104]
Do we need hundreds of classifiers to solve real world classification problems? Journal of Machine Learning Research, 15 0 (90): 0 3133--3181, 2014
Manuel Fern \'a ndez-Delgado, Eva Cernadas, Sen \'e n Barro, and Dinani Amorim. Do we need hundreds of classifiers to solve real world classification problems? Journal of Machine Learning Research, 15 0 (90): 0 3133--3181, 2014. URL http://jmlr.org/papers/v15/delgado14a.html
2014
-
[105]
A comparison of alternative tests of significance for the problem of m rankings
Milton Friedman. A comparison of alternative tests of significance for the problem of m rankings. The annals of mathematical statistics, 11 0 (1): 0 86--92, 1940
1940
-
[106]
Approximations of the critical region of the fbietkan statistic
Ronald L Iman and James M Davenport. Approximations of the critical region of the fbietkan statistic. Communications in Statistics-Theory and Methods, 9 0 (6): 0 571--595, 1980
1980
-
[107]
A simple sequentially rejective multiple test procedure
Sture Holm. A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics, pages 65--70, 1979
1979
-
[108]
statistical comparisons of classifiers over multiple data sets
Salvador Garcia and Francisco Herrera. An extension on" statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons. Journal of Machine Learning Research, 9 0 (12), 2008
2008
Reviewed August 2, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.