arfpy: A Python Package for Density Estimation and Generative Modeling with Adversarial Random Forests

Kristin Blesch; Marvin N. Wright

doi:10.5334/jors.492

arfpy: A Python Package for Density Estimation and Generative Modeling with Adversarial Random Forests

Journal of Open Research Software

Volume 12 (2024): Issue 1

By: Kristin Blesch and Marvin N. Wright

Open Access

|May 2024

Abstract

This paper introduces arfpy, a python implementation of Adversarial Random Forests, which is a lightweight procedure for synthesizing new data that resembles some given data. The software arfpy equips practitioners with straightforward functionalities for both density estimation and generative modeling. The method is particularly useful for tabular data and its competitive performance is demonstrated in previous literature. As a major advantage over the mostly deep learning based alternatives, arfpy combines the method’s reduced requirements in tuning efforts and computational resources with a user-friendly python interface. This supplies audiences across scientific fields with software to generate data effortlessly.

https://github.com/bips-hb/arfpy.

References

Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial nets. Advances in Neural Information Processing Systems. 2014; 27.
Search in Google Scholar Back to article
Xu L, Skoularidou M, Cuesta-Infante A, Veeramachaneni K. Modeling tabular data using conditional GAN. Advances in Neural Information Processing Systems. 2019; 32.
Search in Google Scholar Back to article
Kingma DP, Welling M. Auto-encoding variational bayes. International Conference on Learning Representations; 2014.
Search in Google Scholar Back to article
Rezende D, Mohamed S. Variational inference with normalizing flows. Proceedings of the 32nd International Conference on Machine Learning. 2015; 37: 1530–1538.
Search in Google Scholar Back to article
Ho J, Jain A, Abbeel P. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems. 2020; 33: 6840–6851.
Search in Google Scholar Back to article
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I. Attention is all you need. Advances in Neural Information Processing Systems. 2017; 30.
Search in Google Scholar Back to article
Watson DS, Blesch K, Kapar J, Wright MN. Adversarial random forests for density estimation and generative modeling. International Conference on Artificial Intelligence and Statistics. PMLR. 2023; 206: 5357–5375.
Search in Google Scholar Back to article
Breiman L. Random forests. Machine learning. 2001; 45: 5–32. DOI: 10.1023/A:1010933404324
Open DOI Search in Google Scholar Back to article
Grinsztajn L, Oyallon E, Varoquaux G. Why do tree-based models still outperform deep learning on typical tabular data? Advances in Neural Information Processing Systems. 2022; 35: 507–520.
Search in Google Scholar Back to article
Nock R, Guillame-Bert M. Generative forests. arXiv Preprint 2308.03648; 2023. DOI: 10.48550/arXiv.2308.03648
Open DOI Search in Google Scholar Back to article
Wright MN, Watson DS. arf: Adversarial Random Forests; 2023. URL https://CRAN.R-project.org/package=arf. R package version 0.1.3.
Search in Google Scholar Back to article
Gautier L, et al. rpy2: Python-r bridge. GitHub repository; 2023. URL https://github.com/rpy2/rpy2.
Search in Google Scholar Back to article
van der Schaar Lab. synthcity: A library for generating and evaluating synthetic tabular data. GitHub repository; 2023. URL https://github.com/vanderschaarlab/synthcity.
Search in Google Scholar Back to article
Shi T, Horvath S. Unsupervised learning with random forest predictors. Journal of Computational and Graphical Statistics. 2006; 15(1): 118–138. DOI: 10.1198/106186006X94072
Open DOI Search in Google Scholar Back to article