Csv2xyd: A Python Software for Processing Large Biodiversity Datasets for Endemism Analysis

Jonathan Liria; Ana Soto-Vivas

doi:10.5334/jors.538

Csv2xyd: A Python Software for Processing Large Biodiversity Datasets for Endemism Analysis

Journal of Open Research Software

Volume 13 (2025): Issue 1

By: Jonathan Liria and Ana Soto-Vivas

Open Access

|Jul 2025

Abstract

Biodiversity repositories are important in biogeography and conservation investigations. A key component of biogeographical research is identifying areas of endemism, which involves examining multiple datasets. Due to this, we developed csv2xyd a Python software with a graphical user interface to process data from CSV to XYD format for endemism analysis. The software detects species with typographical errors, checks taxonomic inconsistencies, removes duplicate occurrences, and offers filtering options. After being tested on large datasets, csv2xyd proved to be an effective tool for data handling. This software enhances the integration of several biodiversity repositories for endemism analysis by optimizing data processing workflow.

References

Nelson G, Ellis S. The history and impact of digitization and digital data mobilization on biodiversity research. Phil. Trans. R. Soc. 2018;B 374:20170391. DOI: 10.1098/rstb.2017.0391
Open DOI Search in Google Scholar Back to article
Scott B, Baker E, Woodburn M, Vincent S, Hardy H, Smith V. The Natural History Museum Data Portal. Database. 2019;1–14. DOI: 10.1093/database/baz038
Open DOI Search in Google Scholar Back to article
Escalante T, Morrone JJ, Rodríguez-Tapia G. Biogeographic regions of North American mammals based on endemism. Biological Journal of the Linnean Society. 2013;110:485–499. DOI: 10.1111/bij.12142
Open DOI Search in Google Scholar Back to article
Casagranda D, de Grosso DML. Areas of Endemism: Methodological and Applied Biogeographic Contributions from South America. InTech. 2013. DOI: 10.5772/55482
Open DOI Search in Google Scholar Back to article
Noguera-Urbano E. El endemismo: diferenciación del término, métodos y aplicaciones. Acta Zoológica Mexicana. 2017;33:89–107. DOI: 10.21829/azm.2017.3311016
Open DOI Search in Google Scholar Back to article
Szumik CA, Cuezzo F, Goloboff PA, Chalup AE. An optimality criterion to determine areas of endemism. Syst. Biol. 2002;51:806–816. DOI: 10.1080/10635150290102483
Open DOI Search in Google Scholar Back to article
Szumik CA, Goloboff PA. Areas of endemism: an improved optimally criterion. Syst. Biol. 2004;53:968–977. DOI: 10.1080/10635150490888859
Open DOI Search in Google Scholar Back to article
Szumik C, Casagranda MD, Roig-Juñent S. Manual de NDM/VNDM: Programas para la identificación de áreas de endemismo. Instituto Argentino de Estudios Filogenéticos, Año V, Vol. 3. Argentina; 2006. https://www.lillo.org.ar/phylogeny/endemism/Manual_VNDM.pdf.
Search in Google Scholar Back to article
Liria J, Szumik CA, Goloboff PA. Analysis of endemism of world arthropod distribution data supports biogeographic regions and many established subdivisions. Cladistics. 2021;37:559–570. DOI: 10.1111/cla.12448
Open DOI Search in Google Scholar Back to article
Liria J. Áreas de endemismo de Ecuador: un análisis a partir de datos de distribución de especies de plantas, animales y hongos. Revista mexicana de biodiversidad. 2022;93:e934031. DOI: 10.22201/ib.20078706e.2022.93.4031
Open DOI Search in Google Scholar Back to article
Maldonado C, Molina CI, Zizka A, Persson C, Taylor CM, Albán J, Chilquillo E, Rønsted N, Antonelli A. Species diversity and distribution in the era of Big Data. Global Ecology and Biogeography. 2015;24:973–984. DOI: 10.1111/geb.12326
Open DOI Search in Google Scholar Back to article
Feng X, Enquist B, Park D, Boyle B, Breshears D, Gallagher R, Lien A, Newman E, Burger J, Maitner B, Merow C, Li Y, Huynh K, Ernst K, Baldwin E, Foden W, Hannah LB, Morueta-Holme N, Neves D, Núñez-Regueiro MM, Oliveira-Filho A, Peet R, Pillet M, Roehrdanz P, Sandel B, Serra-Diaz, Jímová I, Svenning J, Violle C, Weitemier T, Wiser S, Lopez-Hoffman L. A review of the heterogeneous landscape of biodiversity databases: Opportunities and challenges for a synthesized biodiversity knowledge base. Global Ecology and Biogeography. 2022;31(7):1242–1260. DOI: 10.1111/geb.13497
Open DOI Search in Google Scholar Back to article
Van Rossum G, Drake FL. Python 3 Reference Manual. Scotts Valley, CA: CreateSpace; 2009. p. 242.
Search in Google Scholar Back to article
Lundh F. An introduction to tkinter. 1999. www.pythonware.com/library/tkinter/introduction/index.htm.
Search in Google Scholar Back to article
McKinney W. Data Structures for Statistical Computing in Python. In: van der Walt S, Millman J, editors. Proceedings of the 9th Python in Science Conference. 2010;56–61. DOI: 10.25080/Majora-92bf1922-00a
Open DOI Search in Google Scholar Back to article
Rocklin M. Dask: Parallel Computation with Blocked algorithms and Task Scheduling. In: Proceedings of the 14th Python in Science Conference; 2015. pp. 126–132. DOI: 10.25080/Majora-7b98e3ed-013
Open DOI Search in Google Scholar Back to article
Cohen S. FuzzyWuzzy: Fuzzy string matching in Python. 2011. https://github.com/seatgeek/fuzzywuzzy.
Search in Google Scholar Back to article
Folium developers. Folium: Python Data. Leaflet.js Maps. 2017. https://python-visualization.github.io/folium/.
Search in Google Scholar Back to article
Harris C, Millman K, Van der Walt S, Gommers R, Virtanen P, Cournapeau D, Wieser E, Taylor L, Berg S, Smith S, Kern R, Picus M, Hoyer S, van Kerkwijk M, Brett M, Haldane A, Fernández del Río J, Wiebe M, Peterson P, Gérard-Marchant P, Sheppard K, Reddy T, Weckesser W, Abbasi H, Gohlke G, Olipha T. Array programming with NumPy. Nature. 2020;585:357–362. DOI: 10.1038/s41586-020-2649-2
Open DOI Search in Google Scholar Back to article
Jordahl K, Van den Bossche J, Fleischm J, Wasserman M, McBride J, Gerard F. geopandas/geopandas: v0.8.1. 2020. DOI: 10.5281/zenodo.3946761
Open DOI Search in Google Scholar Back to article
Gillies S. Shapely: Geometric objects, predicates, and operations; 2007. https://shapely.readthedocs.io.
Search in Google Scholar Back to article
Szumik CA, Goloboff PA. Higher taxa and the identification of areas of endemism. Cladistics. 2015;31:568–572. DOI: 10.1111/cla.12112
Open DOI Search in Google Scholar Back to article
Hill M. Diversity and evenness: a unifying notation and its consequences. Ecology. 1973;54:427–432. DOI: 10.2307/1934352
Open DOI Search in Google Scholar Back to article
Hijmans R. DIVA-GIS: A free computer program for mapping and geographic data analysis; 2012. https://www.diva-gis.org/.
Search in Google Scholar Back to article
Atlas of Living Australia. Occurrence download “Cnidaria”. 2024. https://doi.ala.org.au/doi/ba60d4b0-c8cb-4542-8940-5c19144b24cd (Accessed 5 August 2024).
Search in Google Scholar Back to article
GBIF.org. GBIF Occurrence download “Chordata”. 2024a. DOI: 10.15468/dl.uwujsm (Accessed 15 July 2024).
Open DOI Search in Google Scholar Back to article
GBIF.org. GBIF Occurrence download “Aves”. 2024b. DOI: 10.15468/dl.rxhk3s (Accessed 17 July 2024).
Open DOI Search in Google Scholar Back to article