nub: A Rendering and Interaction Library for Visual Computing in Processing

Jean Pierre Charalambos

doi:10.5334/jors.477

nub: A Rendering and Interaction Library for Visual Computing in Processing

Journal of Open Research Software

Volume 13 (2025): Issue 1

By: Jean Pierre Charalambos

Open Access

|Mar 2025

Abstract

The nub library is introduced as an open-source tool for rendering and interaction in the Processing language. Designed for visual computing research, it features a functional and declarative API that simplifies the creation of hierarchical node trees. By decoupling rendering from interaction, the library supports customizable workflows for diverse scenarios, including multi-view scene management, view-frustum culling, gesture-based navigation, and shadow mapping. Seamless integration with Processing ensures compatibility across desktop, Python, and Android platforms. Rich examples and detailed documentation demonstrate its capabilities, making it accessible to researchers, educators, and creative programmers. The framework’s extensibility and focus on usability provide a robust foundation for teaching and experimentation in visual computing.

References

Akenine-Möller T, Haines E, Hoffman N, Pesce A, Iwanicki M, Hillaire S. Real-Time Rendering 4th Edition. A K Peters/CRC Press, Boca Raton, FL, USA; 2018. DOI: 10.1201/b22086
Open DOI Search in Google Scholar Back to article
Andreou N, Aristidou A, Chrysanthou Y. Pose representations for deep skeletal animation. Computer Graphics Forum. 2022; 41(8): 155–167. DOI: 10.1111/cgf.14632
Open DOI Search in Google Scholar Back to article
Beyer J, Hadwiger M, Pfister H. State-of-the-art in gpu-based large-scale volume visualization. Computer Graphics Forum. 2015; 34(8): 13–37. DOI: 10.1111/cgf.12605
Open DOI Search in Google Scholar Back to article
Biswas S, Yin K, Shugrina M, Fidler S, Khamis S. Hierarchical neural implicit pose network for animation and motion retargeting. ArXiv, abs/2112.00958; 2021.
Search in Google Scholar Back to article
Chaparro S. Master Thesis. Método de cinemática inversa en tiempo real basado en FABRIK para estructuras altamente restrictas; 2021. https://repositorio.unal.edu.co/handle/unal/79872.
Search in Google Scholar Back to article
Charalambos JP. Proscene: A feature-rich framework for interactive environments. SoftwareX. 2017; 6: 48–53. DOI: 10.1016/j.softx.2017.01.002
Open DOI Search in Google Scholar Back to article
Colubri A, Fry B. Introducing processing 2.0. In ACM SIGGRAPH 2012 Talks, SIGGRAPH 2012, New York, NY, USA. Association for Computing Machinery; 2012. DOI: 10.1145/2343045.2343061
Open DOI Search in Google Scholar Back to article
Deng Y, Ni Y, Li Z, Mu S, Zhang W. Toward real-time ray tracing: A survey on hardware acceleration and microarchitecture techniques. ACM Computing Surveys. 08, 2017; 50: 1–41. DOI: 10.1145/3104067
Open DOI Search in Google Scholar Back to article
Du Z, Chiang Y-J. Out-of-core simplification and crack-free lod volume rendering for irregular grids. Computer Graphics Forum. 2010; 29(3): 873–882. DOI: 10.1111/j.1467-8659.2009.01705.x
Open DOI Search in Google Scholar Back to article
Friston S, Dobos J, Wong C, Fan C, Montero S, Steed A. Rectangular selection of components in large 3d models on the web. In The 24th International Conference on 3D Web Technology, Web3D ’19. New York, NY, USA; 2019. pages 1–9. ACM. DOI: 10.1145/3329714.3338125
Open DOI Search in Google Scholar Back to article
Gumbau J, Sbert M, Szirmay-Kalos L, Chover M, González C. Shadow map filtering with gaussian shadow maps. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI ’11. New York, NY, USA; 2011. pages 75–82. ACM. DOI: 10.1145/2087756.2087766
Open DOI Search in Google Scholar Back to article
Jankowski J, Hachet M. A Survey of Interaction Techniques for Interactive 3D Environments. In Eurographics 2013 – STAR. Girona, Spain; May 2013.
Search in Google Scholar Back to article
Jurado JM, Graciano A, Ortega L, Feito FR. Web-based gis application for real-time interaction of underground infrastructure through virtual reality. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, SIGSPATIAL ’17. New York, NY, USA; 2017. pages 97: 1–97: 4. ACM. DOI: 10.1145/3139958.3140004
Open DOI Search in Google Scholar Back to article
Kaukonen L. Human skull and neck; 2019. https://sketchfab.com/3d-models/human-skull-and-neck-a47ef69ff3a4402783cff0f841bc5e0a. Available under the CC Attribution license.
Search in Google Scholar Back to article
Kim YJ, Lin MC, Manocha D. Collision Detection. Springer Netherlands, Dordrecht; 2018. pages 1–24. DOI: 10.1007/978-94-007-7194-9_26-1
Open DOI Search in Google Scholar Back to article
John. Lasseter. Luxo jr. film; 1986.
Search in Google Scholar Back to article
LaViola Jr JJ, Kruijff E, McMahan RP, Bowman D, Poupyrev IP. 3D user interfaces: theory and practice. Addison-Wesley Professional; 2017.
Search in Google Scholar Back to article
Li J, Wu H, Yang C, Wong DW, Xie J. Visualizing dynamic geosciences phenomena using an octree-based view-dependent lod strategy within virtual globes. Computers & Geosciences. 2011; 37(9): 1295–1302. DOI: 10.1016/j.cageo.2011.04.003
Open DOI Search in Google Scholar Back to article
Li Z, Zheng Z, Wang L, Liu Y. Animatable gaussians: Learning pose-dependent gaussian maps for high-fidelity human avatar modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2024.
Search in Google Scholar Back to article
Maria M, Horna S, Aveneau L. Constrained convex space partition for ray tracing in architectural environments. Computer Graphics Forum. 2017; 36(1): 288–300. DOI: 10.1111/cgf.12801
Open DOI Search in Google Scholar Back to article
Mattausch O, Bittner J, Jaspe A, Gobbetti E, Wimmer M, Pajarola R. Chc+rt: Coherent hierarchical culling for ray tracing. Computer Graphics Forum. 2015; 34(2): 537–548. DOI: 10.1111/cgf.12582
Open DOI Search in Google Scholar Back to article
McIntosh L, Riecke BE, DiPaola S. Efficiently simulating the bokeh of polygonal apertures in a post-process depth of field shader. Comput. Graph. Forum. September 2012; 31(6): 1810–1822. DOI: 10.1111/j.1467-8659.2012.02097.x
Open DOI Search in Google Scholar Back to article
Peters C. Non-linearly quantized moment shadow maps. In Proceedings of High Performance Graphics, HPG ’17. New York, NY, USA; 2017. pages 15:1–15:11 ACM. DOI: 10.1145/3105762.3105775
Open DOI Search in Google Scholar Back to article
Peters C, Klein R. Moment shadow mapping. In Proceedings of the 19th Symposium on Interactive 3D Graphics and Games, i3D ’15. New York, NY, USA; 2015. pages 7–14. ACM. DOI: 10.1145/2699276.2699277
Open DOI Search in Google Scholar Back to article
Reas C, Fry B. Make: Getting Started with Processing. Maker Media, Inc.; 2010.
Search in Google Scholar Back to article
Reas C, Fry B. Processing: A Programming Handbook for Visual Designers and Artists. The MIT Press, Cambridge, Massachusetts; 2014.
Search in Google Scholar Back to article
Riecke BE, LaViola JJ, Kruijff E. 3d user interfaces for virtual reality and games: 3d selection, manipulation, and spatial navigation. In ACM SIGGRAPH 2018 Courses, SIGGRAPH 2018, New York, NY, USA. Association for Computing Machinery; 2018. DOI: 10.1145/3214834.3214869
Open DOI Search in Google Scholar Back to article
Selgrad K, Reintges C, Penk D, Wagner P, Stamminger M. Real-time depth of field using multi-layer filtering. In Proceedings of the 19th Symposium on Interactive 3D Graphics and Games, i3D ’15. New York, NY, USA; 2015. pages 121–127. ACM. DOI: 10.1145/2699276.2699288
Open DOI Search in Google Scholar Back to article
Shiffman D. Learning Processing: A Beginner’s Guide to Programming Images, Animation, and Interaction. Morgan Kaufmann, 2nd edition; 2015.
Search in Google Scholar Back to article
Stylos J, Myers BA. The implications of method placement on api learnability. In Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering, SIGSOFT ’08/FSE-16. New York, NY, USA; 2008. pages 105–112. ACM. DOI: 10.1145/1453101.1453117
Open DOI Search in Google Scholar Back to article
Vinkler M, Havran V, Bittner. Performance comparison of bounding volume hierarchies and kd-trees for gpu ray tracing. Computer Graphics Forum. 2016; 35(8): 68–79. DOI: 10.1111/cgf.12776
Open DOI Search in Google Scholar Back to article
Wang X, Tang M, Manocha D, Tong R. Efficient bvh-based collision detection scheme with ordering and restructuring. Computer Graphics Forum. 2018; 37(2): 227–237. DOI: 10.1111/cgf.13356
Open DOI Search in Google Scholar Back to article
Weier M, Roth T, Hinkenjann A, Slusallek P. Foveated depth-of-field filtering in head-mounted displays. ACM Trans. Appl. Percept. September 2018; 15(4): 26: 1–26: 14. DOI: 10.1145/3238301
Open DOI Search in Google Scholar Back to article
Xue J, Zhao G, Xiao W. An efficient gpu out-of-core framework for interactive rendering of large-scale cad models. Computer Animation and Virtual Worlds. 2016; 27(3–4): 231–240. DOI: 10.1002/cav.1704
Open DOI Search in Google Scholar Back to article
Yuksel C, Schaefer S, Keyser J. Parameterization and applications of catmull-rom curves. Comput. Aided Des. July 2011; 43(7): 747–755. DOI: 10.1016/j.cad.2010.08.008
Open DOI Search in Google Scholar Back to article