2D Radiometric Mapping of Chromatic Decay in Heritage Façades via Photogrammetric Atlases
DOI:
https://doi.org/10.9744/dimensi.52.2.129-144Keywords:
photogrammetric texture atlases, radiometry, chromatic decay, diagnostic mapping, hybrid classificationAbstract
Diagnosing early chromatic decay on tropical heritage façades is challenging because subtle discoloration is often masked by variable illumination and heterogeneous material properties. This study addresses that gap with two objectives: (1) to develop a radiometry-aware hybrid framework for chromatic decay detection, and (2) to validate its robustness across four heritage façades in Semarang, Indonesia. The methodology integrates 2D radiometrically normalized photogrammetric texture atlases, multi-space color and texture descriptors (HSV, CIELAB, GLCM, LBP), hierarchical spectral clustering, and Random Forest refinement with expert annotations. On 2,480 annotated tiles, the hybrid approach achieved aggregate micro-F1 ≈ 0.86 (per-site 0.84–0.87), surpassing cluster-only baselines (0.80) and RF-only models (0.82). Calibration with isotonic regression yielded Brier scores of 0.11–0.13 and Expected Calibration Error (ECE) ≈ 0.05–0.07. Statistical robustness was supported by site-stratified bootstrap and Wilcoxon tests. The resulting calibrated decay maps enable prioritized inspections, evidence-based conservation, and monitoring of tropical heritage assets.
Downloads
References
Antonelli, F., Iovine, S., M. (2024). Essential Oils and Essential Oil-Based Products Compared to Chemical Biocides Against Microbial Patinas on Stone Cultural Heritage. Coatings, 14(12), 1546. https://doi.org/10.3390/coatings14121546
Barburiceanu, S., Terebes, R., & Meza, S. (2021). 3D Texture Feature Extraction and Classification Using GLCM and LBP-Based Descriptors. Applied Sciences, 11(5), 2332. https://doi.org/10.3390/app11052332
Binarti, F., Pranowo, P., Aditya, C., & Matzarakis, A. (2024). Characterizing the local climate of large-scale archaeological parks in the tropics. Journal of Cultural Heritage Management and Sustainable Development. https://doi.org/10.1108/JCHMSD-08-2023-0124
Broomandi, P., Jahanbakhshi, A., Fathian, A., Darynova, Z., Janatian, N., Nikfal, A., Kim, J. R., & Karaca, F. (2022). Impacts of ambient air pollution on UNESCO world cultural heritage sites in Eastern Asia: Dose-response calculations for material corrosions. Urban Climate, 46, 101275. https://doi.org/10.1016/j.uclim.2022.101275
Carvalho Ottoni, A. L., & Cordeiro Ottoni, L. T. (2025). A deep learning approach for cultural heritage building classification using transfer learning and data augmentation. Journal of Cultural Heritage, 74, 214–224. https://doi.org/10.1016/j.culher.2025.06.010
Cui, H., & Yasseri, T. (2024). AI-enhanced collective intelligence. Patterns, 5(11), 101074. https://doi.org/10.1016/j.patter.2024.101074
Eltouny, K. A., & Liang, X. (2023). Large‐scale structural health monitoring using composite recurrent neural networks and grid environments. Computer-Aided Civil and Infrastructure Engineering, 38(3), 271–287. https://doi.org/10.1111/mice.12845
Fabbri, K., & Bonora, A. (2021). Two new indices for preventive conservation of the cultural heritage: Predicted risk of damage and heritage microclimate risk. Journal of Cultural Heritage, 47, 208–217. https://doi.org/10.1016/j.culher.2020.09.006
Fu, X., & Angkawisittpan, N. (2024). Detecting surface defects of heritage buildings based on deep learning. Journal of Intelligent Systems, 33(1). https://doi.org/10.1515/jisys-2023-0048
Galantucci, R. A., Musicco, A., Verdoscia, C., & Fatiguso, F. (2025). Machine Learning for the Semi-Automatic 3D Decay Segmentation and Mapping of Heritage Assets. International Journal of Architectural Heritage, 19(3), 389–407. https://doi.org/10.1080/15583058.2023.2287152
Gbran, H., Rukayah, S., Suprapti, A., & Pandelaki, E. E. (2025a). A Hybrid Framework Employing Deep Learning for 3D Decay Segmentation and Adaptive Mapping of Heritage Structures : Insights from an Experiment. ISVS E-Journal, 12(4), 101–135. https://doi.org/10.61275/ISVSej-2025-11-04-06
Gbran, H., Rukayah, S., Suprapti, A., & Pandelaki, E. E. (2025b). Innovative Strategies for Optimizing Energy Efficiency and Thermal Comfort in Heritage Architecture: The Case of Lawang Sewu. Nternational Journal of Energy Technology, 16(2), 90–101. https://www.researchtrend.net/ijet/pdf/Innovative-Strategies-for-Optimizing-Energy-Efficiency-and-Thermal-Comfort-in-Heritage-Architecture-The-Case-of-Lawang-Sewu-Hassan-Gbran-14.pdf
Grau-Bové, J., Orr, S. A., Thomas, H., & Andrews, M. (2025). Using damage functions to map heritage climatology at a global scale. Science of The Total Environment, 963, 178350. https://doi.org/10.1016/j.scitotenv.2024.178350
Gupta, P., Nguyen, T. N., Gonzalez, C., & Woolley, A. W. (2025). Fostering Collective Intelligence in Human–AI Collaboration: Laying the Groundwork for COHUMAIN. Topics in Cognitive Science, 17(2), 189–216. https://doi.org/10.1111/tops.12679
Hancock, J. T., Khoshgoftaar, T. M., & Liang, Q. (2025). A problem-agnostic approach to feature selection and analysis using SHAP. Journal of Big Data, 12(1), 12. https://doi.org/10.1186/s40537-024-01041-1
Hassan, H. M., Abdel Hafiez, H. E., Sallam, M. A., Bedon, C., Fasan, M., & Henaish, A. (2025). Multidisciplinary Approach of Proactive Preservation of the Religions Complex in Old Cairo—Part 1: Geoscience Aspects. Heritage, 8(2), 56. https://doi.org/10.3390/heritage8020056
Icomos, F., Roland, P., C. (2002). Ethical Commitment Statement for ICOMOS Members ( Revision , November 2002 , Madrid ). November, 1–6.
Jiang, Z., Xia, Q., Wang, Z., Zhu, K., Su, Q., Wang, J., Huang, Y., Wu, B., & Hong, Y. (2025). Cultural Heritage Color Regeneration: Interactive Genetic Algorithm Optimization Based on Color Network and Harmony Models. Applied Sciences, 15(4), 1720. https://doi.org/10.3390/app15041720
Kutlu, İ. (2025). Scientific mapping of artificial intelligence (AI) assisted applications in historical building conservation. Journal of Asian Architecture and Building Engineering, 1–21. https://doi.org/10.1080/13467581.2025.2505794
Laohaviraphap, N., & Waroonkun, T. (2024). Integrating Artificial Intelligence and the Internet of Things in Cultural Heritage Preservation: A Systematic Review of Risk Management and Environmental Monitoring Strategies. Buildings, 14(12), 3979. https://doi.org/10.3390/buildings14123979
Martín, D., Arroyo, G., Ruiz de Miras, J., López, L., Blanc, M. R., Vílchez, J. L., Sarrazin, P., & Torres, J. C. (2025). XMapsLab: A program for the creation and study of maps for Cultural Heritage. Journal of Cultural Heritage, 73, 1–10. https://doi.org/10.1016/j.culher.2025.02.011
Negi, A., & Sarethy, I. P. (2019). Microbial Biodeterioration of Cultural Heritage: Events, Colonization, and Analyses. Microbial Ecology, 78(4), 1014–1029. https://doi.org/10.1007/s00248-019-01366-y
Okamoto, N., & Akama, H. (2022). Extended Invariant Information Clustering Is Effective for Leave-One-Site-Out Cross-Validation in Resting State Functional Connectivity Modeling. Frontiers in Neuroinformatics, 15. https://doi.org/10.3389/fninf.2021.709179
Ortega-Morales, O., Montero-Muñoz, , C. (2021). Deterioration and microbial colonization of cultural heritage stone buildings in polluted and unpolluted tropical and subtropical climates: A meta-analysis. International Biodeterioration & Biodegradation, 143, 104734. https://doi.org/10.1016/j.ibiod.2019.104734
Pang, B., Yang, J., Xia, T., Zhang, A., Zhang, K., Xu, Q., & Wang, F. (2025). Automated heritage building component recognition and modelling based on local features. Journal of Cultural Heritage, 71, 252–264. https://doi.org/10.1016/j.culher.2024.12.006
Penjor, T., Banihashemi, S., Hajirasouli, A., & Golzad, H. (2024). Heritage building information modeling (HBIM) for heritage conservation: Framework of challenges, gaps, and existing limitations of HBIM. Digital Applications in Archaeology and Cultural Heritage, 35, e00366. https://doi.org/10.1016/j.daach.2024.e00366
Silva, C., & Oliveira, L. (2024). Artificial Intelligence at the Interface between Cultural Heritage and Photography: A Systematic Literature Review. Heritage, 7(7), 3799–3820. https://doi.org/10.3390/heritage7070180
Silva Filho, T., Song, H., , P. (2023). Classifier calibration: a survey on how to assess and improve predicted class probabilities. Machine Learning, 112(9), 3211–3260. https://doi.org/10.1007/s10994-023-06336-7
Torres-González, M., Rodríguez-Antuña, L., Bienvenido-Huertas, D., Alducin-Ochoa, J. M., León-Muñoz, M., & Rubio-Bellido, C. (2025). Courtyards as passive climate buffers: Enhancing thermal comfort and preventive conservation in mediterranean climates. Energy and Buildings, 336, 115496. https://doi.org/10.1016/j.enbuild.2025.115496
V, K. K., N, A., R, S., & Kannan, R. (2025). An end-to-end deep learning framework for structural damage assessment using semantic segmentation and point cloud analysis. Results in Engineering, 27, 106555. https://doi.org/10.1016/j.rineng.2025.106555
Xiao, Z., Tian, Z., Chen, T., Ouyang, C., Zhou, Y., Heng, C. K., & Lucchi, E. (2025). Sustainable adaptation of heritage buildings in tropical rainforest climates: The innovative practice of Tanjong Pagar Railway Station in Singapore. Energy and Buildings, 335, 115560. https://doi.org/10.1016/j.enbuild.2025.115560
Zumpano, R.,G. (2025). Raman spectroscopy and SERS: Recent advances in cultural heritage diagnostics and the potential use of anisotropic metal nanostructures. Journal of Cultural Heritage, 71, 282–301. https://doi.org/10.1016/j.culher.2024.12.010
Gbran, H., Rukayah, S., & Suprapti, A. (2025). Smart Heritage Management and Economic Sustainability Through AI and IoT : A Digital Strategy for Lawang Sewu in Indonesia. JESH: Journal of Social, Economics, and Humanities, 3(1). https://doi.org/10.30595/jesh.v3i1.320
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
