Explainable spatial AI analyzes tumor-immune interactions to predict immunotherapy outcomes and identify new targets
DOI:
https://doi.org/10.63808/ihf.v2i3.510Keywords:
Explainable AI, Spatial omics, Tumor immune microenvironment, Immunotherapy prediction, Target discovery, Deep learningAbstract
The effectiveness of immune checkpoint inhibitors (ICIs) heavily depends on the complex spatial interactions of cells within the tumor microenvironment (TME). However, existing predictive biomarkers generally lack spatial resolution and interpretability, making it difficult to guide clinical decisions or reveal actionable targets. This study aims to develop an interpretable spatial AI framework to systematically decode the tumor-immune spatial architecture, achieve high-accuracy predictions of immunotherapy responses, and identify new immunotherapy targets. We collected pre-treatment tumor samples from melanoma and non-small cell lung cancer patients across multiple centers, simultaneously obtaining spatial transcriptomics and multiplex immunofluorescence data. We developed a deep learning framework called “SpaImmune,” which integrates graph attention networks and visual transformer architectures, modeling hundreds of thousands of cells based on their real spatial coordinates as a heterogeneous graph network to automatically learn multi-scale features of the immune microenvironment. The model’s explainability module uses attention weight mechanisms and SHAP values to quantify each spatial component’s contribution to predictions and extract higher-order interaction rules. In three independent validation cohorts, SpaImmune predicted the objective response to ICIs with area under the curve (AUC) values all over 0.91, significantly outperforming methods based on immune cell density, PD-L1 expression, and traditional machine learning. Explainability analysis revealed that the tight spatial coupling of B cells and CD4⁺ follicular helper T cells in tertiary lymphoid structures (TLS) is the strongest feature for predicting treatment response. More importantly, by scanning the cell-gene spatial colocalization network built by the model, we discovered a molecule called SLAMF7, previously unreported as an immune target, which is highly expressed specifically in immune-active regions and associated with good prognosis. Subsequent in vitro functional tests confirmed that activating SLAMF7 can enhance CD8⁺ T cell tumor-killing function, while blocking it weakens immunotherapy effects. Explainable spatial AI can faithfully reveal the intrinsic logic of tumor-immune interactions, not only greatly improving predictive accuracy for immunotherapy but also directly guiding rational discovery of new targets, offering a whole new paradigm for spatial intelligence-driven precision immuno-oncology.
References
[1] Cabrita, R., Lauss, M., Sanna, A., et al. (2020) Tertiary lymphoid structures improve immunotherapy and survival in melanoma. Nature, 577(7791), 561-565. https://doi.org/10.1038/s41586-019-1914-8
[2] Campanella, G., Hanna, M. G., Geneslaw, L., et al. (2019) Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med, 25(8), 1301-1309. https://doi.org/10.1038/s41591-019-0508-1
[3] Chen, K. H., Boettiger, A. N., Moffitt, J. R., et al. (2015) Spatially resolved, highly multiplexed RNA profiling in single cells. Science, 348(6233), aaa6090. https://doi.org/10.1126/science.aaa6090
[4] Courtiol, P., Maussion, C., Moarii, M., et al. (2019) Deep learning-based classification of mesothelioma improves prediction of patient outcome. Nat Med, 25(10), 1519-1525. https://doi.org/10.1038/s41591-019-0583-3
[5] Fridman, W. H., Pagès, F., Sautès-Fridman, C., Galon, J. (2012) The immune contexture in human tumours: Impact on clinical outcome. Nat Rev Cancer, 12(4), 298-306. https://doi.org/10.1038/nrc3245
[6] Galon, J., Costes, A., Sanchez-Cabo, F., et al. (2006) Type, density, and location of immune cells within human colorectal tumors predict clinical outcome. Science, 313(5795), 1960-1964. https://doi.org/10.1126/science.1129139
[7] Goltsev, Y., Samusik, N., Kennedy-Darling, J., et al. (2018) Deep profiling of mouse splenic architecture with CODEX multiplexed imaging. Cell, 174(4), 968-981.e15. https://doi.org/10.1016/j.cell.2018.07.010
[8] Havel, J. J., Chowell, D. & Chan, T. A. (2019) The evolving landscape of biomarkers for checkpoint inhibitor immunotherapy. Nat Rev Cancer, 19(3), 133-150. https://doi.org/10.1038/s41568-019-0116-x
[9] Helmink, B. A., Reddy, S. M., Gao, J., et al. (2020) B cells and tertiary lymphoid structures promote immunotherapy response. Nature, 577(7791), 549-555. https://doi.org/10.1038/s41586-019-1922-8
[10] His, E. D., Steinle, R., Balasa, B., et al. (2008) CS1, a potential new therapeutic antibody target for the treatment of multiple myeloma. Clin Cancer Res, 14(9), 2775-2784. https://doi.org/10.1158/1078-0432.CCR-07-4246
[11] Hu, J., Li, X., Coleman, K., et al. (2021) SpaGCN: Integrating gene expression, spatial location and histology to identify spatial domains and spatially variable genes by graph convolutional network. Nat Methods, 18(11), 1342-1351. https://doi.org/10.1038/s41592-021-01255-8
[12] Hunter, M. V., Moncada, R., Weiss, J. M., et al. (2021) Spatially resolved transcriptomics reveals the architecture of the tumor-microenvironment interface. Nat Commun, 12(1), 6278. https://doi.org/ 10.1038/s41467-021-26614-z
[13] Keren, L., Bosse, M., Marquez, D., et al. (2018) A structured tumor-immune microenvironment in triple negative breast cancer revealed by multiplexed ion beam imaging. Cell, 174(6), 1373-1387.e19. https://doi.org/10.1016/j.cell.2018.08.039
[14] Liu, G. (2026) The application of artificial intelligence in tumor immunotherapy: integrating multi-omics data to achieve efficacy prediction and combination strategies. Applied Artificial Intelligence Research, 2(2). https://doi.org/10.65455/q72yq328
[15] Lundberg, S. M. & Lee, S. I. (2017) A unified approach to interpreting model predictions. 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4765–4774. https://doi.org/10.48550/arXiv.1705.07874
[16] Mariathasan, S., Turley, S. J., Nickles, D., et al. (2018) TGFβ attenuates tumour response to PD-L1 blockade by contributing to exclusion of T cells. Nature, 554(7693), 544-548. https://doi.org/10.1038/nature25501
[17] Nirmal, A. J., Maliga, Z., Vallius, T., et al. (2022) The spatial landscape of progression and immunoediting in primary melanoma at single-cell resolution. Cancer Discov, 12(6), 1518-1541. https://doi.org/10.1158/2159-8290.CD-21-1357
[18] Petitprez, F., de Reyniès, A., Keung, E. Z., et al. (2020) B cells are associated with survival and immunotherapy response in sarcoma. Nature, 577(7791), 556-560. https://doi.org/10.1038/s41586-019-1906-8
[19] Schürch, C. M., Bhate, S. S., Barlow, G. L., et al. (2020) Coordinated cellular neighborhoods orchestrate antitumoral immunity at the colorectal cancer invasive front. Cell, 182(5), 1341-1359.e19. https://doi.org/10.1016/j.cell.2020.07.005
[20] Selvaraju, R. R., Cogswell, M., Das, A., et al. (2017) Grad-CAM: Visual explanations from deep networks via gradient-based localization. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 618-626. https://doi.org/10.1109/ICCV.2017.74
[21] Ståhl, P. L., Salmén, F., Vickovic, S., et al. (2016) Visualization and analysis of gene expression in tissue sections by spatial transcriptomics. Science, 353(6294), 78-82. https://doi.org/10.1126/science.aaf2403
[22] Topalian, S. L., Hodi, F. S., Brahmer, J. R., et al. (2012) Safety, activity, and immune correlates of anti-PD-1 antibody in cancer. N Engl J Med, 366(26), 2443-2454. https://doi.org/10.1056/NEJMoa1200690
[23] Wu, S. Z., Al-Eryani, G., Roden, D. L., et al. (2021) A single-cell and spatially resolved atlas of human breast cancers. Nat Genet, 53(9), 1334-1347. https://doi.org/10.1038/s41588-021-00911-1
[24] Zhao, S., Liang, X., Xie, J., et al. (2025) Integrating pathology genomics and single-cell genomics to identify lactate metabolism-related prognostic features and therapeutic strategies for melanoma. Apoptosis, 30(11-12), 2963-2988. https://doi.org/10.1007/s10495-025-02190-1
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Gang Liu, Jia Wang, Jia Zhu

This work is licensed under a Creative Commons Attribution 4.0 International License.