Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Grounding Functional Similarity by Invariance-Aware Model Stitching
Linköping University, Department of Electrical Engineering, Computer Vision. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-5213-6757
Linköping University, Department of Electrical Engineering, Computer Vision. Linköping University, Faculty of Science & Engineering.ORCID iD: 0009-0006-1528-7894
Linköping University, Department of Electrical Engineering, Computer Vision. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-6096-3648
2026 (English)In: Proceedings of the 43rd International Conference on Machine Learning, San Diego: The International Conference on Machine Learning (ICML) , 2026, p. 1-22Conference paper, Published paper (Refereed)
Abstract [en]

In deep learning, functional similarity evaluation quantifies the extent to which independently trained models learn similar input--output relationships. In model stitching, functional similarity is framed as representation forward compatibility, i.e., whether the representations of two models can be aligned to solve a given task. Recent studies, however, highlight a critical limitation: models relying on different information cues can still produce compatible representations, making them appear misleadingly similar (Smith et al., 2025). We attribute this failure to standard model stitching being inherently blind to the invariance properties of the stitched models. To address this limitation, we introduce the forward--backward compatibility requirement under which we formulate the invariance-aware model stitching. Through analyzing key stitching configurations, we study the interplay between forward and backward compatibility, showing that invariance-aware model stitching provides a more principled approach to functional similarity evaluation while revealing functional discrepancies previously obscured.

Place, publisher, year, edition, pages
San Diego: The International Conference on Machine Learning (ICML) , 2026. p. 1-22
Keywords [en]
model stitching, functional similarity evaluation, representation learning
National Category
Computer Vision and Learning Systems
Identifiers
URN: urn:nbn:se:liu:diva-226318OAI: oai:DiVA.org:liu-226318DiVA, id: diva2:2089426
Conference
Proceedings of the 43rd International Conference on Machine Learning, Seoul, South Korea, July 6th - 11th, 2026
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

The full text is published under the CC BY 4.0 license.

https://creativecommons.org/licenses/by/4.0/

Available from: 2026-08-03 Created: 2026-08-03 Last updated: 2026-08-03Bibliographically approved

Open Access in DiVA

fulltext(6030 kB)19 downloads
File information
File name FULLTEXT01.pdfFile size 6030 kBChecksum SHA-512
621b261146e4a69a80f326b020daf3a954f00fc90dd4e61252a4bba431f88a679e9c1aaaa279739bffb2a6f3cd4aa10eac113ede95d9eba847910dcfc2d2603b
Type fulltextMimetype application/pdf

Other links

Link to publication (with reviews)Link to arXiv version

Search in DiVA

By author/editor
Athanasiadis, IoannisKarmush, AnmarFelsberg, Michael
By organisation
Computer VisionFaculty of Science & Engineering
Computer Vision and Learning Systems

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1438 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf