Digitala Vetenskapliga Arkivet

Driftstörningar
Det förekommer återkommande driftstörningar på några av sök-portalerna på grund av hög belastning. Vi arbetar på att lösa problemet, ni kan tillfälligt mötas av ett felmeddelande.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Parameter-efficient Large AI Model Co-inference at Multi-cluster Edge Networks
KTH, Skolan för elektroteknik och datavetenskap (EECS), Teknisk informationsvetenskap.ORCID-id: 0000-0002-0980-1395
Shenzhen University, College of Electronic and Information Engineering, Shenzhen, China.
ShanghaiTech University, School of Information Science and Technology, China.
Beijing University of Posts and Telecommunications, Beijing, China.
Visa övriga samt affilieringar
2026 (Engelska)Ingår i: ICC 2026 - IEEE International Conference on Communications, Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2026Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

The increasing scale and computational demands of large artificial intelligence models (LAIMs) pose significant challenges for efficient inference among distributed devices in resource-constrained environments. This paper presents a multi-cluster LAIM co-inference framework in which an edge server, equipped with multiple graphics processing units (GPUs), coordinates user clusters to fulfill inference requests. We assume that devices within each cluster capture data from different perspectives, and then use on-device lightweight LAIMs to generate local features. The edge server collects and fuses these features to produce a more accurate inference result. To capture the fundamental trade-off between model pruning and co-inference performance under multi-device scenarios, we theoretically characterize the impact of pruning ratio and device contribution based on the rate-distortion analysis and partial information decomposition. Guided by the analysis, we then jointly optimize the pruning ratio, task scheduling, and transmit power to minimize inference distortion subject to the latency, energy, and capacity constraints. Extensive simulations demonstrate that the proposed framework achieves superior performance in comparison to existing baselines, offering improved inference quality and resource efficiency in multi-cluster edge environments.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE) , 2026.
Nationell ämneskategori
Datavetenskap (datalogi) Datorsystem Datorteknik
Identifikatorer
URN: urn:nbn:se:kth:diva-386492DOI: 10.1109/ICC59461.2026.11587850Scopus ID: 2-s2.0-105045349035OAI: oai:DiVA.org:kth-386492DiVA, id: diva2:2089911
Konferens
2026 IEEE International Conference on Communications, ICC 2026, Glasgow, United Kingdom, May 24-28 2026
Anmärkning

Part of ISBN 979-8-3195-4209-0

QC 20260805

Tillgänglig från: 2026-08-05 Skapad: 2026-08-05 Senast uppdaterad: 2026-08-05Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Sök vidare i DiVA

Av författaren/redaktören
Lyu, Zhonghao
Av organisationen
Teknisk informationsvetenskap
Datavetenskap (datalogi)DatorsystemDatorteknik

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 13 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf