Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Complexity Certification Algorithms for Mixed-Integer Linear and Quadratic Programming: with Applications to Hybrid MPC
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0003-2314-6531
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Model predictive control (MPC) generates control actions by iteratively solving optimization problems while explicitly accounting for system dynamics and constraints. Hybrid MPC extends this framework to systems involving both continuous and discrete variables, where the underlying optimization problems typically take the form of mixed-integer linear programs (MILPs) or mixed-integer quadratic programs (MIQPs), depending on the chosen performance measures. Ensuring the reliable real-time execution of hybrid MPC, particularly in safety-critical applications, requires rigorous worst-case computational complexity guarantees to meet limited time and hardware constraints.

Motivated by this need, this thesis develops a comprehensive framework for certifying the worst-case computational complexity of solving MILPs and MIQPs, tailored to hybrid MPC applications. Specifically, it focuses on the branch-and-bound (B&B) method, a standard approach for solving these non-convex optimization problems through solving a sequence of relaxations. The proposed framework quantifies key complexity measures, such as the total number of linear systems of equations solved in relaxations (iterations) and the number of relaxations (B&B nodes) explored within B&B, to provide a priori guarantees on computational effort, thereby enabling a deep understanding of the computational resources needed to solve these optimization problems in real time.

To enhance practical applicability, the framework is extended to incorporate algorithmic strategies commonly used in B&B, such as various branching strategies, node-selection strategies, and warm-starting of the solver of the relaxations in B&B. Additionally, it is adapted to suboptimal B&B algorithms, which reduce computational effort by trading off global optimality. The framework is further extended to certify certain primal heuristics, including start and improvement heuristics, which leverage feasible solutions to enhance efficiency throughout the B&B process. To further improve scalability, this thesis introduces parallel complexity-certification algorithms, enabling the analysis of high-dimensional and computationally demanding problems. By providing theoretical guarantees and detailed insights, these results facilitate the reliable deployment of B&B-based MILP and MIQP solvers, which are essential for real-time applications such as hybrid MPC, where computational tractability needs to be ensured a priori.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2025. , p. 67
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2441
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:liu:diva-212610DOI: 10.3384/9789181180367ISBN: 9789181180350 (print)ISBN: 9789181180367 (electronic)OAI: oai:DiVA.org:liu-212610DiVA, id: diva2:1947197
Public defence
2025-04-25, Online through Zoom (contact ninna.stensgard@liu.se) and Ada Lovelace, B Building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Note

Funding agencies: The Wallenberg AI, Autonomous Systems, and Software Program (WASP), funded by the Knut and AliceWallenberg Foundation

Available from: 2025-03-25 Created: 2025-03-25 Last updated: 2025-03-25Bibliographically approved
List of papers
1. Overall Complexity Certification of a Standard Branch and Bound Method for Mixed-Integer Quadratic Programming
Open this publication in new window or tab >>Overall Complexity Certification of a Standard Branch and Bound Method for Mixed-Integer Quadratic Programming
2022 (English)In: 2022 AMERICAN CONTROL CONFERENCE (ACC), Atlanta, GA, USA: IEEE, 2022, p. 4957-4964Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents a method to certify the computational complexity of a standard Branch and Bound method for solving Mixed-Integer Quadratic Programming (MIQP) problems defined as instances of a multi-parametric MIQP. Beyond previous work, not only the size of the binary search tree is considered, but also the exact complexity of solving the relaxations in the nodes by using recent results from exact complexity certification of active-set QP methods. With the algorithm proposed in this paper, a total worst-case number of QP iterations to be performed in order to solve the MIQP problem can be determined as a function of the parameter in the problem. An important application of the proposed method is Model Predictive Control for hybrid systems, that can be formulated as an MIQP that has to be solved in real-time. The usefulness of the proposed method is successfully illustrated in numerical examples.

Place, publisher, year, edition, pages
Atlanta, GA, USA: IEEE, 2022
Keywords
Mixed-integer quadratic Programming, Complexity Certification
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-188903 (URN)10.23919/ACC53348.2022.9867176 (DOI)000865458704088 ()2-s2.0-85138492032 (Scopus ID)9781665451963 (ISBN)9781665494809 (ISBN)
Conference
American Control Conference (ACC), Atlanta, GA, USA, 08-10 June, 2022
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

Funding: Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2022-09-30 Created: 2022-09-30 Last updated: 2025-03-25Bibliographically approved
2. Exact Complexity Certification of a Standard Branch and Bound Method for Mixed-Integer Linear Programming
Open this publication in new window or tab >>Exact Complexity Certification of a Standard Branch and Bound Method for Mixed-Integer Linear Programming
2022 (English)In: Proceedings of 2022 Conference on Decision and Control (CDC), Institute of Electrical and Electronics Engineers (IEEE), 2022, p. 6298-6305Conference paper, Published paper (Refereed)
Abstract [en]

Model predictive control (MPC) with linear cost function for hybrid systems requires the solution of a mixed-integer linear program (MILP) at each sampling time. The branch and bound (B&B) method is a commonly used tool for solving mixed-integer problems. In this work, we present an algorithm to exactly certify the computational complexity of a standard B&B-based MILP solver. By the proposed method, guarantees on worst-case complexity bounds, e.g., the worst-case iterations or size of the B&B tree, are provided. This knowledge is a fundamental requirement for the implementation of MPC in a real-time system. Different node selection strategies, including best-first, are considered when certifying the complexity of the B&B method. Furthermore, the proposed certification algorithm is extended to consider warm-starting of the inner solver in the B&B. We illustrate the usefulness of the proposed algorithm by comparing against the corresponding online MILP solver in numerical experiments using both cold-started and warm-started LP solvers.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Series
IEEE Conference on Decision and Control, ISSN 0743-1546, E-ISSN 2576-2370
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-192390 (URN)10.1109/CDC51059.2022.9992451 (DOI)000948128105047 ()2-s2.0-85147012584 (Scopus ID)9781665467629 (ISBN)9781665467612 (ISBN)
Conference
The 61st IEEE Conference on Decision and Control (CDC), Cancun, Mexico, 06-09 December, 2022
Note

Funding: Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2023-03-14 Created: 2023-03-14 Last updated: 2025-03-25Bibliographically approved
3. Exact Complexity Certification of Suboptimal Branch-and-Bound Algorithms for Mixed-Integer Linear Programming
Open this publication in new window or tab >>Exact Complexity Certification of Suboptimal Branch-and-Bound Algorithms for Mixed-Integer Linear Programming
2023 (English)In: IFAC PAPERSONLINE, ELSEVIER , 2023, Vol. 56, no 2, p. 7428-7435Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we present a method to exactly certify the computational complexity of standard suboptimal branch-and-bound (B&B) algorithms for computing suboptimal solutions to mixed-integer linear programming (MILP) problems. Three well-known approaches for suboptimal B&B are considered. This work shows that it is possible to exactly certify the computational complexity also when these approaches are used. Moreover, it also enables to compute exact bounds on the level of suboptimality actually to be obtained online, also for methods previously without any such guarantees. It additionally provides a novel deeper insight into how they affect the performance of the B&B algorithm in terms of the required computation time and memory storage. The exact bounds on the online worst-case computational complexity (e.g., the accumulated number of LP solver iterations or size of the B&B tree) and the worst-case suboptimality computed with the proposed method are very relevant for real-time applications such as Model Predictive Control (MPC) for hybrid systems. The numerical experiments confirm the correctness of the proposed method, and they demonstrate the usefulness of the certification method for certification of a standard online B&B-based MILP solver employing the three considered suboptimal techniques. Copyright (c) 2023 The Authors.

Place, publisher, year, edition, pages
ELSEVIER, 2023
Keywords
Numerical methods for optimal control; Optimal control of hybrid systems; Mixed-integer linear programming; Branch and bound method; Complexity certification; Suboptimal solutions
National Category
Discrete Mathematics
Identifiers
urn:nbn:se:liu:diva-202555 (URN)10.1016/j.ifacol.2023.10.624 (DOI)001122557300187 ()
Conference
22nd World Congress of the International Federation of Automatic Control (IFAC), Yokohama, JAPAN, jul 09-14, 2023
Note

Funding Agencies|Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2024-04-16 Created: 2024-04-16 Last updated: 2025-03-25
4. Exact Complexity Certification of Start Heuristics in Branch-and-Bound Methods for Mixed-Integer Linear Programming
Open this publication in new window or tab >>Exact Complexity Certification of Start Heuristics in Branch-and-Bound Methods for Mixed-Integer Linear Programming
2023 (English)In: 2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, IEEE , 2023, p. 2292-2299Conference paper, Published paper (Refereed)
Abstract [en]

Model predictive control (MPC) with linear performance measure for hybrid systems requires the solution of a mixed-integer linear program (MILP) at each time instance. A well-known method to solve MILP problems is branch-and-bound (B&B). To enhance the performance of B&B, start heuristic methods are often used, where they have shown to be useful supplementary tools to find good feasible solutions early in the B&B search tree, hence, reducing the overall effort in B&B to find optimal solutions. In this work, we extend the recently-presented complexity certification framework for B&B-based MILP solvers to also certify computational complexity of the start heuristics that are integrated into B&B. Therefore, the exact worst-case computational complexity of the three considered start heuristics and, consequently, the B&B method when applying each one can be determined offline, which is of significant importance for real-time applications of hybrid MPC. The proposed algorithms are validated by comparing against the corresponding online heuristic-based MILP solvers in numerical experiments.

Place, publisher, year, edition, pages
IEEE, 2023
Series
IEEE Conference on Decision and Control, ISSN 0743-1546, E-ISSN 2576-2370
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-201875 (URN)10.1109/CDC49753.2023.10384105 (DOI)001166433801147 ()9798350301243 (ISBN)9798350301250 (ISBN)
Conference
62nd IEEE Conference on Decision and Control (CDC), IEEE Control Syst Soc, Singapore, SINGAPORE, dec 13-15, 2023
Note

Funding Agencies|Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation

Available from: 2024-03-28 Created: 2024-03-28 Last updated: 2025-03-25

Open Access in DiVA

fulltext(3887 kB)150 downloads
File information
File name FULLTEXT01.pdfFile size 3887 kBChecksum SHA-512
2203d955a6f0dfa7bec12c320bf502d2a7a5a7a28dde759272535d3225604aa27eaeb3385b9aa3bf8be954881606fbf187710233809db99e5a75038728013ee7
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Search in DiVA

By author/editor
Shoja, Shamisa
By organisation
Automatic ControlFaculty of Science & Engineering
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 153 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 976 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf