Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Interpretable and Specialized Conformal Predictors
Jönköping University, School of Engineering, JTH, Computer Science and Informatics, JTH, Jönköping AI Lab (JAIL).ORCID iD: 0000-0003-0412-6199
Jönköping University, School of Engineering, JTH, Computer Science and Informatics, JTH, Jönköping AI Lab (JAIL).ORCID iD: 0000-0003-0274-9026
School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Sweden.
Dept. of Information Technology, University of Borås, Sweden.
2019 (English)In: Conformal and Probabilistic Prediction and Applications / [ed] Alex Gammerman, Vladimir Vovk, Zhiyuan Luo, Evgueni Smirnov, 2019, p. 3-22Conference paper, Published paper (Refereed)
Abstract [en]

In real-world scenarios, interpretable models are often required to explain predictions, and to allow for inspection and analysis of the model. The overall purpose of oracle coaching is to produce highly accurate, but interpretable, models optimized for a specific test set. Oracle coaching is applicable to the very common scenario where explanations and insights are needed for a specific batch of predictions, and the input vectors for this test set are available when building the predictive model. In this paper, oracle coaching is used for generating underlying classifiers for conformal prediction. The resulting conformal classifiers output valid label sets, i.e., the error rate on the test data is bounded by a preset significance level, as long as the labeled data used for calibration is exchangeable with the test set. Since validity is guaranteed for all conformal predictors, the key performance metric is efficiency, i.e., the size of the label sets, where smaller sets are more informative. The main contribution of this paper is the design of setups making sure that when oracle-coached decision trees, that per definition utilize knowledge about test data, are used as underlying models for conformal classifiers, the exchangeability between calibration and test data is maintained. Consequently, the resulting conformal classifiers retain the validity guarantees. In the experimentation, using a large number of publicly available data sets, the validity of the suggested setups is empirically demonstrated. Furthermore, the results show that the more accurate underlying models produced by oracle coaching also improved the efficiency of the corresponding conformal classifiers.

Place, publisher, year, edition, pages
2019. p. 3-22
Series
Proceedings of Machine Learning Research, ISSN 2640-3498 ; 105
Keywords [en]
Interpretability, Decision trees, Classification, Oracle coaching, Conformal prediction
National Category
Bioinformatics (Computational Biology)
Identifiers
URN: urn:nbn:se:hj:diva-46804OAI: oai:DiVA.org:hj-46804DiVA, id: diva2:1369238
Conference
Proceedings of the Eighth Symposium on Conformal and Probabilistic Prediction and Applications, 9-11 September 2019, Golden Sands, Bulgaria
Available from: 2019-11-11 Created: 2019-11-11 Last updated: 2019-11-11Bibliographically approved

Open Access in DiVA

fulltext(664 kB)5 downloads
File information
File name FULLTEXT01.pdfFile size 664 kBChecksum SHA-512
8a65074b63d339c4cbb48735f74cd9e622b19cee4d741699d02c2404b294811c5de116d9687547e57250f88f3a810e8b6654fa57cf55e962dae99beaa75d45c6
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Johansson, UlfLöfström, Tuwe
By organisation
JTH, Jönköping AI Lab (JAIL)
Bioinformatics (Computational Biology)

Search outside of DiVA

GoogleGoogle Scholar
Total: 5 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 31 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf