Change search
ReferencesLink to record
Permanent link

Direct link
Regression Trees for Streaming Data with Local Performance Guarantees
University of Borås, School of Business and IT. (CSL@BS)
University of Borås, School of Business and IT. (CSL@BS)
University of Borås, School of Business and IT. (CSL@BS)
University of Borås, School of Business and IT. (CSL@BS)
2014 (English)Conference paper (Refereed)
Abstract [en]

Online predictive modeling of streaming data is a key task for big data analytics. In this paper, a novel approach for efficient online learning of regression trees is proposed, which continuously updates, rather than retrains, the tree as more labeled data become available. A conformal predictor outputs prediction sets instead of point predictions; which for regression translates into prediction intervals. The key property of a conformal predictor is that it is always valid, i.e., the error rate, on novel data, is bounded by a preset significance level. Here, we suggest applying Mondrian conformal prediction on top of the resulting models, in order to obtain regression trees where not only the tree, but also each and every rule, corresponding to a path from the root node to a leaf, is valid. Using Mondrian conformal prediction, it becomes possible to analyze and explore the different rules separately, knowing that their accuracy, in the long run, will not be below the preset significance level. An empirical investigation, using 17 publicly available data sets, confirms that the resulting rules are independently valid, but also shows that the prediction intervals are smaller, on average, than when only the global model is required to be valid. All-in-all, the suggested method provides a data miner or a decision maker with highly informative predictive models of streaming data.

Place, publisher, year, edition, pages
IEEE , 2014.
Keyword [en]
Conformal Prediction, Streaming data, Regression trees, Interpretable models, Machine learning, Data mining
National Category
Computer Science Computer and Information Science
URN: urn:nbn:se:hb:diva-7324DOI: 10.1109/BigData.2014.7004263Local ID: 2320/14627ISBN: 978-1-4799-5666-1/14OAI: diva2:888037
IEEE International Conference on Big Data, 27-30 October, 2014, Washington, DC, USA


This work was supported by the Swedish Foundation for Strategic

Research through the project High-Performance Data Mining for Drug Effect

Detection (IIS11-0053), the Swedish Retail and Wholesale Development

Council through the project Innovative Business Intelligence Tools (2013:5)

and the Knowledge Foundation through the project Big Data Analytics by

Online Ensemble Learning (20120192).

Available from: 2015-12-22 Created: 2015-12-22

Open Access in DiVA

fulltext(927 kB)25 downloads
File information
File name FULLTEXT01.pdfFile size 927 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Johansson, UlfSönströd, CeciliaLinusson, HenrikBoström, Henrik
By organisation
School of Business and IT
Computer ScienceComputer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 25 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 325 hits
ReferencesLink to record
Permanent link

Direct link