Change search
ReferencesLink to record
Permanent link

Direct link
Producing Implicit Diversity in ANN Ensembles
University of Borås, School of Business and IT. (CSL@BS)
University of Borås, School of Business and IT. (CSL@BS)
2012 (English)Conference paper (Refereed)
Abstract [en]

Combining several ANNs into ensembles normally results in a very accurate and robust predictive models. Many ANN ensemble techniques are, however, quite complicated and often explicitly optimize some diversity metric. Unfortunately, the lack of solid validation of the explicit algorithms, at least for classification, makes the use of diversity measures as part of an optimization function questionable. The merits of implicit methods, most notably bagging, are on the other hand experimentally established and well-known. This paper evaluates a number of straightforward techniques for introducing implicit diversity in ANN ensembles, including a novel technique producing diversity by using ANNs with different and slightly randomized link structures. The experimental results, comparing altogether 54 setups and two different ensemble sizes on 30 UCI data sets, show that all methods succeeded in producing implicit diversity, but that the effect on ensemble accuracy varied. Still, most setups evaluated did result in more accurate ensembles, compared to the baseline setup, especially for the larger ensemble size. As a matter of fact, several setups even obtained significantly higher ensemble accuracy than bagging. The analysis also identified that diversity was, relatively speaking, more important for the larger ensembles. Looking specifically at the methods used to increase the implicit diversity, setups using the technique that utilizes the randomized link structures generally produced the most accurate ensembles.

Place, publisher, year, edition, pages
IEEE , 2012.
Keyword [en]
Artificial neural networks, implicit diversity, ANN ensemble technique, Computer Science, Computer Science, Ensemble Learning, Neural Networks
National Category
Software Engineering
Research subject
Bussiness and IT
URN: urn:nbn:se:hb:diva-6809DOI: 10.1109/IJCNN.2012.6252713ISI: 000309341302072Local ID: 2320/11277ISBN: 978-1-4673-1488-6ISBN: 978-1-4673-1489-3OAI: diva2:887512
Neural Networks (IJCNN), The 2012 International Joint Conference on
Available from: 2015-12-22 Created: 2015-12-22

Open Access in DiVA

fulltext(197 kB)13 downloads
File information
File name FULLTEXT01.pdfFile size 197 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Johansson, UlfLöfström, Tuve
By organisation
School of Business and IT
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 13 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 5 hits
ReferencesLink to record
Permanent link

Direct link