Correlated activity pruning (CAPing)

C. M. Roadknight, D. Palmer-Brown, G. E. Mills

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

The generalisation ability of an Artificial Neural Network (ANN) is dependent on its architecture. An ANN with the correct architecture will learn the task presented by the training set but also acquire rales that are general enough to correctly predict outputs for unseen test set examples. To obtain this optimum network architecture it is often necessary to apply a labourious ‘trial and error’ approach. One approach that helps to achieve optimum network architecture in a more intelligent way is pruning. Such methods benefit from the learning advantages of larger networks while reducing the amount of overtraining or memorisation within these networks. Sietsma and Dow (1988) describe an interactive pruning method that uses several heuristics to identify units that fail to contribute to the solution and therefore can be removed with no degradation in performance. This approach removes units with constant outputs over all the training patterns as these are not participating in the solution. Also, units with identical or opposite activations for all patterns can be combined. The approach to merging hidden units detailed in Sietsma and Dow’s paper is useful, however, it only covers perfectly correlated, binary activations.

Original languageEnglish
Title of host publicationComputational Intelligence
Subtitle of host publicationTheory and Applications - International Conference, 5th Fuzzy Days, 1997, Proceedings
EditorsBernd Reusch
PublisherSpringer Nature Link
Pages591-592
Number of pages2
ISBN (Print)3540628681, 9783540628682
DOIs
Publication statusPublished - 1997
Event5th Fuzzy Days International Conference on Computational Intelligence, CI 1997 - Dortmund, Germany
Duration: 28 Apr 199730 Apr 1997

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1226
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th Fuzzy Days International Conference on Computational Intelligence, CI 1997
Country/TerritoryGermany
CityDortmund
Period28/04/9730/04/97

Fingerprint

Dive into the research topics of 'Correlated activity pruning (CAPing)'. Together they form a unique fingerprint.

Cite this