High Capacity Associative Memories and Small World Networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)
29 Downloads (Pure)


Models of associative memory usually have full connectivity or if diluted, random symmetric connectivity. In contrast biological neural systems have predominantly local, non-symmetric connectivity. Here we investigate sparse networks of threshold units, trained with the perception learning rule. The units are arranged in a small world network, with short path-lengths but cliquish connectivity. The connectivity may be symmetric or non-symmetric. The results show that the small-world networks with non-symmetric weights perform well as associative memories. It is also shown that in highly dilute networks with random connectivity, it is symmetry of the weights, rather than symmetry of the connectivity matrix, that causes poor performance.
Original languageEnglish
Title of host publication. Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN04 1
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Publication statusPublished - Jul 2004


Dive into the research topics of 'High Capacity Associative Memories and Small World Networks'. Together they form a unique fingerprint.

Cite this