TY - GEN
T1 - High Capacity Associative Memories and Small World Networks
AU - Davey, N.
AU - Christianson, B.
AU - Adams, R.G.
N1 - Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
PY - 2004/7
Y1 - 2004/7
N2 - Models of associative memory usually have full connectivity or if diluted, random symmetric connectivity. In contrast biological neural systems have predominantly local, non-symmetric connectivity. Here we investigate sparse networks of threshold units, trained with the perception learning rule. The units are arranged in a small world network, with short path-lengths but cliquish connectivity. The connectivity may be symmetric or non-symmetric. The results show that the small-world networks with non-symmetric weights perform well as associative memories. It is also shown that in highly dilute networks with random connectivity, it is symmetry of the weights, rather than symmetry of the connectivity matrix, that causes poor performance.
AB - Models of associative memory usually have full connectivity or if diluted, random symmetric connectivity. In contrast biological neural systems have predominantly local, non-symmetric connectivity. Here we investigate sparse networks of threshold units, trained with the perception learning rule. The units are arranged in a small world network, with short path-lengths but cliquish connectivity. The connectivity may be symmetric or non-symmetric. The results show that the small-world networks with non-symmetric weights perform well as associative memories. It is also shown that in highly dilute networks with random connectivity, it is symmetry of the weights, rather than symmetry of the connectivity matrix, that causes poor performance.
M3 - Conference contribution
SP - 177
EP - 182
BT - . Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN04 1
PB - Institute of Electrical and Electronics Engineers (IEEE)
ER -