ARTIFICIALNEURAL NETWORKS, 2

Proceedings of the 1992 International Conferenceon Artificial Neural Networks (ICANN-92)

Brighton, United Kingdom, 4-7 September, 1992

Edited by

IgorALEKSANDERDepartment of Electrical and Electronic Engineering

Imperial College of Science Technology and MedicineLondon, United Kingdom

and

John TAYLORDepartment of Mathematics

King's College LondonLondon, United Kingdom

Volume 2 _ _ _ ^

ONIVERSITATSBIBLIOTHEKHANNOVER

TECMMSCHEAT

1992

NORTH-HOLLANDAMSTERDAM • LONDON • NEW YORK • TOKYO

XIX

•

Table of ContentsVOLUME 2

Neurobiology 1Organizer: J.G.Taylor

Temporal Sequence Storage (Invited Paper) 841J.G. Taylor

Gamma-band and Beta-band Cortical Oscillations 847R.M.J. Cotterill, C. Nielsen

Synchronization and Label-switching in Networks of Laterally Coupled 851Model NeuronsA. Nischwitz, H. Gliinder, A. von Oertzen, P. Klausner

A Model for the Organization of Neocortical Maps 855CR. Renfrew

The Neuronal Computation Time 861G. Bugmann

Redundancy Reduction of a Gabor Representation: A Possible Computational 865Role for Feedback from Primary Visual Cortex to Lateral Geniculate NucleusA.E.C. Pece

Connection Weights Based on Molecular Mechanisms in Aplysia Neuron Synapses 869R. Lahoz-Beltra, SJt. Hameroff, J.E. Dayhoff

Dynamic Phenomena in the Olfactory Bulb: I. Bifurcation Sequences, Coexistence 873of Periodicity and Chaos, Synaptic Modification Induced TransitionsP. Erdi, T. Grobler, K. Kaski

Dynamic Phenomena in the Olfactory Bulb: II. Model for a Simple Associative Memory 877T. Grobler, P. Erdi, K. Kaski,

A Model of Adaptive Development of Complex Cortical Cells 881H.G. Barrow, AJ. Bray

Activity-Induced "Colour Blob" Formation 885H.G. Barrow, AJ. Bray

Neurobiology 2Organizer: E.T. Rolls

Computational Analysis of the Operation of a Real Neuronal Network in the Brain : 891The role of the Hippocampus in Memory (Invited Paper)A.Treves, E.T. Rolls,

XX

Architectural Consequences of Mapping 3D Space Representations onto 2D 899G. Hartmann

A Neural Network for Fixation Point Selection Based on Spatial Knowledge 903M. Hirahara, T. Nagano

Phase Transitions, Hysteresis and Overshoot in Developing Neural 907NetworksA. van Ooyen, J. van Pelt

A Distributed Model of the Representational States in Classical Conditioning 911E.P.Fulcher

A Neural Model of Cortical Cells Characterized by Gabor-like Receptive Fields - 917Application to Texture SegmentationG.M. Bisio, DD. Caviglia, G. Indiveri, L. Raffo, S.P. Sabatini

Stochastic and Oscillatory Burst Activities in a Model of Spiking Neurons 921J. Deppisch, H.-U. Bauer, T. Schillen, P. Konig, K. Pawelzik, T. Geisel

Reinforcement Learning: Being Wise during the Event 925E.P. Fulcher

A Simulation of the Gated Thalamo-Cortical Model 929FJV. Alavi, J.G. Taylor

The Biomagnetic Inverse Problem 933F.N Alavi, J.G. Taylor, A.A. Ioannides

Limitations of Logical Reasoning in Neural Networks and Reasoning by Analogy 937A. de Callatay

Algorithms 1Organizer: W.E. Snyder

A Unified Theory of Edge-preserving S moo thing (Invited paper) 1675 *W.E. Snyder, Y-S. Han, G.L. Bibro

G-Nets and Learning Recurrent Random Networks 943E.Gelenbe

On a Class of Efficient Learning Algorithms for Multi-Layered Neural Networks 947F. Biegler-Konig, F. Bdrmann

A Hybrid Genetic Algorithm for Training Neural Networks 953V.Petridis, S. Kazarlis, A. Papaikonomou, A. Filelis

Matching the Topology of a Neural Net to a Particular Problem: 957Preliminary Results UsingCorrelation Analysis as a Pruning ToolD. Tsaptsinos, A.R. Mirzai, JR. Leigh

XXI

Performance Comparison of Learning Algorithms in Hopfield Networks 961K.-R. Muller, A. Waldenspuhl

A Study of Maximum Matching on Boltzmann Machines 965X. Yao, B. Marks jo

Generation of Inhibitory Connections to Minimize Internal and External Entropy 969R. Kamimura

The Extended Quickprop 973M. Fombellida, J. Destini

Evolutionary Construction Algorithms for Topology Conserving Neural Nets 979SR. Jockusch, J.S. McCaskill

SCAWI: An Algorithm for Weight Initialization of a Sigmoidal Neural Network 983G.P. Drago, S. Ridella

An Approximation -Based Model of Associative Memory 987A.Labbi

Pruning Neural Nets by a Genetic Algorithm 991PJ.B. Hancock

Optimizing Multilayer Networks Layer per Layer without Back-Propagation 995R. LengelU, T. Denoeux

Entropy and Generalization in Feedforward Nets 999L.S. Smith

Improving Convergence of Back-Propagation by Handling Flat-Spots 1003in die Output LayerK. Balakrishnan, V. Honavar

Fast Convergence of Neural Networks by Application of a New Min-Max 1011AlgorithmA. Chella, F. Sorbello

Algorithms 2Organizer: R. Hecht-Nielsen

The Munificence of High Dimensionality (Invited Paper) 1017R. Hecht-Nielsen

A Tripartite Framework for Artificial Neural Networks 1031H. Wiklicky, T. Denoeux, A. Lafuente, J. Olarte, S. Rementeria, V. Walravens

Back-Propagation Algorithm for Neural Networks Using Random Pulse Streams 1035J.W. Suh, S.-I. Chae

A Collection of Constraint Design Rules for Neural Optimization Problems 1039//JV. Schaller

XX11

Optimization of the Rectilinear Steiner Tree Using a Mean Field Theory Model 1043U. Peine, HP. Siemon

A New Learning Scheme for Dynamic Self-Adaption of Learning Revelant Parameters 1047R. Salomon, L. van Hemmen

Growing Cell Structures: A Self-Organizing Network in k Dimensions 1051B. Fritzke

Distributed Generation of Synchronous, Asynchronous, and Partially 1057Synchronous/Asynchronous Updating Dynamics by a Self-Organizing OscillatoryNetworkF.M.G. Franca

Direct Approaches to Improving the Robustness of Multilayer Neural Networks 1063G. Bugmann, P. Sojka, M. Reiss, M. Plumbley, J. Taylor

A Study on Generalization Properties of Artificial Neural Network Using Fahlman 1067and Lebiere's Learning AlgorithmM. Hamamoto, J. Kamruzzaman, Y. Kumagai

Domain Independent Testing and Performance Comparisons for Neural Networks 1071F. Hergert, H.G. Zimmermann, U. Kramer, W. Finnoff

The Optimal Elastic Net: Finding Solutions to the Travelling Salesman Problem 1077J.V. Stone

Bayesian Networks for Temporal Segmentation 1081R. Orre, A. Lansner

Adaptive Constrained Optimization for Improving the Topological Maps 1085H. Schwenk, P. Gallinari, X. Draincourt

Signal ProcessingOrganizer: F. Fogelman-Soulie

A Recurrent Neural Network Model 1091A.B. Bulsari, H. Sax&n

The Minimum Entropy Neuron: A New Building Block for Clustering 1095TransformationsR.W. Brause

Nonlinear Hebbian Algorithms for Sinusoidal Frequency Estimation 1099/. Karhunen, J. Joutsensalo

Systolic Implementation of Orthogonal-Inverse Updating Algorithm 1103L. Wang, I. Hartimo

The Neural Impulse Response Filter 1107V. Tresp, I. Leuthdusser, M. Schlang, R. Neuneier, K. Abraham-Fuchs, W. Hdrer

Stabilization Properties of Multilayer Feedforward Networks with Time-Delay Synapses 1113AD.Back, A.C. Tsoi

XX111

A Measure of Nonlinearity in Time Series Using Neural Network Prediction Model 1117N. Toda, N. Murai, S. Usui

Pattern Recognition 1Organizer: D. Bounds

A Neural Network Approach to Fault Location in Nonlinear DC Circuits 1123G. Rutkowski

Optimization of the Distance-based Neural Network by Akaike's Information Criterion 1127H.Sakou

Loss Function Based Neural Classifiers 1135T. Hrycej

Image Compression for Neural Networks Using Chebyshev Polynomials 1139P.M. Williams

Training the Gradient Field of a Dynamic Hopfield (Recurrent) Network for 1143ClassificationC. Hicks, H. Ogawa

Classification of Epilectic EEG by Using Self-organizing Maps 1147P. Elo, J. Saarinen, A. Vdrri, H. Nieminen, K. Kaski

Protein Structure Prediction and Neural Networks 1151/. Vanhala, E. dementi, K. Kaski

A Neural Network for Meteor Trail Classification 1155DD. Fraser, Z. Khan, D.C. Levy

High-speed Learning in a Supervised, Self-growing Net 1159D. Palmer-Brown

Parallel Processing System with Fixed Connections as a New Approach to 1163Handwritten Digit RecognitionR. Babic

A Modified Hypermap Architecture for Classification of Biological Signals 1167B. Bruckner, M. Franz, A. Richter

Applications and Pattern Recognition 2Organizer: B. Angeniol

Texture Image Classification Based on Interframe Principal Features 1173C. Shang, K. Brown

Interframe Principal Feature Extraction Using a Multi-layer Feedforward 1177Neural NetworkC. Shang, K. Brown

A Method for Analyzing Decision Regions in Learning Vector Quantization Algorithms 1181J.T. Laaksonen

XXIV

Tracking Particles in a High Energy Particle Detector Using a Neural Gas Network 1185Ml,. Goldstein

Hand-written Japanese Kanji Character Recognition by a Structured 1189Self-growing Neural Network "CombNET-II"A. Iwata, Y. Ino, K.-I. Hotta, N. Suzumura

Development of MLP/LVQ Hybrid Networks for Classification of 1193Remotely-Sensed Satellite ImagesR. Hernandez, A. Varfis, I. Kanellopoulos, G. Wilkinson

A Deformable Templates Approach for Track Finding 1197M. Ohlsson

Pattern Recognition with Artificial Neural Networks - A Benchmark Study of 1201Scaling BehaviourT. Rognvaldsson

Reconstruction of Tokamak Density Profiles Using Feedforward Networks 1207C. Bishop, I. Strachan, J. O'Rourke, G. Maddison, P. Thomas

Pattern Recognition with the Random Neural Network 1211M. Mokhtari

Designing Modular Network Architectures Using a Genetic Algorithm 1215BL.M. Happel, JM.J. Murre

On Clustering Properties of Hierarchical Self-organizing Maps 1219J. Lampinen

SOC: A Self-organizing Classifier 1223P. Morasso, A. Pareto, V. Sanguineti

Cumulant-based Neural Network Classifiers 1227A. Tirakis, A. Delopoulos, S. Kollias

Model Based Approach for Generating and Structuring a Learning Database 1231for Real-scale 3D Identification TasksD. Gastinel, F. Fogelman Soulie

SoftwareOrganizer: P.C. Treleavan

Neural Network Programming Environments (Invited Paper) 1237ML. Recce, P.C. Treleavan

A Structured Design, Development and Integration Methodology for Real-world 1245Applications of Artificial Neural NetworksG. Whittington, C.T. Spracklen

A New Artificial Neural Network Classifier 1253A. Adams, SJ. Bye, P. Vamplew

XXV

Software Package for Multilayer Perceptron Simulation as Associative Memory 1257A. Dzienlinski, S. Skoneczny, R. Foltyniewicz

Efficient Simulation of Massive Neural Networks on Machines with Limited Memory 1261T. Tollenaere, J.M. Saraiva, MM. Van Hulle

SESAME - A Software Package Environment for Combining Multiple Neural Network 1265Paradigms and ApplicationsA. Linden, C. Tietz

A Design Framework for Neural Nets 1269L.S. Smith

Using a Library of Efficient Data Structures and Algorithms as a Neural Network 1273Research ToolB. Fritzke

Transforming Neural Network Specifications to Parallel Programs 1277L.M.WJ. Rutten, M.CJ.D. van Eekelen, MJ. Plasmeijer

The Implementation of Artificial Neural Networks on Parallel Heterogeneous 1283ArchitecturesG.E. Fagg, PR. Minchinton, S.A. Williams

Implementations of Very Large Recurrent ANNs on Massively Parallel SIMD 1287ComputersP. Hammarlund, A. Lansner

An Acoustical Signal Recognizer Implemented on a Novel Interactive 1291Object-oriented Neural Network SimulatorJ.F. Leber, G.S. Moschytz

Cognitive SystemsOrganizer: E. Burattini

NES: a Neural Shell for Diagnostic Expert Systems (Invited Paper) 1685*E. Burattini, M. De Gregorio, G. Tamburrini

A Connectionist Approach to Solving Tangram Puzzles 1297K. Oflazer

A Connectionist model of pure Alexia 1301K. Mayall, G.W. Humphreys

Cognition and Neural Network Modelling 1305H. Huning

Counting with Artificial Neural Networks: An Experiment 1311J. Hoekstra

Combining Supervised and Unsupervised Learning in a Model of Catergorisation 1315A.V. Robins

XXVI

On the Beauty of Nature 1321B.F. Katz

Basins of Attraction in Disordered Networks 1325A. Wuensche

Sequential Learning in Mean Field Autoassociators 1331J. Levy, D. Bairaktaris

Variability in the Pathogenesis of Alzheimer Disease: Analytical Results 1335M. Herrmann, D. Horn, E. Ruppin, M. Usher

Microeconomic Experiments by Neural Networks 1339P. Terna

Interacting Neural Networks: An Artificial Life Approach for Stock Markets 13435. Margarita

Resolving Lingiustic Ambiguities with a Neural Data-oriented Parsing (DOP) System 1347J.C. Scholtes

Implementing the Semantic Subsystem for a Model of Language Acquisition 1351NJ. Sales

Finding Multi-faculty Structure 1357MM. Gera

A Connectionist Approach to Anaphora Resolution in Task-Orientated Discourses 1361OB. Coelho

Unsupervised Methods for Finding Linguistic Categories 1365S. Finch, N. Chater

The Speed and Slips of Mental Arithmetic 1369R. Dallaway

Looks Recognition by Adaptive Junction 1373Y. Ajioka, K. Inoue

A Connectionist Approach to Effects of Anxiety and Task Difficulty on Learning 1377A.FR. Araujo

A Neural Network Architecture which uses Cellular Automata to Get 1381Context-specific Associative MemoryH.-J. Boehme, E. Koerner, H.-M. Gross, R. Moeller

Temporal Order, Timing, and Probability Context Effects on Pattern Recognition and 1385Categorization in Neural NetworksJ.P. Banquet, JL. Contreras-Vidal

Distributed Representation: A Critique of Minimal Networks 1391F.P. Cilliers

XXV11

HardwareOrganizer: S. Garth

To Simulate or not to Simulate (Invited Paper) 1397SJ. Garth

Three Dimensional Neural Network Synthesis 1405FJ. Lopez-Aligue, I. Acevedo-Sotoca, MA. Jaramillo-Mordn

Hopfield's Binary Networks: Simulations on Tree-connected Transputer Networks 1409A.d'Acierno, R. Vaccaro

Further Developments of a Ring Based Multiprocessor Architecture for Backprop 1415SimulationM.A. Turega

The NAND-Net - Binary Connectionist Model 1419A. Garzotto

Adaptable VLSI Neural Network of Tens of Thousand Connections 1423I.S. Han, KM. Ahn, TM. Park, KM. Jun

Hardware Implementations of PC A Neural Networks 1427P. Kotilainen, J.Saarinen, K. Kaski

VLSI Architecture of the Self-organizing Neural Network Using Synchronous 1431Pulse-density Modulation TechniqueJ. Tomberg, K. Kaski

A Processor Ring for the Implementation of Neural Networks with Cortical Architecture 1435M. Huck, F. Worgotter, U. Eysel

The Dynamic Ring Architecture 1439F. Castillo, J. Cabestany, J.M. Moreno

Parallel Hardware Implementation of the General Neural Unit Model 1443P. Ntourntoufis

Using Threshold Gates to Implement Sigmoid Nonlinearity 1447V. Beiu, J.A. Peperstraete, R. Lauwereins

Hardware Implementations of Kohonen's Self-organzing Feature Map 1451Topic: HardwareH. Speckmann, P. Thole, W. Rosenstiel

RENNS - A REconfigurable Neural Network Server 14550. Landsverk, J. Greipsland, J.G. Solheim, J.A. Mathisen, H. Dahle, L. Utne

NAC: A Building Block for Neural Architectures 1461M. Cavaiuolo, A.J.S. Yakovleff, CR. Watson

A Massively Parallel Implementation of Autoassociative Neural Networks for 1465Image CompressionA. Basso

XXV111

A Faithful Analog Implementation of The Boltzmann Machine 1469E. Belhaire, P. Garda, Z. Yiming

Commercial/Industrial Hardware SystemsOrganizer: C. Hughes

A Temporal Noisy-Leaky Integrator Neuron Constructed Using pRAMs 1473C. Chrisodoulou, J.G. Taylor, T.G. Clarkson, G. Bugmann

Optical High Order Feedback Neural Network Using an Optical Fibre Amplifier 1479Z.Q. Mao, DR. Selviah, J.E. Midwinter

Mindshape: A Neurocomputer Concept Based on a Fractal Architecture 1483JMM. Heemskerk, J. M.J. Murre, A. Melissant, M. Pelgrom, P.T.W. Hudson

Parallel Distributed Computation 1487J. Austin

A VLSI Implementation of Programmable Cellular Neural Networks 1491G.C. Cardarilli, R. Lojacono, M. Salerno, F. Sargeni

Radial Base Network for Dynamic Fault Detection 1495/ . Suontausta, T. Sorsa, H. Koivo

A Neural Technique for Satellite Coverage Plans Optimization 1499P.Burrascano, M.Melis

Integrated Cooperation between Unsupervised and Supervised Learning for a 1503Defect Classification ProblemJ.-D. Muller, M. Samuelides

Neural Network Image Segmention for Automated Visual InspectionU. Schramm, K. Spinnler

A Comparison between Chemotaxis and Back-Propagation Learning Applied toColour Recipe PredictionJ.M. Bishop, MJ. Bushnell, S. Westland

Dynamic Model for a Plant Using Associative Memory System 1517K. Goto, T. Yamaguchi, T. Takagi

Large Scale Application of Neural Networks to Protein Classification 1521EA. Ferrdn, B. Pflugfelder, P. Ferrara

An Ordering Theorem that Allows for Ordering Changes 1525EA. Ferrdn

Process State Monitoring Using Self-organizing Maps 1531M. Kasslin, J. Kangas, O. Simula

XXIX

The Hardware Implementation of Logical Neural Networks in an Ultrasonic 1535Weld Control SystemRR. Stroud, S.S. Swallow

The Control of Submerged Arc Welding Using Neural Network Interpretation of 1539UltrasoundTJ. Harris, RR Stroud

Algorithms and Applications 1Organizer: W. Biittner

Reliability in Neural Network Learning (Invited Paper) 1547W. Burner

Automated Radar Behaviour Analysis Using Hierarchical Neural Network Architectures 1559G. Whittington, C.T. Spracklen

A Neural Network Approach to Restrictive Channel Routing Problems 1565K.T. Sun, H.C. Fu

BPCLS: A Classified Learning Search Algorithm Based on Back-Propagation 1569ModelJ.Fan.R.Yu

Selection of Optimal Parameters for Kohonen Self-organizing Feature Maps 1573HP. Siemon

Digit Classification Using an Edge Based Heirarchical Neural Representation 1579M. Busemann, G. Hartmann, K.O. Krduter, E. Seidenberg, H. Wiemers

Selecting Reliable Kohonen Maps for Data Analysis 1583A. Varfis, C. Versino

A Logical Neural Network Based Character Recognition System that Adapts to 1587an Author's Writing StyleJ. Nellis, TJ. Stonham

Optical Character Recognition and Cooperating Neural Networks techniques 1591J. Loncelle, N. Derycke, F. Fogelman Soulii

Solving the Human Face Recognition Task using Neural Nets 1595H. Bouattour, F. Fogelman Soulii, E. Viennet

Scene Segmentation Using Multiresolution Analysis and MLP 1599E. Viennet, F. Fogelman Soulii

Secondary Structure of Proteins from NMR Data by Neural Nets 1603M. Giacomini, T. Parisini, C. Ruggiero

Comparative Study of Neural Networks and Non Parametric Statistical Methods for 1607Off-Line Handwritten Character RecognitionY. Idan, J.-M. Auger, N. Darbel, M. Sales, R. Chevallier, B. Dorizzi, G. Cazuguel

XXX

Integration of a Connectionist Model in Information Retrieval Systems 1611J. Mothe, C. Soule-Dupuy

High Impedance Fault Detection using Recurrent Networks 1615S. Fernando, F. Islam, P. Utama, K. Watson

Algorithms and Applications 2Organizer: O. Simula

Self-Organizing Feature Maps in Texture Classification and Segmentation 1621O.Simula, A. Visa

Prediction of Monthly Transition of the Composition Stock Price Index 1629Using Recurrent Back-propagationCM. Lee, K.C.Park

EuclidNet - A Multilayer Neural Network using the Euclidian Distance as 1633Propagation RuleG. Dorffner

Neural Network Approach for Detecting Heart Disease 1637Z. Shen, M. Clarke, R.W. Jones, T. Alberti

Pattern Classification Using Neural Networks for Diagnostic Problem Solving 1641K.S. Swamp, H.S. Chandrasekharaiah

Machine-generated Music with Themes 1645M. Jakobsson

A Neural Network for Hyphenation 1647W. Daelemans, A. van den Bosch

Temporal Sparse Distributed Memory: Identifying Temporal Patterns via 1651Homeomorphic Contractions of MemoryL.M. Manevitz

Communication Load Reduction for Neural Network Implementations on 1655Message Passing MulticomputersB. Kreimeier, M, Schone, R. Eckmiller

Teaching a Neural Network to Play GO-MOKU 1659B. Freisleben

The Neural Composer: A Network for Musical Applications 1663B. Freisleben

Quadratic Load Flow Calculation in Electric Power Systems Using a Hopfield Model 1667H. Mori

Object Recognition in Traffic Scenes by Neural Networks 1671B. Blockl, L. Tsinas

Author Index 1693

(* Indicates page numbers of papers received too late for correct positioning)