Abstract
This paper presents a set of techniques that allow generating
a class of testbeds that can be used to test recurrent neural networks
capabilities of integrating information in time. More in particular,
the
testbeds allow evaluating the capability of such models, and possibly
other architectures and algorithms, of (a) categorizing different
time series,
(b) anticipating future signal levels on the basis of past ones, and
(c)
functioning robustly with respect to noise and other systematic random
variations of the temporal and spatial properties of the input time
series.
The paper also presents a number of analysis tools that can be used
to
understand the functioning and organization of the dynamical internal
representations that recurrent neural networks develop to acquire
the
aforementioned capabilities, for example to understand how they capture
time regularities such as periodicity, repetitions, spikes, numbers,
levels and rates of change of input signals. The utility of the proposed
testbeds is illustrated by testing and studying the capacity of Elman
neural networks to predict and categorize different signals in two
simple
tasks.
Users
Please
log in to take part in the discussion (add own reviews or comments).