ADALINE network decision boundary decision boundary adaption custom function function parameters adaptive filter example noise cancellation example prediction application prediction example training adaptive linear networks adaptive linear networks amplitude detection applications adaptive filtering aerospace automotive banking defense electronics entertainment financial insurance manufacturing medical medical oil and gas exploration robotics speech telecommunications transportation architecture bias connection bias connection input connection input connection input delays layer connection layer connection layer delays number of inputs number of inputs number of layers number of layers number of outputs number of outputs number of targets number of targets output connection output connection target connection target connection backpropagation backpropagation algorithm example backtracking search batch training batch training batch training dynamic networks static networks Bayesian framework benchmark benchmark BFGS quasi-Newton algorithm bias connection definition initialization function learning learning function learning parameters subobject subobject value value box distance Brent's search cell array derivatives errors initial layer delay states input P input vectors inputs and targets inputs property layer targets layers property matrix of concurrent vectors matrix of sequential vectors sequence of outputs sequential inputs tap delayed inputs weight matrices and bias vectors Charalambous' search classification input vectors linear regions code mathematical equivalents perceptron network writing competitive layer competitive neural network example competitive transfer function competitive transfer function competitive transfer function concurrent inputs concurrent inputs conjugate gradient algorithm Fletcher-Reeves update Polak-Ribiere update Powell-Beale restarts scaled continuous stirred tank reactor control control design electromagnet electromagnet feedback linearization feedback linearization model predictive control model predictive control model predictive control model predictive control model predictive control model predictive control model reference control model reference control model reference control model reference control model reference control model reference control NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 plant plant plant robot arm time horizon training data CSTR custom neural network dead neurons decision boundary decision boundary definition demonstrations appelm1 applin3 definition demohop1 demohop2 demorb4 nnd10lc nnd11gn nnd12cg nnd12m nnd12mo nnd12sd1 nnd12sd1 nnd12vl distance distance box custom function Euclidean link Manhattan tuning phase dynamic networks dynamic networks training training early stopping early stopping electromagnet electromagnet Elman network recurrent connection Euclidean distance export networks networks training data feedback linearization feedback linearization feedforward network finite impulse response filter finite impulse response filter Fletcher-Reeves update generalization regularization generalized regression network golden section search gradient descent algorithm gradient descent algorithm batch with momentum with momentum graphical user interface graphical user interface gridtop topology Hagan, Martin 24, 25 Hagan, Martin 24, 25 hard limit transfer function hard limit transfer function hard limit transfer function heuristic techniques hidden layer definition home neuron Hopfield network architecture design equilibrium point solution trajectories stable equilibrium point target equilibrium points horizon hybrid bisection-cubic search import networks networks training data training data incremental training initial step size function initialization additional functions custom function definition function parameters parameters input connection number range size subobject subobject subobject input vector outlier input vectors classification dimension reduction distance topology input weights definition inputs concurrent concurrent sequential sequential installation guide Jacobian matrix Kohonen learning rule lambda parameter layer connection dimensions distance function distances initialization function net input function number positions size subobject topology function transfer function layer weights definition learning rate adaptive maximum stable optimal ordering phase too large tuning phase learning rules custom Hebb Hebb with decay instar Kohonen outstar supervised learning unsupervised learning Widrow-Hoff Widrow-Hoff Widrow-Hoff Widrow-Hoff Widrow-Hoff Widrow-Hoff learning vector quantization creation learning rule learning rule LVQ network subclasses target classes union of two subclasses least mean square error least mean square error Levenberg-Marquardt algorithm reduced memory line search functions backtracking search Brent's search Charalambous' search golden section search hybrid bisection-cubic search linear networks design linear transfer function linear transfer function linear transfer function linear transfer function linear transfer functions linearly dependent vectors link distance log-sigmoid transfer function log-sigmoid transfer function log-sigmoid transfer function MADALINE magnet magnet Manhattan distance maximum performance increase maximum step size mean square error function least least memory reduction model predictive control model predictive control model predictive control model predictive control model predictive control model predictive control model reference control model reference control model reference control model reference control model reference control model reference control momentum constant mu parameter NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 NARMA-L2 neighborhood net input function custom network definition dynamic dynamic static network function network layer competitive definition network/Data Manager window Neural network definition 18 neural network adaptive linear adaptive linear competitive custom feedforward generalized regression multiple layer multiple layer multiple layer one layer one layer one layer one layer one layer probabilistic radial basis self organizing self-organizing feature map Neural Network Design 24 Instructor's Manual 24 Overheads 24 neuron dead (not allocated) definition home Newton's method NN predictive control NN predictive control NN predictive control NN predictive control NN predictive control NN predictive control normalization inputs and targets mean and standard deviation notation abbreviated abbreviated layer transfer function symbols transfer function symbols numerical optimization one step secant algorithm ordering phase learning rate outlier input vector output connection number size subobject subobject output layer definition linear overdetermined systems overfitting pass definition pattern recognition perceptron learning rule perceptron learning rule normalized perceptron network code creation limitations performance function custom modified parameters plant plant plant plant identification plant identification plant identification plant identification Polak-Ribiere update postprocessing post-training analysis Powell-Beale restarts predictive control predictive control predictive control predictive control predictive control predictive control preprocessing principal component analysis probabilistic neural network design quasi-Newton algorithm BFGS radial basis design efficient network function network network design radial basis transfer function recurrent connection recurrent networks regularization automated resilient backpropagation robot arm self-organizing feature map (SOFM) network neighborhood one-dimensional example two-dimensional example self-organizing networks sequential inputs sequential inputs S-function sigma parameter simulation definition SIMULINK generating networks NNT block set Simulink NNT blockset spread constant squashing functions static networks batch training training subobject bias bias bias input input input input layer layer output output output target target target weight weight weight weight weight supervised learning target output training set system identification system identification system identification system identification system identification system identification tan-sigmoid transfer function tapped delay line tapped delay line target connection number size subobject subobject target output time horizon topologies custom function gridtop topologies for SOFM neuron locations training batch batch competitive networks custom function definition definition efficient faster function incremental ordering phase parameters post-training analysis self organizing feature map styles tuning phase training data training set training styles training with noise transfer functions competitive competitive competitive custom definition derivatives hard limit hard limit linear linear linear log-sigmoid log-sigmoid log-sigmoid radial basis saturating linear soft maximum tan-sigmoid triangular basis transformation matrix tuning phase learning rate tuning phase neighborhood distance underdetermined systems unsupervised learning variable learning rate algorithm vectors linearly dependent weight definition delays delays initialization function initialization function learning learning learning function learning function learning parameters learning parameters size size subobject subobject subobject value value value weight function weight function weight function custom weight matrix definition Widrow-Hoff learning rule Widrow-Hoff learning rule Widrow-Hoff learning rule Widrow-Hoff learning rule Widrow-Hoff learning rule Widrow-Hoff learning rule workspace (command line)