RU2159504C2 - Threshold gate which weights are set using binary signals - Google Patents

Abstract

FIELD: computer engineering, bionics. SUBSTANCE: device may be used as tuned unit for control devices and as basis element of artificial neural networks. Device has n input s of n weight modification units 2, first and second linear adders 3, 8, zero comparison circuit 4, k binary memory registers 6, k binary signal converters 7, which may produce positive and negative weight values, multiplication circuit 9. When binary signals are received in (0,1) notation, they are stored by weight modification units 2 in memory registers 6 and converted into (-1, 1) notation in k binary signal converters 7. Produced signals are received by second adder 8, which outputs natural weight values, which are received by multiplication circuit 9. threshold can be designed as arbitrary weight of threshold gate, when constant input signal equal to 1 is received at respective input. Outputs of weight modification unit 2 sends products to inputs of adder 3, which outputs weighted input. Zero comparison circuit 4 produces binary 1 signal, when output of adder 3 is greater than zero. If it is equal to zero or negative, then binary 0 signal is produced. This results in possibility to design logical networks, in which control binary signals for weight application and threshold are produced either by the same threshold gate or other threshold gates. EFFECT: increased functional capabilities, increased reliability.

Description

 The invention relates to the field of computer engineering and bionics, can be used as a custom module for control logic devices, and also as a basic element of artificial neural networks.

 Threshold elements are known that use various physical elements and laws to memorize weights and thresholds [1, 2].

 The disadvantages of these devices are low functionality, low noise immunity, high complexity of the scheme for changing weights and thresholds.

 Closest to the invention is a device for modeling a neuron containing n inputs connected to the inputs of n blocks of modification of weights, the outputs of which are connected to the summing inputs of a linear adder, the output of which is connected to a comparison circuit [3].

 The main disadvantages of this device are the low speed and complexity of control associated with multi-cycle operation of the used logic elements.

 An object of the invention is to expand the functionality of a threshold element with setting weights with binary signals at its minimum complexity and maximum speed of setting weights, by creating a new mechanism for modifying its weights during operation using control binary signals.

The problem is achieved in that in the threshold element with the installation of scales by binary signals, containing n inputs associated with the inputs of n blocks of modification of the scales, the outputs of which are connected to the summing inputs of the first linear adder, the output of which is connected to the comparison circuit, while the modification blocks of the scales contain binary memory elements, a multiplication circuit, a second linear adder, the output of which is connected to the first input of the multiplication circuit, the second input of which is one of n inputs 1 _i (i = 1 ... n) of the threshold element with setting of the weights with binary signals, and the resulting products from the weight modification blocks are fed to the summing inputs of the first linear adder, they are additionally introduced into the k control input modification blocks, while k binary signal converters are introduced into the weight modification blocks, which make it possible to form a positive or negative weight value, and binary memory elements are made in the form of k binary memory elements, in which the binary signals entering the k control inputs of the modification blocks are stored AIAM, wherein k binary elements memory outputs are connected to inputs k binary signal converters whose outputs are connected to inputs of the second summing k of the linear combiner, and the comparison circuit is configured as a comparison circuit with zero.

 The invention is illustrated by drawings.

In FIG. 1 shows a diagram of a threshold element with setting weights with binary signals; in FIG. 2 is a diagram of blocks 2 ₁ , ..., 2 _n modification of the balance.

The device (Fig. 1) contains: n inputs 1 _i , ..., 1 _n , n blocks of modification of weights 2 ₁ , ..., 2 _n , the first linear adder 3, a comparison circuit with zero 4.

Blocks 2 ₁ , ..., 2 _n modification of the balance (Fig. 2) contain k control inputs 5 ₁ , ..., 5 _k , k binary memory elements 6 ₁ , ..., 6 _k , k binary signal converters 7 ₁ , ..., 7 _k , second linear adder 8, multiplication scheme 9.

The device operates as follows. When binary signals in the basis (0, 1) arrive at k control inputs 5 ₁ , ..., 5 _k blocks 2 ₁ , ..., 2 _{n of the} modification of the weights, they are stored in k binary memory elements 6 ₁ , ... , 6 _k , and then conversion from the basis (0, 1) to the basis (-1, 1) with the help of k binary signal converters 7 ₁ , ..., 7 _k , which allow generating positive or negative weight values. The binary signals obtained as a result of this conversion are fed to the second linear adder 8, which generates at its output the natural value of the generated weight w _i (i = 1 ... n). This value is fed to one of the two inputs of the multiplication circuit 9, to the second input of the multiplication circuit 9 receives the input signal x _i in the basis (0, 1). The threshold function can be performed by any weight of the threshold element with setting weights by binary elements, if the input corresponding to this weight receives a constant value of the input signal x _i = 1. Received products from the outputs of blocks 2 ₁ ,. .., 2 _{n the} formation of the weights go to the inputs of the adder 3, forming at its output a weighted sum (x ₁ w ₁ + ... + x _n w _n ). This sum is fed to the input of the comparison circuit with zero 4. If the output value of the first linear adder 3 is greater than zero, then binary signal 1 is generated at the output of the comparison circuit with zero 4, if the output value of the first linear adder 3 is zero or negative, then the output of the circuit comparison with zero 4 is formed binary signal 0.

Thus, the threshold element with setting weights by binary signals, using the analog operations of multiplying, summing and comparing with zero, allows you to make the necessary changes to the weights and threshold with the necessary level of discreteness and maximum speed, using control binary signals for this, which extends the functionality of the threshold element with the installation of scales by binary signals and opens up the possibility of creating customizable logical networks in which control binary signals for changing Nia weights and threshold can be produced both by the threshold setting element with weights binary signals and the other threshold elements with installation weights binary signals. In addition, it opens the possibility of increasing the reliability of the threshold element with setting weights with binary signals by increasing the number of binary memory elements that determines the maximum value of the corresponding weight w _i .

SOURCES OF INFORMATION
1. Levchenko E.B. Artificial neural networks: elements and architectures. In the book. Neurocomputer as the basis of thinking computers. M .: Nauka, 1993, 239 p.

 2. Vavilov E.N., Egorov B.M., Lantsev B.C., Totsenko V.G. Synthesis of schemes on threshold elements. M .: Soviet radio, 1970, p. 367.

 3. A.S. 1479944, USSR, MKI G 06 G 7/60. Device for modeling a neuron / A.V. Kalyaev, Yu.Yu. Chernukhin, Yu.A. Bryukhomitsky and G.A. Galuev. Publ. in B.I. 1989, N 18 (prototype).

Claims (1)

A threshold element with setting the scales by binary signals, containing n inputs connected to the inputs of n blocks of modification of the scales, the outputs of which are connected to the summing inputs of the first linear adder, the output of which is connected to the comparison circuit, while the modification blocks of the scales contain binary memory elements, a multiplication circuit, a second linear combiner, the output of which is connected to the first input of the multiplication circuit, a second input which is one of inputs n _{l i (i = l ... n} ) with a threshold setting element weights binary signals as received The output products from the weight modification blocks are fed to the summing inputs of the first linear adder, characterized in that the weight modification blocks have k control inputs, and k binary signal converters are introduced into the weight modification blocks, which make it possible to form a positive or negative weight value, and binary memory elements made in the form of k binary memory elements, in which the binary signals entering the k control inputs of the weight modification blocks are stored, and k outputs are binary x memory elements are connected to the inputs of k binary signal converters, the outputs of which are connected to k summing inputs of the second linear adder, and the comparison circuit is made in the form of a comparison circuit with zero.

Images