RU2316806C1 - Device for inputting information into electric devices - Google Patents

Abstract

FIELD: engineering of devices for inputting information into electronic devices, in particular, mobile phones, computers, control panels, home appliances and other technological devices.

SUBSTANCE: device contains body meant for mounting structural elements. On the working surface of the body, miniature manipulator is positioned, which realizes functions of controlled element. In internal space of the body, marker with possible movement under effect of magnetic gravity forces from the side of manipulator, magnetic field and acoustic signal sensors and optic-electronic control block, including electronic and optical systems, are positioned.

EFFECT: creation of device for information input, which may display absolute coordinates of position of wireless, miniature manipulator, as cursor, and to transfer control signals by means of the same, and device may also be integrated with electronic device controlled by it.

9 cl, 10 dwg

Description

The invention can be used to enter information into electronic devices, in particular into mobile telephones, computers, control panels, photos, video, audio, household and other technological devices, by controlling the cursor displayed on the display of a controlled electronic device, as well as by transmitting control signals.

Devices for inputting information into electronic devices are widely known. It is known, for example, a device for indicating the position of the manipulator, described in JP patent No. 10171582 A (WACOM CO LTD) 06/26/1998. "Position indicator" [1]. The device contains two surfaces located in parallel and with a given distance between each other with an electrically conductive raster. A manipulator, which is a controlled element of the device, is installed on the outer side of the upper surface; the manipulator may contain a permanent magnet. Between the surfaces with a conductive raster is an electrically conductive movable element. When the manipulator moves along the surface of the device, the electrically conductive element moves between two surfaces with an electrically conductive raster, since it is affected by the force of magnetic attraction from the side of the manipulator. Moreover, the indicated movable element, at its location, causes a change in capacitive coupling between the indicated surfaces, which allows the device control unit to determine the position coordinates of the movable element and enter them into the computer.

The disadvantages of the "Position Indicator" are the low reliability due to the fact that the capacitive coupling between surfaces with a conductive raster is extremely sensitive to vibrations, thermal and mechanical deformations of these surfaces that occur during operation of the device, which can lead to the loss by the control unit of the coordinate control of the position of the movable element .

In addition, the device is not capable of transmitting the signals necessary for controlling a computer, such as, for example, the well-known computer mouse.

Closest to the invention in essence and the technical result achieved is a device for optical input of information of the type “mouse” described in US patent No. 4751505 NKI: 340/710 “Optical mouse” [2].

The patent describes a device containing a housing designed for mounting structural elements, at the same time performing the function of a controlled element and an element whose position coordinates are determined. The housing has microswitches on its surface for transmitting control signals and contains electronic and optical systems. The optical system projects an image of a portion of the working surface under the casing of the device illuminated by the light source onto a matrix photodetector, which is part of the electronic system. The photodetector is a matrix of photodiodes built on the basis of the CMOS-KMDP technology. The image processing processor, which is part of the electronic system, takes high-frequency images of the surface under the “mouse”, while the processor’s ADC, performing line-by-line scanning, estimates the illumination of each matrix element. Based on the analysis of a series of consecutive images of the surface, the processor calculates the resulting indicators corresponding to the direction and magnitude of the movement of the mouse body along the X and Y axes, under the influence of the operator’s hand. The data obtained is transmitted to the controller chip, which is part of the electronic mouse system, which is also responsible for the reaction to pressing the microswitches, rotating the scroll wheel, etc. This microcircuit already directly transfers information about the direction of mouse movement to the PC, converting the data into signals transmitted via the PS / 2 or USB interfaces. And already the computer, using the mouse driver, on the basis of the information received through these interfaces, moves the cursor on the monitor screen and executes commands corresponding to the angle of rotation of the scroll wheel and pressing the microswitches.

The optical mouse has disadvantages.

The design of the optical system and the presence of numerous elements in the body of the manipulator do not allow a miniature mouse to be made.

In addition, the presence of a wire for data and power transmission limits its mobility, and the wireless “mouse” has a lot of weight due to batteries and requires periodic charging.

In addition, a horizontal working surface is required for the mouse.

The disadvantages described above, in aggregate, do not allow the use of a “mouse” to control mobile devices, such as cell phones.

The technical result of the claimed invention is the creation of a device for inputting information into electronic devices, which allows you to display the absolute position coordinates of a miniature and wireless manipulator that performs the function of a controlled element in the form of a cursor on the display of a controlled electronic device.

An additional technical result of the invention is the creation of such a device design in which a control signal can be transmitted using a miniature and wireless manipulator.

Another technical result of the invention is to improve the usability of the miniature manipulator of the device.

Another technical result of the invention is a device design integrated with an electronic device controlled by it.

These technical results are achieved due to the fact that the inventive device for inputting information into electronic devices contains a controlled element, a housing with a light source installed in it and an electronic system containing an electrically coupled matrix photodetector, an image processing processor and a controller chip, while the controlled element is a miniature manipulator containing at least one permanent magnet and placed on the surface of the housing, while the light source is made in the form a light emitting panel is mounted opposite and parallel to the photodetector, while between the light source and the photodetector there is a marker containing at least one permanent magnet and made to move parallel to the surface of the photodetector, under the influence of magnetic forces from the manipulator, while the processing processor images made with the possibility of determining the coordinates of the position of the marker by its shadow on the surface of the photodetector.

In addition, at least one sensor that is sensitive to the marker’s magnetic field and electrically connected to the controller chip is additionally installed in the device’s case.

In addition, an acoustic vibration sensor of the housing is additionally installed in the device’s case, while the device’s electronic system further comprises a pulse acoustic signal processing unit electrically connected to the sensor and the controller chip.

In addition, the manipulator further comprises at least one emitter of pulsed sound signals in the form of an elastic membrane.

In addition, on the surface of the manipulator, in the center of its upper part, a recess is made.

In addition, the manipulator and marker further comprise an outer layer of material with a low coefficient of friction.

In addition, the marker further comprises a spontaneous motion blocking unit.

In addition, the marker is arranged to move and rotate parallel to the surface of the photodetector, under the influence of magnetic forces from the side of the manipulator, while the marker further comprises an opaque diaphragm in which there is at least one transparent window, and the image processor is configured to determine the coordinates position and angle of rotation of the marker, by its shadow on the surface of the photodetector.

In addition, the device is integrated with the electronic device it controls.

The invention is illustrated by the following graphic materials.

Figa - General view of the device, in cross section.

Figb is a General view of the device with the possibility of transmitting control signals, in section.

Figv is a device with magnets in the form of a square frame, in a section.

Fig. 1d is a sectional view of a device with ring magnets.

Figure 2a is a diagram of the interaction of the magnetic poles of the manipulator and the marker with magnets in the shape of a square frame.

Fig.2b is a diagram of the interaction of the magnetic poles of the manipulator and marker with ring magnets.

Figa - illustration to the verbal description of the algorithm for finding the coordinates and angle of rotation of the manipulator, in General form.

Figb - illustration to the verbal description of the algorithm for finding the coordinates and angle of rotation of the manipulator.

Figure 4 - block diagram of the algorithm for finding the coordinates of the manipulator and the angle of rotation.

5 is a block diagram of the principle of operation of the device according to example 1.

6 is a block diagram of the principle of operation of the device according to example 2.

7 is a block diagram of the principle of operation of the device according to example 4.

Fig is a timing diagram of the transmission and conversion of pulsed acoustic signals.

Figa - General view of a device integrated with a controlled electronic device, top view.

Figb - section (aa) integrated device.

Figure 10 is a structural diagram of a device.

The inventive device (Fig. 10) contains: 1 - a housing, 2 - a photodetector, 3 - a manipulator, 4 - a marker, 5 - a light source, 6 - a sensor of acoustic vibrations of the case, 7 - a sensor sensitive to the magnetic field of the marker, 22 - working surface 23 - electronic system.

The manipulator 3 is a controlled element of the device and is located on the working surface 22 of the housing 1. In addition, the device contains a marker 4, which is an element whose position coordinates are determined. In this case, the photodetector 2, the acoustic vibration sensor of the housing 6 and the sensors sensitive to the magnetic field of the marker 7 are sensitive elements of the electronic system 23.

Photodetector 2 is a sensitive element of the image processing processor (not indicated), which is part of the electronic system of the device 23, acts as a position-sensitive sensor. Photodetector 2 is a matrix of photodiodes, which are photosensitive elements, while the matrix is made, for example, using standard CMOS-KMDP technology based on amorphous silicon, with the architecture of active or passive pixels [3]. A similar matrix photodetector, but of a smaller size, is used in the prototype, in addition, similar matrix photodetectors are used in graphic information input devices in computer systems [4] and in other devices [3]. Matrix photodetector 2 is located in the internal space of the device casing under the working surface 22 (Fig.1a) and has dimensions proportional to the size of the display. To control a personal computer, the photodetector can have dimensions: 70 × 90 mm, to control a cell phone, the photodetector can have dimensions: 10 × 10 mm, it is possible to design a matrix photodetector with other sizes. The number of photosensitive elements of the matrix photodetector 2 is selected in accordance with the required resolution of the device. Moreover, since the device allows you to determine the absolute coordinates of the position of the manipulator, its resolution can be considered sufficient at the level of resolution of the display. For example, for controlling a personal computer, the number of matrix elements can be: 1280 · 1024≈1.3 · 10 ⁶ , for controlling a cell phone, the number of matrix elements can be: 100 · 100 = 1 · 10 ⁴ , it is possible to produce a matrix photodetector with another resolution.

The light source 5 is a flat light-emitting panel located in the inner space of the device body opposite and parallel to the matrix photodetector 2, at a distance greater than the thickness of the marker 4 (figa). As a light-emitting panel, for example, a roll-type electroluminescent lamp is used, which creates uniform diffused illumination with a high brightness (about 50 lux) [5], [6]. The linear dimensions of the light emitting panel are equal to the linear dimensions of the matrix photodetector. The emission spectrum of the light emitting panel corresponds to the spectral sensitivity range of the photodetector.

The manipulator 3 in the simplest case is a permanent magnet (figa). In this case, a part of the surface of the housing of the device 1, on which the manipulator is moved to enter information into the electronic device, forms a working surface 22. The device can be integrated with the electronic device controlled by it, in this case the working part is the surface of the controlled device, for example, in a cellular phone (figa, b). A part of the housing 1 of the device located under the working surface 22, on which the manipulator is moved, is made of non-magnetic material, such as plastic. Under the working surface adjacent to the manipulator, there is a marker 4, in the simplest case representing a permanent magnet (figa). Permanent magnets of the manipulator and marker are made, for example, according to the technology of magnetoplastics from rare-earth magnets, neodymium-iron-boron (Nd-Fe-B) [7]. Permanent magnets of the manipulator and marker can be made in the form of a ring, disk or square, and can also have a different shape. In this case, the magnets can have axial, radial and bipolar or multipolar magnetization, and can also have other magnetization. The manufacturing technology, the shape and type of magnetization of the magnets do not matter, the fact that the magnetic poles of the permanent magnets of the manipulator and the marker are located so that an attractive force arises between the manipulator and the marker due to the interaction of their magnetic fields [7], [8] . This solution allows you to use the magnetic circuit formed by the permanent magnets of the manipulator and the marker, in order to synchronize the movements of the marker 4, occurring under the action of the attractive force from the side of the manipulator 3, with the movements of the manipulator, occurring under the influence of the fingers of the operator’s hand (figa). The manipulator 3 is moved along the working surface of the device 22, while the marker 4 synchronously and adjacently moves along the surface of the matrix photodetector 2, blocking the luminous flux from the light-emitting panel 5 to the matrix photodetector 2 and forming a shadow on its surface. If necessary, the photodetector array 2 and the light emitting panel 5 may be mutually reversed, with a light emitting panel under the working surface (reciprocal position not shown). Thus, the task of determining the coordinates of the position of the manipulator is reduced to the task of determining the coordinates of the position of the marker, performing synchronous and adjacent to the manipulator movement.

The image processing processor (not indicated), which is part of the electronic system 23 (Fig. 10), in accordance with the established algorithm (Fig. 4), conducts a multiplex interrogation of matrix photodetector elements and transfers using a comparator (not shown) distributed over the area of the photodetector optical information formed by the shadow of a marker into a temporal sequence of digital signals. In this case, the surveyed elements of the matrix photodetector located in the shadow of the marker are assigned the value 0, and elements outside the shadow of the marker are assigned the value 1, and then the processor determines the coordinates of the marker position using the established algorithm, while the position coordinates are displayed on the display of the electronic device the manipulator. Since the light-emitting panel creates high illumination on the surface of the matrix photodetector, and the level of illumination on its elements is estimated only by two values, the matrix photodetector can have an architecture of passive pixels and a low duty cycle, and the photosensitive elements of the matrix can have a low dynamic range, which greatly simplifies the manufacturing technology matrices [3]. Thus, the technical result is ensured: the creation of a device for inputting information into electronic devices, which allows to display the absolute position coordinates of a miniature and wireless manipulator that performs the function of a controlled element in the form of a cursor on the display of a controlled electronic device.

To achieve an additional technical result, the magnetic properties of the marker 4 are used for positional control of individual sensors 7 (figb), sensitive to the magnetic field of the marker and located next to the trajectory of the marker [8]. This allows you to control simple functions of electronic devices, for example, turning on, answering a call in cell phones, in the same way as in the case of conventional microswitches - when marker 4 approaches sensor 7, for example, a Hall sensor or a reed switch, the electronic system circuits are switched 23 (figure 10). To transmit control signals similar to clicking on the left and right mouse buttons, an emitter 13 (Fig. 1d), or several similar emitters of pulsed sound signals installed in the manipulator, and the working surface 22, the acoustic vibration sensor of the housing 6 ( figb) and a processing unit of pulsed acoustic signals (not indicated), which is part of the electronic system 23 (Fig.10). When you click on the upper part of the manipulator, formed by an elastic cap 11 (Fig.1d), with a force exceeding the response threshold of the emitter of pulsed sound signals 13, a sound pulse is emitted. In this case, a longitudinal mechanical wave propagates through the housing of the device 1 and is detected by the acoustic vibration sensor of the housing 6 (Fig. 1b), for example, a piezoelectric microphone. The processing unit of pulsed acoustic signals makes a selective selection of acoustic signals in frequency and amplitude, which allows the electronic system to uniquely determine the fact of pressing or releasing [9], [10]. To transmit control signals similar to control signals transmitted using the scroll wheel of the mouse, the rotational movement of the manipulator is used. When the manipulator 3, and with it the magnet 9, rotates around their axis of symmetry along the working surface 22, the magnet 15 rotates synchronously and adjacent to the surface of the photodetector 2, and with it the marker 4 (figv and figa). At the same time, a shadow forms with a characteristic area on the photosensitive surface of the photodetector - an illuminated area located under the transparent window 20 of the diaphragm 14, which makes it possible to unambiguously determine the angle of rotation of the marker. Thus, the task of determining the angle of rotation of the manipulator is reduced to the task of determining the angle of rotation of the marker, performing synchronous and adjacent to the manipulator rotation. The image processing processor, which is part of the electronic system 23 (figure 10) according to the established algorithm of operation (figure 4), determines the angle of rotation of the marker, while the display shows the absolute value of the angle of rotation of the manipulator. Thus, the technical result is provided: creation of such a device design in which control signals can be transmitted using a miniature and wireless manipulator.

To improve the usability of the miniature manipulator, for example for entering handwritten text, a recess 21 is made on the surface of the manipulator in the center of the upper part (Fig. 1c). Having established, for example, the writing part of the pencil in the recess, the movements that are usual when writing the text are produced, while entraining the manipulator with the pencil rod. In addition, the presence of the manipulator gaskets 8, which has an outer layer of material with a low coefficient of friction (not shown), as well as the presence on the diaphragm 14 of a marker of a similar layer made, for example, of Teflon or fluoroplastic, reduces the amount of force required to move the manipulator . In addition, the presence of a blocking block of spontaneous movement in the marker allows you to remove the manipulator from the working surface, for example, for cleaning, while the marker remains fixed motionless. Thus, a technical result is provided: improving the usability of the miniature manipulator of the device.

Given that the elements of the device, namely the manipulator, the wall of the device’s body, a matrix photodetector, a marker and a light-emitting panel, can have a thickness of not more than 1 mm [3], [6], [7], the total thickness of the device can be no more than 5 millimeters while the linear dimensions of the device are equal to the dimensions of the working surface (figa). For example, in a cell phone, the device can be installed instead of the panel with microswitches (figa, b). Thus, the technical result is ensured: the device design integrated with the electronic device controlled by it.

Examples of specific performance.

Example 1

On figa shown: 1 - the case of the device, 2 - matrix photodetector, 3 - manipulator, 4 - marker, 5 - light source.

The manipulator is a permanent magnet, made in the form of a disk with bipolar axial magnetization. The marker is a permanent magnet, made in the form of a disk with bipolar axial magnetization. The transmission of control signals, similar to pressing the left and right buttons of the “mouse” manipulator, is carried out by pressing the microswitches located on the surface of the device (not shown).

Figure 5 presents the block diagram of the operation of the device according to example 1.

The device operates as follows.

The manipulator 3 is moved along the working surface of the device 22 by applying a finger force to it (Fig. 1a). Since disk magnets 3; 4 manipulators and markers have axial magnetization, the same dimensions and face opposite poles towards each other, an attractive force acts between the manipulator 3 and marker 4, which presses the marker against the photodetector matrix 2 and carries it away after the manipulator moves. Thus, synchronously and adjacent to the translational movement of the manipulator 3 on the working surface 22 in the inner space of the device body 1, the movement of the marker 4 occurs along the surface of the photodetector matrix 2. In doing so, the marker blocks the light flux from the light source 5 to the matrix photodetector 2, which is the receiver of the light signal of the image processing processor, which is part of the electronic system of the device 23 (figure 10), and forms a shadow on the photosensitive elements of the photodetector matrix.

The image processing processor, which is part of the electronic system of the device 23 (figure 10), according to the established algorithm of operation, scans in the form of an address survey of the elements of the photodetector matrix. The comparator, which is part of the processor (not shown), depending on the voltage on the elements of the matrix, assigns them digital values.

The voltage U on the photosensitive elements of the matrix: U = f (E).

Where

E - illumination.

On matrix elements that are completely covered by a marker, U = 0, since the illumination for these elements is E = 0, and the elements are set to 0. On elements not closed from the light source by a marker, U ≠ 0, since the illumination for these elements is E ≠ 0, and the elements are assigned the value 1. Thus, to determine the current coordinates of the position of the center of the manipulator, it is enough to determine the coordinates of the matrix elements that are in the shadow formed by the marker with U = 0 and, using the established algorithm, calculate the coordinates of its center.

The determination of the current coordinates of the position of the center of the marker is possible, for example, according to the algorithm shown in figa, b. Suppose, for example, that the photodetector matrix is made with the number of elements M · N equal to 300 × 300 and has a spacing of elements: h = 0.1 mm. The size of the matrix photodetector will be 30 × 30 mm. The radius of the marker R is, for example, 5 mm, and for calculations by the algorithm, a numerical value is assigned to it: R = R / h. With the above value of h, the value of R = 50. To determine the current coordinates of the manipulator, the current coordinates of the projection of the center of the marker on the plane of the photodetector matrix are determined.

The matrix scanning cycle begins with an element with the coordinates: X = O; Y = O (Figure 3a) and is carried out line by line in the direction Y with a pitch larger R, to detect on the line Y _o = R _{n of} element X; Y _o with voltage U = 0. Next, line-by-line scanning of elements in a rectangular zone of dimensions R · (R-1) from the element X _about ; Y _o - (R-1) in the direction of the element X _o + R; Y _o until an element with voltage U = 0 is detected on line Ymin (Fig. 3b). Next, the line is scanned Ymin + R until the detection of the element Xmin with a voltage of U = 0. The desired projection of the center of the marker O on the plane of the matrix is the element of the matrix O 'with coordinates X = Xmin + R; Y = Ymin + R, data about which is recorded in the random access memory of the processor. Thus, the absolute coordinates of the position of the manipulator are determined. The error in determining the coordinate: ε = [OO '] ≤h, in the case of applying the above matrix will be: ε≤0.1 mm. The frequency of the scanning cycles of the matrix can be up to 30 frames / s, which is associated with the inertia of human vision, since the processor determines the absolute coordinates of the position of the manipulator, which will always be unambiguously displayed on the display. Each frame entering the processor will be a data sequence with a maximum amount of: V≈M · (N / R-1) + R ² bits.

Where

M and N are the number of matrix elements in rows and columns, respectively. In the case of applying the above matrix, V 4 4 kbps or V 15 15 kbps. The low amount of data transmitted to the processor allows you to use the device to control cell phones and other electronic devices with a low clock frequency of the central processor, which allows you to use it to enter information into simple electronic devices.

After each scan cycle, the processor transmits X coordinate data; Y to the controller chip (not indicated), which is part of the electronic system of the device 23 (figure 10). The controller microcircuit is an element of coordination between the electronic system of the information input device and the electronic system of the controlled device. At the same time, the controller microcircuit also receives control signals from microswitches located on the device case (not shown), similar to pressing the mouse buttons (Fig. 5). In the case of using the device to control the cursor of a computer, the controller chip converts the marker coordinates into signals transmitted via the PS / 2 or USB interfaces. The computer, using the device driver, based on the information received through these interfaces, moves the cursor on the monitor screen in accordance with the movement of the manipulator, for example, to select menu items, and executes commands corresponding to pressing the microswitches.

4, the above described algorithm is presented in the form of a flowchart. Part 1 - search for the first element under the shadow formed by the marker. Part 2 - finding the value of Y for the projection of the center of the marker. Part 3 - search for the value of X. Part 4 - not performed.

Example 2

Figures 1b and 1c show: 1 — the case of the device, 2 — the matrix photodetector, 3 — the manipulator, 4 — the marker, 5 — the light source, 7 — the sensor sensitive to the magnetic field of the marker, 8 — the pad of the manipulator, 9 — the permanent magnet the manipulator, 11 - the cap of the manipulator, 14 - the opaque diaphragm of the marker, 15 - the permanent magnet of the marker, 20 - a transparent window in the diaphragm, 21 - the recess on the surface of the cap.

Permanent magnets of the manipulator and marker 9; 15 are made in the form of a square frame, with bipolar axial magnetization (figa). The pad of the manipulator 8 and the diaphragm 14 on the outside contain a layer of material with a low coefficient of friction (not shown), which is used as a fluoroplastic. As a sensor sensitive to the magnetic field of marker 7, a magnetically controlled contact is used - a reed switch. The transmission of control signals, similar to pressing the left and right buttons of the “mouse” manipulator, is carried out by pressing the microswitches located on the surface of the device (not shown).

Figure 6 presents the block diagram of the operation of the device according to example 2.

The device operates as follows.

The manipulator 3 is moved along the working surface of the device 22 (Figs. 1b and 1c), applying a finger force to the cap 11. If necessary, a more accurate positioning of the manipulator or for handwriting input of text is made, for example, the writing part of the pencil is placed in the recess 21 and the usual writing the text of the movement, while capturing the manipulator with the pencil rod. The presence of the gasket 8, which on the outside has a layer of material with a low coefficient of friction (not shown), significantly reduces the amount of force required to move the manipulator. Since the frame magnets 9; 15 of the manipulator and the marker have axial magnetization, the same size and face opposite poles towards each other (Fig. 2a), an attractive force acts between the manipulator 3 and marker 4, which presses the marker against the photosensitive matrix 2 and carries it away after the manipulator moves. Since the magnets of the manipulator and the marker have the shape of a square frame, when the manipulator 3 is rotated by the efforts of the fingers, around its vertical axis of symmetry, and with it the magnet 9, the magnetic flux changes in the gap formed by the magnets of the manipulator and marker. In this case, a moment of forces arises, driving the magnet 15, and with it the marker 4 into rotational motion in the same direction (Fig. 2a). Thus, synchronously and adjacent to the translational and rotational movement of the manipulator 3 on the working surface 22, in the inner space of the device body 1, on the surface of the matrix photodetector 2, the marker 4 moves. The diaphragm 14 has an outer layer of material with a low coefficient of friction ( not shown), increases the synchronizing moment during the movement of the manipulator and marker and reduces the amount of force required to move the manipulator. When marker 4 approaches the zone where the sensor 7 is sensitive to the magnetic field of the marker (Fig. 1b), the magnetic field of the permanent magnet of the marker acts on the sensor, as a result of which it triggers and commutes the circuits of the electronic system 23 (Fig. 10), for example turning on a controlled device. When the marker approaches a similar sensor located elsewhere, the sensor is triggered and, for example, the controlled electronic device is turned off. In addition, the marker 4 during movement blocks the luminous flux from the light source 5 to the photodetector array 2, which is the light signal receiver of the image processing processor, which is part of the electronic system of the device 23 (Fig. 10). In this case, the marker forms a shadow on the photosensitive elements of the photodetector matrix in accordance with the shape of the diaphragm 14, which may have at least one transparent window 20 (Fig. 1c and Fig. 2a).

The image processing processor, which is part of the electronic system of the device 23 (figure 10) according to the established algorithm of operation, scans in the form of an address survey of matrix elements. The comparator, which is part of the processor, depending on the voltage on the elements of the matrix, assigns them digital values.

The voltage U on the photosensitive elements of the matrix: U = f (E).

Where

E - illumination.

On the matrix elements completely covered by the opaque sections of the marker diaphragm, U = 0, since the illumination for these elements is E = 0, and the elements are set to 0. On elements not closed from the light source by the marker diaphragm, U ≠ 0, since the illumination for of these elements E ≠ 0, and the elements are assigned the value 1. Thus, to determine the current coordinates of the position of the center of the manipulator, it suffices to determine the coordinates of the matrix elements that are in the shadow formed by the marker with U = 0 and, using the established algorithm, calculate oordinaty its center. To determine the angle of rotation of the manipulator, it is sufficient to determine the coordinates of the matrix elements that are under the transparent window of the marker diaphragm with U ≠ 0 and, using the established algorithm, calculate the current value of the angle.

The determination of the current coordinates of the position of the center of the marker and the angle of its rotation is possible, for example, according to the algorithm shown in figa, b. Suppose, for example, that the photodetector matrix is made with the number of M · N elements equal to 300 × 300, has a step of arrangement of photosensitive elements: h = 0.1 mm. The size of the matrix will be 30 × 30 mm. The diaphragm 14 shown in (Fig. 2a) is an opaque disk of radius R. Moreover, since a square magnet is used, it is assigned an integer numerical value for the calculations according to the algorithm: R≥√0.5L / h.

Where

L is the length of the side of the applied magnet in the marker.

For example, L = 7 mm, then R = 50. On the diaphragm there is a transparent window 20 (Fig. 2a) in the form of an aperture with a radius r _о ≥2b at a distance r from the center of the marker O. To determine the current coordinates of the manipulator, determine the current coordinates of the projection of the center of the marker on the plane of the photodetector matrix. To determine the angle of rotation of the manipulator, the current coordinates of the projection of the transparent marker window onto the plane of the matrix photodetector are determined.

The matrix scanning cycle begins with an element with the coordinates: X = O; Y = O (Figure 3a) and is carried by line Y in the direction of increasing increments to detect R on line Y _o = R _{n of} element X; Y _o with voltage U = 0. Next, line-by-line scanning of elements in a rectangular zone of dimensions R · (R-1) from the element X _about ; Y _o - (R-1) in the direction _of X toward + R element; Y _o until an element with voltage U = 0 is detected on line Ymin (Fig. 3b). Next, the line is scanned Ymin + R until the detection of the element Xmin with a voltage of U = 0. The desired projection of the center of the marker O on the plane of the matrix is the element of the matrix O 'with coordinates X = Xmin + R; Y = Ymin + R, data about which is recorded in the random access memory of the processor. Thus, the absolute coordinates of the position of the manipulator are determined. The error in determining the coordinate: ε = [OO '] ≤h, in the case of applying the above matrix will be: ε≤0.1 mm.

After determining the coordinates of X; Y, a clockwise scan is performed of matrix elements located near a circle with center O 'and radius r, with a scan step μ' corresponding to the condition: μ '= 360 ° / p, a sin μ'≥4r _о / r.

Where

p is an integer.

This condition allows not to fix the angle changes during random local rotations that occur at the moment of linear movement of the manipulator, for example p = 12, μ '= 30 °. The coordinates of the scanned elements are calculated by the formula Xc = X + Sc; Yc = Y + Cc.

Where

c is the step number of the circular scan, with 0≤s≤p;

Sc, Cc are integers, moreover: Sc≈r · sin (μ '· s) and Сс≈r · cos (μ' · s).

All values of Sc and Cc are stored in the read-only memory of the processor and are extracted for use in arithmetic - the logical device of the processor, when determining the coordinates of the elements Xc; Yc as s increases. The value c = 0 corresponds to the angle μ = 0 and the element of the matrix A, with coordinates X; Y + r. If all scanned elements Xc; Yc, when changing the values from 0 to p, have a voltage of U = 0, this means that the projection of the aperture window onto the matrix plane is in the gap between the scanned elements, while the value of c determined in the previous scan cycle does not change. Upon detection of the element Xc; Yc, for which U ≠ 0, a new value of c is fixed in the random access memory of the processor, to which the angle μ = μ '· s will uniquely correspond. Thus, the absolute value of the angle of rotation of the manipulator is determined accurate to the scan step μ '.

The frequency of the scanning cycles of the matrix can be up to 30 frames / s, since the processor determines the absolute coordinates of the position of the manipulator, which will always be uniquely displayed on the display. Each frame entering the processor will be a data sequence with a maximum amount of V≈M · (N / R-1) + R ² bits.

Where

M and N are the number of matrix elements in rows and columns, respectively.

In the case of applying the above matrix V≤4 kbit or V≤15 kbit per second. The low amount of data transmitted to the processor allows you to use the device to control cell phones and other electronic devices with a low clock frequency of the central processor.

After each scan cycle, the processor transmits X coordinate data; Y and step number of the circular scan with, the controller chip, which is part of the electronic system of the device 23 (figure 10). The controller microcircuit is an element of coordination between the electronic system of the information input device and the electronic system of the controlled device. At the same time, the controller chip also receives control signals from microswitches located on the device’s case (not shown), similar to pressing the buttons of the mouse, and signals from sensors sensitive to the magnetic field of marker 7 (Fig. 1b). In the case of using the device to control the cursor of a computer, the controller chip converts the marker coordinates into signals transmitted via the PS / 2 or USB interfaces. The computer, using the device driver, based on the information received through these interfaces, moves the cursor on the monitor screen in accordance with the movement of the manipulator, for example, to select menu items. In addition, the computer executes commands corresponding to the angle of rotation of the manipulator, similar to the scroll wheel of the manipulator “mouse”, and also executes commands corresponding to pressing the microswitches and triggering sensors sensitive to the magnetic field of the marker.

4, the above described algorithm is presented in the form of a flowchart. Part 1 - search for the first element under the shadow formed by the marker. Part 2 - finding the value of Y for the projection of the center of the marker. Part 3 - finding the value of X for the projection of the center of the marker. Part 4 - finding the value from the circular scan step.

Example 3

The device differs from the device described in example 2 in the design of the manipulator and marker. Figure 1g shows: 9; 10 - permanent magnets of the manipulator, 15; 16 - permanent marker magnets, 17 - disk, 18 - washer, 19 - holder.

Permanent magnets 9 and 15 are made in the form of a ring, with multi-pole axial magnetization. Permanent magnets 10 and 16 are made in the form of a ring, with bipolar axial magnetization. The disk 17 has on the outside a layer of material with a high coefficient of friction (not shown), which is used, for example, silicone. The washer 18 is made of an elastic material, such as brass.

The device operates similarly to the device described in example 2, while the magnetic coupling between the manipulator 3 and the marker 4 is formed by ring magnets 9 and 15 and, in addition to them, ring magnets 10 and 16. Ring magnets 9; 15 have axial magnetization, the same diameters and are opposite poles facing each other (fig.2b), which leads to the occurrence of an attractive force between the manipulator and the marker and carries away the latter after the movements of the manipulator. Since the magnets are 9; 15 are multipolar with an equal number of poles, when the manipulator rotates around its vertical axis of symmetry, and with it of magnet 9, the magnetic flux changes between its poles and the poles of magnet 15. In this case, a moment of forces arises leading magnet 15, and with it and the marker rotates in the same direction. The ring magnet 10 is fixed motionless in the center of the ring magnet 9, on the gasket 8. The ring magnet 16 is mounted on an elastic washer 18 held by the holder 19, which is fixed motionless in the center of the ring magnet 15, on the gasket 14 (Fig. 1d). Since the magnets are 10; 16 have axial magnetization, the same diameters and face opposite poles towards each other (fig.2b), this leads to the occurrence of an attractive force between them and increases the synchronizing moment between the manipulator and the marker during their movement. When removing the manipulator 3 (fig.1b) from the working surface, for example, for cleaning, the magnetic interaction between the magnets of the manipulator and the marker disappears, while the magnet 16 (fig.1d) moves away from the gasket 14 under the influence of the curved washer 18 and rests against the disk 17 against a light source 5, which is a light emitting panel. Moreover, since the disk 17 externally contains a layer of material with a high coefficient of friction (not shown), the marker is fixed motionless in the gap between the photodetector 2 and the light-emitting panel 5. When the manipulator is mounted on a work surface adjacent to the marker, between the magnet of the manipulator 10 and the magnet of the marker 16, an attractive force arises, while the elastic washer 18 bends, the magnet 16 fixed on it, and with it the disk 17 depart from the light emitting panel 5. Thus, the marker contains a self-locking block arbitrary movement, consisting of a holder 19, an elastic washer 18, an annular magnet 16 and a disk 17 (Fig.1d).

Example 4

The device differs from the device described in example 3, the design of the manipulator and the presence of a sensor of acoustic vibrations of the housing. On figb and 1g are shown: 6 - the sensor of acoustic vibrations of the body, 11 - the cap, 12 - the pusher, 13 - the emitter of pulsed sound signals.

The cap 11 is made of an elastic material, such as brass. The pusher 12 is made of an elastic material, for example, silicone. The emitter of sound signals 13 is made in the form of a membrane and is made of an elastic material, such as brass. Figure 7 presents a block diagram of the operation of the device according to example 4.

The device operates similarly to the device described in example 2 and example 3. In this case, when the cap 11 is pressed with the force necessary to move the manipulator along the working surface, the cap bends and the pusher 12 exerts pressure on the membrane 13, convex side facing the cap and installed in the ring magnet 10 parallel to its base. With increasing pressure, in order to enter the control signal, the pusher bends the membrane in the opposite direction. Membrane deflection occurs abruptly and at full amplitude. In this case, the membrane 13 (Fig. 1d) emits a sound pulse, which is a damped acoustic vibration. When the magnitude of the pressure exerted on the cap 11, the membrane returns to its original position, also emitting a pulse of sound. The membrane used in the emitter of pulsed audio signals is similar to the membranes installed in the microswitches of the mouse, which also emit sound when the microswitches of the mouse are pressed, but also switch the electric circuit.

When sound is emitted, a longitudinal mechanical wave propagates through the magnet 10, gasket 8, body 1 (Fig. 1d), the acoustic vibration sensor of the body 6 (Fig. 1b), which is a sensitive element of the processing unit of pulsed acoustic signals (not indicated), included in the composition of the electronic system of the device 23 (figure 10). The signals emitted by the membrane 13 (Fig. 1d) and received by the sensor 6 are characterized by a stable amplitude and shape of the frequency spectrum, due to the coefficient of elasticity of the membrane and its size, as well as similar properties of other elements of the device located along the path of the sound wave. Moreover, the frequency characteristics of the signal do not depend on the location of the manipulator on the working surface of the device, since the natural frequency of oscillations of the emitting membrane 13 is much higher than the natural frequency of oscillations of the housing of the device 1, due to the fact that the dimensions of the working surface of the device are much larger than the dimensions of the membrane of the emitter of pulsed sound signals. The structure of the processing unit of pulsed acoustic signals (figure 10) includes an acoustic relay (not shown). In this case, the processing unit of pulsed acoustic signals selectively selects signals, for example, based on a high-pass filter, and the acoustic relay commutes the input circuit of the controller chip (Fig. 10). When you click on the cap of the manipulator 11 (Fig.1d), a pulse signal with a characteristic frequency and amplitude for the emitter, corresponding to the input parameters of the processing unit of pulsed acoustic signals, puts the acoustic relay in the “on” state, which is equivalent to clicking on the left mouse button . The next active pulsed acoustic signal that occurs when the pressure on the cap is weakened puts the relay in the “off” state, which is equivalent to releasing the left mouse button. The processing unit of pulsed acoustic signals can be multichannel and tuned to various characteristic frequencies of several emitters of pulsed sound signals placed in the manipulator, which is equivalent to using additional buttons in the mouse. To transmit control signals similar to pressing the right button of the mouse, a finger can be clicked on the body of the device 1. In this case, the processing unit of the pulsed acoustic signals (Fig. 10) is made two-channel, where the second channel is tuned to a low frequency of the sound pulse, arising when a finger clicks on the body of the device.

On Fig shows a timing diagram for the signals received by the processing unit of the pulsed acoustic signals during operation of the device. The voltage Ua is an analog signal taken from the acoustic oscillation sensor of the housing 6 when pressing and releasing the upper part of the device manipulator. The voltage Um is a signal processed by the frequency filter, with Um = f (Ua, ν).

Where

ν is the characteristic frequency for the applied pulsed acoustic emitter.

The voltage Ud is the signal level at the output of the acoustic relay, with Ud = f (Um, to).

Where

to - time between pressing and releasing the manipulator.

Time t1 displays a double click on the manipulator cap, functionally similar to double clicking on the left button of the mouse “manipulator”. Voltage Ua 'is an analog signal of the required amplitude, formed by clicking a finger on the housing of the device. The voltage Ud 'is the signal level at the output of the acoustic relay through the second channel, with Ud' = f (Ua ', λ).

Where

λ is the characteristic frequency of the sound pulse that occurs when a click is made. Moreover, ν >> λ. Thus, the acoustic properties of the membrane and the housing of the device allow the use of pulsed sound waves emitted with their help to enter control signals.

Since the materials and components used in the device are manufactured and mass-produced, the claimed device can be produced at electronic enterprises using standard technologies. Due to the simple and compact design of the claimed device will be widely used in electronic devices, in particular in mobile telephones, computers, control panels, household and other technological devices.

Information sources

1. JP patent No. 10171582 A (WACOM CO LTD), 06/26/1998.

2. US patent No. 4751505. 06/14/1988. 340/710; 178/18; 250/221 (prototype).

3. Internet resource: www.ssga.ru/erudites_info/ccd_and_cmos/oes/63/00.html.

4. Larionov A.M., Gornets N.N. Peripheral devices in computing systems, M., 1991.

5. Mazur A.I., Grachev V.N. Electrochemical indicators, M., Radio and Communication, 1985.

6. Internet resource: www.glowlight.ru.

7. Internet resource: www.valtar.ru.

8. Burke G.Yu. Reference manual on magnetic phenomena, M., 1991.

9. Acoustic switch, the journal "Radio", 1985, No. 2; 1986, No. 6-8.

10. Borovsky V.P. Handbook of circuitry for a radio amateur. K., Technique, 1987.

Claims (9)

1. A device for inputting information into electronic devices containing a controlled element, a housing with a light source installed in it and an electronic system containing an electrically coupled matrix photodetector, an image processing processor that transmits coordinate data to the controller chip, designed to coordinate the operation of the said electronic system and controlled device, characterized in that the controlled element is a miniature manipulator located on the surface of the housing and containing in itself as at least one permanent magnet, while the light source is made in the form of a flat light-emitting panel, is mounted opposite and parallel to the matrix photodetector, while between the light source and said photodetector there is a marker containing at least one permanent magnet and made to move parallel to the surface of the aforementioned photodetector under the influence of magnetic forces from the side of the manipulator, while the image processor is designed to determine the coordinates of zitsii marker on its shadow on the surface of said photodetector. 2. The device according to claim 1, characterized in that at least one sensor is additionally installed in the device’s body, which is sensitive to the magnetic field of the marker and is electrically connected to the controller chip. 3. The device according to claim 1, characterized in that the housing of the device additionally has a sensor for acoustic vibrations of the housing, while the electronic system of the device further comprises a processing unit for pulsed acoustic signals electrically connected to the specified sensor and the controller chip. 4. The device according to claim 1, characterized in that the manipulator further comprises at least one emitter of pulsed sound signals in the form of an elastic membrane. 5. The device according to claim 1, characterized in that a recess is made on the surface of the manipulator in the center of its upper part. 6. The device according to claim 1, characterized in that the manipulator and marker further comprise an outer layer of material with a low coefficient of friction. 7. The device according to claim 1, characterized in that the marker further comprises a blocking block for spontaneous movement. 8. The device according to claim 1, characterized in that the marker is arranged to move and rotate parallel to the surface of the matrix photodetector under the influence of magnetic forces from the side of the manipulator, while the marker further comprises an opaque diaphragm in which there is at least one transparent window, and the image processing processor is designed to determine the coordinates of the position and angle of the marker by its shadow on the surface of the specified photodetector. 9. The device according to any one of claims 1 to 8, characterized in that it is integrated with an electronic device controlled by it.

Images