CN115407881A - Real-time intelligent error correction keyboard - Google Patents

Real-time intelligent error correction keyboard Download PDF

Info

Publication number
CN115407881A
CN115407881A CN202211072329.XA CN202211072329A CN115407881A CN 115407881 A CN115407881 A CN 115407881A CN 202211072329 A CN202211072329 A CN 202211072329A CN 115407881 A CN115407881 A CN 115407881A
Authority
CN
China
Prior art keywords
key
finger
module
transverse position
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202211072329.XA
Other languages
Chinese (zh)
Inventor
赵加强
孙晓红
孙兵
戴长志
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weifang University
Original Assignee
Weifang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weifang University filed Critical Weifang University
Priority to CN202211072329.XA priority Critical patent/CN115407881A/en
Publication of CN115407881A publication Critical patent/CN115407881A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202Constructional details or processes of manufacture of the input device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238Programmable keyboards

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

The invention discloses a real-time intelligent error correction keyboard, which comprises software and hardware, and the error correction principle is as follows: the method comprises the steps that a photoelectric conversion circuit is arranged, fingers which press keys are fingers of a hand of which hand are detected, whether the fingers are keys which a typist wants to press or not is judged according to the corresponding relation of typing fingering, and if the fingers are not keys which the typist wants to press, codes of the output keys are modified; for example: if the currently pressed key is an '8' key, detecting that the finger pressing the key is a right-hand index finger, according to the corresponding relation of typing fingering, the right-hand index finger should press a '7' key adjacent to the '8' key, obviously, the intention of a typist is to press the '7' key, and if the result is wrong to be the '8' key, the key code corresponding to the '7' key should be output; the invention can correct the errors of adjacent keys at the left and right positions, reduce the probability of typing errors and effectively improve the working efficiency.

Description

Real-time intelligent error correction keyboard
Technical Field
The invention relates to a real-time intelligent error correction keyboard.
Background
The keyboard is the most common information input tool, and the keys of the common computer keyboard are dozens or even hundreds, so that the condition of wrong key pressing often occurs when characters are input, the speed of character input is reduced, the mood of a user is influenced, and the probability of wrong key pressing is higher especially for the group who uses computers infrequently or has slow reaction speed due to physical function reduction; however, even for some groups with low pressing error rate, when the finger is moved across a large range to perform the key pressing, for example, the basic keypad of the common characters is moved to an uncommon keypad such as a directional keypad, a numeric keypad, and a home keypad on the right side of the keyboard, since the two keypads are far apart, the key pressing cannot be performed accurately, and the probability of the key pressing error is high; once a key press error occurs, the speed of inputting characters is slow, and the work efficiency is reduced, so that it is necessary to provide a keyboard with error correction function. At present, a scheme for realizing error correction in a software mode is available, some frequently-occurring error habits of people are subjected to statistical error correction, and the universality and the practicability are not strong.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a real-time intelligent error correcting keyboard combining software and hardware, and the problem that the pressing error between left and right adjacent keys can be corrected without counting the personal input error habit.
In order to solve the technical problem, the technical scheme of the invention is as follows: the real-time intelligent error correction keyboard comprises a plurality of keys, and is also provided with a key scanning detection module, a plurality of finger detection modules, a finger lighting source, a communication interface module and a key coding error correction module, wherein each finger detection module, each key scanning detection module and each communication interface module are respectively connected with the key coding error correction module; the key scanning detection module is used for judging whether a key is in a pressed state or not and transmitting the key code of the key in the pressed state to the key code error correction module; the finger lighting light source comprises a plurality of lighting units which are distributed with the finger detection modules in a staggered manner, the lighting direction is from bottom to top, and the light intensity of the finger lighting light source is changed periodically; the communication interface module is in signal connection with a computer;
each finger detection module is arranged on the keyboard, a row of finger detection modules which are uniformly distributed is correspondingly arranged behind each row of keys, and two rows of finger detection modules which are uniformly distributed are correspondingly arranged behind the last row of keys; all the finger detection modules are aligned front to back, left to right and form a two-dimensional array; the finger detection module comprises a mounting hole, a light-transmitting cover plate, a photosensitive sensor and a signal processing circuit, wherein the mounting hole is a vertical blind hole formed in the surface of the keyboard, light-absorbing materials are arranged around the inside of the vertical blind hole, the light-transmitting cover plate covers the opening of the vertical blind hole, the photosensitive sensor is arranged at the bottom end of the inside of the vertical blind hole and connected with the signal processing circuit, the opening of the vertical blind hole is rectangular, the front and back directions are long edges, the left and right directions are short edges, the photosensitive range of the photosensitive sensor is fan-shaped, the height of the photosensitive range intersection of the photosensitive sensor positioned in front of the same row of keys and the height of the photosensitive range intersection of the photosensitive sensor positioned behind the same row of keys are greater than or equal to 4cm, and the height of the photosensitive range intersection of the adjacent photosensitive sensors on the same row and on the same row of the same side is greater than or equal to 4cm; the signal processing circuit is connected with the photosensitive sensors and comprises an amplification detection circuit and a conversion control circuit, each photosensitive sensor is correspondingly connected with one amplification detection circuit, the amplification detection circuits are used for carrying out alternating current amplification and detection on electric signals generated by the photosensitive sensors to generate direct current signals, the direct current signals enter the conversion control circuit and then are connected to the bus circuit, and the conversion control circuit is used for controlling the on-off of the direct current signals;
the key coding error correction module comprises a signal acquisition control module, an analog-to-digital conversion module, a sensor transverse position storage module, a finger transverse position acquisition module, a fingering rule storage module, a key transverse position storage module and a comparison error correction module; the signal acquisition control module is respectively in signal connection with the analog-to-digital conversion module and the finger detection module, the analog-to-digital conversion module is respectively in signal connection with the finger detection module, the signal acquisition control module and the finger transverse position acquisition module, the sensor transverse position storage module is in signal connection with the finger transverse position acquisition module, and the finger transverse position acquisition module, the key transverse position storage module and the fingering rule storage module are respectively in signal connection with the comparison error correction module;
the sensor transverse position storage module is internally stored with transverse position data of each finger detection module on a keyboard; the signal acquisition control module controls the analog-to-digital conversion module to sequentially convert the direct current signals of the finger detection modules into digital signals and transmit the digital signals to the finger transverse position acquisition module, and the finger transverse position acquisition module forms a pair of two-dimensional image data by the received digital signals; then the finger transverse position acquisition module carries out image recognition on the two-dimensional image data to obtain transverse position data of the left and right index fingers, middle fingers, ring fingers and little fingers; the fingering rule storage module stores corresponding relations between the fingers and the keys, and each key with the error correcting function is pressed down by the only finger which is fixedly matched according to the corresponding relations; the key transverse position storage module is internally stored with transverse position data corresponding to each key on the keyboard;
the error correcting process of the comparison error correcting module comprises the following steps:
step one, the comparison error correction module acquires transverse position data of a pressed key from the key transverse position storage module;
step two, the comparison error correction module receives the key codes of the pressed keys transmitted by the key scanning detection module, and then judges whether the keys are single keys or not according to the number of the key codes;
reading the transverse position data of the fingers of the finger transverse position acquisition module and the transverse position data of the pressed key in the key transverse position storage module, comparing the two data, and taking the finger closest to the transverse position data of the pressed key as the finger of the pressed key; if the finger pressing the key and the pressed key accord with the corresponding relation in the fingering rule storage module, the key code is directly transmitted to the communication interface module without changing and then transmitted to the computer; if the finger pressing the key and the pressed key do not accord with the corresponding relation in the fingering rule storage module, selecting the key code of the key corresponding to the finger pressing the key from two keys adjacent to each other left and right of the pressed key and transmitting the key code to the communication interface module.
As a preferred technical solution, the image recognition step is:
s1, firstly, presetting a threshold, wherein the data of the threshold is larger than the data corresponding to the signal generated by the environment reflected light passing through the analog-to-digital conversion module, then comparing all image data with the preset threshold, reserving the data larger than or equal to the threshold, and enabling the data smaller than the threshold to return to zero;
s2, firstly, presetting the maximum value of all image data as P, the maximum value of a neighborhood pixel of the image as Q, the data value corresponding to the current pixel as F, and K as a proportionality coefficient; when F > = K (P + Q)/2, defining the data corresponding to the current pixel as '1', otherwise, defining the data corresponding to the current pixel as '0', wherein the value of K is an adjustable quantity;
s3, identifying the finger position, specifically as follows:
s31, defining 8 finger transverse position variables A, B, C, D, E, F, G and H, and 10 intermediate variables, wherein each variable is initialized to 0, the total number of lines of the image is i, the current line code is n, and n is initialized to 0;
s32, n = n +1, detecting a region with a continuous value of '1', if the region is detected, comparing the region with the transverse position data corresponding to the detected region in the previous row, if the region does not have overlapped data, calculating the average value of the corresponding transverse position data, storing the average value of the transverse position data into an intermediate variable, and if the region does not have overlapped data, not calculating and storing the transverse position; this step is looped until n = i, stopping the detection;
s33, sorting the intermediary variables with the numerical values not being 0 according to the data size, assigning the numerical values of the four transverse position variables from small to large to A, B, C and D respectively, correspondingly assigning the transverse positions of the little finger, the ring finger, the middle finger and the index finger of the left hand, assigning the numerical values of the four intermediary variables from large to small to H, G, F and E respectively, and correspondingly assigning the transverse position data of the little finger, the ring finger, the middle finger and the index finger of the right hand.
As a preferred technical solution, the image recognition method includes obtaining a contour line of a finger through an edge detection calculation tool, then performing curve fitting, and finding an extreme point of a curve, where the lateral position data corresponding to the extreme point is the lateral position data corresponding to each finger.
As a preferred technical solution, when a pressed single key performs error correction, if the comparison error correction module stores the corresponding relationship in the module according to the fingering rule, and a key code corresponding to a finger currently pressing the key is not found in the two adjacent key codes on the left and right, the pressed key code is directly transmitted to the communication interface module without being changed.
As a preferable technical scheme, the method also comprises the following steps between the step one and the step two: if the pressed key is not a single key, firstly judging whether the key is a combined key, if the key is the combined key, not executing error correction, and directly transmitting the key code of the pressed key to the communication interface module; if the key is not the combined key, judging whether the key which is pressed at the same time currently is two left and right adjacent keys, if not, not executing error correction, and directly transmitting the key code generated by pressing to the communication interface module; if the key is adjacent to the left key and the right key, reading the transverse position data of the two keys, and taking the average value of the transverse position data as reference data; and then comparing the transverse position data of each finger obtained by the finger transverse position acquisition module with the reference data, wherein the finger closest to the reference data is the finger for pressing the key, and finally selecting the key code corresponding to the finger for pressing the key from the two pressed keys and transmitting the key code to the communication interface module.
Due to the adoption of the technical scheme, the invention has the beneficial effects that: the invention can correct the key press error of the left and right adjacent keys or the simultaneous pressing error of the left and right adjacent keys, can solve 80 percent of key press errors in actual operation, reduces the probability of key press errors, improves the accuracy rate of character input, improves the working efficiency and reduces the working strength. Compared with the mode of needing to count the input error probability in the prior art, the method can correct the frequently-occurring repetitive errors, and can better realize the correction effect on some low-frequency errors with low occurrence probability, so that the correction method has better universality and higher use value.
Drawings
The drawings are only for purposes of illustrating and explaining the present invention and are not to be construed as limiting the scope of the present invention. Wherein:
FIG. 1 is a block diagram of the architecture of an embodiment of the present invention;
FIG. 2 is a block diagram of a key code error correction module according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a position of a finger detecting module according to an embodiment of the invention;
FIG. 4 is an enlarged schematic view of the embodiment of the present invention at A in FIG. 3;
FIG. 5 is a schematic diagram of a finger detection module;
FIG. 6 is a corresponding schematic block diagram between a photosensitive sensor and signal processing circuitry according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a signal processing circuit according to an embodiment of the present invention;
FIG. 8 is a flowchart illustrating a method for correcting coding errors according to an embodiment of the present invention;
FIG. 9 is a schematic diagram illustrating a correspondence between keys and fingers according to an embodiment of the present invention;
FIG. 10 is a finger down view of an embodiment of the present invention;
FIG. 11 is a flow chart of finger lateral position identification according to an embodiment of the present invention;
FIG. 12 is a schematic illustration of two-dimensional image data according to an embodiment of the invention;
in the figure: 1-a keyboard; 2-key scanning detection module; 3-a finger detection module; 31-mounting holes; 32-a light-transmissive cover plate; 33-a light sensitive sensor; 34-a signal processing circuit; 35-an amplification detection circuit; 36-a switching control circuit; 37-bus circuit; 4-a finger illumination source; 5-a communication interface module; 6-a key code mistake correcting module; 61-signal acquisition control module; 62-analog-to-digital conversion module; 63-a sensor lateral position storage module; 64-a finger lateral position acquisition module; 65-fingering rule storage module; 66-key transverse position storage module; 67-alignment error correction module.
Detailed Description
The invention is further illustrated below with reference to the figures and examples. In the following detailed description, certain exemplary embodiments of the present invention have been described by way of illustration only. Needless to say, a person skilled in the art realizes that the described embodiments can be modified in various different ways without departing from the spirit and scope of the present invention. Accordingly, the drawings and description are illustrative in nature and not intended to limit the scope of the claims.
The key misoperation usually occurs between adjacent keys, the adjacent keys comprise an upper adjacent key, a lower adjacent key and a left adjacent key and a right adjacent key, and as the keyboard keys are transversely unfolded, the distance of the up-down movement of the fingers is small, the distance of the left-right movement is large, more than eighty percent of the misoperation is left-right pressing errors, and the scheme provided by the scheme can correct the left-right pressing errors.
The first embodiment is as follows:
in order to describe the orientation relationship more clearly, in this embodiment, the upper, lower, front, back, left and right are redefined, the keyboard is first placed in front of the user, the direction perpendicular to the keyboard surface is the upper and lower direction, the direction away from the keyboard surface is the upper direction, the direction close to the keyboard surface is the lower direction, the left side of the keyboard is the left side, the right side of the keyboard is the right side, the side of the keyboard away from the user is the front, and the side of the keyboard close to the user is the back.
As shown in fig. 1, the real-time intelligent error correction keyboard comprises a plurality of keys, and the keyboard 1 is further provided with a key scanning detection module 2, a plurality of finger detection modules 3, a finger lighting source 4, a communication interface module 5 and a key coding error correction module 6.
The key scanning detection module 2 is connected with the key code error correction module 6, judges whether a key is in a pressed state or not, and transmits the key code of the key in the pressed state to the key code error correction module 6; the key scanning detection module 2 has functions of the common keyboard 1, and belongs to the prior art, and is not described herein again.
Referring to fig. 3 to 7, the finger detecting module 3 is used for sensing whether a finger is present on the keyboard 1. The finger detection modules 3 are arranged on the keyboard, a row of finger detection modules 3 which are uniformly distributed are correspondingly arranged behind each row of keys, and two rows of finger detection modules 3 which are uniformly distributed are correspondingly arranged behind the last row of keys; all the finger detection modules 3 are aligned front to back, left to right to form a two-dimensional array; each key corresponds to at least five adjacent finger detection modules 3, and the finger detection modules 3 are used for converting optical signals reflected by fingers above the keys into electric signals; the number of the finger detecting modules 3 corresponding to each key is 5-10, in this embodiment, 5, see fig. 4, that is, each key uses 5 finger detecting modules 3 to sense the finger reflected light, so that it can be ensured that the finger position has a sufficient measurement value.
Referring to fig. 5, the finger detection module 3 includes a mounting hole 31, a light-transmitting cover plate 32, a light-sensitive sensor 33 and a signal processing circuit, the mounting hole 31 is a vertical blind hole formed on the surface of the keyboard, the vertical blind hole is formed by enclosing a rectangular body with an opening at the top end, light-absorbing materials are arranged around the inside of the vertical blind hole, the light-transmitting cover plate 32 covers the opening of the vertical blind hole, the light-sensitive sensor 33 is arranged at the bottom end of the inside of the vertical blind hole, the light-sensitive sensor 33 is connected with the signal processing circuit, the opening of the vertical blind hole is rectangular, the front and rear direction is a long side, the left and right direction is a short side, the front and rear and left and right sides of the light-sensitive range of the light-sensitive sensor 33 are fan-shaped, the height of the light-sensitive range cross point of the light-sensitive sensor 33 in front of the same row of keys and the light-sensitive range cross point of the light-sensitive sensor 33 in the rear is greater than or equal to 4cm, and the height of the light-sensitive range cross point of the adjacent light-sensitive sensors 33 in the left and right of the same row is controlled to avoid that the reflected light of fingers is sensed by the two light-sensitive sensors 33 to influence the measurement accuracy of the measurement when typing characters; when the fingers are used for typing, the distance between the surface of the fingers facing the keyboard and the keyboard is generally not more than 3cm, so that the height of the intersection point is set to be 4cm, and the reflected light of the fingers at the same position can be ensured to be sensed by one photosensitive sensor 33; the photosensor 33 may be a photo-sensitive electronic device such as a photo-transistor, a photo-diode, or a photo-resistor. When the finger is used for typing, because the position of the little finger is relatively back relative to other fingers, when the last row of keys is pressed, the little finger is not easy to sense, so that the two rows of finger detection modules 3 are arranged behind the last row of keys, and when the last row of keys is pressed, the little finger can be prevented from not being sensed by the photosensitive sensor 33.
The light emitted by the finger lighting source 4 is above the keyboard, the light source can be an infrared light source or a visible light source, if a finger is above the key, the reflected light of the finger falls on the photosensitive sensor 33, so that if the photosensitive sensor 33 receives the reflected light, the finger enters the corresponding transverse position of the finger detection module 3. Referring to fig. 6 and 7, the signal processing circuit 34 is connected to the photosensors 33, and includes an amplification detector circuit 35 and a conversion control circuit 36, each photosensor 33 is correspondingly connected to one amplification detector circuit 35, the amplification detector circuit 35 performs ac amplification and detection on an electric signal generated by the photosensor 33 to generate a dc signal, the dc signal enters the conversion control circuit 36 and is then connected to a bus circuit 37, and the conversion control circuit 36 is configured to control on/off of the dc signal. The finger detection modules 3 in all rows are aligned up and down, and the output of the finger detection modules 3 in the same column is respectively connected with each signal line of the bus, so that the signals of the finger detection modules 3 in the same column can be synchronously acquired to the finger transverse position acquisition module.
The finger lighting source 4 comprises a plurality of lighting units, the lighting units and the finger detection module 3 are distributed in a staggered mode, the lighting direction is from bottom to top, and the light intensity of the finger lighting source is changed periodically; the light intensity of the finger lighting source 4 is changed periodically, the power supply uses an LED light source, the current for driving the finger lighting source 4 to emit light is a superposed sine wave on the basis of a direct current signal, and the frequency of the sine wave is preferably 10-50 Khz.
The communication interface module 5 is in signal connection with a computer; the communication interface module 5 has functions of the common keyboard 1, and belongs to the prior art, and is not described herein again.
Referring to fig. 2, the key code error correction module 6 includes a signal acquisition control module 61, an analog-to-digital conversion module 62, a sensor transverse position storage module 63, a finger transverse position acquisition module 64, a fingering rule storage module 65, a key transverse position storage module 66, and a comparison error correction module 67; the signal acquisition control module 61 respectively with analog-to-digital conversion module 62 finger detection module 3 signal connection, analog-to-digital conversion module 62 respectively with finger detection module 3 signal acquisition control module 61 finger transverse position obtains module 64 signal connection, sensor transverse position storage module 63 with finger transverse position obtains module 64 signal connection, finger transverse position obtain module 64 button transverse position storage module 66, fingering rule storage module 65 respectively with compare error correction module 67 signal connection.
The sensor transverse position storage module 63 stores transverse position data of each finger detection module 3 on the keyboard 1; that is, each finger detection module 3 has a piece of position information on the keyboard 1, and the key transverse position storage module 66 stores transverse position data of keys; for example, the "8" key labeled in fig. 3, the corresponding lateral position data of the "8" key on the keyboard 1 is 80mm, that is, the value from the middle position of the "8" key to the leftmost end of the keyboard 1 is 80mm, then 80mm represents the lateral position data of the "8" key, and since the "8" key corresponds to five finger detecting modules 3, each finger detecting module 3 also has a fixed lateral position data, for example, the center of the first finger detecting module 3 is 76mm from the leftmost end of the keyboard 1, then 76mm is taken as the lateral position data of the first finger detecting module 3, and so on, the lateral position data of the second finger detecting module 3 is 78mm, the lateral position data of the third finger detecting module 3 is 80mm, the lateral position data of the fourth finger detecting module 3 is 82mm, and the lateral position data of the fifth finger detecting module 3 is 84mm.
The signal acquisition control module 61 controls the direct current signals of the finger detection module 3 to sequentially enter the analog-to-digital conversion module and convert the direct current signals into digital signals, and transmits the digital signals to the finger transverse position acquisition module 64, and the finger transverse position acquisition module 64 forms a pair of two-dimensional image data by the received digital signals; and then, carrying out image recognition on the two-dimensional image data to obtain the transverse position data of the index finger, the middle finger, the ring finger and the little finger of the left hand and the right hand, and specifically, determining the transverse position data of the fingertips of all the fingers by using the pattern recognition method to improve the accuracy of the transverse positions of the fingers.
The image recognition steps are as follows:
s1, primary threshold processing: the method is used for filtering data corresponding to signals generated by ambient reflected light, and specifically comprises the following operations: firstly, presetting a threshold, wherein data of the threshold is larger than data corresponding to a signal generated by environment reflected light through the analog-to-digital conversion module 62, then comparing all image data with the preset threshold, reserving data larger than or equal to the threshold, and zeroing data smaller than the threshold, wherein in the embodiment, the assigned value range can be 0.05-0.15 times of the maximum value of a pixel;
s2, secondary data processing: the method is used for performing binary data processing on the data subjected to the primary threshold processing, and specifically comprises the following operations: firstly, presetting a maximum value P in all image data, a maximum value Q of a neighborhood pixel of an image, a data value F corresponding to a current pixel, and a proportionality coefficient K; when F > = K (P + Q)/2, defining the data corresponding to the current pixel as '1', otherwise, defining the data corresponding to the current pixel as '0', wherein the value of K is an adjustable quantity and can be between 0.1 and 0.5; through the secondary data processing, the front position of the finger is high in received illumination intensity, the front of the light ray is reflected to the sensor at an angle of 90 degrees, so that the F value of the corresponding pixel is large, the processed data is 1, the reflected light at the middle position of the two fingers is the light ray of the palm reflected after the light ray penetrates through the finger gap, or the reflected light of the side face of the finger, the light capable of being reflected to the sensor in the two cases is much weaker than the reflected light of the front, the F value of the corresponding pixel is small, and the processed data is 0.
S3, recognizing finger positions
S31, defining 8 finger transverse position variables A, B, C, D, E, F, G and H, and 10 intermediate variables, and initializing each variable to be 0; the total number of lines of the image is i, the current line code is n, and n is initialized to 0;
s32, n = n +1, detecting a region with a continuous value of '1', if so, comparing the detected region with the transverse position data corresponding to the detected region in the previous row, if no overlapped data exists, calculating the average value of the corresponding transverse position data, storing the average value of the transverse position data into an intermediate variable, and if the data is overlapped, not calculating and storing the transverse position; this step is looped until n = i, stopping the detection;
s33, sorting intermediary variables with values not equal to 0 according to the data size, and respectively assigning values of four transverse position variables from small to large to A, B, C and D, wherein the values correspond to the transverse positions of a little finger, a ring finger, a middle finger and an index finger of a left hand, the values of the four intermediary variables from large to small are respectively assigned to H, G, F and E, and the values correspond to the transverse position data of the little finger, the ring finger, the middle finger and the index finger of a right hand;
the "no coincident data" described in step S32, which is further explained herein with reference to fig. 12, assuming that the detection proceeds to the fourth row, a first continuous "1" region is found, the three "1" regions correspond to the lateral position data 19, 20, 21, and the lateral position data corresponding to the region detected in the previous row is not the same, so the average value 20 is calculated and stored in an intermediate variable, and when the second continuous "1" region is detected, the three "1" regions correspond to the lateral position data 27, 28, 29, and since the lateral position data 27, 28, 29 has already appeared at the time of the second row detection, the average value is not calculated and is not stored.
Under normal conditions, after one detection is performed, 10 continuous '1' areas can be detected, and the area of the position average value is stored, the 10 average values are stored in 10 medium variables, corresponding to the transverse positions of the 10 fingers close to the fingertip, but the positions of the thumbs of a small number of people may be positioned behind the index finger, so that the problem that the thumbs cannot be detected may occur, only 8 continuous '1' areas are detected, only 8 medium variables with the average values are stored, and the other two medium variables are 0 values, so after the 0 value variable is removed, the remaining variables respectively correspond to eight fingers with the thumbs removed, and because the key responsible for the thumbs is simple, errors generally cannot occur, and the thumbs are not in the error change range of the embodiment, so that only the transverse position data of the remaining 8 fingers needs to be obtained.
The fingering rule storage module 65 stores the corresponding relationship between each finger and the key, and each key with the error correction function has a unique fixed matched finger to press according to the corresponding relationship; in this embodiment, a key pressing rule is set, for convenience of description, the left upper corner or the right upper corner of each key is distinguished by a symbol, referring to fig. 9, a left upper corner of the key is denoted as a left little finger with a pentagonal mark, a left upper corner of the key is denoted as a left ring finger with a quadrangular mark, a left upper corner of the key is denoted as a left middle finger with a triangular mark, a left upper corner of the key is denoted as a left index finger with a circular mark, a right upper corner of the key is denoted as a right little finger with a pentagonal mark, a right upper corner of the key is denoted as a right ring finger with a quadrangular mark, a right upper corner of the key is denoted as a right middle finger with a triangular mark, a right upper corner of the key is denoted as a right index finger with a circular mark, taking a commonly used "8" key as an example, if the "8" key is pressed by the right hand, the fingering method is not wrong, and if the "8" key is pressed by other fingers, the fingering method is wrong. The corresponding relationship of the keys in this embodiment is one of the ways that the error correction effect can be improved, but is not limited to this, and the user can change the corresponding relationship of the keys according to the actual needs, and can modify and reset the keys.
The key transverse position storage module 66 stores transverse position data corresponding to each key on the keyboard 1, and ensures that each key has corresponding transverse position data, for example, the "8" key marked in fig. 3, and stores and defines the transverse position data corresponding to the "8" key on the keyboard 1 as 80mm, that is, the value from the middle position of the "8" key to the leftmost end of the keyboard 1 is 80mm, and then 80mm represents the transverse position data of the "8" key.
Referring to fig. 8, the error correction process of the comparison error correction module is as follows:
step one, after the comparison error correcting module 67 receives the key code of the pressed key transmitted by the key scanning detection module 2, judging whether the key is a single key;
step two, if the key is a single key, reading the transverse position data of the corresponding key from the key transverse position storage module 66;
reading the transverse position data of the finger transverse position acquisition module 64 and the transverse position data of the pressed key in the key transverse position storage module 66, comparing the two data, and taking the finger closest to the transverse position data of the pressed key as the finger for pressing the key; if the finger pressing the key and the pressed key accord with the corresponding relation in the fingering rule storage module 65, the key code is directly transmitted to the communication interface module 5 and then transmitted to the computer without changing; if the finger pressing the key and the pressed key do not conform to the corresponding relationship in the fingering rule storage module 65, the key code corresponding to the finger pressing the key is selected from two keys adjacent to each other on the left and right of the pressed key and transmitted to the communication interface module 5.
Taking the keys "7", "8", "9" and "10" as examples, referring to fig. 10, according to the fingering rule storage module 65, the finger matched with the "7" key is the right index finger, the finger matched with the "8" key is the right middle finger, the finger matched with the "9" key is the left middle finger, the finger matched with the "0" key is the right ring finger, according to the key transverse position storage module 66, the transverse position data of the "7" key is 70mm, the transverse position data of the "8" key is 80mm, the transverse position data of the "9" key is 90mm, and the transverse position data of the "0" key is 100mm;
when the fingers are placed according to the positions in fig. 10 (1), when the 8 key is pressed, the comparison and error correction module 67 finds that the transverse position data corresponding to the 8 key is 80mm according to the key transverse position storage module 66; meanwhile, the transverse position data of the index finger, the middle finger, the ring finger and the little finger of the right hand obtained by the transverse position acquisition module 64 by the image recognition method are 71.5mm, 78.5mm, 87.5mm and 95.5mm in sequence;
comparing the transverse position data corresponding to each finger with the transverse position data 80mm corresponding to the 8 key, wherein the transverse position data of the middle finger of the right hand is 78.5mm, and is closest to the transverse position data of the 8 key, so that the middle finger of the right hand can be determined to press the 8 key; then, according to the key rule stored in the fingering rule storage module 65, it is found that the middle finger of the right hand is the same as the finger fixedly matched with the '8' key, the fingering is correct, and the character '8' code is directly transmitted to the communication interface module 5;
when the fingers are placed according to the middle position in fig. 10 (2), and the "8" key is pressed, the finger transverse position obtaining module 64 recognizes that the transverse position data of the index finger, the middle finger, the ring finger and the little finger of the right hand are 78.5mm, 87.5mm, 95.5mm and 107.5mm, respectively; the transverse position data corresponding to the key of '8' is 80mm; comparing the transverse position data corresponding to each finger with the transverse position data 80mm corresponding to the '8' key, wherein the transverse position data of the right index finger is 78.5mm, and is closest to the transverse position data of the '8' key, so that the '8' key can be pressed by the right index finger; then, according to the key rule stored in the fingering rule storage module 65, it is found that the fingers fixedly matched with the right index finger and the "8" key are different, indicating that the fingering is wrong, and then, in the "7" key and the "8" key, the key corresponding to the right index finger is selected, wherein the key code fixedly matched with the right index finger contains the "7" key, and then the character "7" code corresponding to the "7" key is transmitted to the communication interface module 5.
However, when the pressed single key performs error correction, if the comparison error correction module 67 does not find the key code corresponding to the finger pressing the key currently in the two adjacent key codes according to the corresponding relationship in the fingering rule storage module 65, the pressed key code is directly transmitted to the communication interface module 5 without being changed.
The method also comprises the following steps between the first step and the second step: if the pressed key is not a single key, firstly judging whether the key is a combined key, if the key is the combined key, not executing correction, and directly transmitting the key code of the pressed key to the communication interface module 5; if the key is not a combined key, judging whether the key which is pressed at the same time currently is two left and right adjacent keys, if not, not executing error correction, and directly transmitting the key code generated by pressing to the communication interface module 5; if the key is adjacent to the left key and the right key, reading the transverse position data of the two keys, and taking the average value of the transverse position data as reference data; then, the horizontal position data of each finger is compared with the reference data, the finger closest to the reference data is the finger pressing the key, and finally, the key code corresponding to the finger pressing the key is selected from the two pressed keys and transmitted to the communication interface module 5. For example: when the fingers are placed according to the positions in fig. 10 (3), when the "7" key and the "8" key are pressed simultaneously, the finger transverse position obtaining module 64 recognizes that the transverse position data of the index finger, the middle finger, the ring finger and the little finger of the right hand are 78mm, 85mm, 94mm and 102mm in sequence;
the transverse position data corresponding to the key of '7' is 70mm, the transverse position data corresponding to the key of '8' is 80mm, and the average value of the transverse position data of the key of '7' and the key of '8' is 75mm, and the transverse position data is used as the transverse position data of two keys; then, the horizontal position data corresponding to each finger is compared with the horizontal position data 75mm corresponding to the "7" key and the "8" key, wherein the finger position identification information of the right index finger is 78mm, which is closest to 75mm, so that it can be determined that the "7" key and the "8" key are pressed simultaneously by the right index finger, and then the key code matched with the right index finger is selected from the "7" key and the "8" key according to the fingering rule storage module 65, wherein the character "7" corresponding to the "7" key is transmitted to the communication interface module 5 if the character code matched with the right index finger is the same as the fixed character code matched with the right index finger.
The keyboard 1 is provided with a mistake correcting on-off switch, and whether the key code mistake correcting module 6 operates or not is controlled by turning on and off the mistake correcting on-off switch. When the error correction on-off switch is turned on, if the key is pressed by the error the key code error correction module 6 can execute error correction, correct characters after error correction are transmitted to the communication interface module 5, and when the error correction on-off switch is turned off, if the key is pressed by the error the key code error correction module 6 does not execute error correction, the generated characters are directly transmitted to the communication interface module 5.
The method can correct the key errors of the left and right adjacent keys or the simultaneous pressing errors of the left and right adjacent keys, and the adopted method has the advantages of less formation of inferior data quantity, less calculation quantity, short time delay of error correction and capability of realizing real-time error correction.
The digital keypad on the right side of the keyboard is provided with two special keys of '+' and 'enter', the lengths of the two keys span two rows of keys, so that a corresponding row of finger detection modules is lacked at the two keys, therefore, a special finger detection module is arranged at the position where the finger detection module row corresponding to the middle position of the '+' and 'enter' keys is interrupted, and the special finger detection module is not provided with the mounting hole and the light-transmitting cover plate; the special finger detection module is provided with a special finger photosensitive sensor and a signal processing circuit which are the same as the finger measurement modules of other keys, and the physical position can be flexibly set; since the special finger photosensitive sensor cannot sense the finger reflected light, the corresponding output signal is zero and is only used for forming a complete two-dimensional data.
The image recognition step for such special keys is basically the same as the image recognition step for ordinary keys, except that the following steps are added between step S2 and step S3: the data corresponding to the special finger measuring modules corresponding to the '+' and the 'enter' is modified to be the same as the data corresponding to the same column of the finger measuring modules in the previous row. The role of this step is: when the previous line of the special finger measuring module senses the reflected light of the finger, the corresponding data of the special finger measuring module is modified to be the same as the previous line, so that the up-and-down continuity of the two-dimensional data can be ensured, and the operation of the later finger transverse position acquisition module is facilitated.
Fig. 12 is a partial schematic view of a two-dimensional image in which only a part of data is shown for schematically expressing the principle of the two-dimensional image. In actual use, the number of abscissas covers the entire keyboard.
The second embodiment:
the present embodiment is different from the first embodiment mainly in that the image recognition method is different, and other structures and methods are the same. In this embodiment, the image recognition method includes obtaining a contour line of the finger through an edge detection calculation tool, then performing curve fitting, and finding out an extreme point of a curve, where the horizontal position data corresponding to the extreme point is the horizontal position data corresponding to each finger. In this embodiment, a Canny operator edge detection tool is used to obtain a finger contour map, which is the prior art and is not described herein again.
The foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are given by way of illustration of the principles of the present invention, but that various changes and modifications may be made without departing from the spirit and scope of the invention, and such changes and modifications are within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.

Claims (5)

1. The real-time intelligent error correction keyboard comprises a plurality of keys and is characterized in that the keyboard is also provided with a key scanning detection module, a plurality of finger detection modules, a finger lighting source, a communication interface module and a key coding error correction module, and each finger detection module, the key scanning detection module and the communication interface module are respectively connected with the key coding error correction module; the key scanning detection module is used for judging whether a key is in a pressed state or not and transmitting the key code of the key in the pressed state to the key code mistake-changing module; the finger lighting light source comprises a plurality of lighting units which are distributed with the finger detection modules in a staggered manner, the lighting direction is from bottom to top, and the light intensity of the finger lighting light source is changed periodically; the communication interface module is in signal connection with a computer;
each finger detection module is arranged on the keyboard, a row of finger detection modules which are uniformly distributed is correspondingly arranged behind each row of keys, and two rows of finger detection modules which are uniformly distributed are correspondingly arranged behind the last row of keys; all the finger detection modules are aligned front to back, left to right and form a two-dimensional array; the finger detection module comprises a mounting hole, a light-transmitting cover plate, a photosensitive sensor and a signal processing circuit, wherein the mounting hole is a vertical blind hole formed in the surface of the keyboard, light-absorbing materials are arranged around the inside of the vertical blind hole, the light-transmitting cover plate covers the opening of the vertical blind hole, the photosensitive sensor is arranged at the bottom end of the inside of the vertical blind hole and connected with the signal processing circuit, the opening of the vertical blind hole is rectangular, the front and back directions are long edges, the left and right directions are short edges, the photosensitive range of the photosensitive sensor is fan-shaped, the height of the photosensitive range intersection of the photosensitive sensor positioned in front of the same row of keys and the height of the photosensitive range intersection of the photosensitive sensor positioned behind the same row of keys are greater than or equal to 4cm, and the height of the photosensitive range intersection of the adjacent photosensitive sensors on the same row and on the same row of the same side is greater than or equal to 4cm; the signal processing circuit is connected with the photosensitive sensors and comprises amplification detection circuits and conversion control circuits, each photosensitive sensor is correspondingly connected with one amplification detection circuit, the amplification detection circuits are used for carrying out alternating current amplification and detection on electric signals generated by the photosensitive sensors to generate direct current signals, the direct current signals enter the conversion control circuits and then are connected to the bus circuit, and the conversion control circuits are used for controlling the connection and disconnection of the direct current signals;
the key coding error correction module comprises a signal acquisition control module, an analog-to-digital conversion module, a sensor transverse position storage module, a finger transverse position acquisition module, a fingering rule storage module, a key transverse position storage module and a comparison error correction module; the signal acquisition control module is respectively in signal connection with the analog-to-digital conversion module and the finger detection module, the analog-to-digital conversion module is respectively in signal connection with the finger detection module, the signal acquisition control module and the finger transverse position acquisition module, the sensor transverse position storage module is in signal connection with the finger transverse position acquisition module, and the finger transverse position acquisition module, the key transverse position storage module and the fingering rule storage module are respectively in signal connection with the comparison error correction module;
the sensor transverse position storage module is internally stored with transverse position data of each finger detection module on a keyboard; the signal acquisition control module controls the analog-to-digital conversion module to sequentially convert the direct current signals of the finger detection modules into digital signals and transmit the digital signals to the finger transverse position acquisition module, and the finger transverse position acquisition module forms a pair of two-dimensional image data by the received digital signals; then the finger transverse position acquisition module carries out image recognition on the two-dimensional image data to obtain transverse position data of the left and right index fingers, middle fingers, ring fingers and little fingers; the fingering rule storage module stores corresponding relations between the fingers and the keys, and each key with the mistake correcting function is pressed by a unique fixedly matched finger according to the corresponding relations; the key transverse position storage module is internally stored with transverse position data corresponding to each key on the keyboard;
the error correction process of the comparison error correction module is as follows:
step one, the comparison error correcting module receives a key code of a pressed key transmitted by the key scanning detection module, and then judges whether the key is a single key or not according to the number of the key codes;
step two, if the key is a single key, the comparison and error correction module acquires the transverse position data of the pressed key from the key transverse position storage module;
reading the transverse position data of the finger transverse position acquisition module and the transverse position data of the pressed key in the key transverse position storage module, comparing the two data, and taking the finger closest to the transverse position data of the pressed key as the finger of the pressed key; if the finger pressing the key and the pressed key accord with the corresponding relation in the fingering rule storage module, the key code is directly transmitted to the communication interface module without changing and then transmitted to the computer; if the finger pressing the key and the pressed key do not accord with the corresponding relation in the fingering rule storage module, selecting the key code of the key corresponding to the finger pressing the key from two left and right adjacent keys of the pressed key and transmitting the key code to the communication interface module.
2. The real-time intelligent error correction keyboard of claim 1, wherein: the image recognition steps are as follows:
s1, firstly, presetting a threshold, wherein the data of the threshold is larger than the data corresponding to the signal generated by the environment reflected light passing through the analog-to-digital conversion module, comparing all image data with the preset threshold, reserving the data larger than or equal to the threshold, and returning the data smaller than the threshold to zero;
s2, firstly, presetting the maximum value of all image data as P, the maximum value of a neighborhood pixel of the image as Q, the data value corresponding to the current pixel as F, and K as a proportionality coefficient; when F > = K (P + Q)/2, defining the data corresponding to the current pixel as '1', otherwise, defining the data corresponding to the current pixel as '0', wherein the value of K is an adjustable quantity;
s3, identifying the finger position, specifically as follows:
s31, defining 8 finger transverse position variables A, B, C, D, E, F, G and H, and 10 intermediate variables, wherein each variable is initialized to be 0; the total number of lines of the image is i, the current line code is n, and n is initialized to 0;
s32, n = n +1, detecting a region with a continuous value of '1', if the region is detected, comparing the region with the transverse position data corresponding to the detected region in the previous row, if the region does not have overlapped data, calculating the average value of the corresponding transverse position data, storing the average value of the transverse position data into an intermediate variable, and if the region does not have overlapped data, not calculating and storing the transverse position; this step is looped until n = i, stopping the detection;
s33, sorting the intermediary variables with the numerical values not being 0 according to the data size, assigning the numerical values of the four transverse position variables from small to large to A, B, C and D respectively, correspondingly assigning the transverse positions of the little finger, the ring finger, the middle finger and the index finger of the left hand, assigning the numerical values of the four intermediary variables from large to small to H, G, F and E respectively, and correspondingly assigning the transverse position data of the little finger, the ring finger, the middle finger and the index finger of the right hand.
3. The real-time intelligent error correction keyboard of claim 1, wherein: the image identification method comprises the steps of obtaining the contour lines of the fingers through an edge detection calculation tool, then carrying out curve fitting, and finding out the extreme points of the curve, wherein the transverse position data corresponding to the extreme points are the transverse position data corresponding to each finger.
4. The real-time intelligent error correction keyboard of claim 1, wherein: when the pressed single key performs error correction, if the comparison error correction module stores the corresponding relation in the module according to the fingering rule, and a key code corresponding to the finger pressing the key currently is not found in the left and right adjacent key codes, the pressed key code is directly transmitted to the communication interface module without being changed.
5. The real-time intelligent error correction keyboard of claim 1, wherein: the method also comprises the following steps between the first step and the second step:
if the pressed key is not a single key, firstly judging whether the key is a combined key, if the key is the combined key, not executing correction, and directly transmitting the key code of the pressed key to the communication interface module; if the key is not the combined key, judging whether the key which is pressed at the same time currently is two left and right adjacent keys, if not, not executing error correction, and directly transmitting the key code generated by pressing to the communication interface module; if the key is adjacent to the left key and the right key, reading the transverse position data of the two keys, and taking the average value of the transverse position data as reference data; and then comparing the transverse position data of each finger obtained by the finger transverse position acquisition module with the reference data, wherein the finger closest to the reference data is the finger for pressing the key, and finally selecting the key code corresponding to the finger for pressing the key from the two pressed keys and transmitting the key code to the communication interface module.
CN202211072329.XA 2022-09-02 2022-09-02 Real-time intelligent error correction keyboard Withdrawn CN115407881A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211072329.XA CN115407881A (en) 2022-09-02 2022-09-02 Real-time intelligent error correction keyboard

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211072329.XA CN115407881A (en) 2022-09-02 2022-09-02 Real-time intelligent error correction keyboard

Publications (1)

Publication Number Publication Date
CN115407881A true CN115407881A (en) 2022-11-29

Family

ID=84163812

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211072329.XA Withdrawn CN115407881A (en) 2022-09-02 2022-09-02 Real-time intelligent error correction keyboard

Country Status (1)

Country Link
CN (1) CN115407881A (en)

Similar Documents

Publication Publication Date Title
CA2480057C (en) Symbol encoding apparatus and method
US5521986A (en) Compact data input device
EP1062627B1 (en) Image sensing operator input device
AU614382B2 (en) Touch panel apparatus
KR100811015B1 (en) Method and apparatus for entering data using a virtual input device
US20060066589A1 (en) Input device
EP0171284B1 (en) Optical digitizer
US20040032346A1 (en) Information input device, information processing device and information input method
US20100283756A1 (en) Method and apparatus for recognizing touch
WO1994010652A1 (en) Apparatus and method for a text input system and universal computer input device
CN105528592A (en) Fingerprint scanning method and device and gesture recognition method and device
CN1635541A (en) Photoelectric detection positioning system and method for computer touch screen
WO1998058346A1 (en) Pointing device with optical fingerprint recognition and tracking capability
CN104620207A (en) Low power operation of an optical touch-sensitive device for detecting multitouch events
JP3744552B2 (en) Pen input device
KR20140038745A (en) Touch system comprising optical touch panel and touch pen, and method of controlling interference optical signal in touch system
JP5655573B2 (en) Computer apparatus, input system, and program
US6504526B1 (en) Wireless pointing system
CN115407881A (en) Real-time intelligent error correction keyboard
CN115291737A (en) Photoelectric intelligent error correction keyboard
KR101512082B1 (en) system and method for mode switching of electronic pen
KR100713720B1 (en) Touch key-pad device
KR100700815B1 (en) Method for scanning a user's touch in touch screen
CN103064505A (en) Simulation keyboard utilizing finger forms as keys
KR20130072606A (en) Apparatus for providing input interface and operating method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20221129

WW01 Invention patent application withdrawn after publication