CN202018647U - Visual keyboard - Google Patents

Abstract

The utility model relates to a visual keyboard, which belongs to the field of electronic information and IT (information technology), and consists of a keyboard unit and a processing unit. The keyboard unit consists of a line laser, a CMOS (complementary metal oxide semiconductor) camera and a printed keyboard, and the processing unit consists of a single chip microcomputer. The line laser horizontally arranged in front of the printed keyboard emits a layer of laser light to cover the whole printed keyboard, the CMOS camera is arranged on the single chip microcomputer, the single chip microcomputer has processing functions such as crystal oscillation, and the CMOS camera is connected with the single chip microcomputer through two rows of serial bus pins on the back side. The visual keyboard capable of customizing personalized keyboard buttons is manufactured by applying elements such as the single chip microcomputer, the CMOS camera, the line laser and the like, combines optical knowledge skillfully, can be widely applied to a keyboard for the disabled, a tablet-type PC (personal computer), a notebook computer, an industrial environment, a cleaning room, a sterile and medical environment, testing equipment and transporting equipment for aviation and railways.

Description

Dummy keyboard

Technical field

The utility model relates to and belongs to electronic information and IT works field, relates to a kind of dummy keyboard specifically, so that need the electronic product of keyboard to avoid using physical keyboard.

Background technology

Nowadays, along with development of science and technology, the form of keyboard is also more various, and it is more and more littler, more and more convenient that volume becomes, but the people still is subjected to the limitation of environment for use.A large amount of bacteriums of for example, carrying in the keyboard and virus can't make its good being applied in the medical aseptic environment; A lot of physical disabilities are using conventional keyboard that a lot of inconveniences are still arranged; Conventional keyboard also can't satisfy the demand of modern's personalization.In view of these shortcomings, wish to design the keyboard of propertyization one by one, broken through the restriction of conventional keyboard fixed mode and load mode, be implemented in the target that easily realizes keypad function under any environment.

Certainly, dummy keyboard has all been invented out by nowadays a lot of manufacturer.The application places of dummy keyboard is very extensive, can be widely used on physical disabilities' keyboard, flat PC, notebook computer, industrial environment, toilet, the aseptic and transportation equipments such as medical environment, testing apparatus and air rail.Existing dealer proposes a kind of dummy keyboard of projection, and for example U.S. Pat 6650318, publication number are this projection type virtual keyboards all on the books such as Chinese invention patent application of CN1479191A.Or the dummy keyboard of HRR company design, they produce a kind of size and the similar dummy keyboard of small-sized mobile phone, and it is projected to adjacent interface surface by light emitting source with dummy keyboard.This module is produced by the high-efficiency holographic optics original paper illumination through particular design, and element has the red diode laser instrument.When the user touched key position on the interface surface, the plane on the button limit will reflect light, directly passes on the sensor assembly.The light that user and interface surface interaction are reflected reaches infrared filter, and reflexes to the CMOS image sensor in the sensor assembly.Sensor chip (virtual interface process nuclear TM) includes the hardware of customization, can determine catoptrical position in real time.The shape of keyboard is got on the desktop, by the button of keyboard identification finger touch.Though form is fine, cost is high, can not satisfy the demand of ordinary populace.

Existing projection dummy keyboard, to project dummy keyboard, this often needs a large amount of LED to most employing LED, and the equal dense arrangement of these LED, to reach needed luminance brightness of projection dummy keyboard and uniformity coefficient as light source.But be that meeting increases cost, consumption increases electric power so on the one hand; Be that overstocked easy array makes the heat of its generation be difficult to shed on the other hand, reduce serviceable life.

Summary of the invention

Be subjected to machine made constraint at nowadays most keyboard, can not satisfy specific group and environment requirement, the purpose of this utility model is intended to utilize AVR single-chip microcomputer, camera, red line laser instrument and flat board to design a kind of novel dummy keyboard, to address the above problem.

In order to achieve the above object, the utility model has adopted following technical scheme.It is made up of keyboard unit and processing unit, it is characterized in that, described keyboard unit is made up of a laser line generator, CMOS camera, printing keyboard, processing unit is made up of single-chip microcomputer, described laser line generator lies in a horizontal plane in the front of printing keyboard, launches one deck laser and covers whole printing keyboard, and described CMOS camera is placed on the single-chip microcomputer, single-chip microcomputer has processing capacities such as crystal oscillator, and links to each other with single-chip microcomputer by the back side two row pin of getting lines crossed.

Described CMOS camera is placed in the front upper place of printing keyboard, and the scope of its shooting can cover whole printing keyboard, and can obtain characteristic point coordinates, and described laser line generator is placed in the below of camera.

Described printing keyboard is a kind of black plank that can not be reflective, and integral body is the T type, and button is made with the mazarine card paper, sticks on to print on the keyboard.

Described single-chip microcomputer is equipped with elements such as switch, serial ports and crystal oscillator for the AVR single-chip microcomputer is placed on the development board.

Dummy keyboard is made up of four major parts: laser line generator, camera, AVR single-chip microcomputer and printing keyboard.Laser line generator, this laser instrument can be launched a line laser and penetrate on metope, print the keyboard top when it is placed on, and the laser of ejaculation can locate to cover whole keyboard plane for several millimeters at the distance keyboard, specifically sees Fig. 1.General reddish yellow line laser can, but because the easier resolution of redness, red laser line generator is used in suggestion.Because the color of keyboard is a black, on the laser overlay keyboard that sends, naked eyes can not differentiated the color of color laser.Yet when finger touches was on printing keyboard, finger blocked the laser of directive metope, and corresponding finger will redden.Camera is installed in the front upper place of keyboard, sees Fig. 2.The zone that camera perception finger is red and be the signal that to handle for single-chip microcomputer with the coordinate transformation in zone.The effect of single-chip microcomputer is conversion and the processing capacity that realizes signal, and alternative single-chip microcomputer can be 51 single-chip microcomputers, also can be the abundant more AVR single-chip microcomputer of resource, but will select the high relatively model of processing speed, to improve the speed and the capacity of deal with data.Single-chip microcomputer should be selected the high model of those processing poweies, can accept as the processing speed more than the ATmega32.The coordinate that the position that single-chip microcomputer is pointed according to the signal framing of receiving also will be pointed is sent to computing machine with the form of sexadecimal number, and computing machine is converted to corresponding letter according to this number with this position, thereby has finished the identifying of dummy keyboard.

On hardware connected, the CMOS camera was fixed on oblique the place ahead of going up of keyboard, aimed at the position of keyboard; Laser line generator be installed in camera below, penetrate one deck laser towards keyboard, provide power supply separately by battery case; Connect by line between camera and the single-chip microcomputer, specifically can be referring to Fig. 3; Be connected by com port between single-chip microcomputer and the computing machine.

In the selection of device, concrete, for camera, select this a CMOS camera of C3038 for use, this camera provides a red detection function, ceaselessly obtain the view data of the part of taking the photograph, be higher than the numerical value of setting, will report corresponding coordinate to single-chip microcomputer in case find red numerical value.The zone of the perception redness that the camera energy is responsive, this red area and black on every side form a sharp contrast, and camera can identify easily.Keyboard Designing becomes the black background color and does the font printing with mazarine, so more helps red identification.Used JAVA to develop a program in the exploitation of host computer, any letter or number that this program can become any one location definition the user to need.At last, the keyboard of printing adopts the plank of A3 size, and the base plate of black and blue button also can adopt other dark colours printings in, as long as follow distinguishing that redness can be good.

For standardization, designed traditional button pattern, and with the plank of A3 size as the button plane.Later stage can be done personalized adjustment according to the difference of application places.

The present invention has finally finished designing requirement, and correctly output character or data.Consider the reason at narrow camera and laser visual angle, need design different keyboard layouts and calibration, with all buttons of guaranteeing with rational accuracy of detection.Go out general keyboard by imagination, and designed the test accuracy chart, the result who measures is produced precision figure, see Fig. 4, the power of the test in the middle of this chart is higher than the edge.And for test, attempt 100 main buttons, and the threshold that acceptance is set is in 70 (edges) and 80 (central authorities).This means, pass through test at least 70 or 80 ability if can discern some key exactly.Improved degree of accuracy greatly.

In order to improve processing speed, can adopt another microprocessor simultaneously or add that a FPGA carries out data processing.Can add sound effect, when the different button computer-chronograph of touching will send different prompt tones, convenient disabled person's use.

Beneficial effect of the present invention be elements such as this dummy keyboard utilization single-chip microcomputer, CMOS camera, laser line generator produce can the personalized customization keyboard dummy keyboard, can be widely used on physical disabilities' keyboard, flat PC, notebook computer, industrial environment, toilet, the aseptic and transportation equipments such as medical environment, testing apparatus and air rail.

Description of drawings

Fig. 1: laser line generator synoptic diagram;

Fig. 2: whole connection layout;

Fig. 3: camera and single-chip microcomputer line graph;

Fig. 4: keyboard test accuracy chart;

Fig. 5: OV6630 pin assignments figure (Pin Assignment);

Fig. 6: ATmega32 pin assignments figure (Pin Assignment).

Embodiment

A kind of dummy keyboard, form by keyboard unit and processing unit, described keyboard unit is made up of a laser line generator 3, CMOS camera 2, printing keyboard 4, processing unit is made up of single-chip microcomputer 1, described laser line generator 3 lies in a horizontal plane in the front of printing keyboard 4, launches one deck laser and covers whole printing keyboard 4, and described CMOS camera 2 is placed on the single-chip microcomputer, single-chip microcomputer has processing capacities such as crystal oscillator, and links to each other with single-chip microcomputer 1 by the back side two row pin of getting lines crossed.

Described CMOS camera 2 is placed in the front upper place of printing keyboard 4, and the scope of its shooting can cover whole printing keyboard 4, and can obtain characteristic point coordinates, and described laser line generator 3 is placed in the below of camera 2.

Described printing keyboard 4 is a kind of black planks that can not be reflective, and integral body is the T type, and button is made with the mazarine card paper, sticks on to print on the keyboard 4.

Described single-chip microcomputer 1 is equipped with elements such as switch, serial ports and crystal oscillator for the AVR single-chip microcomputer is placed on the development board.

1. software is realized

Software is formed and mainly is divided into 5 parts:

(1) utilize the I2C agreement to carry out communicating by letter between single-chip microcomputer and the camera;

(2) speed with 6 frame/seconds reads the data that camera obtains;

(3) view data that receives is handled to obtain corresponding position;

(4) position with correspondence converts sexadecimal number to, uses the PS/2 protocol transmission to computer then;

(5) java applet utilizes the serial ports transmission to instruct to single-chip microcomputer so that it begins next identifying.

1.1 main process

At first, the PORTA mouth of initial ATMega32 is accepted UV input signal from camera and is carried out I2C with the PORTC mouth with camera and communicate by letter, and the traffic rate with serial ports is set at 19 simultaneously, 200bps.The fault value function that moves then on the camera to seek the red zone that is higher than the fault value on the Black thumbpads background.And then, call a function that is called " init_cam " and come camera is carried out a warm reset and the size of camera is set at 176 * 144, open Automatic white balance simultaneously and the rate setting of will make a video recording at 6fps with the raising pickup quality.Simultaneously output format is arranged on 16 bit patterns (Y=GGGG and UV=BRBR) of Y/UV.Infinite loop of routine call checks in the formation whether have then.If no, formation is the renewal of PS2 and propagates.

1.2 image processing process

Calling the getRedlndex function catches data of each row of camera and they is handled.The signal of at first waiting for VSYNC has new signal output to show on UV and the Y.Then, wait for that the HREF data of new delegation are because first line data is invalid.In this, we can be defined as it bayer images pattern of one 176 pixel.

Because not having enough internal memories stores in the process of entire frame of data, in the processing of each perpendicular line.In the vertical synchronization (VSYNC) of each valid data, HREF stops about 0.8ms and camera data becomes invalid, and this adequate time handles data line for us.. when each vertical synchronization (VSYNC) was arrested, whether each pixel of circular test had the redness point above threshold value to be found to check.Reach the pixel of this fault value for each, checked a whether pixel red of pixel again, this has shown being present on the continuous lines of a button.If find a such pixel, so, this pixel mapping to one scale-of-two is by the X of number of scans group searching correspondence, Y value.If this value is effectively, just convert thereof into sexadecimal number and be sent to PC.

1.3I2C communication protocol

The I2C agreement is single-chip microcomputer and other chip communications protocol commonly used, owing to only need two lines, so fine use.

The characteristics of I2C bus:

(1) only requires serial time clock line SCL of serial data line SDA of two bus lines;

(2) each be connected to the device of bus can be by unique address and simple main frame/slave of always existing concern the software set address; Main frame can be used as main transmitter or main frame receiver;

(3) it is real many host buses, if two or more main frames while initialize data transfer can prevent that data are destroyed by collision detection and arbitration;

(4) 8 of serial bidirectional data transfers bit rate can reach can reach under the 400kbit/s fast mode under the 100kbit/s quick mode under mode standard and can reach 4Mbit/s;

(5) the burr ripple of the wave filter on the sheet on can the elimination bus data line guarantees data integrity.

Therefore select for use the I2C bus protocol to carry out communicating by letter of single-chip microcomputer and camera.This agreement is used one 2 line communication plan, and this is to activate pull-up resistor by a 10K ohm.Clock signal, camera provides scl line, and frequency is provided by following formula: 16MHz/(16+2 * (TWBR) (4TWPS)).We the decision with best solution, with satisfy minimum requirements be bit rate be provided with register (TWBR) to 72 and status register (TWSR) be 0.The remainder of code is according to the standard agreement by the Philip definition.The register that this camera can be write is write a start bit, secondly is a target register address, then in target data.

1.4 camera is set

With the resolution setting of camera is 176 * 144, because this is the minimum that can detect printing keyboard on the whole A3 size paper.In this project, per second is caught 6 color image frames.This camera output format is set to 16 and catches the UV/Y data, comprising the UV data of BRBR form and and the Y data of GGGG form, the Y data are ignored fully simultaneously.

1.5PS/2 keyboard output

The general keyboard that six pin mini-DIN connectors are arranged then is referred to as the ps/2 keyboard.Have only four pin meaningful in fact in the connector.They be respectively Clock (clock pin), DATA (data pin) ,+5V (supply pin) and Ground (power supply ground).On the physical connection of ps/2 keyboard and pc machine as long as guarantee that these four lines are corresponding one by one just passable.The ps/2 keyboard provides+the 5V power supply by the ps/2 port of pc, and two other pin Clock (clock pin) and DATA (data pin) are open-collector, so must connect the pull-up resistor of big resistance.They keep high level at ordinary times, have output the time just to be pulled to low level, float to high level on automatically afterwards.The 250ms time is used in decision on the time set, waits for the time of 700ms.When timer 1 interruption emission, it is when transmission, and clock setting is high in the following order: start bit (0), data bit, the position of check bit (all XORs), position of rest (2).If no, clock status upgrades.The remainder of code is only kept the character that an element in the formation can hold here and is transmitted.A get and put method are arranged in the formation, upgrade the pointer of 2 arrays.

1.6Java host computer procedure

Use Java to work out a host computer procedure, computed serial ports of this program and computing machine communicate, and value that can self-defined each button representative.

2. hardware is realized

2.1 hardware is formed

Hardware mainly is made up of four parts:

1., single-chip microcomputer

2., camera and interlock circuit

3., laser line generator

4., print keyboard

2.2 hardware is selected

1., the selection of single-chip microcomputer

Why we select the Atmega32 single-chip microcomputer, are because it has some following advantages.At first, it is 8 AVR﹠amp of high-performance, low-power consumption; The reg microprocessor has advanced risc architecture, the EEPEOM of 1024 bytes, and higher than the ATmega16 processing speed, erasing and writing life reaches 100,000 times, can realize the operation that really reads while write, supports debug function in the sheet of expansion.These characteristics are enough to satisfy the requirement that this project data is handled.ATmega32 works on the 5V voltage, and speed class is 0-16MHz.The line pin figure is seen Fig. 5.Certainly, we find to test the back, and the processing speed of ATmega32 is also good not as what imagined originally, and we infer that the higher chip of processing power will obtain better result.

In the selection of crystal oscillator, select 16.000 crystal oscillators to provide vibration for single-chip microcomputer; Single-chip microcomputer provides electric power by computing machine for it by USB interface; Data transmission is undertaken by COM, and pin interface is seen Fig. 6.

2., the selection of camera

Select the camera acquisition device of OV6630CMOS Image sensors as us, it is similar with OV6130COMS Image Sensors of the same type, and one 352 * 288 image array can both be provided, and obtains data with the speed of per second 60 frames.Because we recognize that OV6630 can not find infrared ray effectively, so the red line laser instrument of employing 637nm as an alternative.The data of obtaining image-region that it can continue, after the red value of specific region was higher than setting special, single-chip microcomputer just can be determined its position, thus definite button.OV6630 works under the voltage of 3.3V, and carries out communication by the I2C agreement.It can provide 4-bit, 8-bit, the perhaps data image of 16-bit output.

3., laser line generator

Used red laser line generator to produce the laser plane of one deck redness.Originally we plan to adopt light emitting diode to realize, but effect is unsatisfactory, use the red laser pipe to produce harm to human eye, and therefore having selected red wavelength is that the laser instrument of 637nm reduces this harm as much as possible.Laser instrument only need be connected on the power supply of 3V and just can work.Owing to do not know the segment angle (fan angle) of laser instrument, see Fig. 1, so can only determine the distance of laser instrument,, determine that the distance of the edge 40cm that laser instrument is nearest apart from keyboard just can obtain more satisfactory effect through repetition test by test apart from keyboard.

4., the making of keyboard

The user can design the keyboard that needs as required voluntarily, regardless of different kinds of, content, quantitatively all accomplished personalizedly completely, but for standardized measurement of initial stage, we have designed standardized keyboard to measure index such as button precision.The later stage user can design the keyboard content according to individual demand, can be widely used in physical disabilities' use, the medical and gnotobasis, in the means of transport such as steamer, aircraft.

2.3 hardware connects

We link to each other single-chip microcomputer with camera, and provide power supply by connecting computer for it; Laser line generator then provides electric power by the battery of 3V; Single-chip microcomputer links to each other with computing machine by com port, carries out the transmission of data.

Claims (5)

1. dummy keyboard, it is made up of keyboard unit and processing unit, it is characterized in that, described keyboard unit is made up of a laser line generator, CMOS camera, printing keyboard, and processing unit is made up of single-chip microcomputer, and described laser line generator lies in a horizontal plane in the front of printing keyboard, launch one deck laser and cover whole printing keyboard, described CMOS camera is being placed on the single-chip microcomputer, and single-chip microcomputer has processing capacities such as crystal oscillator, and links to each other with single-chip microcomputer by the back side two row pin of getting lines crossed.

2. dummy keyboard according to claim 1 is characterized in that, described CMOS camera, be placed in the front upper place of printing keyboard, the scope of its shooting can cover whole printing keyboard, and can obtain characteristic point coordinates, and described laser line generator is placed in the below of camera.

3. dummy keyboard according to claim 1 and 2 is characterized in that, described printing keyboard is a kind of black plank that can not be reflective, and integral body is the T type, and button is made with the mazarine card paper, sticks on to print on the keyboard.

4. dummy keyboard according to claim 1 and 2 is characterized in that, described single-chip microcomputer is equipped with switch, serial ports and crystal oscillator element for the AVR single-chip microcomputer is placed on the development board.

5. dummy keyboard according to claim 3 is characterized in that, described single-chip microcomputer is equipped with switch, serial ports and crystal oscillator element for the AVR single-chip microcomputer is placed on the development board.

Images