CN103135772B - Keysheet module and display system - Google Patents
Keysheet module and display system Download PDFInfo
- Publication number
- CN103135772B CN103135772B CN201110386717.0A CN201110386717A CN103135772B CN 103135772 B CN103135772 B CN 103135772B CN 201110386717 A CN201110386717 A CN 201110386717A CN 103135772 B CN103135772 B CN 103135772B
- Authority
- CN
- China
- Prior art keywords
- image picture
- light source
- picture frame
- finger
- keysheet module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
A kind of Keysheet module, comprises multiple keyboard, optics finger navigation and coffret. This keyboard is in order to trigger digital signal. This optics finger navigation is in order to detect physiological feature and displacement. This coffret is in order to transmit this digital signal, this physiological feature and this displacement to display device. The present invention also proposes a kind of display system.
Description
Technical field
The present invention is about a kind of man-machine interface system, especially with regard to a kind of Keysheet module with user physiological feature detection function and display system.
Background technology
Optics finger navigation (opticalfingermouse, OFM) is little due to volume, generally is suitable for arranging in pairs or groups in other electronic installations. Known optical finger mouse is the intensity variation detecting user finger surface reflection light, uses the contact condition judging finger and the finger displacement relative to touch surface. But, along with industrialized development, user uses the time of various electronic installation to be gradually increased, and does not even know beyond physical load. But, general electronic installation also cannot detect user physiological situation at that time.
Known blood oxygen saturation instrument (pulseoximeter) is that the mode utilizing non-intrusion type is to detect blood oxygen concentration and the Pulse Rate of user, it can generate red light beam (wavelength about 660 nanometers) and infrared light (wavelength about 910 nanometers) penetrates detected part, and utilize and with oxygen haemachrome (oxyhemoglobin) and deoxygenated blood red pigment (Deoxyheamo-globin), special spectrum had the characteristic of different absorbance and penetrate the intensity variation of light with detection, referring for example to U.S. Patent No. 7, 072, No. 701, title is the monitoring mode (Methodforspectro-photometricbloodoxygenationmonitoring) of blood oxygen concentration. after detecting the intensity variation penetrating light of two kinds of wavelength, then calculate blood oxygen concentration with following equation
Blood oxygen concentration=100% �� [HbO2]/([HbO2]+[Hb]);
Wherein, [HbO2] represent band oxygen hemoglobin concentration; [Hb] represents deoxygenated blood lycopene concentration.
The light intensity penetrating light of two kinds of wavelength detected by general blood oxygen saturation instrument can present change as shown in Figure 1 along with heart beating, this is that the blood flow volume can constantly expanded along with heart beating due to blood vessel and shrink and light beam is passed through changes, and then changes the absorbed ratio of light energy. Thereby, then can calculate the blood absorbance to different spectrum according to the intensity information being continually changing, to calculate the physiologic informations such as band oxygen hemoglobin concentration and deoxygenated blood lycopene concentration respectively, finally recycle above-mentioned blood oxygen concentration formula and calculate blood oxygen concentration.
But, owing to blood oxygen saturation instrument is the intensity variation that detection penetrates light, thus different light intensity signals can be detected along with different detected part; Additionally, when the detected part that blood oxygen saturation instrument detects is moved, then can detect that the chaotic waveform of acutely variation cannot be computed correctly out physiologic information according to this, thus it is not appropriate for for the electronic installation of operation in movement.
In consideration of it, the present invention proposes a kind of Keysheet module detecting user physiological feature and display system, wherein this Keysheet module is in time detecting physiological feature, can eliminate finger and move the signal disturbing caused.
Summary of the invention
One object of the present invention is providing a kind of Keysheet module and display system, this Keysheet module passes through the reflected light signal analyzing finger to detect contact condition, finger displacement and user physiological feature, and the mode of operation according at least one keyboard generates digital signal, carry out corresponding action with relation control display device.
Another object of the present invention is providing a kind of control chip, it passes through the reflected light signal analyzing finger to detect contact condition, finger displacement and user physiological feature, and the mode of operation according at least one keyboard generates digital signal, use output is encoded, sorts and/or compresses this finger information, physiologic information and digital signal information.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user physiological feature, and has the mechanism eliminating environment light source impact.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user physiological feature, and has the mechanism reducing interference.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user physiological feature, when namely entering park mode after idle Preset Time.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user physiological feature, can give up physiological feature when finger displacement is too big.
For reaching above-mentioned purpose, the present invention provides a kind of Keysheet module, in order to detect and to export physiological feature and the digital signal of finger. This Keysheet module comprises multiple keyboard, the first light source, secondary light source, light source control unit, at least one imageing sensor and processing unit. This first light source sends the light of first wave length to this finger. This secondary light source sends the light of second wave length to this finger. This light source control unit controls this first light source and this secondary light source is luminous. This imageing sensor receives the reflection light from this finger to generate multiple first image picture frames of relatively this first light source igniting and this secondary light source is lighted relatively multiple second image picture frames with sampling frequency. This processing unit is according to described first image picture frame and described second image picture frame calculates this physiological feature and the mode of operation according to described keyboard generates this digital signal.
According to another feature of the present invention, the present invention also provides for a kind of Keysheet module for user manipulation. This Keysheet module comprises multiple keyboard, optics finger navigation, communication protocol unit and coffret. Described keyboard is in order to trigger digital signal. This optics finger navigation is in order to detect physiological feature and the finger displacement of this user. This communication protocol unit processes in order to be encoded, sort and to compress at least one of which for this digital signal, this physiological feature and this finger displacement. This coffret is in order to this digital signal of output processing, this physiological feature and this finger displacement.
According to another feature of the present invention, the present invention also provides for a kind of picture system, comprises display device and Keysheet module. This display device is in order to show image. This Keysheet module output digit signal and physiological feature, to this display device, update shown image according to this digital signal and show this physiological feature controlling this display device.
In the embodiment of the present invention, every this first image picture frame is divided into the mean flow rate of an at least two parts calculating often part, uses independent component analytic process or blind source separation method to analyze this this often a part of mean flow rate of described first image picture frame in the hope of the first brightness flop; Every this second image picture frame is divided into the mean flow rate of an at least two parts calculating often part, uses independent component analytic process or blind source separation method to analyze this this often a part of mean flow rate of described second image picture frame in the hope of the second brightness flop; And calculate physiological feature according to this first brightness flop and this second brightness flop.
In the Keysheet module of the present invention and picture system, described physiological feature comprises blood oxygen concentration and Pulse Rate. By the present invention in that and come separate mobile information and physiologic information by independent component analytic process or blind source separation method, finger can be eliminated and move the signal disturbing caused.
Accompanying drawing explanation
Fig. 1 is the schematic diagram that blood oxygen saturation instrument is detected the intensity variation penetrating light;
Fig. 2 A is the schematic diagram of the display system of one embodiment of the invention;
Fig. 2 B is the schematic diagram of the optics finger navigation of the Keysheet module of one embodiment of the invention;
Fig. 2 C is the block chart of the display system of one embodiment of the invention;
Fig. 3 is the schematic diagram of the acquired image picture frame of the imageing sensor of the optics finger navigation of the Keysheet module of one embodiment of the invention;
Fig. 4 is the imageing sensor of the optics finger navigation of the Keysheet module of the embodiment of the present invention, and wherein light filter system is arranged at side in face of section senses;
Fig. 5 is in the optics finger navigation of the Keysheet module of the embodiment of the present invention, the schematic diagram of Image Acquisition and light source luminescent;
Fig. 6 is the schematic diagram of the processing unit separate mobile information of the Keysheet module of the embodiment of the present invention and physiologic information;
Fig. 7 is the flow chart of the physiological feature detection method of the embodiment of the present invention;
Fig. 8 is the schematic diagram of the optics finger navigation of the Keysheet module of another embodiment of the present invention.
Description of reference numerals
1 Keysheet module 10 keyboard
111,112 light source 12,12 ' light guide
13,13 ' touching control 13S touch surface
14 imageing sensor 14f light filters
14S sensing face 15 processing unit
151 finger detection unit 152 keyboard detection unit
16 light source control unit 17 communication protocol unit
18 coffret 2 display devices
20 word 21 cursors
22 host apparatus 23 represent unit
9 finger 9S finger surfaces
I1-I2NImage picture frame B1-B2N��B1��-B2N' mean flow rate
S11-S15Step
Detailed description of the invention
In order to the above and other purpose of the present invention, feature and advantage can be become apparent from, hereafter will coordinate appended diagram, be described in detail below. In the explanation of the present invention, identical component is to represent with identical symbol, first illustrates at this.
Shown in reference Fig. 2 A, the schematic diagram of the picture system of its display embodiment of the present invention, comprise Keysheet module 1 and display device 2. This display device 2 can be such as TV, projection screen, gaming machine screen, computer screen or other are in order to show the display device of image. This Keysheet module 1 in order to control this display device 2 update display in perhaps image and display physiological feature; Wherein, this Keysheet module 1 can wire or wirelessly couple this display device 2. This Keysheet module 1 is in order to detect and to export physiological feature, contact condition, finger displacement and digital signal to this display device 2.
This Keysheet module 1 comprises multiple keyboard 10, optics finger navigation and coffret 18, wherein this optics finger navigation comprises touching control and manipulates in upper for finger, and this touching control can be combined in described keyboard 10 one of them (being such as shown as 13) or independent of its outer (being such as shown as 13 '). Described keyboard 10 triggers digital signal in order to the mode of operation (pressed state) according to user, for instance can generate, by pressing at least one keyboard, the digital signal that different resistance value, magnitude of voltage, concussion frequency etc. are relevant; Wherein this digital signal is such as the general keyboard institute exporter such as word 20, numeral, symbol and/or control signal. This optics finger navigation is then in order to detect the physiological feature of the contact condition of user finger, displacement and this user, and wherein this physiological feature such as includes blood oxygen concentration and Pulse Rate etc. In the present embodiment, when this optics finger navigation judges that this contact condition is as contact state, carries out the detection of this displacement and this physiological feature soon. This digital signal, contact condition, displacement and physiological feature are then wire or wirelessly sent to this display device 2 by this coffret 18, so that this display device 2 updates display image according to this digital signal, and show this displacement and physiological feature.
With reference to shown in Fig. 2 B, the schematic diagram of the optics finger navigation of the Keysheet module 1 of its display embodiment of the present invention, it comprises two light sources 111 and 112, light guide 12 (number of light guide is only exemplary herein), touching control 13, imageing sensor 14, processing unit 15 and light source control unit 16. Should be noted that, in Fig. 2 B, the spatial relationship of each component is only exemplary, is not limited to the present invention. Described light source 111 and 112 can be such as light emitting diode or laser diode, in order to generate the light of different wave length respectively to finger surface 9S, described wavelength is preferably two wavelength that general BOLD contrast uses, for instance the infrared light of the HONGGUANG of about 660 nanometers and about 905,910 or 940 nanometers. It will be appreciated that wavelength described herein refers to the centre wavelength of light source luminescent spectrum.
This light guide 12 guides to this touching control 13 in order to the light sent by described light source 111 and 112; Wherein, as long as this light guide 12 can guide light that described light source 111 and 112 sends to this touching control 13, its structure, number and guide-lighting mode there is no specific restriction. In other embodiments, if the light that described light source 111 and 112 sends can be directly transmitted to this touching control 13, this light guide 12 is also likely to not implement.
This touching control 13 has touch surface 13S and manipulates thereon for this finger 9, and the light that this touching control 13 preferably sends relative to described light source 111 and 112 is transparent; Wherein when this touching control 13 is incorporated into key board 10, this key board 10 light that then preferably relatively described light source 111 and 112 sends is transparent. When this finger 9 comes close to or in contact with the touch surface 13S of this touching control 13, the light that described light source 111 and 112 sends is reflected. It will be appreciated that the area of this touch surface 13S more than or less than this finger surface 9S, can there is no specific restriction.
This imageing sensor 14 receives from the reflection light of this touching control 13 (this finger surface 9S) with sampling parameters to generate multiple image picture frames (each image picture frame such as has 16 �� 16 pixels); Wherein this sampling parameters such as comprises time of exposure, image gain (can be analogy gain or numerical digit gain) etc. This imageing sensor 14 is preferably active array-type imageing sensor, for instance cmos image sensor.
This processing unit 15 generates corresponding digital signal according to the mode of operation of described keyboard 10, and multiple the image picture frames exported according to this imageing sensor 14 detect the physiological feature of the contact condition of this finger 9 this touch surface 13S relative, displacement and this user. This digital signal, contact condition, displacement and the physiological feature that this processing unit 15 is tried to achieve such as can wire or wirelessly be transferred into has at least one display device representing unit to display or corresponding control; Wherein, this expression unit can be such as that display, cresset, seven bytes show and/or audio unit. This display device can be portable electronic devices or household electronic device.
This light source control unit 16 couples this processing unit 15, and luminous to coordinate the image picture frame of this imageing sensor 14 to obtain the described light source 111 and 112 of control, its embodiment will be described hereafter.
In the present embodiment, described light source 111 and 112, this imageing sensor 14, this processing unit 15 and this light source control unit 16 are as optics finger navigation, in order to detect and to export the contact condition of this finger 9, displacement and physiological feature.
With reference to shown in Fig. 2 A to 2C, Fig. 2 C is the block chart of the display system of the embodiment of the present invention. Keysheet module 1 comprises multiple keyboard the 10, first light source 111, secondary light source 112, this imageing sensor 14, this processing unit 15, this light source control unit 16, communication protocol unit 17 and coffret 18, and wherein this Keysheet module 1 forms display system with host apparatus 22 and expression unit 23. Owing to this processing unit 15 is by multi-functional computing, it can comprise finger detection unit 151 in order to detect this contact condition of this finger 9 this touch surface 13S relative, finger displacement and physiological feature, and comprise keyboard detection unit 152 and generate and export this digital signal in order to the mode of operation (pressed state) according to described keyboard 10; That is, this processing unit 15 can be single element or be divided into two unit.
This first light source 111 such as sends wavelength and is about the HONGGUANG of 660 nanometers to this finger 9; This secondary light source 112 such as sends wavelength and is about the infrared light of 905,910 or 940 nanometers to this finger 9; In a broad sense, this first light source 111 and this secondary light source 112 can send the light of two wavelength that general BOLD contrast uses respectively. This light source control unit 16 controls this first light source 111 and this secondary light source 112 is luminous. This imageing sensor 14 receives the reflection light of this first light source 111 from this finger surface 9S and this secondary light source 112. This communication protocol unit 17 exports after being encoded, sort and/or compress at least one routine processes in order to this digital signal, contact condition, displacement and the physiological feature tried to achieve for this processing unit 15 to this coffret 18 and is transmitted. This coffret 18 can be such as PS2 interface, USB interface, blue tooth interface or other keyboards coffret applicatory, in order to this digital signal after coding, sequence and/or compression, contact condition, displacement and physiological feature to be transmitted to outside host apparatus 22 by the mode of wired or wireless transmission; Wherein, wired and Radio Transmission Technology has been it is known that therefore repeat no more in this. This host apparatus 22 is coupled to be had at least one this display device 2 representing unit 23, is shown in order to control this display device 2 by this expression unit 23 and/or is responded this digital signal, contact condition, displacement and the physiological feature that receive. This host apparatus 22 can be combined in this expression unit 23 to form a display device or independent of outside it.
The Keysheet module 1 of the embodiment of the present invention can be arranged in pairs or groups and be had the display device 2 representing unit 23, allow user can control cursor on this expression unit 23, execution software and picture by this Keysheet module 1 show, and (depend on the numerical value of physiological feature) when showing tired or excited state in physiological feature to user proposition warning; Wherein, represent that the mode such as available software of physiological feature and warning performs the mode that picture shows, cresset shows or sound shows and reaches, there is no specific restriction. This display device 2 such as can according to this digital signal image switching, display symbol, image update, adjustment display parameters etc.; Cursor action is controlled according to this displacement; Show this physiological feature and generate alert status when this physiological feature is beyond preset value, for instance picture is dimmed, image insertion, auditory tone cues etc., but do not limit with this.
In one embodiment, this Keysheet module 1 also can use two imageing sensors to detect the light (namely imageing sensor 14 is replaced by two imageing sensors) of the generated different wave length of described light source 111 and 112, one of them imageing sensor or two imageing sensors respectively can arrange the spectrum that band pass filter (bandpassfilter) selects to be intended to receive.
Owing to this processing unit 15 (keyboard detection unit 152) generates the mode of digital signal for it is known that therefore repeat no more in this according to described keyboard 10. The mode calculating this contact condition, finger displacement and physiological feature only for this processing unit 15 (finger detection unit 151) below is described in detail; That is, the action of the optics finger navigation formed only for described light source 111 and 112, this imageing sensor 14, this processing unit 15 (finger detection unit 151) and this light source control unit 16 in following description illustrates.
Sampling mechanism
The optics finger navigation of the present embodiment is to use two light sources 111 and 112 and two kinds of functions of execution simultaneously; Wherein, the detection function of contact condition and displacement do not limit use specific wavelength image picture frame, the detection of physiological feature function then must correspondence different wave length image picture frame calculate respectively. First the sampling mechanism of image picture frame is below described.
In one embodiment, this light source control unit 16 controls this first light source 111 and secondary light source 112 is luminous in turn, this imageing sensor 14 is then with high speed and fixing sampling frequency (such as per second 3,000) synchronize this first light source 111 or this secondary light source 112 light acquisition image picture frame, and export multiple images picture frame I as shown in Figure 31-I5... to this processing unit 15 (finger detection unit 151), wherein said image picture frame I1-I6... comprise the first image picture frame I1��I3��I5..., lighting of its such as this first light source 111 relative, and the second image picture frame I2��I4��I6..., lighting of its such as this secondary light source 112 relative.
This processing unit 15 can according to described first image picture frame and described second image picture frame I1-I6... judge contact condition and calculate displacement, such as judge whether this finger 9 comes close to or in contact with this touch surface 13S according to described first image picture frame and the described brightness of the second image picture frame with the comparative result of at least one threshold value, wherein when the brightness of described image picture frame is more than or less than this at least one threshold value, namely judge to enter contact state; After entering contact state, this processing unit 15 can according to this displacement of correlation calculations between two the first image picture frames, a first image picture frame and a second image picture frame or two the second image picture frames. Should be noted that, the present embodiment is the image picture frame of the reflection light that must utilize corresponding two different wave lengths carries out judging contact condition and calculating the running of displacement, is distinct from conventional navigation device.
This processing unit 15 is according to described first image picture frame I1��I3��I5... calculate the brightness flop of described first image picture frame, and according to described second image picture frame I2��I4��I6... calculate the brightness flop (in rear detailed description) of described second image picture frame, and calculate two kinds of absorbed ratios of spectrum according to this respectively to obtain band oxygen hemoglobin concentration HbO2And deoxygenated blood lycopene concentration Hb, finally utilize blood oxygen concentration formula to calculate blood oxygen concentration; And calculate Pulse Rate by the comparative result of the brightness flop of described first image picture frame and/or described second image picture frame with at least one threshold value.
In another embodiment, this light source control unit 16 controls this first light source 111 and this secondary light source 112 is synchronized with the image picture frame of this imageing sensor 14 and obtains simultaneously luminous; That is, now this imageing sensor 14 can be simultaneously received the reflection light of two kinds of wavelength. Therefore, in this embodiment, a part of front of the sensing face 14S of this imageing sensor 14 preferably also sets up light filter 14f (as shown in Figure 4), wherein this light filter 14f can be band pass filter so that the section senses face 14S at this light filter 14f rear is only capable of sensing the spectrum of the spectrum of this first light source 111 or this secondary light source 112 so that this processing unit 15 can differentiate the first image picture frame (relatively the parts of images picture frame of this first light source 111) and the second image picture frame (relatively the parts of images picture frame of this secondary light source 112). It will be appreciated that in the present embodiment this light filter 14f position is set and area is not limited to shown in Fig. 4.
Thereby, this processing unit 15 equally can according to described first image picture frame and described second image picture frame I1-I6... calculate a contact condition and displacement; And can according to described first image picture frame I1��I3��I5... calculate the brightness flop of described first image picture frame and according to described second image picture frame I2��I4��I6... calculate the brightness flop of described second image picture frame, and according to the relation of two brightness flop calculate blood oxygen concentration and Pulse Rate at least one.
It will be appreciated that, owing to this imageing sensor 14 is likely to the light of different wave length is had different light receiving efficiencies, or the luminosity of this first light source 111 and this secondary light source 112 is incomplete same, therefore preferably before this Keysheet module 1 dispatches from the factory, it is adjusted (such as adjusting the sampling parameters such as the time of exposure of relative different wave length image picture frame, image gain) for the brightness of this imageing sensor 14 detected image picture frame, so that the acquired initial pictures picture frame of this imageing sensor 14 has roughly the same brightness, to eliminate the probability of erroneous judgement.
The spirit of the present embodiment is in that, control this first light source 111 and this secondary light source luminous 112 with this light source control unit 16 luminous, make this imageing sensor 14 receive the reflection light from this finger 9 to generate multiple first image picture frames of this first light source igniting relatively and this secondary light source is lighted relatively multiple second image picture frames with sampling frequency; This processing unit 15 then calculates this contact condition, finger displacement and physiological feature according to described first image picture frame and the second image picture frame.
Eliminate environment light mechanism
In Fig. 2 B, owing to this contact 13 is transparent, simultaneously finger 9 can printing opacity, this environment light Keysheet module 1 outside can be received by this imageing sensor 14 by this finger 9 and contact 13 (13 ') and have influence on the image quality of its acquired image picture frame. In the present embodiment, it is not luminous during part that this light source control unit 16 can control this first light source 111 and this secondary light source 112.
Such as refer to shown in Fig. 5, it shows the Image Acquisition luminous situation with this first light source 111 and this secondary light source 112 of this imageing sensor 14; Wherein, solid arrow represents light source igniting (or lighting with the first brightness) and dotted line arrow represents that light source extinguishes (or lighting with the second brightness), and this second brightness is such as less than this first brightness. Fig. 5 (A) shows that this imageing sensor 14 continues to obtain image picture frame with fixing sampling frequency. Fig. 5 (B) shows that this first light source 111 and this secondary light source 112 are that simultaneously place is bright and extinguish in turn, and therefore this imageing sensor 14 then can get bright image picture frame (light source igniting or light with this first brightness) and dark image picture frame (light source extinguishes or lights with this second brightness) in turn. Fig. 5 (C) shows that this first light source 111 and this secondary light source 112 are lighted once every two image picture frames simultaneously, and it is commonly angled relative to this finger 9 and has the situation of relatively low displacement. As previously mentioned, when this first light source 111 and this secondary light source 112 are lighted simultaneously (Fig. 5 (B) and (C)), this imageing sensor 14 comprises light filter 14f with the space region image picture frame every different light sources so that the part of this imageing sensor 14 can sense the reflection light of this first light source 111 and another part can sense the reflection light of this secondary light source 112.
When this finger 9 contact or near this touch surface 13S time, bright image picture frame acquired during relative to light source igniting comprises (finger reflection light+veiling glare+environment light), the dark image picture frame acquired time non-lit up relative to light source then only comprises (environment light), if therefore bright image picture frame being deducted dark image picture frame, then can effectively eliminate the impact of environment light. This processing unit 15 then can calculate this contact condition, finger displacement and physiological feature according to the difference image picture frame of bright dark image picture frame.
Shown in Fig. 5 (D), it shows that this first light source 111 and this secondary light source 112 are the embodiments lighted in turn. In this embodiment, owing to make this imageing sensor 14 get dark image picture frame, therefore this light source control unit 16 controls this first light source 111 and this secondary light source 112 image picture frame of being separated by and alternately lights, for instance when the time td of Fig. 5 (D), two light sources are not all lighted. Thereby, this processing unit 15 then can calculate difference the first image (bright first image picture frame-dark image picture frame) and difference the second image (bright second image picture frame-dark image picture frame), and calculates this contact condition, finger displacement and physiological feature according to described difference image. As it was previously stated, when this first light source 111 and this secondary light source 112 are lighted in turn, this imageing sensor 14 with time zone every the image picture frame relative to different light sources.
The spirit of the present embodiment is in that, make this light source control unit 16 control this first light source 111 and this secondary light source 112 is simultaneously or alternately luminous, and make this imageing sensor 14 can get described light source not luminous time dark image picture frame, and by calculate bright dark image difference image to eliminate the impact of environment light. Therefore, the luminous situation of each light source shown in Fig. 5 is only exemplary, is not limited to the present invention.
Noise reduction mechanisms
Interference can be there is due in the image picture frame that this imageing sensor 14 is acquired, and interference is generally distributed in acquired image picture frame in a random way, therefore the present embodiment can enter to calculate that M opens image picture frame further and improve signal to noise ratio (SNR), to increase the degree of accuracy of calculating physiological feature; Such as, every 10 image picture frames are added, and two groups of 10 image picture frames being added can partly repeat or not repeat completely. It will be appreciated that when this first light source 111 and this secondary light source 112 are to light in turn, the image picture frame of the present embodiment and the respectively described first image picture frame (I of such as Fig. 31+I3+I5...) and and the described second image picture frame (I of such as Fig. 32+I4+I6...) sum, this is owing to must calculate two groups of intensity variation respectively. But, when this first light source 111 and this secondary light source 112 are to light simultaneously, the image picture frame of the present embodiment and be then the continuous print image picture frame (I of such as Fig. 31+I2+I3+I4+I5+I6...), and by post processing by space region every in the way of differentiate two groups of intensity variation. Additionally, when coordinating above-mentioned elimination environment light mechanism, the image picture frame of the present embodiment and be then the sum of difference image picture frame; That is, then carry out noise reduction process after having performed elimination environment optical processing. In other embodiments, also can only perform to eliminate environment optical processing and noise reduction process one of them.
As previously mentioned, this imageing sensor 14 likely obtains image with different sampling parameters at different conditions, such as this imageing sensor 14 is likely to be of different absorbances relative to the light of different wave length, therefore described first image picture frame and described second image picture frame may be made to have roughly the same brightness with sampling parameters such as different time of exposure and image gains, correctly can carry out post processing according to described image picture frame, that is the sampling parameters of this first image picture frame and the second image picture frame relatively is likely to differ. In order to get rid of the impact of different sampling parameters, every image picture frame or M can be opened image picture frame and or average divided by sampling parameters to be normalized, for instance (M open image picture frame and/sampling parameters) or (M open image picture frame average/sampling parameters); Wherein, M is positive integer.
Physiological feature calculates
During relative to different light source igniting, the acquired image picture frame of this imageing sensor 14 includes physiologic information and finger mobile message simultaneously. Therefore, in the present embodiment, this processing unit 15 (or this finger detection unit 151) first needs, by after two kinds of information separation, to be computed correctly physiological feature; That is, two kinds of information are separated by this processing unit 15 for example with independent component analytic process (IndependentComponentAnalysis, ICA) or blind source separation method (BlindSourceSeparation, BSS).
With reference to shown in Fig. 3 and 6, with the first image picture frame I described in Fig. 31��I3��I5... for example, by multiple first image picture frames (can be original image picture frame, through eliminating environment light mechanism and/or the first image picture frame of processing of noise reduction mechanisms) or multiple first image picture frames and (M open original image picture frame and, through M elimination environment light mechanism and/or noise reduction mechanisms processed open the first image picture frame and) every image picture frame or image picture frame and be divided at least two parts try to achieve mean flow rate respectively, for instance by image picture frame I1Being divided into mean flow rate is B1And B1' two parts; By image picture frame I3Being divided into mean flow rate is B3And B3' two parts; ...; By image picture frame I2N-1Being divided into mean flow rate is B2N-1And B2N-1' two parts (can more than two parts in other embodiments). Then, utilizing independent component analytic process or blind source separation method to isolate the first mobile message and the first physiologic information (as shown in Figure 6), it is all shown as brightness flop line style. The present embodiment is that the brightness flop line style that mobile message is given up and utilized physiologic information is to calculate physiological feature. It will be appreciated that owing to the sampling frequency of this imageing sensor 14 is far longer than pulse frequency, therefore isolated physiologic information can be shown that the line style (similar Fig. 1) that light intensity changes with pulse; The distribution of isolated mobile message does not limit as shown in Figure 6. Additionally, two parts of described image picture frame segmentation are not limited to upper and lower two parts. Additionally, due to the physiologic information of the light of relative two different wave lengths must be calculated respectively, above-mentioned separable programming is to be respectively directed to the first image picture frame I1��I3��I5... (corresponding first light source igniting) and the second image picture frame I2��I4��I6... (corresponding secondary light source is lighted) carries out. Described second image picture frame (I2��I4��I6...) also it is separated into the brightness flop such as the second mobile message and the second physiologic information, and give up the second mobile message and merely with the brightness flop of the second physiologic information. Should be noted that, when utilize image picture frame with or when the information that on average carries out separates, the I in Fig. 61-I2N-1And I2-I2NEach of which represent M open image picture frame and, average or its normalized result.
It must be stressed that the contact condition of this finger 9 and displacement are directly to be tried to achieve according to described first image picture frame and the second image picture frame by this processing unit 15, it is not required to use the first mobile message after separating and the second mobile message. Independent component analytic process or blind source separation method mainly in order to mixed signal to be separated, after isolated mobile message is given up, can eliminate finger and move the signal disturbing caused.
In the present embodiment, this processing unit 15 calculates Pulse Rate always according to the comparative result of at least one threshold value with this first brightness flop and/or this second brightness flop.
Park mode
The Keysheet module 1 of the embodiment of the present invention, after idle Preset Time, can enter park mode. Such as, this processing unit 15, when Preset Time judges that this finger 9 does not come close to or in contact with this touch surface 13S, can enter park mode. In park mode, for instance the Image Acquisition of this imageing sensor 14 can be suspended and suspend the luminescence of described light source 111 and 112.
Physiological feature gives up mechanism
The processing unit 15 of the Keysheet module 1 of the embodiment of the present invention can calculate displacement and physiological feature simultaneously, but accurate physiological feature calculates and is preferably in the relatively low situation of displacement. Therefore, the present embodiment can judge that whether finger displacement is more than preset value in advance, if this finger displacement is more than this preset value, the image picture frame that then this imageing sensor 14 is acquired is only in order to calculate displacement and to judge that contact condition is without to calculate physiological feature, even if or calculate physiological feature and also process without this communication protocol unit 17 or this coffret 18 transmits, and directly being given up. This preset value then determines according to practical application, for instance, but be not limited to, can according to sensing face 14S and/or the size decision searching frame.
This Keysheet module 1 method according to the reflection light detection physiological feature of finger surface 9S, comprises the steps of the light that provides first wave length and second wave length to finger surface (step S11); Obtain the reflection light of light of this first wave length to generate multiple first image picture frames and to obtain the reflection light of light of this second wave length to generate multiple second image picture frame (step S12); Every this first image picture frame and every this second image picture frame are divided at least two parts and try to achieve mean flow rate (the step S of every part13); Independent component analytic process or blind source separation method is utilized to analyze this mean flow rate of this every part of described first image picture frame in the hope of this mean flow rate of the first brightness flop this every part analyzing described second image picture frame in the hope of the second brightness flop (step S14); And try to achieve physiological feature (step S according to this first brightness flop and this second brightness flop15). Before the embodiment of each step of the present embodiment is specified in, therefore repeat no more in this.
In another embodiment, the element partially or in whole of described light source 111 and 112, this imageing sensor 14, this processing unit 15, this light source control unit 16, this communication protocol unit 17 and this coffret 18 also can be made as control chip or packaging body, as shown in Figure 8. This control chip or packaging body are in order to detect mode of operation and the contact condition of this finger 9, displacement and the physiological feature of described keyboard 10, and export encoded, sequence and/or this contact condition of compression, displacement, physiological feature and digital signal; Wherein calculate the mode of this contact condition, displacement and physiological feature as it was previously stated, therefore repeat no more in this. In addition it will be appreciated that the configuration mode of each element is only exemplary in this optics finger navigation in Fig. 8, and it is not used to the restriction present invention. In other embodiments, described compression processes and also can additionally arrange compression unit execution.
In sum, it is known that Keysheet module also cannot detect the physiological feature of user, and BOLD contrast calculate the mode of blood oxygen concentration because of have cannot judge mobile in the factor such as detected part and incompatible on Keysheet module. Therefore, the present invention also provides for a kind of Keysheet module and display system (Fig. 2 A to 2C), wherein this Keysheet module can detect finger information and keypad information simultaneously, and control display device and update display content according to this keypad information and show this finger information. The Keysheet module of various embodiments of the present invention can detect the physiological feature of user while detection finger displacement, and can effectively eliminate finger and move the signal disturbing caused and eliminate environment light source impact, and there is park mode and give up the mechanism of physiologic information.
Although the present invention is open with previous embodiment, so it is not limited to the present invention, and any persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when doing various changes and amendment. Therefore protection scope of the present invention is when being as the criterion depending on the defined person of appended claims.
Claims (18)
1. a Keysheet module, in order to detect and to export physiological feature and the digital signal of finger, described Keysheet module comprises:
Multiple keyboards;
First light source, light to the described hands sending first wave length refers to;
Secondary light source, sends the light of second wave length to described finger, and wherein, described second wave length is different from described first wave length;
Light source control unit, controls described first light source and described secondary light source is luminous;
At least one imageing sensor, receives reflection multiple the second image picture frames lighted with multiple the first image picture frames and relatively described secondary light source generating relatively described first light source igniting of light from described finger with sampling frequency; And
Processing unit, calculate displacement and described physiological feature according to described first image picture frame and described second image picture frame and the mode of operation according to described keyboard generates described digital signal, wherein when described displacement is more than preset value, described first image picture frame that at least one imageing sensor described is acquired and described second image picture frame are only in order to calculate described displacement without to calculate described physiological feature.
2. Keysheet module according to claim 1, wherein said processing unit: every described first image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described first image picture frame in the hope of the first brightness flop; Every described second image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described second image picture frame in the hope of the second brightness flop; And calculate described physiological feature according to described first brightness flop and described second brightness flop.
3. Keysheet module according to claim 1 and 2, wherein said physiological feature comprises blood oxygen concentration and/or Pulse Rate.
4. Keysheet module according to claim 2, wherein said processing unit calculates Pulse Rate always according to the comparative result of at least one threshold value with at least one in described first brightness flop and described second brightness flop.
5. Keysheet module according to claim 1, the also brightness and at least one threshold value to described first image picture frame and described second image picture frame of wherein said processing unit compares to judge contact condition.
6. Keysheet module according to claim 1, wherein said processing unit calculates described displacement according to two described first image picture frames, a described first image picture frame and described second image picture frame, two described second image picture frames.
7. Keysheet module according to claim 1, wherein said light source control unit: control described first light source and described secondary light source lights in turn so that described imageing sensor receives the reflection light of described first light source and described secondary light source in turn; Or control described first light source and described secondary light source lights so that described imageing sensor receives the reflection light of described first light source and described secondary light source simultaneously simultaneously, and described imageing sensor comprises light filter, this light filter is covered in a part for the sensing face of described imageing sensor.
8. Keysheet module according to claim 1, wherein said first light source, described secondary light source, described light source control unit, at least one imageing sensor described and described processing unit are packaged into control chip to export the described physiological feature of at least one routine processes in encoded, sequence and compression and described digital signal.
9. Keysheet module according to claim 1, this Keysheet module also comprises touching control, and this touching control manipulates thereon for described finger; Wherein said touching control is in described keyboard or independent of outside described keyboard.
10. a Keysheet module, manipulates for user, and described Keysheet module comprises:
Multiple keyboards, in order to trigger digital signal;
Optics finger navigation, in order to detect physiological feature and the finger displacement of described user, described optics finger navigation comprises:
First light source, the light sending first wave length refers to hands;
Secondary light source, sends the light of second wave length to described finger, and wherein, described second wave length is different from described first wave length;
Light source control unit, controls described first light source and described secondary light source is luminous;
At least one imageing sensor, receives reflection multiple the second image picture frames lighted with multiple the first image picture frames and relatively described secondary light source generating relatively described first light source igniting of light from described finger with sampling frequency; And
Processing unit, calculate and export described physiological feature and described finger displacement according to described first image picture frame and described second image picture frame, wherein when described finger displacement is more than preset value, described first image picture frame that at least one imageing sensor described is acquired and described second image picture frame are only in order to calculate described finger displacement without to calculate described physiological feature;
Communication protocol unit, in order at least one process in being encoded for described digital signal, described physiological feature and described finger displacement, sort and compress; And
Coffret, in order to the described digital signal of output processing, described physiological feature and described finger displacement.
11. Keysheet module according to claim 10, wherein said processing unit: every described first image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described first image picture frame in the hope of the first brightness flop; Every described second image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described second image picture frame in the hope of the second brightness flop; And calculate described physiological feature according to described first brightness flop and described second brightness flop.
12. Keysheet module according to claim 11, wherein said processing unit calculates Pulse Rate always according to the comparative result of at least one threshold value with at least one in described first brightness flop and described second brightness flop.
13. Keysheet module according to claim 10, the also brightness and at least one threshold value to described first image picture frame and described second image picture frame of wherein said processing unit compares to judge contact condition.
14. a display system, this display system comprises:
Display device, in order to show image; And
Keysheet module, output digit signal and physiological feature to described display device, update shown image according to described digital signal and show described physiological feature controlling described display device, and described Keysheet module comprises:
Multiple keyboards;
First light source, the light sending first wave length refers to hands;
Secondary light source, sends the light of second wave length to described finger, and wherein, described second wave length is different from described first wave length;
Light source control unit, controls described first light source and described secondary light source is luminous;
At least one imageing sensor, receives reflection multiple the second image picture frames lighted with multiple the first image picture frames and relatively described secondary light source generating relatively described first light source igniting of light from described finger with sampling frequency; And
Processing unit, calculate displacement and described physiological feature according to described first image picture frame and described second image picture frame and the mode of operation according to described keyboard generates described digital signal, wherein when described displacement is more than preset value, described first image picture frame that at least one imageing sensor described is acquired and described second image picture frame are only in order to calculate described displacement without to calculate described physiological feature.
15. display system according to claim 14, wherein when described physiological feature is beyond preset value, described display device generates alert status.
16. display system according to claim 14, wherein said processing unit: every described first image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described first image picture frame in the hope of the first brightness flop; Every described second image picture frame is divided into the mean flow rate of at least two parts the every part of calculating, analyzes the described mean flow rate of described every part of described second image picture frame in the hope of the second brightness flop; And calculate described physiological feature according to described first brightness flop and described second brightness flop.
17. display system according to claim 14, wherein said processing unit calculates described displacement according to two described first image picture frames, a described first image picture frame and described second image picture frame, two described second image picture frames, and described Keysheet module exports described displacement to described display device with the cursor shown by display device described in relation control.
18. display system according to claim 16, wherein said processing unit calculates Pulse Rate always according to the comparative result of at least one threshold value with at least one in described first brightness flop and described second brightness flop.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110386717.0A CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110386717.0A CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103135772A CN103135772A (en) | 2013-06-05 |
| CN103135772B true CN103135772B (en) | 2016-06-01 |
Family
ID=48495704
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110386717.0A Active CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103135772B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109062419A (en) * | 2018-08-09 | 2018-12-21 | 郑州大学 | A kind of laser projection virtual keyboard of optimization |
| CN113934308A (en) * | 2020-07-14 | 2022-01-14 | 致伸科技股份有限公司 | Keyboard device with physiological parameter detection function |
| CN114343597A (en) * | 2021-12-29 | 2022-04-15 | 北京小米移动软件有限公司 | Physiological parameter monitoring method and device, keyboard, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| CN101605495A (en) * | 2006-11-23 | 2009-12-16 | 英戈·弗洛尔 | Medical measuring device |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5370475B2 (en) * | 2009-03-19 | 2013-12-18 | 株式会社島津製作所 | Optical biological measurement apparatus and analysis method |
-
2011
- 2011-11-29 CN CN201110386717.0A patent/CN103135772B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101605495A (en) * | 2006-11-23 | 2009-12-16 | 英戈·弗洛尔 | Medical measuring device |
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103135772A (en) | 2013-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI474215B (en) | Keyboard module and display system | |
| TWI476641B (en) | Remote controller and display system | |
| TWI475193B (en) | Optical distance measurement system and operation method thereof | |
| TWI438658B (en) | User interface system and optical finger mouse system | |
| TWI489325B (en) | Optical finger mouse, electronic device and physiological characteristic detection device | |
| TWI451295B (en) | Optical finger mouse, mouse control module and physiological characteristic detection method thereof | |
| US8160311B1 (en) | System and method for detecting facial gestures for control of an electronic device | |
| EP2156279B1 (en) | Button based color navigation method and device in a lighting or visualization system | |
| US10905340B2 (en) | Physiological detection device | |
| CN103135772B (en) | Keysheet module and display system | |
| US20040125147A1 (en) | Device and method for generating a virtual keyboard/display | |
| CN103425852B (en) | User's recognition methods, physiology detection apparatus and physiological detection method | |
| TW201346610A (en) | User identification method, physiological detection device and physiological detection method | |
| CN103135853A (en) | Optical input device, detection method and method for optical input device | |
| CN103034342B (en) | Optics finger navigation, electronic installation and physiological characteristic pick-up unit | |
| CN103123542B (en) | Optical mouse and method of operating thereof | |
| CN103135801B (en) | Human-computer interface system and finger mouse system | |
| CN104731317B (en) | Guider and image display system | |
| CN103135800B (en) | Optics finger navigation, mouse control module and physiological characteristic detection method thereof | |
| CN109150152A (en) | Optical profile type control key and its operation method and imaging sensor | |
| CN110083299A (en) | Bimodulus optical navigator | |
| CN103126686A (en) | Optical ranging system and operation method thereof | |
| CN108784656B (en) | Wearing identification method and device of wearable equipment and wearable equipment | |
| CN109691069A (en) | Shield lower Systems for optical inspection, electronic equipment and object proximity detection method | |
| CN103136919B (en) | Remote control and display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |