CN103135772A - Keyboard module and display system - Google Patents
Keyboard module and display system Download PDFInfo
- Publication number
- CN103135772A CN103135772A CN2011103867170A CN201110386717A CN103135772A CN 103135772 A CN103135772 A CN 103135772A CN 2011103867170 A CN2011103867170 A CN 2011103867170A CN 201110386717 A CN201110386717 A CN 201110386717A CN 103135772 A CN103135772 A CN 103135772A
- Authority
- CN
- China
- Prior art keywords
- image picture
- light source
- picture frame
- finger
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
A keyboard module comprises a plurality of keyboard keys, an optic finger mouse and a transmission interface. The keyboard keys are used for triggering digital signals. The optic finger mouse is used for detecting physiological features and displacement. The transmission interface is used for transmitting the digital signals, the physiological features and the displacement to a display device. Further provided is a display system.
Description
Technical field
The invention relates to a kind of man-machine interface system, particularly about a kind of Keysheet module and display system with user's physiological characteristic measuring ability.
Background technology
Optics finger navigation (optical finger mouse, OFM) because volume is little, looks good with usually in other electronic installations.The known optical finger mouse is the intensity variation that detects user's finger surface reflection ray, uses the contact condition of judgement finger and finger with respect to the displacement of touch surface.Yet along with industrialized development, the user uses the time of various electronic installation to increase gradually, even exceeds physical load and does not know.Yet general electronic installation also can't detect user's physiological situation at that time.
known blood oxygen saturation instrument (pulse oximeter) is to utilize the mode of non-intrusion type to detect user's blood oxygen concentration and Pulse Rate, it can generate red light beam (wavelength is 660 nanometers approximately) and infrared light light beam (wavelength is 910 nanometers approximately) penetrates detected part, and utilize band oxygen protoheme (oxyhemoglobin) and deoxygenated blood red pigment (Deoxyheamo-globin) special spectrum to be had the characteristic of different absorptivities to detect the intensity variation of penetrating light, for example with reference to United States Patent (USP) the 7th, 072, No. 701, title is the monitoring mode (Method for spectro-photometric blood oxygenation monitoring) of blood oxygen concentration.After detecting the intensity variation of penetrating light of two kinds of wavelength, then calculate blood oxygen concentration with following formula
Blood oxygen concentration=100% * [HbO
2]/([HbO
2]+[Hb]);
Wherein, [HbO
2] expression band oxygen protoheme concentration; [Hb] expression deoxygenated blood red pigment concentration.
The light intensity of the penetrating light of the general detected two kinds of wavelength of blood oxygen saturation instrument can present along with heartbeat variation as shown in Figure 1, this is because the blood flow volume change that makes light beam pass through constantly be expanded and be shunk to blood vessel can along with heartbeat, and then changes the absorbed ratio of luminous energy.By this, can calculate blood to the absorptivity of different spectrum according to the intensity information of continuous variation, to calculate respectively the physiologic informations such as band oxygen protoheme concentration and deoxygenated blood red pigment concentration, recycle at last above-mentioned blood oxygen concentration formula and calculate blood oxygen concentration.
Yet, because blood oxygen saturation instrument is to detect to penetrate the intensity variation of light, thereby different light intensity signals can be detected along with different detected part; In addition, when the detected part that detects when blood oxygen saturation instrument is moved, the chaotic waveform of violent change can be detected and can't correctly calculate according to this physiologic information, thus itself and be not suitable for mobile in the electronic installation of operation.
Given this, the present invention proposes a kind of Keysheet module and display system of the user's of detection physiological characteristic, and wherein this Keysheet module when detecting physiological characteristic, can be eliminated the mobile signal that causes of finger and disturb.
Summary of the invention
One object of the present invention is providing a kind of Keysheet module and display system, the reflected light signal that this Keysheet module is pointed by analysis is to detect contact condition, finger displacement and user's physiological characteristic, and generate the numerical digit signal according to the mode of operation of at least one keyboard, carry out corresponding action with relative control display device.
Another object of the present invention is providing a kind of control chip, its reflected light signal of pointing by analysis is to detect contact condition, finger displacement and user's physiological characteristic, and generate the numerical digit signal according to the mode of operation of at least one keyboard, use output is encoded, sort and/or compress this finger information, physiologic information and numerical digit signal message.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user's physiological characteristic, and has the mechanism of eliminating the environment light source impact.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user's physiological characteristic, and has the mechanism that reduces interference.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user's physiological characteristic, namely enters park mode after idle Preset Time.
Another object of the present invention is providing a kind of Keysheet module and display system, and it can detect contact condition, finger displacement and user's physiological characteristic, can give up physiological characteristic when the finger displacement is too large.
For reaching above-mentioned purpose, the invention provides a kind of Keysheet module, in order to detect and to export physiological characteristic and the numerical digit signal of finger.This Keysheet module comprises a plurality of keyboards, the first light source, secondary light source, light source control unit, at least one imageing sensor and processing unit.This first light source sends the light of the first wavelength and points to this.This secondary light source sends the light of second wave length and points to this.This light source control unit control this first light source and this secondary light source luminous.This imageing sensor reaches with many first image picture frames that generate relative this first light source igniting many second image picture frames that relative this secondary light source is lighted with the reflected light that sampling frequency receives from this finger.This processing unit calculates this physiological characteristic and generates this numerical digit signal according to the mode of operation of described keyboard according to described the first image picture frame and described the second image picture frame.
According to another characteristics of the present invention, the Keysheet module that the present invention also provides a kind of user of confession to control.This Keysheet module comprises a plurality of keyboards, optics finger navigation, communications protocol unit and transmission interface.Described keyboard is in order to trigger the numerical digit signal.Physiological characteristic and the finger displacement of this optics finger navigation in order to detect this user.This communications protocol unit is in order to encode, to sort and to compress at least wherein a kind of processing for this numerical digit signal, this physiological characteristic and this finger displacement.This numerical digit signal, this physiological characteristic and this finger displacement that this transmission interface was processed in order to output.
According to another characteristics of the present invention, the present invention also provides a kind of picture system, comprises display device and Keysheet module.This display device is in order to show image.This Keysheet module output digit signal and physiological characteristic are to this display device, to control this display device according to the shown image of this numerical digit signal update and to show this physiological characteristic.
In the embodiment of the present invention, every this first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, and this mean flow rate of using independent component analytic approach or blind source separation method to analyze this every part of described the first image picture frame changes in the hope of the first brightness; Every this second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, this mean flow rate of using independent component analytic approach or blind source separation method to analyze this every part of described the second image picture frame changes in the hope of the second brightness; And change and this second brightness change calculations physiological characteristic according to this first brightness.
In Keysheet module of the present invention and picture system, described physiological characteristic comprises blood oxygen concentration and Pulse Rate.The present invention can eliminate the mobile signal that causes of finger and disturb by coming separate mobile information and physiologic information with independent component analytic approach or blind source separation method.
Description of drawings
Fig. 1 is the schematic diagram of the intensity variation of blood oxygen saturation penetrating light that instrument detects;
Fig. 2 A is the schematic diagram of the display system of one embodiment of the invention;
Fig. 2 B is the schematic diagram of optics finger navigation of the Keysheet module of one embodiment of the invention;
Fig. 2 C is the calcspar of the display system of one embodiment of the invention;
Fig. 3 is the schematic diagram of the image picture frame that obtains of the imageing sensor of optics finger navigation of the Keysheet module of one embodiment of the invention;
Fig. 4 is the imageing sensor of optics finger navigation of the Keysheet module of the embodiment of the present invention, and wherein light filter system is arranged at part sensing face the place ahead;
Fig. 5 is in the optics finger navigation of Keysheet module of the embodiment of the present invention, the schematic diagram of Image Acquisition and light source luminescent;
Fig. 6 is the processing unit separate mobile information of Keysheet module of the embodiment of the present invention and the schematic diagram of physiologic information;
Fig. 7 is the process flow diagram of the physiological characteristic detection method of the embodiment of the present invention;
Fig. 8 is the schematic diagram of optics finger navigation of the Keysheet module of another embodiment of the present invention.
Description of reference numerals
1 Keysheet module 10 keyboards
111,112 light sources 12,12 ' light guide
13,13 ' touching control 13S touch surface
14 imageing sensor 14f light filters
151 finger detecting unit 152 keyboard detection unit
16 light source control unit 17 communications protocol unit
18 transmission interface 2 display device
20 word 21 cursors
22 host apparatus 23 represent the unit
9 finger 9S finger surfaces
I
1-I
2NImage picture frame B
1-B
2N, B
1'-B
2N' mean flow rate
S
11-S
15Step
Embodiment
In order to allow above and other purpose of the present invention, feature and the advantage can be more obvious, hereinafter will coordinate appended diagram, be described in detail below.In explanation of the present invention, identical member is with identical symbolic representation, first illustrates at this.
Shown in Fig. 2 A, the schematic diagram that it shows the picture system of the embodiment of the present invention comprises Keysheet module 1 and display device 2.This display device 2 for example can be TV, projection screen, game machine screen, computer screen or other are in order to show the display device of image.This Keysheet module 1 is in order to control in these display device 2 update displayed perhaps image and to show physiological characteristic; Wherein, this Keysheet module 1 can couple this display device 2 wired or wirelessly.This Keysheet module 1 is in order to detect and to export physiological characteristic, contact condition, finger displacement and numerical digit signal to this display device 2.
This Keysheet module 1 comprises a plurality of keyboards 10, optics finger navigation and transmission interface 18, wherein this optics finger navigation comprises touching control and controls for pointing in upper, and this touching control can be incorporated into described keyboard 10 one of them (for example being shown as 13) or be independent of that it is outer (for example be shown as 13 ').Described keyboard 10 triggers the numerical digit signal in order to the mode of operation (pressed state) according to the user, such as generating the relevant numerical digit signal such as different resistance values, magnitude of voltage, concussion frequency by pressing at least one keyboard; Wherein this numerical digit signal is such as being the general keyboard exporter of institute such as word 20, numeral, symbol and/or control signal.In order to the contact condition, displacement and this user's that detect user finger physiological characteristic, wherein this physiological characteristic is such as comprising blood oxygen concentration and Pulse Rate etc. for this optics finger navigation.In the present embodiment, when this optics finger navigation judges that this contact condition for the contact attitude, carries out the detection of this displacement and this physiological characteristic soon.18 of this transmission interfaces are sent to this display device 2 with this numerical digit signal, contact condition, displacement and physiological characteristic wired or wirelessly, so that this display device 2 shows image according to this numerical digit signal update, and show this displacement and physiological characteristic.
Shown in Fig. 2 B, the schematic diagram of the optics finger navigation of the Keysheet module 1 of its demonstration embodiment of the present invention, it comprises two light sources 111 and 112, light guide 12 (number of light guide is only for exemplary), touching control 13, imageing sensor 14, processing unit 15 and light source control unit 16 herein.Should be noted that, in Fig. 2 B, the spatial relationship of each member is only exemplary, is not to limit the present invention.Described light source 111 and 112 for example can be light emitting diode or laser diode, in order to generate respectively different wave length to finger surface 9S, described wavelength is preferably two wavelength that general blood oxygen instrument uses, for example approximately ruddiness of 660 nanometers and the approximately infrared light of 905,910 or 940 nanometers.Scrutable is that wavelength described herein refers to the centre wavelength of light source luminescent spectrum.
This light guide 12 is in order to guide to this touching control 13 with described light source 111 and 112 light that send; Wherein, as long as this light guide 12 can guide described light source 111 and 112 light that send to this touching control 13, its structure, number and leaded light mode there is no specific limited.In other embodiment, if the light that described light source 111 and 112 sends can be directly into being incident upon this touching control 13, this light guide 12 also may be implemented.
This touching control 13 has touch surface 13S to be controlled thereon for this finger 9, and this touching control 13 is better is transparent with respect to described light source 111 and 112 light that send; Wherein work as this touching control 13 and be incorporated into key board 10,10 better relatively described light sources 111 of this key board and 112 light that send are transparent.When this finger 9 came close to or in contact with the touch surface 13S of this touching control 13, described light source 111 and 112 light that send were reflected.Scrutable is that the area of this touch surface 13S can be greater than or less than this finger surface 9S, there is no specific limited.
This imageing sensor 14 receives reflected light from this touching control 13 (this finger surface 9S) to generate many image picture frames (each image picture frame for example has 16 * 16 pixels) with sampling parameters; Wherein this sampling parameters is such as comprising time shutter, image gain (can be the gain of analogy gain or numerical digit) etc.This imageing sensor 14 is preferably active array-type imageing sensor, for example cmos image sensor.
This processing unit 15 generates corresponding numerical digit signal according to the mode of operation of described keyboard 10, and detects contact condition, displacement and this user's of relative this touch surface 13S of this finger 9 physiological characteristic according to many image picture frames that this imageing sensor 14 is exported.This numerical digit signal, contact condition, displacement and the physiological characteristic that this processing unit 15 is tried to achieve for example can be transferred into wired or wirelessly has at least one display device that represents the unit to show or corresponding control; Wherein, this expression unit for example can be display, cresset, seven bytes and shows and/or audio units.This display device can be portable electronic devices or household electronic device.
This light source control unit 16 couples this processing unit 15, obtains the described light source 111 and 112 of control with the image picture frame that coordinates this imageing sensor 14 luminous, after its embodiment will be specified in.
In the present embodiment, described light source 111 and 112, this imageing sensor 14, this processing unit 15 and this light source control unit 16 are as optics finger navigation, in order to contact condition, displacement and the physiological characteristic that detects and export this finger 9.
Shown in Fig. 2 A to 2C, Fig. 2 C is the calcspar of the display system of the embodiment of the present invention.Keysheet module 1 comprises a plurality of keyboards 10, the first light source 111, secondary light source 112, this imageing sensor 14, this processing unit 15, this light source control unit 16, communications protocol unit 17 and transmission interface 18, and wherein this Keysheet module 1 and host apparatus 22 and expression unit 23 form display systems.Because this processing unit 15 is to carry out multi-functional computing, its can comprise finger detecting unit 151 in order to this contact condition of detecting relative this touch surface 13S of this finger 9, point displacement and physiological characteristic, and comprise keyboard detection unit 152 and generate and export this numerical digit signal in order to the mode of operation (pressed state) according to described keyboard 10; That is this processing unit 15 can be single element or is divided into two unit.
This first light source 111 for example sends wavelength and is about the ruddiness of 660 nanometers to this finger 9; This secondary light source 112 for example sends wavelength and is about the infrared light of 905,910 or 940 nanometers to this finger 9; In a broad sense, this first light source 111 and this secondary light source 112 can send respectively the light of two wavelength that general blood oxygen instrument uses.These light source control unit 16 these first light sources 111 of control and this secondary light source 112 are luminous.This imageing sensor 14 receives from this first light source 111 of this finger surface 9S and the reflected light of this secondary light source 112.Encode, sort in order to this numerical digit signal, contact condition, displacement and the physiological characteristic of trying to achieve for this processing unit 15 and/or compress and export this transmission interface 18 to after at least a routine processes and transmit in this communications protocol unit 17.This transmission interface 18 for example can be PS2 interface, USB interface, blue tooth interface or other keyboards transmission interface applicatory, in order to will encode, sort and/or compress after this numerical digit signal, contact condition, displacement and the physiological characteristic mode by wired or wireless transmission transfer to outside host apparatus 22; Wherein, wired and Radio Transmission Technology has been known, therefore repeat no more in this.This host apparatus 22 is coupled to have at least one this display device 2 that represents unit 23, in order to control this display device 2 by these expression unit 23 demonstrations and/or to respond this numerical digit signal, contact condition, displacement and the physiological characteristic that receives.This host apparatus 22 can be incorporated in this expression unit 23 to form a display device or to be independent of outside it.
The Keysheet module 1 of the embodiment of the present invention can be arranged in pairs or groups and be had the display device 2 of expression unit 23, allow the user control cursor, executive software and picture disply on this expression unit 23 by this Keysheet module 1, and (numerical value that depends on physiological characteristic) propose to warn when physiological characteristic shows tired or excited state to the user; Wherein, the mode that the mode of expression physiological characteristic and caution for example can utilize software to carry out picture disply, cresset demonstration or sound demonstration is reached, and there is no specific limited.This display device 2 is such as can be according to this numerical digit signal image switching, displaying symbol, image update, adjustment display parameter etc.; Control the cursor action according to this displacement; Show this physiological characteristic and generate alert status when this physiological characteristic exceeds preset value,, image insertion dimmed such as picture, auditory tone cues etc., but do not limit with this.
In an embodiment, this Keysheet module 1 also can use two imageing sensors to detect respectively described light source 111 and 112 different wave lengths that generate (being that imageing sensor 14 is replaced by two imageing sensors), and one of them imageing sensor or two imageing sensors can arrange the spectrum that bandpass optical filter (bandpass filter) selects institute's wish to receive.
Because this processing unit 15 (keyboard detection unit 152) has been known according to the mode that described keyboard 10 generates the numerical digit signals, therefore repeat no more in this.The mode of below only calculating this contact condition, finger displacement and physiological characteristic for this processing unit 15 (finger detecting unit 151) is elaborated; That is the action of the optics finger navigation that below only forms for described light source 111 and 112, this imageing sensor 14, this processing unit 15 (finger detecting unit 151) and this light source control unit 16 in the explanation describes.
Sampling mechanism
The optics finger navigation of the present embodiment is to use two light sources 111 and 112 also to carry out simultaneously two kinds of functions; Wherein, the measuring ability of contact condition and displacement does not limit the image picture frame that uses specific wavelength, and the image picture frame that the detection of physiological characteristic function must corresponding different wave length calculates respectively.Below at first key diagram is machine-processed as the sampling of picture frame.
In an embodiment, these light source control unit 16 these first light sources 111 of control and secondary light source 112 are luminous in turn, 14 of this imageing sensors with at a high speed and fixing sampling frequency (for example per second 3,000) synchronously this first light source 111 or lighting of this secondary light source 112 are obtained the image picture frame, and output many image picture frame I as shown in Figure 3
1-I
5... to this processing unit 15 (finger detecting unit 151), wherein said image picture frame I
1-I
6... comprise the first image picture frame I
1, I
3, I
5..., it is lighting of relative this first light source 111 for example, and the second image picture frame I
2, I
4, I
6..., it is lighting of relative this secondary light source 112 for example.
This processing unit 15 can be according to described the first image picture frame and described the second image picture frame I
1-I
6... judgement contact condition and displacement calculating amount, for example judge according to the brightness of described the first image picture frame and described the second image picture frame and the comparative result of at least one threshold value whether this finger 9 comes close to or in contact with this touch surface 13S, wherein when the brightness of described image picture frame is greater than or less than this at least one threshold value, i.e. judgement enters the contact attitude; After entering the contact attitude, this processing unit 15 can be according to this displacement of correlation calculations between two the first image picture frames, first image picture frame and second image picture frame or two the second image picture frames.Should be noted that, be to utilize the catoptrical image picture frame of corresponding two different wave lengths to judge the running of contact condition and displacement calculating amount in the present embodiment, and be different from traditional guider.
This processing unit 15 is according to described the first image picture frame I
1, I
3, I
5... the brightness that calculates described the first image picture frame changes, and according to described the second image picture frame I
2, I
4, I
6... the brightness that calculates described the second image picture frame changes (in rear detailed description), and calculates respectively according to this two kinds of absorbed ratios of spectrum to obtain band oxygen protoheme concentration HbO
2And deoxygenated blood red pigment concentration Hb, utilize at last the blood oxygen concentration formula to calculate blood oxygen concentration; And by the brightness variation of described the first image picture frame and/or described the second image picture frame and the comparative result calculating Pulse Rate of at least one threshold value.
In another embodiment, the image picture frame that these light source control unit 16 these first light sources 111 of control and this secondary light source 112 are synchronized with this imageing sensor 14 obtains simultaneously luminous; That is this moment, this imageing sensor 14 can receive the reflected light of two kinds of wavelength simultaneously.Therefore, in this embodiment, a part of the place ahead of the sensing face 14S of this imageing sensor 14 preferably also arranges light filter 14f (as shown in Figure 4), wherein this light filter 14f can be bandpass optical filter so that the part sensing face 14S at this light filter 14f rear only can this first light source 111 of sensing spectrum or the spectrum of this secondary light source 112 so that this processing unit 15 can be differentiated the first image picture frame (the parts of images picture frame of this first light source 111 relatively) and the second image picture frame (the parts of images picture frame of this secondary light source 112 relatively).Scrutable is that in the present embodiment, the setting position of this light filter 14f and area are not limited to shown in Figure 4.
By this, this processing unit 15 equally can be according to described the first image picture frame and described the second image picture frame I
1-I
6... calculate a contact condition and displacement; And can be according to described the first image picture frame I
1, I
3, I
5... the brightness that calculates described the first image picture frame changes and according to described the second image picture frame I
2, I
4, I
6... the brightness that calculates described the second image picture frame changes, and according to the relation that two brightness change calculate blood oxygen concentration and Pulse Rate at least one of them.
Scrutablely be, because this imageing sensor 14 may have different light receiving efficiencies to different wave length, perhaps the luminosity of this first light source 111 and this secondary light source 112 is incomplete same, therefore goodly in dispatching from the factory before, this Keysheet module 1 adjusts (sampling parameters such as time shutter of the relative different wave length image picture frame of adjustment, image gain) for the brightness of 14 detected image picture frames of this imageing sensor, so that the initial pictures picture frame that this imageing sensor 14 obtains has roughly the same brightness, to eliminate the disconnected possibility of erroneous judgement.
The spirit of the present embodiment is, luminous with these light source control unit 16 these first light sources 111 of control and this secondary light source luminous 112, make this imageing sensor 14 reach with many first image picture frames that generate relative this first light source igniting many second image picture frames that relative this secondary light source is lighted with the reflected light that sampling frequency receives from this finger 9; 15 of this processing units calculate this contact condition, finger displacement and physiological characteristic according to described the first image picture frame and the second image picture frame.
Elimination surround lighting mechanism
In Fig. 2 B, because this contact element 13 is transparent, pointing simultaneously 9 can printing opacity, and the surround lighting of this Keysheet module 1 outside can be had influence on by these imageing sensor 14 receptions the image quality that it obtains the image picture frame by this finger 9 and contact element 13 (13 ').In the present embodiment, this light source control unit 16 can control this first light source 111 and this secondary light source 112 is not luminous during part.
For example please refer to shown in Figure 5ly, it shows the Image Acquisition of this imageing sensor 14 and the luminous situation of this first light source 111 and this secondary light source 112; Wherein, solid arrow represents light source igniting (or lighting with the first brightness) and the dotted line arrow represents that light source extinguishes (or lighting with the second brightness), and this second brightness is for example less than this first brightness.Fig. 5 (A) shows that this imageing sensor 14 continues to obtain the image picture frame with fixing sampling frequency.Fig. 5 (B) shows that this first light source 111 and this secondary light source 112 are that simultaneously the place is bright and extinguish in turn, so 14 of this imageing sensors can get bright image picture frame (light source igniting or light with this first brightness) and dark image picture frame (light source extinguishes or lights with this second brightness) in turn.Fig. 5 (C) shows that this first light source 111 and this secondary light source 112 light once simultaneously every two image picture frames, and it has the situation of low displacement usually with respect to this finger 9.As previously mentioned, when this first light source 111 and this secondary light source 112 are lighted simultaneously (Fig. 5 (B) and (C)), this imageing sensor 14 comprises light filter 14f with the image picture frame of space region every Different Light, but but so that the reflected light of this first light source 111 of part sensing of this imageing sensor 14 and the reflected light of this secondary light source 112 of another part sensing.
During when these finger 9 contacts or near this touch surface 13S, the bright image picture frame that obtains during with respect to light source igniting comprises (finger reflected light+parasitic light+surround lighting), the dark image picture frame that obtains when not lighting with respect to light source only comprises (surround lighting), if therefore bright image picture frame is deducted dark image picture frame, can effectively eliminate the impact of surround lighting.15 of this processing units can calculate according to the difference image picture frame of bright dark image picture frame this contact condition, finger displacement and physiological characteristic.
Shown in Fig. 5 (D), it shows that this first light source 111 and this secondary light source 112 are embodiments of lighting in turn.In this embodiment, owing to will making this imageing sensor 14 get dark image picture frame, therefore this light source control unit 16 is controlled this first light source 111 and this secondary light source 112 image picture frame alternately of being separated by and is lighted, and for example two light sources are not all lighted when the time td of Fig. 5 (D).By this, 15 of this processing units can calculate difference the first image (bright the first image picture frame-dark image picture frame) and difference the second image (bright the second image picture frame-dark image picture frame), and calculate this contact condition, finger displacement and physiological characteristic according to described difference image.As previously mentioned, when this first light source 111 and this secondary light source 112 were lighted in turn, this imageing sensor 14 separated image picture frame with respect to Different Light with the time.
The spirit of the present embodiment is, make this light source control unit 16 control this first light source 111 and 112 whiles or luminous in turn of this secondary light source, and make this imageing sensor 14 can get the dark image picture frame of described light source when not luminous, and the difference image by calculating bright dark image is to eliminate the impact of surround lighting.Therefore, the luminous situation of each light source shown in Fig. 5 is only exemplary, is not to limit the present invention.
Noise reduction mechanism
Can exist in the image picture frame that obtains due to this imageing sensor 14 and disturb, and disturb and usually be distributed in the image picture frame that is obtained in random mode, therefore the present embodiment can further advance to calculate that M opens the image picture frame and improve signal to noise ratio (S/N ratio) (SNR), to increase the degree of accuracy of calculating physiological characteristic; For example, every 10 image picture frames are carried out addition, and 10 image picture frames of two groups of additions can repeat partly or not repeat fully.Scrutablely be, when this first light source 111 and this secondary light source 112 are when lighting in turn, the image picture frame of the present embodiment and be respectively described the first image picture frame (I of Fig. 3 for example
1+ I
3+ I
5...) and and described the second image picture frame (I of Fig. 3 for example
2+ I
4+ I
6...) and, this is owing to must calculating respectively two groups of intensity variation.Yet, when this first light source 111 and this secondary light source 112 are to light simultaneously, the image picture frame of the present embodiment and be the continuous image picture frame (I of Fig. 3 for example
1+ I
2+ I
3+ I
4+ I
5+ I
6...), and by aftertreatment with space region every mode differentiate two groups of intensity variation.In addition, when coordinating above-mentioned elimination surround lighting mechanism, the image picture frame of the present embodiment and be the difference image picture frame with; That is, execute to eliminate and then carry out noise reduction process after surround lighting is processed.In other embodiment, also can only carry out eliminate that surround lighting is processed and noise reduction process one of them.
As previously mentioned, this imageing sensor 14 might obtain image with different sampling parameters under different condition, for example this imageing sensor 14 may have different absorptivities with respect to different wave length, therefore may make described the first image picture frame and described the second image picture frame have roughly the same brightness with sampling parameters such as different time shutter and image gains, can correctly carry out aftertreatment according to described image picture frame, that is the sampling parameters of this first image picture frame and the second image picture frame may be not identical relatively.In order to get rid of the impact of different sampling parameters, every image picture frame or M can be opened the image picture frame and or on average divided by sampling parameters to carry out normalized, for example (M open the image picture frame and/sampling parameters) or (M open the image picture frame average/sampling parameters); Wherein, M is positive integer.
Physiological characteristic is calculated
When lighting with respect to Different Light, the image picture frame that this imageing sensor 14 obtains includes physiologic information and finger mobile message simultaneously.Therefore, this processing unit 15 in the present embodiment (maybe should point detecting unit 151) at first needs after two kinds of information separated, can correctly calculate physiological characteristic; That is this processing unit 15 for example adopts independent component analytic approach (Independent Component Analysis, ICA) or blind source separation method (Blind Source Separation, BSS) with two kinds of information separated.
Shown in Fig. 3 and 6, with the first image picture frame I described in Fig. 3
1, I
3, I
5... be example, with many first image picture frames (the first image picture frame of can be the original image picture frame, processing through eliminating surround lighting mechanism and/or noise reduction mechanism) or many first image picture frames and (M open the original image picture frame and, through elimination M that surround lighting mechanism and/or noise reduction mechanism processed open the first image picture frame and) every image picture frame or the image picture frame be divided at least two parts and also try to achieve respectively mean flow rate, for example with image picture frame I
1Being divided into mean flow rate is B
1And B
1' two parts; With image picture frame I
3Being divided into mean flow rate is B
3And B
3' two parts; ...; With image picture frame I
2N-1Being divided into mean flow rate is B
2N-1And B
2N-1' two parts (in other embodiment can more than two parts).Then, utilize independent component analytic approach or blind source separation method to isolate the first mobile message and the first physiologic information (as shown in Figure 6), it all is shown as brightness and changes line style.The present embodiment is mobile message is given up and utilized the brightness variation line style of physiologic information to calculate physiological characteristic.Scrutablely be that because the sampling frequency of this imageing sensor 14 is far longer than pulse frequency, therefore the isolated physiologic information of institute can demonstrate light intensity with the line style (similar Fig. 1) of pulse variation; Isolated mobile message distributes and does not limit person as shown in Figure 6.In addition, two parts cutting apart of described image picture frame are not defined as up and down two parts.In addition, due to the physiologic information that must calculate respectively relative two different wave lengths, above-mentioned separable programming is respectively for the first image picture frame I
1, I
3, I
5... (corresponding the first light source igniting) and the second image picture frame I
2, I
4, I
6... (corresponding secondary light source is lighted) carries out.Described the second image picture frame (I
2, I
4, I
6...) also be separated into the brightness such as the second mobile message and the second physiologic information and change, and give up the second mobile message and only utilize the brightness of the second physiologic information to change.Should be noted that, when utilize the image picture frame and or when on average carrying out information separated, the I in Fig. 6
1-I
2N-1And I
2-I
2NEach all represent M open the image picture frame and, average or its normalized result.
It must be emphasized that, the contact condition of this finger 9 and displacement are directly to be tried to achieve according to described the first image picture frame and the second image picture frame by this processing unit 15, do not need to use the first mobile message and the second mobile message after separation.Independent component analytic approach or blind source separation method mainly in order to mixed signal is separated, after isolated mobile message is given up, can be eliminated the mobile signal that causes of finger and disturb.
In the present embodiment, this processing unit 15 also calculates Pulse Rate according to the comparative result of at least one threshold value and this first brightness variation and/or this second brightness variation.
Park mode
The Keysheet module 1 of the embodiment of the present invention can enter park mode after idle Preset Time.For example, when this processing unit 15 judges that in Preset Time this finger 9 does not come close to or in contact with this touch surface 13S, can enter park mode.In park mode, for example can suspend the Image Acquisition of this imageing sensor 14 and suspend the luminous of described light source 111 and 112.
Physiological characteristic is given up mechanism
The processing unit 15 of the Keysheet module 1 of the embodiment of the present invention is displacement calculating amount and physiological characteristic simultaneously, yet accurate physiological characteristic calculating is preferably in the lower situation of displacement.Therefore, the present embodiment can judge in advance that whether the finger displacement is greater than preset value, if should point displacement greater than this preset value, the image picture frame that obtains of this imageing sensor 14 is not only in order to displacement calculating amount and judgement contact condition and in order to calculate physiological characteristic, even perhaps calculate physiological characteristic also without these communications protocol unit 17 processing or 18 transmission of this transmission interface, and directly it given up.This preset value determines according to practical application, such as, but not limited to, determining according to the size of sensing face 14S and/or search frame.
This Keysheet module 1 detects the method for physiological characteristic according to the reflected light of finger surface 9S, comprise the following step: provide the light of the first wavelength and second wave length to finger surface (step S
11); The reflection of light light that obtains this first wavelength with the reflection of light light that generates many first image picture frames and obtain this second wave length to generate many second image picture frame (step S
12); Every this first image picture frame and every this second image picture frame are divided into two parts at least and try to achieve mean flow rate (the step S of every part
13); This mean flow rate of utilizing independent component analytic approach or blind source separation method to analyze this every part of described the first image picture frame changes in the hope of the first brightness and this mean flow rate of analyzing this every part of described the second image picture frame changes (step S in the hope of the second brightness
14); And try to achieve physiological characteristic (step S according to this first brightness variation and this second brightness variation
15).Before the embodiment of each step of the present embodiment has been specified in, therefore repeat no more in this.
In another embodiment, the part of described light source 111 and 112, this imageing sensor 14, this processing unit 15, this light source control unit 16, this communications protocol unit 17 and this transmission interface 18 or whole element also can be made as control chip or packaging body, as shown in Figure 8.This control chip or packaging body be in order to the mode of operation that detects described keyboard 10 and contact condition, displacement and the physiological characteristic of this finger 9, and export this contact condition, displacement, physiological characteristic and the numerical digit signal of encoded, sequence and/or compression; Wherein calculate the mode of this contact condition, displacement and physiological characteristic as previously mentioned, therefore repeat no more in this.Scrutablely in addition be, in Fig. 8 in this optics finger navigation the configuration mode of each element be only exemplary, be not to limit the present invention.In other embodiment, described compression is processed also can arrange the compression unit execution in addition.
In sum, the given key disk module also can't detect user's physiological characteristic, and the mode of blood oxygen instrument calculating blood oxygen concentration is incompatible on Keysheet module because having the factors such as detected part that can't judge in moving.Therefore, the present invention also provides a kind of Keysheet module and display system (Fig. 2 A to 2C), and wherein this Keysheet module can detect finger information and keypad information simultaneously, and the control display device is according to this keypad information update displayed content and show this finger information.The Keysheet module of various embodiments of the present invention can detect user's physiological characteristic when detecting the finger displacement, and can effectively eliminate the mobile signal that causes of finger and disturb and eliminate the environment light source impact, and have park mode and give up the mechanism of physiologic information.
Although the present invention is open with previous embodiment, so it is not to limit the present invention, any persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when doing various changes and modification.Therefore protection scope of the present invention is as the criterion when looking accompanying the claim person of defining.
Claims (20)
1. Keysheet module, in order to detect and to export physiological characteristic and the numerical digit signal of finger, described Keysheet module comprises:
A plurality of keyboards;
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor, the reflected light that receives from described finger with sampling frequency reaches with many first image picture frames that generate relatively described the first light source igniting many second image picture frames that relatively described secondary light source is lighted; And
Processing unit calculates described physiological characteristic and generates described numerical digit signal according to the mode of operation of described keyboard according to described the first image picture frame and described the second image picture frame.
2. Keysheet module according to claim 1, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
3. Keysheet module according to claim 1 and 2, wherein said physiological characteristic comprises blood oxygen concentration and/or Pulse Rate.
4. Keysheet module according to claim 2, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result of described the second brightness in changing calculates Pulse Rate.
5. Keysheet module according to claim 1, wherein said processing unit also compares to judge contact condition to brightness and at least one threshold value of described the first image picture frame and described the second image picture frame.
6. Keysheet module according to claim 1, wherein said processing unit is also according to two described the first image picture frames, described first an image picture frame and described second an image picture frame, two described the second image picture frame displacement calculating amounts.
7. Keysheet module according to claim 1, wherein said light source control unit: control described the first light source and described secondary light source and light in turn so that described imageing sensor receives the reflected light of described the first light source and described secondary light source in turn; Perhaps controlling described the first light source and described secondary light source lights simultaneously so that described imageing sensor receives the reflected light of described the first light source and described secondary light source simultaneously, and described imageing sensor comprises light filter, and this light filter is covered in the part of the sensing face of described imageing sensor.
8. Keysheet module according to claim 1, wherein said the first light source, described secondary light source, described light source control unit, described at least one imageing sensor and described processing unit are packaged into that control chip is encoded to export, described physiological characteristic and the described numerical digit signal of at least a routine processes in sequence and compression.
9. Keysheet module according to claim 1, this Keysheet module also comprises touching control, and this touching control is controlled thereon for described finger; Wherein said touching control is in described keyboard or is independent of outside described keyboard.
10. a Keysheet module, control for the user, and described Keysheet module comprises:
A plurality of keyboards are in order to trigger the numerical digit signal;
Optics finger navigation is in order to physiological characteristic and the finger displacement that detects described user;
The communications protocol unit, in order to encode, sort for described numerical digit signal, described physiological characteristic and described finger displacement and compress at least a processing; And
Transmission interface is in order to export described numerical digit signal, described physiological characteristic and the described finger displacement of processing.
11. Keysheet module according to claim 10, wherein said optics finger navigation also comprises:
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor, the reflected light that receives from described finger with sampling frequency reaches with many first image picture frames that generate relatively described the first light source igniting many second image picture frames that relatively described secondary light source is lighted; And
Processing unit calculates and exports described physiological characteristic and described finger displacement according to described the first image picture frame and described the second image picture frame.
12. Keysheet module according to claim 11, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
13. Keysheet module according to claim 12, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result of described the second brightness in changing calculates Pulse Rate.
14. Keysheet module according to claim 11, wherein said processing unit also compare to judge contact condition to brightness and at least one threshold value of described the first image picture frame and described the second image picture frame.
15. a display system, this display system comprises:
Display device is in order to show image; And
Keysheet module, output digit signal and physiological characteristic are to described display device, to control described display device according to the shown image of described numerical digit signal update and to show described physiological characteristic.
16. display system according to claim 15, wherein when described physiological characteristic exceeded preset value, described display device generated alert status.
17. display system according to claim 15, wherein said Keysheet module also comprises:
A plurality of keyboards;
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor, the reflected light that receives from described finger with sampling frequency reaches with many first image picture frames that generate relatively described the first light source igniting many second image picture frames that relatively described secondary light source is lighted; And
Processing unit calculates described physiological characteristic and generates described numerical digit signal according to the mode of operation of described keyboard according to described the first image picture frame and described the second image picture frame.
18. display system according to claim 17, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
19. display system according to claim 17, wherein said processing unit is also according to two described the first image picture frames, described first an image picture frame and described second an image picture frame, two described the second image picture frame displacement calculating amounts, the described displacement of described Keysheet module output to described display device with the shown cursor of the described display device of relative control.
20. display system according to claim 17, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result of described the second brightness in changing calculates Pulse Rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110386717.0A CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110386717.0A CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103135772A true CN103135772A (en) | 2013-06-05 |
| CN103135772B CN103135772B (en) | 2016-06-01 |
Family
ID=48495704
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110386717.0A Active CN103135772B (en) | 2011-11-29 | 2011-11-29 | Keysheet module and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103135772B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109062419A (en) * | 2018-08-09 | 2018-12-21 | 郑州大学 | A kind of laser projection virtual keyboard of optimization |
| CN113934308A (en) * | 2020-07-14 | 2022-01-14 | 致伸科技股份有限公司 | Keyboard device with physiological parameter detection function |
| CN114343597A (en) * | 2021-12-29 | 2022-04-15 | 北京小米移动软件有限公司 | Physiological parameter monitoring method and device, keyboard, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| CN101605495A (en) * | 2006-11-23 | 2009-12-16 | 英戈·弗洛尔 | Medical measuring device |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
| WO2010106826A1 (en) * | 2009-03-19 | 2010-09-23 | 株式会社 島津製作所 | Photobiological measuring device and analyzing method |
-
2011
- 2011-11-29 CN CN201110386717.0A patent/CN103135772B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101605495A (en) * | 2006-11-23 | 2009-12-16 | 英戈·弗洛尔 | Medical measuring device |
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| WO2010106826A1 (en) * | 2009-03-19 | 2010-09-23 | 株式会社 島津製作所 | Photobiological measuring device and analyzing method |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109062419A (en) * | 2018-08-09 | 2018-12-21 | 郑州大学 | A kind of laser projection virtual keyboard of optimization |
| CN113934308A (en) * | 2020-07-14 | 2022-01-14 | 致伸科技股份有限公司 | Keyboard device with physiological parameter detection function |
| CN114343597A (en) * | 2021-12-29 | 2022-04-15 | 北京小米移动软件有限公司 | Physiological parameter monitoring method and device, keyboard, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103135772B (en) | 2016-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10382854B2 (en) | Near field gesture control system and method | |
| TWI474215B (en) | Keyboard module and display system | |
| TWI476641B (en) | Remote controller and display system | |
| TWI438658B (en) | User interface system and optical finger mouse system | |
| TWI489325B (en) | Optical finger mouse, electronic device and physiological characteristic detection device | |
| TWI475193B (en) | Optical distance measurement system and operation method thereof | |
| TWI451295B (en) | Optical finger mouse, mouse control module and physiological characteristic detection method thereof | |
| KR20160117479A (en) | Motion gesture input detected using optical sensors | |
| CN103425852A (en) | User recognition method, physiological detection device and physiological detection method | |
| EP3019937B1 (en) | Gesture-sensitive display | |
| CN103034342B (en) | Optics finger navigation, electronic installation and physiological characteristic pick-up unit | |
| CN103135772A (en) | Keyboard module and display system | |
| CN104731317B (en) | Guider and image display system | |
| CN103135801B (en) | Human-computer interface system and finger mouse system | |
| WO2017107813A1 (en) | Control apparatus of smart device, smart device, and method and apparatus for operation control | |
| CN103123542B (en) | Optical mouse and method of operating thereof | |
| CN103135800B (en) | Optics finger navigation, mouse control module and physiological characteristic detection method thereof | |
| GB2598812A (en) | Methods and systems for feature operational mode control in an electronic device | |
| CN103126686A (en) | Optical ranging system and operation method thereof | |
| CN103136919B (en) | Remote control and display system | |
| CN106155320B (en) | A kind of car-mounted terminal control method and its device based on gesture identification | |
| CN106325610B (en) | Touch control display system, touch device and touch control display method | |
| CN107704107A (en) | Physiology detection apparatus and its operating method | |
| US20240192763A1 (en) | Electronic device for controlling a user interface via a biometric sensor and control method using the same | |
| WO2022206548A1 (en) | Electronic device and biological detection control method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |