CN103136919A - Remote control and display system - Google Patents
Remote control and display system Download PDFInfo
- Publication number
- CN103136919A CN103136919A CN2011103949039A CN201110394903A CN103136919A CN 103136919 A CN103136919 A CN 103136919A CN 2011103949039 A CN2011103949039 A CN 2011103949039A CN 201110394903 A CN201110394903 A CN 201110394903A CN 103136919 A CN103136919 A CN 103136919A
- Authority
- CN
- China
- Prior art keywords
- image picture
- light source
- picture frame
- telepilot
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
A remote control comprises a plurality of control buttons, an optical ginger mouse and a transmission interface. The control buttons are used for triggering control signals. The optical ginger mouse is used for detecting physiological features and displacement. The transmission interface is used for outputting the control signals, the physiological feature and the displacement to a display device. The invention further provides a display system.
Description
Technical field
The present invention relates to a kind of human-computer interface system, particularly a kind of telepilot and display system with user's physiological characteristic measuring ability.
Background technology
Optics finger navigation (optical finger mouse, OFM) because volume is little, looks good with usually in other electronic installations.The known optical finger mouse is used the contact condition and the displacement of finger with respect to touch surface of judgement finger for detection of the intensity variation of user's finger surface reflection ray.Yet along with industrialized development, the user uses the time of various electronic installation to increase gradually, even exceeds physical load and unconscious.Therefore, if electronic installation has the function that detects user's physiological characteristic and can show at that time physiological situation, can avoid the situation generation of excessively use.
known blood oxygen saturation instrument (pulse oximeter) utilizes the mode of non-intrusion type to detect user's blood oxygen concentration and Pulse Rate, it can produce red light beam (wavelength is 660 nanometers approximately) and infrared light light beam (wavelength is 910 nanometers approximately) penetrates detected part, and the characteristic of utilizing band oxygen protoheme (oxyhemoglobin) and deoxygenated blood red pigment (Deoxyheamo-globin) to have different absorptivities to special spectrum detects the intensity variation of penetrating light, for example with reference to United States Patent (USP) the 7th, 072, No. 701, title is the monitoring mode (Method for spectro-photometric blood oxygenation monitoring) of blood oxygen concentration.After detecting the intensity variation of penetrating light of two kinds of wavelength, then calculate blood oxygen concentration with following formula
Blood oxygen concentration=100% * [HbO
2]/([HbO
2]+[Hb]);
Wherein, [HbO
2] expression band oxygen protoheme concentration; [Hb] expression deoxygenated blood red pigment concentration.
The light intensity of the penetrating light of the general detected two kinds of wavelength of blood oxygen saturation instrument can present along with heartbeat variation as shown in Figure 1, this be due to blood vessel can along with heartbeat constantly enlargement and contraction make the blood flow volume that light beam passes through change, and then change the absorbed ratio of luminous energy.By this, can calculate blood to the absorptivity of different spectrum according to the intensity information of continuous variation, to calculate respectively the physiologic informations such as band oxygen protoheme concentration and deoxygenated blood red pigment concentration, recycle at last above-mentioned blood oxygen concentration formula and calculate blood oxygen concentration.
Yet, penetrate the intensity variation of light because blood oxygen saturation instrument detects, thereby different light intensity signals can be detected along with different detected part; In addition, when the detected part that detects when blood oxygen saturation instrument is moved, the chaotic waveform of violent change can be detected and can't correctly calculate according to this physiologic information, thus itself and be not suitable for mobile in the electronic installation of operation.
Given this, the present invention proposes a kind of telepilot and display system of the user's of detection physiological characteristic, and wherein said telepilot can effectively be eliminated the mobile signal that causes of finger and disturb when detecting physiological characteristic.
Summary of the invention
The purpose of this invention is to provide a kind of telepilot and display system, the reflected light signal that described telepilot is pointed by analysis is pointed displacement, contact condition and user's physiological characteristic to detect, and produce control signal according at least one mode of operation of controlling button, carry out corresponding action with relative control display device.
Another purpose of the present invention is providing a kind of telepilot control chip, its reflected light signal of pointing by analysis is pointed displacement, a contact condition and user's physiological characteristic to detect one, and produce a control signal according at least one mode of operation of controlling button, use output is encoded, sort and/or compress described finger information, physiologic information and control signal information.
Another purpose of the present invention is to provide a kind of telepilot and display system, and it can detect finger displacement, contact condition and user's physiological characteristic, and has the mechanism of eliminating the environment light source impact.
Another purpose of the present invention is to provide a kind of telepilot and display system, and it can detect finger displacement, contact condition and user's physiological characteristic, and has the mechanism that reduces interference.
Another purpose of the present invention is to provide a kind of telepilot and display system, and it can detect finger displacement, contact condition and user's physiological characteristic, namely enters park mode after idle Preset Time.
Another purpose of the present invention is providing a kind of telepilot and display system, and it can detect finger displacement, contact condition and user's physiological characteristic, can give up physiological characteristic when the finger displacement is too large.
For reaching above-mentioned purpose, the invention provides a kind of telepilot, for detection of also exporting physiological characteristic and the control signal of finger.Described telepilot comprises a plurality of control buttons, the first light source, secondary light source, light source control unit, at least one imageing sensor and processing unit.Described control button is used for Trig control signal.Described the first light source sends the light of the first wavelength to described finger.Described secondary light source sends the light of second wave length to described finger.Described light source control unit described the first light source of control and described secondary light source are luminous.Described imageing sensor receives a plurality of the second image picture frames of lighting with a plurality of the first image picture frames of producing relatively described the first light source igniting and relative described secondary light source from the reflected light of described finger with sampling frequency.Described processing unit calculates described physiological characteristic and produces described control signal according to the mode of operation of described control button according to described the first image picture frame and described the second image picture frame.
According to another characteristics of the present invention, the telepilot that the present invention also provides a kind of user of confession to control.Described telepilot comprises a plurality of control buttons, optics finger navigation and transport interface.Described control button is used for Trig control signal.Described optics finger navigation is for detection of described user's physiological characteristic and finger displacement.Described transport interface is used for exporting described control signal, described physiological characteristic and described finger displacement.
According to another characteristics of the present invention, the present invention also provides a kind of picture system, comprises display device and telepilot.Described display device is used for showing image.Described telepilot output control signal and physiological characteristic are upgraded shown image and show described physiological characteristic according to described control signal to control described display device to described display device.
In embodiment of the present invention, every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, and the described mean flow rate of using independent component analytic approach or blind source separation method to analyze described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of using independent component analytic approach or blind source separation method to analyze described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second brightness change calculations physiological characteristic according to described the first brightness.
In telepilot of the present invention and picture system, described physiological characteristic comprises blood oxygen concentration and Pulse Rate.The present invention can eliminate the mobile signal that causes of finger and disturb by coming separate mobile information and physiologic information with independent component analytic approach or blind source separation method.
Description of drawings
Fig. 1 is the schematic diagram of the intensity variation of blood oxygen saturation penetrating light that instrument detects.
Fig. 2 A is the schematic diagram of the display system of embodiment of the present invention.
Fig. 2 B is the schematic diagram of the telepilot of embodiment of the present invention.
Fig. 2 C is the calcspar of the telepilot of embodiment of the present invention.
Fig. 3 is the schematic diagram of the image picture frame that obtains of the imageing sensor of the telepilot of embodiment of the present invention.
Fig. 4 is the imageing sensor of the telepilot of embodiment of the present invention, and wherein light filter is arranged at part sensing face the place ahead.
Fig. 5 is in the telepilot of embodiment of the present invention, the schematic diagram of Image Acquisition and light source luminescent.
Fig. 6 is the processing unit separate mobile information of telepilot of embodiment of the present invention and the schematic diagram of physiologic information.
Fig. 7 is the process flow diagram of the physiological characteristic detection method of embodiment of the present invention.
Fig. 8 is the schematic diagram of the telepilot of the another embodiment of the present invention.
Description of reference numerals
1 telepilot 10 is controlled button
111,112 light source 12 light guides
13 touching control 13S touch surface
14 imageing sensor 14f light filters
151 finger detecting unit 152 indicative control units
16 light source control unit 17 mnemons
18 transport interface 2 display device
21 cursor 22 control modules
23 represent unit 9 fingers
9S finger surface I
1-I
2NThe image picture frame
B
1-B
2N, B
1'-B
2N' mean flow rate S
11-S
15Step
Embodiment
In order to make above and other purpose of the present invention, feature and advantage more obvious, hereinafter will coordinate accompanying drawing, be described in detail below.In explanation of the present invention, identical member first illustrates at this with identical symbolic representation.
Fig. 2 A is the schematic diagram of the picture system of embodiment of the present invention, comprises telepilot 1 and display device 2.Described display device 2 can be for example TV, projection screen, game machine screen, computer screen or other display device for the demonstration image.The relatively described display device 2 of described telepilot 1 can be the various telepilots such as TV remote controller, projection screen telepilot, game machine telepilot, UltraVNC, is used for controlling in described display device 2 update displayed perhaps image and shows physiological characteristic; Wherein, described telepilot 1 can couple described display device 2 wired or wirelessly.Described telepilot 1 for detection of and export physiological characteristic, contact condition, finger displacement and control signal to described display device 2.
Described telepilot 1 comprises a plurality of control buttons 10, optics finger navigation and transport interface 18, wherein said optics finger navigation comprises touching control 13 to be controlled for pointing in upper, and described touching control 13 can be incorporated into described control button 10 one of them or be independent of outside it.The Trig control signal of pressing that described control button 10 is used for according to the user is such as controlling button to produce the relevant control signal such as different resistance values, magnitude of voltage, concussion frequency by pressing at least one.For detection of contact condition, displacement and the described user's of user finger physiological characteristic, wherein said physiological characteristic is such as comprising blood oxygen concentration and Pulse Rate etc. for described optics finger navigation.In present embodiment, for the contact attitude, just begin to carry out the detection of described displacement and described physiological characteristic when the described contact condition of described optics finger navigation judgement.18 of described transport interface are sent to described display device 2 with described control signal, contact condition, displacement and physiological characteristic wired or wirelessly, so that described display device 2 is according to described control signal update displayed image and show described displacement and physiological characteristic.Scrutable is that although touching control 13 described in Fig. 2 A is arranged at the upper surface of described telepilot 1, in other embodiments, described touching control 13 also can be arranged at lower surface or other positions that is beneficial to finger touch of described telepilot 1, there is no specific limited.
Fig. 2 B is the schematic diagram of the telepilot 1 of embodiment of the present invention, and it comprises a plurality of control buttons 10, two light sources 111 and 112, light guide 12 (number of light guide is only exemplary), touching control 13, imageing sensor 14, processing unit 15, light source control unit 16 and transport interface 18 herein.Should be noted that, in Fig. 2 B, the spatial relationship of each member is only exemplary, is not for limiting the present invention.Described control button 10 is such as, but not limited to, having the functions such as channel selection, parameter adjustment, Array selection, and it is according to mode of operation (pressed state) Trig control signal of finger 9.Described light source 111 and 112 for example can be light emitting diode or laser diode, be used for producing different wave length to finger surface 9S respectively, described wavelength is preferably two wavelength that general blood oxygen instrument uses, for example approximately ruddiness of 660 nanometers and the approximately infrared light of 905,910 or 940 nanometers.Scrutable is that wavelength described herein refers to the centre wavelength of light source luminescent spectrum.
Described light guide 12 is used for described light source 111 and 112 light that send are guided to described touching control 13; Wherein, as long as described light guide 12 can guide light to described touching control 13, its structure, number and leaded light mode there is no specific limited.In other embodiments, if the light that described light source 111 and 112 sends can be incident to described touching control 13, described light guide 12 also may be implemented.
Described touching control 13 has touch surface 13S to be controlled thereon for described finger 9, and described touching control 13 is preferably transparent with respect to described light source 111 and 112 light that send.When described finger 9 came close to or in contact with the touch surface 13S of described touching control 13, described light source 111 and 112 light that send were reflected.Scrutable is that the area of described touch surface 13S can be greater than or less than described finger surface 9S, there is no specific limited.
Described imageing sensor 14 receives reflected light from described touching control 13 (described finger surface 9S) to produce a plurality of image picture frames (the image picture frame for example has 16 * 16 pixels) with sampling parameters; Wherein said sampling parameters is such as comprising time shutter, image gain (can be the gain of analogy gain or numerical digit) etc.Described imageing sensor 14 is preferably active array-type imageing sensor, for example cmos image sensor.
Described processing unit 15 produces corresponding control signal according to the mode of operation of described control button 10, and detects contact condition, displacement and the described user's of the relatively described touch surface 13S of described finger 9 physiological characteristic according to a plurality of image picture frames that described imageing sensor 14 is exported.Described control signal, contact condition, displacement and the physiological characteristic that described processing unit 15 is tried to achieve for example can be transferred into wired or wirelessly has at least one display device that represents the unit to show or corresponding control; Wherein, described expression unit for example can be display, cresset, seven bytes and shows and/or audio units.Described display device can be portable electronic devices or household electronic device.
Described light source control unit 16 couples described processing unit 15, obtains the described light source 111 and 112 of control with the image picture frame that coordinates described imageing sensor 14 luminous, after its embodiment will be specified in.
Described transport interface 18 is transmitted described control signal, contact condition, displacement and physiological characteristic to described display device 2 wired or wirelessly.
In present embodiment, described light source 111 and 112, described imageing sensor 14, described processing unit 15 and described light source control unit 16 are as optics finger navigation, for detection of contact condition, displacement and the physiological characteristic of described finger 9.
With reference to Fig. 2 A to 2C, Fig. 2 C shows the calcspar of the telepilot 1 of embodiment of the present invention, it comprises a plurality of control buttons 10, the first light source 111, secondary light source 112, described imageing sensor 14, described processing unit 15, described light source control unit 16, mnemon 17 and described transport interface 18, and wherein said telepilot 1 is with control module 22 and represent that unit 23 forms display systems.Because described processing unit 15 carries out multi-functional computing, it can comprise finger detecting unit 151 for detection of the described contact condition of the relatively described touch surface 13S of described finger 9, finger displacement and physiological characteristic, and comprises indicative control unit 152 and be used for producing and export described control signal according to the mode of operation (pressed state) of described control button 10; That is described processing unit 15 can be single element or is divided into two unit.
Described the first light source 111 for example sends wavelength and is about the ruddiness of 660 nanometers to described finger 9; Described secondary light source 112 for example sends wavelength and is about the infrared light of 905,910 or 940 nanometers to described finger 9; In a broad sense, described the first light source 111 and described secondary light source 112 can send respectively the light of two wavelength that general blood oxygen instrument uses.Described light source control unit 16 described the first light sources 111 of control and described secondary light source 112 are luminous.Described imageing sensor 14 receives from described the first light source 111 of described finger surface 9S and the reflected light of described secondary light source 112.Described mnemon 17 is used for storing the required various parameter informations of described control signal, contact condition, displacement, physiological characteristic and computation process that described processing unit 15 is tried to achieve; Wherein, described control signal also can not be stored in described mnemon 17 and directly be transmitted by described transmission unit 18.18 of described transport interface are used for described control signal, contact condition, displacement and physiological characteristic that described mnemon 17 is stored and transfer to the control module 22 of outside by the mode of wired or wireless transmission; Wherein, wired and Radio Transmission Technology is known, therefore repeat no more.Described control module 22 can be contained in to have at least one described display device 2 that represents unit 23, is used for controlling described display device 2 by described expression unit 23 demonstrations and/or responds described control signal, contact condition, displacement and the physiological characteristic that receives.
The telepilot 1 of embodiment of the present invention can be arranged in pairs or groups and be had the display device 2 of expression unit 23, allow the user control the shown cursor in described expression unit 23 or performed software by described telepilot 1, and (numerical value that depends on physiological characteristic) propose caution to described user when showing tired or excited state in physiological characteristic; Wherein, the mode that the mode of expression physiological characteristic and caution for example can utilize software to carry out picture disply, cresset demonstration or sound demonstration is reached, and there is no specific limited.Described display device 2 such as can be according to described control signal image switching, image update, adjustment volume, adjust display parameter etc.; Control the action of cursor according to described displacement; Show described physiological characteristic and produce alert status when described physiological characteristic exceeds preset value,, image insertion dimmed such as picture, auditory tone cues etc., but do not limit with this.
In one embodiment, described telepilot 1 also can use two imageing sensors to detect respectively described light source 111 and 112 different wave lengths that produce (being that described imageing sensor 14 is replaced by two imageing sensors), and one of them imageing sensor or two imageing sensors can arrange bandpass optical filter (bandpass filter) and select the spectrum that will receive.
Because described processing unit 15 is known according to the mode that described control button 10 produces control signal, therefore repeat no more.The mode of below only calculating described contact condition, finger displacement and physiological characteristic for described processing unit 15 is elaborated; That is the action of the optics finger navigation that below only forms for described light source 111 and 112, described imageing sensor 14, described processing unit 15 (finger detecting unit 151) and described light source control unit 16 in the explanation describes.
Sampling mechanism
The optics finger navigation of present embodiment uses two light sources 111 and 112 also to carry out simultaneously two kinds of functions; Wherein, the measuring ability of contact condition and displacement and indefinite are used the image picture frame of specific wavelength, and the image picture frame that the detection of physiological characteristic function must corresponding different wave length calculates respectively.Below at first key diagram is machine-processed as the sampling of picture frame.
In a kind of embodiment, described light source control unit 16 described the first light sources 111 of control and secondary light source 112 are luminous in turn, 14 of described imageing sensors with at a high speed and fixing sampling frequency (for example per second 3,000) synchronous described the first light source 111 or lighting of described secondary light source 112 obtain the image picture frame, and output a plurality of image picture frame I as shown in Figure 3
1-I
6To described processing unit 15 (finger detecting unit 151), wherein said image picture frame I
1-I
6Comprise the first image picture frame I
1, I
3, I
5, it is lighting of relatively described the first light source 111 for example, and the second image picture frame I
2, I
4, I
6, it is relative institute for example
Described processing unit 15 can be according to described the first image picture frame and described the second image picture frame I
1-I
6Judgement contact condition and displacement calculating amount, for example judge according to the brightness of described the first image picture frame and described the second image picture frame and the comparative result of at least one threshold value whether described finger 9 comes close to or in contact with described touch surface 13S, wherein when the brightness of described image picture frame is greater than or less than described at least one threshold value, i.e. judgement enters the contact attitude; After entering the contact attitude, described processing unit 15 can be according to the described displacement of correlation calculations between two the first image picture frames, first image picture frame and second image picture frame or two the second image picture frames.Should be noted that, be to utilize the catoptrical image picture frame of corresponding two kinds of different wave lengths to judge the running of contact condition and displacement calculating amount in present embodiment, and be different from traditional guider.
Described processing unit 15 is according to described the first image picture frame I
1, I
3, I
5The brightness that calculates described the first image picture frame changes, and according to described the second image picture frame I
2, I
4, I
6The brightness that calculates described the second image picture frame changes (appearance is specified in rear), and calculates respectively according to this two kinds of absorbed ratios of spectrum to obtain band oxygen protoheme concentration HbO
2With deoxygenated blood red pigment concentration Hb, utilize at last the blood oxygen concentration formula to calculate blood oxygen concentration; And by the brightness variation of described the first image picture frame and/or described the second image picture frame and comparative result calculating one Pulse Rate of at least one threshold value.
In another embodiment, the image picture frame that described light source control unit 16 described the first light sources 111 of control and described secondary light source 112 are synchronized with described imageing sensor 14 obtains simultaneously luminous; That is this moment, described imageing sensor 14 can receive the reflected light of two kinds of wavelength simultaneously.therefore, in this embodiment, a part of the place ahead of the sensing face 14S of described imageing sensor 14 preferably also arranges light filter 14f (as shown in Figure 4), wherein said light filter 14f can be bandpass optical filter so that the part sensing face 14S at described light filter 14f rear only can described the first light source 111 of sensing spectrum or the spectrum of described secondary light source 112, so that described processing unit 15 can be differentiated the first image picture frame (the parts of images picture frame of relatively described the first light source 111) and the second image picture frame (the parts of images picture frame of relative described secondary light source 112).Scrutable is that setting position and the area of the 14f of light filter described in present embodiment are not limited to shown in Figure 4.
By this, described processing unit 15 equally can be according to described the first image picture frame and described the second image picture frame I
1-I
6Calculate contact condition and displacement; And can be according to described the first image picture frame I
1, I
3, I
5The brightness that calculates described the first image picture frame changes and according to described the second image picture frame I
2, I
4, I
6The brightness that calculates described the second image picture frame changes, and calculates at least one in blood oxygen concentration and Pulse Rate according to the relation that two brightness change.
scrutablely be, because described imageing sensor 14 may have different light receiving efficiencies to different wave length, perhaps the luminosity of described the first light source 111 and described secondary light source 112 is incomplete same, therefore can adjust the brightness of 14 detected image picture frames of described imageing sensor and (for example adjust the time shutter of relative different wave length image picture frame in the described telepilot 1 front preferred pin that dispatches from the factory, the sampling parameters such as image gain), so that the initial pictures picture frame that described imageing sensor 14 obtains has roughly the same brightness, to eliminate the disconnected possibility of erroneous judgement.
The spirit of present embodiment is, with described light source control unit 16 control described the first light sources 111 and described secondary light source luminous 112 luminous, make described imageing sensor 14 receive a plurality of the second image picture frames of lighting with a plurality of the first image picture frames of producing relatively described the first light source igniting and relative described secondary light source from the reflected light of described finger 9 with sampling frequency; 15 of described processing units calculate described contact condition, finger displacement and physiological characteristic according to described the first image picture frame and the second image picture frame.
Elimination surround lighting mechanism
In Fig. 2 B, because described contact element 13 is transparent, pointing simultaneously 9 can printing opacity, and the surround lighting of described telepilot 1 outside can be received by described imageing sensor 14 with contact element 13 by described finger 9 and have influence on the image quality that it obtains the image picture frame.In present embodiment, described light source control unit 16 can control described the first light source 111 and described secondary light source 112 not luminous during part.
Fig. 5 is the Image Acquisition of described imageing sensor 14 and the luminous situation of described the first light source 111 and described secondary light source 112; Wherein, solid arrow represents light source igniting (or lighting with the first brightness) and dotted arrow represents that light source extinguishes (or lighting with the second brightness); Wherein said the second brightness is less than described the first brightness.To be described imageing sensor 14 continue to obtain the image picture frame with fixing sampling frequency to Fig. 5 A.Fig. 5 B be described the first light source 111 and described secondary light source 112 place is bright and extinguish in turn simultaneously, therefore 14 of described imageing sensors can get bright image picture frame (light source igniting or light with described the first brightness) and image picture frame (light source extinguishes or lights with described the second brightness) secretly in turn.Fig. 5 C is that described the first light source 111 and described secondary light source 112 are lighted once simultaneously every two image picture frames, and it has the situation of low displacement usually with respect to described finger 9.As previously mentioned, when described the first light source 111 and described secondary light source 112 are lighted simultaneously (Fig. 5 B and 5C), described imageing sensor 14 comprises light filter 14f with the image picture frame of space region every Different Light, but but so that the reflected light of described first light source 111 of some sensings of described imageing sensor 14 and the reflected light of the described secondary light source 112 of another part sensing.
During when described finger 9 contacts or near described touch surface 13S, the bright image picture frame that obtains during with respect to light source igniting comprises (finger reflected light+parasitic light+surround lighting), the dark image picture frame that obtains when not lighting with respect to light source only comprises (surround lighting), if therefore bright image picture frame is deducted dark image picture frame, can effectively eliminate the impact of surround lighting.15 of described processing units can calculate described contact condition, finger displacement and physiological characteristic according to the difference image picture frame of bright dark image picture frame.
Fig. 5 D is the embodiment that described the first light source 111 and described secondary light source 112 are lighted in turn.In this embodiment, owing to will make described imageing sensor 14 get dark image picture frame, therefore described light source control unit 16 is controlled described the first light source 111 and the described secondary light source 112 image picture frame alternately of being separated by and is lighted, for example in the time of Fig. 5 D t
dThe time two light sources all do not light.By this, 15 of described processing units can calculate difference the first image (bright the first image picture frame-dark image picture frame) and difference the second image (bright the second image picture frame-dark image picture frame), and calculate described contact condition, finger displacement and physiological characteristic according to described difference image.As previously mentioned, when described the first light source 111 and described secondary light source 112 were lighted in turn, described imageing sensor 14 separated different image picture frames with respect to light source with the time.
The spirit of present embodiment is, make described light source control unit 16 control described the first light source 111 and 112 whiles or luminous in turn of described secondary light source, and make described imageing sensor 14 can get the dark image picture frame of described light source when not luminous, and the difference image by calculating bright dark image is to eliminate the impact of surround lighting.Therefore, the luminous situation of each light source shown in Fig. 5 is only exemplary, is not for limiting the present invention.
Noise reduction mechanism
Can exist in the image picture frame that obtains due to described imageing sensor 14 and disturb, and disturb and usually be distributed in the image picture frame that is obtained in random mode, therefore present embodiment can further be calculated that M opens the image picture frame and improve signal to noise ratio (S/N ratio) (SNR), to increase the degree of accuracy of calculating physiological characteristic; For example, every 10 image picture frames are carried out addition, and 10 image picture frames of two groups of additions can repeat partly or not repeat fully.Scrutablely be, when described the first light source 111 and described secondary light source 112 are lighted in turn, the image picture frame of present embodiment and be respectively described the first image picture frame (I of Fig. 3 for example
1+ I
3+ I
5) and and described the second image picture frame (I of Fig. 3 for example
2+ I
4+ I
6) and, this is owing to must calculating respectively two groups of intensity variation.Yet, when described the first light source 111 and described secondary light source 112 are lighted simultaneously, the image picture frame of present embodiment and be the continuous image picture frame (I of Fig. 3 for example
1+ I
2+ I
3+ I
4+ I
5+ I
6), and by aftertreatment with space region every mode differentiate two groups of intensity variation.In addition, when coordinating above-mentioned elimination surround lighting mechanism, the image picture frame of present embodiment and be the difference image picture frame with; That is, execute to eliminate and then carry out noise reduction process after surround lighting is processed.In other embodiments, also can only carry out eliminate that surround lighting is processed and noise reduction process one of them.
As previously mentioned, described imageing sensor 14 might obtain image with different sampling parameters under different condition, for example described imageing sensor 14 may have different absorptivities with respect to different wave length, therefore may make described the first image picture frame and described the second image picture frame have roughly the same brightness with sampling parameters such as different time shutter and image gains, can correctly carry out aftertreatment according to described image picture frame, that is the sampling parameters of relatively described the first image picture frame and the second image picture frame may be not identical.In order to get rid of the impact of different sampling parameters, every image picture frame or M can be opened the image picture frame and or on average divided by sampling parameters to carry out normalized, for example (M open the image picture frame and/sampling parameters) or (M open the image picture frame average/sampling parameters); Wherein, M is positive integer.
Physiological characteristic is calculated
When lighting with respect to Different Light, the image picture frame that described imageing sensor 14 obtains includes physiologic information and finger mobile message simultaneously.Therefore, processing unit described in present embodiment 15 (or described finger detecting unit 151) at first needs after two kinds of information separated, can correctly calculate physiological characteristic; That is described processing unit 15 for example adopts independent component analytic approach (Independent Component Analysis, ICA) or blind source separation method (Blind Source Separation, BSS) with two kinds of information separated.
With reference to Fig. 3 and 6, with described the first image picture frame I of Fig. 3
1, I
3, I
5Be example, with a plurality of the first image picture frames (the first image picture frame of can be the original image picture frame, processing through eliminating surround lighting mechanism and/or noise reduction mechanism) or a plurality of the first image picture frame and (M open the original image picture frame and, through elimination M that surround lighting mechanism and/or noise reduction mechanism processed open the first image picture frame and) every image picture frame or the image picture frame be divided at least two parts and also try to achieve respectively mean flow rate, for example with image picture frame I
1Being divided into mean flow rate is B
1And B
1' two parts; With image picture frame I
3Being divided into mean flow rate is B
3And B
3' two parts; With image picture frame I
2N-1Being divided into mean flow rate is B
2N-1And B
2N-1' two parts (in other embodiments can more than two parts).Then, utilize independent component analytic approach or blind source separation method to isolate the first mobile message and the first physiologic information (as shown in Figure 6), it all is shown as brightness and changes line style.Present embodiment system gives up mobile message and utilizes the brightness variation line style of physiologic information to calculate physiological characteristic.Scrutablely be that because the sampling frequency of described imageing sensor 14 is far longer than pulse frequency, therefore the isolated physiologic information of institute can demonstrate light intensity with the line style (similar Fig. 1) of pulse variation; Isolated mobile message distributes and does not limit person as shown in Figure 6.In addition, two parts cutting apart of described image picture frame are not defined as up and down two parts.In addition, owing to must calculating respectively relative two
1, I
3, I
5(corresponding the first light source igniting) and the second image picture frame I
2, I
4, I
6(corresponding secondary light source is lighted) carries out.Described the second image picture frame (I
2, I
4, I
6) also be separated into the brightness variations such as the second mobile message and the second physiologic information, wherein give up the second mobile message and utilize the brightness of the second physiologic information to change.Should be noted that, when utilize the image picture frame and or when on average carrying out information separated, the I in Fig. 6
1-I
2N-1And I
2-I
2NEach all represent M open the image picture frame and, average or its normalized result.
It must be emphasized that, the contact condition of described finger 9 and displacement system is directly tried to achieve according to described the first image picture frame and the second image picture frame by described processing unit 15, does not need to use the first and second mobile messages after separation.Independent component analytic approach or blind source separation method are mainly used in mixed signal is separated, and after isolated mobile message is given up, can eliminate the mobile signal that causes of finger and disturb.
In present embodiment, described processing unit 15 also calculates a Pulse Rate according at least one threshold value and one of described the first brightness variation and/or described second brightness variation comparative result.
Park mode
The telepilot 1 of embodiment of the present invention can enter park mode after idle Preset Time.For example, when described processing unit 15 does not come close to or in contact with described touch surface 13S in the described finger 9 of Preset Time judgement, can enter park mode.
Physiological characteristic is given up mechanism
The processing unit 15 of the telepilot 1 of embodiment of the present invention is displacement calculating amount and physiological characteristic simultaneously, yet accurate physiological characteristic is calculated preferably in the lower situation of displacement.Therefore, present embodiment can judge in advance that whether the finger displacement is greater than preset value, if described finger displacement is greater than described preset value, the image picture frame that obtains of described imageing sensor 14 only is used for displacement calculating amount or judgement contact condition and is not used in the calculating physiological characteristic, even perhaps calculate physiological characteristic also by described transport interface 18 transmission and directly do not give up from described mnemon 17.Described preset value determines according to practical application, such as, but not limited to, determining according to the size of sensing face 13S and/or search frame.
Described telepilot 1 detects the method for physiological characteristic according to the reflected light of finger surface 9S, comprise the following step: provide the light of the first wavelength and second wave length to finger surface (step S
11); The reflection of light light that obtains described the first wavelength with the reflection of light light that produces a plurality of the first image picture frames and obtain described second wave length to produce a plurality of the second image picture frame (step S
12); Every described first image picture frame and every described second image picture frame are divided into two parts at least and try to achieve mean flow rate (the step S of every part
13); The described mean flow rate of utilizing independent component analytic approach or blind source separation method to analyze described every part of described the first image picture frame changes in the hope of the first brightness and the described mean flow rate of analyzing described every part of described the second image picture frame changes (step S in the hope of the second brightness
14); With change according to described the first brightness and physiological characteristic (step S is tried to achieve in described the second brightness variation
15).Before the embodiment of each step of present embodiment has been specified in, therefore repeat no more.
In another embodiment, a part of or whole elements of described light source 111 and 112, described imageing sensor 14, described processing unit 15, described light source control unit 16, described mnemon 17 and described transport interface 18 also can be made as control chip or packaging body, as shown in Figure 8.Described control chip is for detection of contact condition, displacement and the physiological characteristic of mode of operation and the described finger 9 of described control button 10, and exports described contact condition, displacement, physiological characteristic and the control signal (for example encoded, sort and/or compressed by described transport interface or also comprise the communication protocol unit and carry out these programs) of encoded, sequence and/or compression; Wherein calculate the mode of described contact condition, displacement and physiological characteristic as previously mentioned, therefore repeat no more.In other words, in a kind of embodiment, optics finger navigation and telepilot control module can be packaged into control chip or packaging body.Scrutable in addition is that in telepilot described in Fig. 81, the configuration mode of each element is only exemplary, is not for restriction the present invention.In other embodiments, described compression is processed also can go back the outer compression unit execution that arranges.
In sum, known remote control also can't detect user's physiological characteristic, and the mode of blood oxygen instrument calculating blood oxygen concentration is incompatible on telepilot because having the factors such as detected part that can't judge in moving.Therefore, the present invention also provides a kind of telepilot (Fig. 2 B and 8) and display system (Fig. 2 A), wherein said telepilot can detect finger information and image control information simultaneously, and the control display device is according to described at least image control information updating displaying contents and show described finger information.The telepilot of each embodiment of the present invention can detect user's physiological characteristic when detecting the finger displacement, and can effectively eliminate and point the mobile signal interference that causes and eliminate the environment light source impact, and has park mode and the mechanism of giving up physiologic information.
Although the present invention discloses with aforementioned embodiments, so it is not for restriction the present invention, any the technical staff in the technical field of the invention, without departing from the spirit and scope of the present invention, when making various changes or modifications.Therefore protection scope of the present invention should be with being as the criterion that appending claims was defined.
Claims (20)
1. telepilot, for detection of and physiological characteristic and the control signal of output finger, this telepilot comprises:
A plurality of control buttons are used for Trig control signal;
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor receives a plurality of the second image picture frames of lighting with a plurality of the first image picture frames of producing relatively described the first light source igniting and relative described secondary light source from the reflected light of described finger with sampling frequency; And
Processing unit calculates described physiological characteristic according to described the first image picture frame and described the second image picture frame, and produces described control signal according to the mode of operation of described control button.
2. telepilot according to claim 1, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
3. telepilot according to claim 1 and 2, wherein said physiological characteristic comprises blood oxygen concentration and/or Pulse Rate.
4. telepilot according to claim 2, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result calculating Pulse Rate of described the second brightness in changing.
5. telepilot according to claim 1, wherein said processing unit also compares to judge contact condition to brightness and at least one threshold value of described the first image picture frame and described the second image picture frame.
6. telepilot according to claim 1, wherein said processing unit are also according to two described the first image picture frames, described first image picture frame and described second an image picture frame and two described the second image picture frame displacement calculating amounts.
7. telepilot according to claim 1, wherein said light source control unit: control described the first light source and described secondary light source and light in turn so that described imageing sensor receives the reflected light of described the first light source and described secondary light source in turn; Perhaps controlling described the first light source and described secondary light source lights simultaneously so that described imageing sensor receives the reflected light of described the first light source and described secondary light source simultaneously, and described imageing sensor comprises light filter, and this light filter is covered in the part of the sensing face of described imageing sensor.
8. telepilot according to claim 1, wherein said the first light source, described secondary light source, described light source control unit, described at least one imageing sensor and described processing unit are packaged into that control chip is encoded to export, described physiological characteristic and the described control signal of at least a routine processes in sequence and compression.
9. telepilot according to claim 1, this telepilot also comprises touching control, and this touching control is controlled thereon for described finger; Wherein said touching control can or be independent of outside described control button for one in described control button.
10. telepilot of controlling for the user, this telepilot comprises:
A plurality of control buttons are used for Trig control signal;
Optics finger navigation is for detection of described user's physiological characteristic and finger displacement; And
Transport interface is used for exporting described control signal, described physiological characteristic and described finger displacement.
11. telepilot according to claim 10, wherein said optics finger navigation also comprises:
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor receives a plurality of the second image picture frames of lighting with a plurality of the first image picture frames of producing relatively described the first light source igniting and relative described secondary light source from the reflected light of described finger with sampling frequency; And
Processing unit calculates and exports described physiological characteristic and described finger displacement according to described the first image picture frame and described the second image picture frame.
12. telepilot according to claim 11, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
13. telepilot according to claim 12, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result calculating Pulse Rate of described the second brightness in changing.
14. telepilot according to claim 11, wherein said processing unit also compare to judge contact condition to brightness and at least one threshold value of described the first image picture frame and described the second image picture frame.
15. a display system, this display system comprises:
Display device is used for showing image; And
Telepilot, output control signal and physiological characteristic upgrade shown image and show described physiological characteristic according to described control signal to control described display device to described display device.
16. display system according to claim 15, wherein when described physiological characteristic exceeded preset value, described display device produced alert status.
17. display system according to claim 15, wherein said telepilot also comprises:
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled described the first light source and described secondary light source luminous;
At least one imageing sensor receives a plurality of the second image picture frames of lighting with a plurality of the first image picture frames of producing relatively described the first light source igniting and relative described secondary light source from the reflected light of described finger with sampling frequency; And
Processing unit calculates described physiological characteristic according to described the first image picture frame and described the second image picture frame, and produces described control signal according to the mode of operation of a plurality of control buttons.
18. display system according to claim 17, wherein said processing unit: every described first image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the first image picture frame changes in the hope of the first brightness; Every described second image picture frame is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of analyzing described every part of described the second image picture frame changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
19. display system according to claim 17, wherein said processing unit is also according to two described the first image picture frames, described first image picture frame and described second an image picture frame and two described the second image picture frame displacement calculating amounts, the described displacement of described telepilot output to described display device with the shown cursor of the described display device of relative control.
20. display system according to claim 17, wherein said processing unit are also according at least one threshold value and described the first brightness changes and at least one the comparative result calculating Pulse Rate of described the second brightness in changing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110394903.9A CN103136919B (en) | 2011-12-02 | 2011-12-02 | Remote control and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110394903.9A CN103136919B (en) | 2011-12-02 | 2011-12-02 | Remote control and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103136919A true CN103136919A (en) | 2013-06-05 |
| CN103136919B CN103136919B (en) | 2015-04-15 |
Family
ID=48496696
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110394903.9A Active CN103136919B (en) | 2011-12-02 | 2011-12-02 | Remote control and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103136919B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104932672A (en) * | 2014-03-17 | 2015-09-23 | 宏达国际电子股份有限公司 | Portable electronic device and method for physiological measurement |
| CN105796057A (en) * | 2016-03-02 | 2016-07-27 | 京东方科技集团股份有限公司 | Electronic device, electronic device system, information processing method and information prompting method |
| CN104932672B (en) * | 2014-03-17 | 2018-08-31 | 宏达国际电子股份有限公司 | Portable electronic equipment and physiological measurements method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004066194A1 (en) * | 2003-01-22 | 2004-08-05 | Nokia Corporation | Improved sensing arrangement |
| CN1687887A (en) * | 2005-05-31 | 2005-10-26 | 天津大学 | Health mouse |
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
-
2011
- 2011-12-02 CN CN201110394903.9A patent/CN103136919B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004066194A1 (en) * | 2003-01-22 | 2004-08-05 | Nokia Corporation | Improved sensing arrangement |
| CN1687887A (en) * | 2005-05-31 | 2005-10-26 | 天津大学 | Health mouse |
| CN101317756A (en) * | 2007-06-06 | 2008-12-10 | 索尼株式会社 | Apparatus for obtaining pulse wave velocity information and method thereof |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104932672A (en) * | 2014-03-17 | 2015-09-23 | 宏达国际电子股份有限公司 | Portable electronic device and method for physiological measurement |
| CN104932672B (en) * | 2014-03-17 | 2018-08-31 | 宏达国际电子股份有限公司 | Portable electronic equipment and physiological measurements method |
| CN105796057A (en) * | 2016-03-02 | 2016-07-27 | 京东方科技集团股份有限公司 | Electronic device, electronic device system, information processing method and information prompting method |
| WO2017148185A1 (en) * | 2016-03-02 | 2017-09-08 | 京东方科技集团股份有限公司 | Electronic device, electronic device system, information processing method, and information prompting method |
| US20180055455A1 (en) * | 2016-03-02 | 2018-03-01 | Boe Technology Group Co., Ltd. | Electronic Apparatus, Electronic Apparatus System, Information Processing Method and Information Prompt Method |
| JP2019514443A (en) * | 2016-03-02 | 2019-06-06 | 京東方科技集團股▲ふん▼有限公司Ｂｏｅ Ｔｅｃｈｎｏｌｏｇｙ Ｇｒｏｕｐ Ｃｏ．，Ｌｔｄ． | Electronic device, electronic device system, information processing method and information presentation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103136919B (en) | 2015-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI476641B (en) | Remote controller and display system | |
| TWI438658B (en) | User interface system and optical finger mouse system | |
| TWI489325B (en) | Optical finger mouse, electronic device and physiological characteristic detection device | |
| TWI475193B (en) | Optical distance measurement system and operation method thereof | |
| TWI474215B (en) | Keyboard module and display system | |
| TWI451295B (en) | Optical finger mouse, mouse control module and physiological characteristic detection method thereof | |
| US10382854B2 (en) | Near field gesture control system and method | |
| CN103529929B (en) | Gesture recognition system and glasses capable of recognizing gesture actions | |
| CN102096524B (en) | Optical type position detection device, hand device and touch panel | |
| CN103425852B (en) | User's recognition methods, physiology detection apparatus and physiological detection method | |
| KR20160117479A (en) | Motion gesture input detected using optical sensors | |
| US9289159B2 (en) | User Identification method, physiological detection device and physiological detection method | |
| CN108429888B (en) | Light supplementing method and mobile terminal | |
| US11027195B2 (en) | Information processing apparatus, information processing method, and program | |
| CN103034342B (en) | Optics finger navigation, electronic installation and physiological characteristic pick-up unit | |
| CN104207760A (en) | Portable electronic device | |
| CN103135801B (en) | Human-computer interface system and finger mouse system | |
| CN103135772A (en) | Keyboard module and display system | |
| CN103123542B (en) | Optical mouse and method of operating thereof | |
| CN103135800B (en) | Optics finger navigation, mouse control module and physiological characteristic detection method thereof | |
| CN108784656B (en) | Wearing identification method and device of wearable equipment and wearable equipment | |
| CN108170299A (en) | Navigation device and image display system | |
| CN103136919B (en) | Remote control and display system | |
| CN103126686A (en) | Optical ranging system and operation method thereof | |
| CN107704107A (en) | Physiology detection apparatus and its operating method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |