CN103135801A - Human-computer interface system and finger mouse system - Google Patents
Human-computer interface system and finger mouse system Download PDFInfo
- Publication number
- CN103135801A CN103135801A CN2011103895255A CN201110389525A CN103135801A CN 103135801 A CN103135801 A CN 103135801A CN 2011103895255 A CN2011103895255 A CN 2011103895255A CN 201110389525 A CN201110389525 A CN 201110389525A CN 103135801 A CN103135801 A CN 103135801A
- Authority
- CN
- China
- Prior art keywords
- picture frame
- image picture
- frame information
- light source
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
A human-computer interface system comprises a slave device and a master device. The slave device provides two lights of different wavelengths to light a finger surface, receives reflected light from the finger surface to generate a plurality of image frames, and calculates and outputs image frame information of the image frames, wherein the number of the image frames is preset. The master device calculates the contact status and the displacement of the finger surface and physiological characteristics of a user according to the image frame information.
Description
Technical field
The present invention relates to a kind of human-computer interface system, particularly a kind of human-computer interface system that can detect simultaneously user's physiological characteristic and finger displacement and contact condition and finger mouse system.
Background technology
Optics finger navigation (optical finger mouse, OFM) because volume is little, is suitable for portable electronic devices usually.General optics finger navigation can detect the intensity variation of user's finger surface reflection ray, and uses the contact condition of judgement finger and finger with respect to the displacement of touch surface.Yet along with industrialized development, the user uses the time of portable electronic devices to increase gradually, even exceeds physical load and oneself is not discovered.Therefore, if a portable electronic devices has simultaneously the function that detects user's physiological characteristic and can propose caution in case of necessity, the situation that can avoid excessively using occurs.
known blood oxygen saturation instrument (pulse oximeter) utilizes the mode of non-intrusion type to detect user's blood oxygen concentration and Pulse Rate, it can generate red light beam (wavelength is 660 nanometers approximately) and infrared light light beam (wavelength is 910 nanometers approximately) penetrates detected part, and utilize band oxygen protoheme (oxyhemoglobin) and deoxygenated blood red pigment (Deoxyheamo-globin) special spectrum to be had the intensity variation of the Characteristics Detection penetrating light of different absorptivities, for example, with reference to United States Patent (USP) the 7th, 072, No. 701, title is the monitoring mode (Method for spectrophotometric blood oxygenation monitoring) of blood oxygen concentration.After detecting the intensity variation of penetrating light of two kinds of wavelength, then calculate blood oxygen concentration with following formula
Blood oxygen concentration=100% * [HbO
2]/([HbO
2]+ [Hb]);
Wherein, [HbO
2] expression band oxygen protoheme concentration; [Hb] expression deoxygenated blood red pigment concentration.
The light intensity of the penetrating light of the general detected two kinds of wavelength of blood oxygen saturation instrument can present along with heartbeat variation as shown in Figure 1, this is because the blood flow volume change that makes light beam pass through can constantly be expanded and shrink to blood vessel along with heartbeat, and then changes the absorbed ratio of luminous energy.By this, can calculate blood to the absorptivity of different spectrum according to the intensity information of continuous variation, to calculate respectively band oxygen protoheme concentration and deoxygenated blood red pigment concentration isoconcentration information, recycle at last above-mentioned blood oxygen concentration formula and calculate blood oxygen concentration.
Yet, penetrate the intensity variation of light because blood oxygen saturation instrument detects, thereby different light intensity signals can be detected along with different detected part; In addition, when the detected part that detects when known blood oxygen saturation instrument is moved, the chaotic waveform of violent change can be detected and can't correctly calculate physiological characteristic according to it, thereby itself and the device that is not suitable for portable electronic devices or needs move operation.
Given this, the present invention proposes a kind of human-computer interface system that can detect simultaneously user's physiological characteristic and finger displacement and contact condition and finger mouse system, it can detect user's physiological characteristic when detecting the finger displacement, and can effectively eliminate the mobile signal that causes and disturb.
Summary of the invention
The purpose of this invention is to provide a kind of human-computer interface system and finger mouse system, its reflected light signal of pointing by analysis is to calculate simultaneously finger displacement and contact condition and user's physiological characteristic.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, and has the mechanism of eliminating the environment light source impact.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, and has noise reduction and economize frequency range mechanism.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, and has the system frequency correction mechanism.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, and enters park mode after idle Preset Time.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, can give up when displacement is too large or not respond physiological characteristic.
Another purpose of the present invention is to provide a kind of human-computer interface system and finger mouse system, and it can detect finger displacement and contact condition and user's physiological characteristic simultaneously, and has the mechanism of verifying data transmission between master and slave devices.
In order to achieve the above object, the invention provides a kind of human-computer interface system, comprise from device and main device.A plurality of the first image picture frames and a plurality of the second image picture frame, calculating and output that said slave device provides two different wave lengths to light with relatively described two different wave lengths of generation from the reflected light of described finger with the described finger that throws light on, reception reach about presetting the second image picture frame information of Zhang Suoshu the second image picture frame about the first image picture frame information of presetting Zhang Suoshu the first image picture frame.Described main device calculates described displacement and described physiological characteristic according to described the first image picture frame information and described the second image picture frame information.
According to another characteristics of the present invention, the present invention also provides a kind of finger mouse system, comprises optical detection apparatus and main frame.Described optical detection apparatus comprises the first light source, secondary light source, light source control unit, imageing sensor and processing unit.Described the first light source sends the light of the first wavelength to described finger.Described secondary light source sends the light of second wave length to described finger.Described light source control unit is controlled lighting and extinguishing of described the first light source and described secondary light source.Described imageing sensor reaches with a plurality of the first image picture frames that generate relatively described the first light source igniting a plurality of the second image picture frames that relatively described secondary light source is lighted with the reflected light that sampling frequency receives from described finger.Described processing unit calculates and exports about the first image picture frame information of default Zhang Suoshu the first image picture frame and about presetting the second image picture frame information of Zhang Suoshu the second image picture frame.Described main frame receives and checks described the first image picture frame information and described the second image picture frame information, and calculates described displacement and described physiological characteristic according to it.
According to another characteristics of the present invention, the present invention also provides a kind of human-computer interface system, comprises finger mouse device and main frame.Described finger mouse device provide two different wave lengths with the finger that throws light on, receive from the reflected light of described finger with a plurality of the first image picture frames of generating relatively described two different wave lengths and lighting and a plurality of the second image picture frame, calculating and output about the first image picture frame information of default Zhang Suoshu the first image picture frame and about the second image picture frame information of default Zhang Suoshu the second image picture frame.Described main frame comprises processing unit and represents the unit.Described processing unit is according to described the first image picture frame information and described the second image picture frame information displacement calculating amount and physiological characteristic.Described expression unit is used for responding described displacement and described physiological characteristic.
In human-computer interface system of the present invention and finger mouse system, described physiological characteristic comprises blood oxygen concentration and Pulse Rate.The present invention can effectively eliminate the mobile signal that causes and disturb by coming separate mobile information and physiologic information with independent component analytic approach or blind source separation method.
In human-computer interface system of the present invention, said slave device can be mouse, telepilot, keyboard, optical distance measurement apparatus or other electronic peripheral devices; Described main device can be TV, projection arrangement, game machine system or computer system.
Description of drawings
Fig. 1 is the schematic diagram of the intensity variation of blood oxygen saturation penetrating light that instrument detects.
Fig. 2 A is the schematic diagram of the human-computer interface system of an embodiment of the present invention.
Fig. 2 B is the block scheme of the human-computer interface system of an embodiment of the present invention.
Fig. 3 is the schematic diagram that the imageing sensor of the human-computer interface system of embodiment of the present invention obtains the image picture frame.
Fig. 4 is the imageing sensor of the human-computer interface system of embodiment of the present invention, and it comprises light filter and is arranged at part sensing face the place ahead.
Fig. 5 is in the human-computer interface system of embodiment of the present invention, the schematic diagram that Image Acquisition and light source point go out.
Fig. 6 is the second processing unit separate mobile information of human-computer interface system of embodiment of the present invention and the schematic diagram of physiologic information.
Fig. 7 is the process flow diagram of the physiological characteristic detection method of embodiment of the present invention.
Description of reference numerals
1 from installing 111 first light sources
112 secondary light source 12 light guides
13 touching control 13S touch surface
14 imageing sensor 141 light filters
16 light source control unit 17 first mnemons
18 transport interface 19 clock pulse makers
2 main device 21 second mnemons
22 verify unit 23 second processing units
231 move/contact detection unit 232 physiological characteristic detecting units
24 expression cell S
11-S
12Step
9 finger 9S finger surfaces
SI
1-SI
2NImage picture frame information I
1-I
6The image picture frame
B
1-B
2N, B
1'-B
2N' mean flow rate
Embodiment
In order to make above and other purpose of the present invention, feature and advantage more obvious, hereinafter will coordinate accompanying drawing, elaborate.In explanation of the present invention, identical member first illustrates at this with identical symbolic representation.
Fig. 2 A is the schematic diagram of the human-computer interface system of embodiment of the present invention, comprises from device (slave device) 1 and main device (master device) 2.Said slave device 1 is preferably an electronic peripheral device; Described main device 2 is preferably and comprises the electronic installation that represents the unit, is used for responding the output (such as carrying out cursor control, software execution and/or physiological status demonstration etc.) of said slave device 1; Wherein said expression unit can be display, cresset, seven bytes demonstration and/or audio units; Described electronic installation can be portable electronic devices or general household electronic device.In one embodiment, human-computer interface system can be the finger mouse system, and said slave device 1 is optical detection apparatus and described main device 2 is main frames, carries out data transmission by wired or wireless mode each other.In another embodiment, human-computer interface system can comprise finger mouse device and main frame, and described main frame also comprises and represents that the unit is used for responding the information of described finger mouse device output.
Human-computer interface system of the present invention is for detection of displacement and the contact condition of user's finger 9, and described user's physiological characteristic, such as comprising blood oxygen concentration and Pulse Rate etc.Generally speaking, when described human-computer interface system is the contact attitude at the described contact condition of judgement, just begin to carry out the calculating of described displacement and described physiological characteristic.
Said slave device 1 comprises two light sources 111 and 112, light guide 12, touching control 13, imageing sensor 14, the first processing unit 15 and light source control unit 16; In Fig. 2 A, the spatial relationship of each member is only exemplary, is not for limiting the present invention.Described two light sources 111 and 112 for example can be light emitting diode or laser diode, and it sends respectively different wave length, and are preferably two wavelength that known blood oxygen instrument uses, for example infrared light of the ruddiness of 660 nanometers and 905,910 or 940 nanometers.Scrutable is that wavelength described herein refers to the centre wavelength of spectrum.
Described light guide 12 is used for described light source 111 and 112 light that send are guided to described touching control 13; Described light guide 12 is not to be defined as reflecting surface, and it also can make described light source 111 and 112 light that send be sent to described touching control 13 in the mode that penetrates, and there is no specific limited.In other embodiments, if the light that described light source 111 and 112 sends can be incident to described touching control 13, also can omit described light guide 12.
Described touching control 13 has touch surface 13S to be controlled on it for described finger 9, and described touching control 13 is preferably transparent with respect to described light source 111 and 112 light that send.When described finger 9 came close to or in contact with described touch surface 13S, described light source 111 and 112 light that send were reflected.Scrutable is that the area of described touch surface 13S can be greater than or less than described finger surface 9S, there is no specific limited.
Described imageing sensor 14 use sampling parameters receive reflected light from described touching control 13 (described finger surface 9S) to generate a plurality of image picture frames (each image picture frame for example has 16 * 16 pixels); Wherein said sampling parameters comprises time shutter, image gain etc., but not as limit.Scrutable is can comprise in addition other in Fig. 2 A in order to guide reflected light to the lens of described imageing sensor 14, to increase the light receiving efficiency of described imageing sensor 14.Described imageing sensor 14 is preferably the active array-type imageing sensor, cmos image sensor for example, but can be also that other are used for the element of sensing image picture frame.
Described the first processing unit 15 calculates and exports the image picture frame information about default Zhang Suoshu image picture frame, for example M open the image picture frame the image picture frame and, average, the normalized image picture frame of image picture frame and or the normalized image picture frame average; That is, M opens the image picture frame when the every output of described imageing sensor 14, described processing unit 15 calculate and export described M open the image picture frame the image picture frame and or the image picture frame average, or further the preferred image picture frame of described image picture frame is on average carried out normalized (be specified in after); In other words, image picture frame information is one and processed the image picture frame of (addition, average, normalized).2 displacement and contact conditions that calculate the relatively described touch surface 13S of described finger 9 according to described image picture frame information of described main device, and described user's physiological characteristic.
Described light source control unit 16 couples described the first processing unit 15, obtains lighting of the described light source 111 of control and 112 and extinguishes (after being specified in) with the image picture frame that coordinates described imageing sensor 14.
With reference to Fig. 2 A and Fig. 2 B, Fig. 2 B is the block scheme of the human-computer interface system of embodiment of the present invention, and it comprises said slave device 1 and described main device 2.Said slave device 1 comprises the first light source 111, secondary light source 112, described imageing sensor 14, described the first processing unit 15, described light source control unit 16, the first mnemon 17, transport interface 18 and clock pulse maker 19.Described main device 2 comprises the second mnemon 21, verifies unit 22, the second processing unit 23 and expression unit 24; Wherein, described the second processing unit 23 carries out multi-functional computing, and it also can comprise movement/contact detection unit 231 and be used for calculating the described physiological characteristic that the described displacement of the relatively described touch surface 13S of described finger 9 and described contact condition and physiological characteristic detecting unit 232 are used for calculating described user; That is described the second processing unit 23 can be single element or is divided into two elements.
Described the first light source 111 for example sends the ruddiness that wavelength is about 660 nanometers; Described secondary light source 112 for example sends the infrared light that wavelength is about 905,910 or 940 nanometers; In a broad sense, described the first light source 111 and described secondary light source 112 send respectively the light of two wavelength that known blood oxygen instrument uses.Described light source control unit 16 is controlled lighting or extinguishing of described the first light source 111 and described secondary light source 112, makes described imageing sensor 14 receive with sampling frequency a plurality of the first image picture frames of lighting with relatively described the first light source 111 of generation from the reflected light of described finger 9 and reaches a plurality of the second image picture frames that relatively described secondary light source 112 is lighted.Described the first processing unit 15 calculates the first image picture frame information of default Zhang Suoshu the first image picture frame, for example M open described the first image picture frame the first image picture frame and, average, normalization the first image picture frame of the first image picture frame and or normalization the first image picture frame average, and calculate the second image picture frame information of default Zhang Suoshu the second image picture frame, for example M open described the second image picture frame the second image picture frame and, average, normalization the second image picture frame of the second image picture frame and or normalization the second image picture frame average.Described the first image picture frame information and described the second image picture frame information that described the first mnemon 17 is for example tried to achieve in order to store described the first processing unit 15 for impact damper (buffer).Described transport interface 18 is used for the mode that described the first image picture frame information and the described second image picture frame information exchange of described the first mnemon 17 storages are crossed wired or wireless transmission is sent to described main device 2; Wherein, wired and Radio Transmission Technology is by known, therefore repeat no more.Should be noted that, if the data transmission adjustment of 2, said slave device 1 and described main device is precisely enough, described the first mnemon 17 can not implemented.19 system frequencies that are used for providing said slave device 1 of described clock pulse maker.
Described the second mnemon 21 is used for storing described the first image picture frame information and described the second image picture frame information that receives from said slave device 1.22 of described verification unit are used for checking whether described the first image picture frame information and described the second image picture frame information had the situation of sampling (oversampling) or data loss (loss).If there were the situation of sampling in described the first image picture frame information and described the second image picture frame information, directly will cross the information of sampling and give up; If there are the situation of data loss in described the first image picture frame information and described the second image picture frame information, the data that can utilize the mode of interpolation (interleaving) to recover to lose; If information does not have the problems referred to above, directly described the first image picture frame information and described the second image picture frame information are sent to described the second processing unit 23.Scrutablely be that because a plurality of functions are carried out in described verification unit 23, it can be carried out all functions or comprise a plurality of elements with single element and carry out respectively described verification, gives up and the function such as interpolation.Described the second processing unit 23 (or described movement/contact detection unit 231) is used for calculating according to described the first image picture frame information and described the second image picture frame information described displacement and the described contact condition of the relatively described touch surface 13S of described finger 9; Described the second processing unit 23 (or described physiological characteristic detecting unit 232) is used for the described physiological characteristic according to described the first image picture frame information and described the second described user of image picture frame information calculating.Described expression unit 24 is used for showing and/or responding described displacement, contact condition and the physiological characteristic that described the second processing unit 23 is obtained.
In a kind of embodiment, described main device 2 for example has the electronic installation of expression unit for TV, projection arrangement, computer system, games system or other; Said slave device 1 can be telepilot, mouse, keyboard, optical distance measurement apparatus or other electronic peripheral devices.In other words, said slave device 1 and described main device 2 couple mutually wired or wirelessly, to form a single element (for example portable apparatus) or a plurality of element (for example appliance system); Said slave device 1 is sent the second image picture frame information that the first image picture frame information that relatively described the first light source 111 lights and relatively described secondary light source 112 are lighted, and 2, described main device calculates and/or respond described displacement, contact condition and physiological characteristic according to described the first image picture frame information and described the second image picture frame information.
Therefore, of the present invention from install 1 can arrange in pairs or groups have the expression unit 24 main device 2, when allowing the user pass through said slave device 1 to control the shown cursor in described expression unit 24 or the performed software of described main device 2, represent described user's physiological characteristic for described user's reference, and (according to the numerical value of physiological characteristic) to described user, caution is proposed when physiological characteristic is shown as fatigue state; Wherein, the mode that shows physiological characteristic and caution for example can utilize the mode of software execution picture disply, cresset demonstration or sound demonstration to reach.
In other embodiments, said slave device 1 also can use two imageing sensors to be used for detecting respectively two different wave lengths, and one of them imageing sensor or two imageing sensors can arrange bandpass optical filter (bandpass filter) and select the spectrum that will receive.
Sampling mechanism
Human-computer interface system of the present invention comprises two light sources and carries out simultaneously two kinds of functions; Wherein, the measuring ability of displacement and contact condition and indefinite are used the image picture frame of specific wavelength, and the image picture frame that the detection of physiological characteristic function must corresponding different wave length calculates respectively.At first the sampling mechanism of image picture frame in the present invention below is described.
In a kind of embodiment, described light source control unit 16 described the first light sources 111 of control and described secondary light source 112 are luminous in turn, 14 of described imageing sensors obtain the image picture frame with high speed and fixing synchronous described the first light source 111 of sampling frequency (for example per second is 3000) or lighting of described secondary light source 112, and export a plurality of image picture frame I as shown in Figure 3
1-I
6To described the first processing unit 15, wherein said image picture frame I
1-I
6Comprise the first image picture frame I
1, I
3, I
5, it is lighting of relatively described the first light source 111 for example; The second image picture frame I
2, I
4, I
6, it is lighting of relatively described secondary light source 112 for example.15 of described the first processing units are obtained respectively M and are opened the first image picture frame I
1, I
3, I
5The first image picture frame information, for example the first image picture frame and (I
1+ I
3+ I
5), the average (I of the first image picture frame
1+ I
3+ I
5)/M, normalization the first image picture frame and (I
1+ I
3+ I
5)/(sampling parameters) or the average (I of normalization the first image picture frame
1+ I
3+ I
5)/(M * sampling parameters), and M open the second image picture frame I
2, I
4, I
6The second image picture frame information, for example the second image picture frame and (I
2+ I
4+ I
6), the average (I of the second image picture frame
2+ I
4+ I
6)/M, normalization the second image picture frame and (I
2+ I
4+ I
6)/(sampling parameters) or the average (I of normalization the second image picture frame
2+ I
4+ I
6)/(M * sampling parameters).In a kind of embodiment, described the first processing unit 15 carries out single treatment, i.e. M=10 with every 10 first and second image picture frames; But not as limit.
Described the second processing unit 23 (or described movement/contact detection unit 231) can be according to described first and second image picture frame information judgement contact condition and displacement calculating amount of storing in described the second mnemon 21, for example judge according to the brightness of described the first image picture frame information and described the second image picture frame information and the comparative result of at least one threshold value whether described finger 9 comes close to or in contact with described touch surface 13S, wherein when the brightness of described image picture frame information is greater than or less than described at least one threshold value, namely judge to enter the contact attitude; After entering the contact attitude, described the second processing unit 23 can calculate described displacement according to the correlativity (correlation) between two the first image picture frame information, first image picture frame information and second image picture frame information or two the second image picture frame information.Should be noted that, although the mode of judging described contact condition and calculating described displacement can make in a known manner, but must utilize the catoptrical image picture frame information of corresponding two different wave lengths judge and calculate in the present invention, and be different from traditional guider (navigation device).
Described the second processing unit 23 (or described physiological characteristic detecting unit 232) must calculate according to described the first image picture frame information the brightness variation of a plurality of the first image picture frame information, and change (after being specified in) according to the brightness that described the second image picture frame information calculates a plurality of the second image picture frame information, and calculate respectively two kinds of absorbed ratios of spectrum to obtain band oxygen protoheme concentration [HbO according to it
2] and deoxygenated blood red pigment concentration [Hb], utilize at last the blood oxygen concentration formula to calculate blood oxygen concentration; And by the brightness variation of described the first image picture frame information and/or described the second image picture frame information and the comparative result calculating Pulse Rate of at least one threshold value.
In another kind of embodiment, the image picture frame that described light source control unit 16 described the first light sources 111 of control and described secondary light source 112 are synchronized with described imageing sensor 14 obtains simultaneously luminous; That is described imageing sensor 14 can receive the reflected light of two kinds of wavelength simultaneously.therefore, in this embodiment, a part of the place ahead of the sensing face 14S of described imageing sensor 14 also can arrange light filter 141 (as shown in Figure 4), wherein said light filter 141 can be bandpass optical filter so that the part sensing face at described light filter 141 rears only can described the first light source 111 of sensing spectrum or the spectrum of described secondary light source 112, so that described the second processing unit 23 (or described movement/contact detection unit 231 and described physiological characteristic detecting unit 232) can be differentiated the first image picture frame information (the parts of images picture frame of relatively described the first light source 111) and the second image picture frame information (the parts of images picture frame of relatively described secondary light source 112).Scrutable is that in the present invention, the position of described light filter 141 and area are not limited to shown in Figure 4.
By this, described the second processing unit 23 (or described movement/contact detection unit 231) can calculate contact condition and displacement according to described the first image picture frame information and described the second image picture frame information equally.Described the second processing unit 23 (or described physiological characteristic detecting unit 232) can change according to the brightness that described the first image picture frame information calculates the first image picture frame information equally and change according to the brightness that described the second image picture frame information calculates the second image picture frame information, and calculates blood oxygen concentration and Pulse Rate according to the relation that two brightness change.
scrutablely be, because described imageing sensor 14 may have different light receiving efficiencies to different wave length, perhaps the luminosity of described the first light source 111 and described secondary light source 112 is incomplete same, therefore can namely adjust for the brightness of 14 detected image picture frames of described imageing sensor before described optics finger navigation 1 dispatches from the factory and (for example adjust the time shutter of relative different wave length image picture frame, the sampling parameters such as image gain), so that the initial pictures picture frame that imageing sensor 14 obtains has roughly the same brightness, to eliminate the disconnected possibility of erroneous judgement.
The spirit of present embodiment is, with said slave device 1 provide two different wave lengths with illumination finger surface 9S, receive reflected light from described finger surface 9S to generate a plurality of image picture frames, calculating and output about the image picture frame information of default Zhang Suoshu image picture frame; 2, described main device calculates contact condition, displacement and physiological characteristic according to described image picture frame information.
Elimination surround lighting mechanism
In Fig. 2 A, because described contact element 13 is transparent, finger can printing opacity simultaneously, and the surround lighting of said slave device 1 outside can be received the image quality that have influence on its image picture frame that obtains with finger by described imageing sensor 14 by described contact element 13.In the present invention, described light source control unit 16 can control described the first light source 111 and secondary light source 112 not luminous during part.
Fig. 5 is the point of the Image Acquisition of described imageing sensor 14 and described the first light source 111 and described secondary light source 112 situation of going out; Wherein, solid arrow represents light source igniting and dotted arrow represents that light source extinguishes.A figure in Fig. 5 is that described imageing sensor 14 continues to obtain the image picture frame with fixed frequency.B figure in Fig. 5 be described the first light source 111 and described secondary light source 112 place is bright and extinguish in turn simultaneously, therefore 14 of described imageing sensors can get bright image picture frame (during light source igniting) and dark image picture frame (when light source extinguishes) in turn.C figure in Fig. 5 is that described the first light source 111 and described secondary light source 112 are lighted once simultaneously every two image picture frames, and it has the situation of low displacement usually with respect to described finger 9.As previously mentioned, when described the first light source 111 and described secondary light source 112 are lighted simultaneously (the B figure in Fig. 5 and C figure), described imageing sensor preferred 14 comprises light filter 141 with the image picture frame of space region every Different Light, but but so that the reflected light of described first light source 111 of part sensing of described imageing sensor 14 and the reflected light of the described secondary light source 112 of another part sensing.
During when described finger 9 contacts or near described touch surface 13S, the bright image picture frame that obtains during with respect to light source igniting comprises (finger reflected light+parasitic light+surround lighting), the dark image picture frame that obtains when not lighting with respect to light source only comprises (surround lighting), if therefore bright image picture frame is deducted dark image picture frame, can effectively eliminate the impact of surround lighting.15 of described the first processing units can calculate difference image picture frame information according to the difference image picture frame of bright image picture frame and dark image picture frame, for example M open the difference image picture frame the difference image picture frame and, average, the normalization difference image picture frame of difference image picture frame and or normalization difference image picture frame average; 23 of described the second processing units can be according to described difference image picture frame information displacement calculating amount, contact condition and physiological characteristic.
D figure in Fig. 5 is the embodiment that described the first light source 111 and described secondary light source 112 are lighted in turn.In this embodiment, owing to will making described imageing sensor 14 get dark image picture frame, therefore described light source control unit 16 is controlled described the first light source 111 and the described secondary light source 112 image picture frame alternately of being separated by and is lighted, for example the time t of the D figure in Fig. 5
dThe time two light sources all do not light.By this, 15 of described the first processing units can calculate difference the first image picture frame (bright the first image picture frame-dark image picture frame) and difference the second image picture frame (bright the second image picture frame-dark image picture frame), and calculate difference the first image picture frame information and difference the second image picture frame information; Described the second processing unit 23 is according to described difference image information displacement calculating amount, contact condition and physiological characteristic.As previously mentioned, when described the first light source 111 and described secondary light source 112 were lighted in turn, described imageing sensor 14 separated image picture frame with respect to Different Light with the time.
The spirit of present embodiment is, make described light source control unit 16 control described the first light source 111 and 112 whiles or luminous in turn of described secondary light source, and make described imageing sensor 14 can get the dark image picture frame of described light source when not luminous, and by calculating difference between bright dark image to eliminate ambient light effects.Therefore, the point of each light source shown in Fig. 5 goes out situation only for exemplary, is not to limit the present invention.
Noise reduction and province's frequency range mechanism
Can exist in the image picture frame that obtains due to described imageing sensor 14 and disturb, and disturb and usually be distributed in the image picture frame that is obtained in random mode, therefore the present invention utilizes described the first processing unit 15 calculate that M open the image picture frame and improve signal to noise ratio (S/N ratio) (SNR), to increase the degree of accuracy of calculating physiological characteristic; For example, every 10 image picture frames are carried out addition, and two groups of 10 continuous image picture frames can repeat partly or not repeat fully.Therefore, every 10 images can obtain an image picture frame and, except can promote news assorted than, because described imageing sensor 14 preferably has high sampling frequency, also can effectively save from installing 1 and the data transmission frequency range of 2, main device; Also can and average the image picture frame in other embodiments.Scrutablely be, when described the first light source 111 and described secondary light source 112 are when lighting in turn, the image picture frame of present embodiment and be respectively described the first image (I of Fig. 3 for example
1+ I
3+ I
5) and and described the second image (I of Fig. 3 for example
2+ I
4+ I
6) and, this is owing to must calculating respectively two groups of intensity variation.Yet, when described the first light source 111 and described secondary light source 112 are lighted simultaneously, the image picture frame of present embodiment and be the continuous image picture frame (I of Fig. 3 for example
1+ I
2+ I
3+ I
4+ I
5+ I
6) and, and differentiate two groups of intensity variation by the mode of aftertreatment.In addition, when coordinating above-mentioned elimination surround lighting mechanism, described the first image picture frame and be difference the first image picture frame and, described the first average, described the second image picture frame of image picture frame average out to difference the first image picture frame and be difference the second image picture frame and, described second image picture frame average out to difference the second image picture frame is average; That is, execute to eliminate and then carry out noise reduction process after surround lighting is processed.In other embodiments, also can only carry out noise reduction process.
As previously mentioned, described imageing sensor 14 might obtain image with different sampling parameters under different condition, for example described imageing sensor 14 may have different absorptivities with respect to different wave length, therefore may make described the first image and described the second image have the roughly the same initial pictures picture frame of brightness with sampling parameters such as different time shutter and image gains, can correctly carry out aftertreatment according to described image picture frame, that is the described sampling parameters of relatively described the first image picture frame and the second image picture frame may be not identical.In the present invention, in order to get rid of the impact of different sampling parameters, M can be opened the image picture frame and or the image picture frame on average divided by sampling parameters to carry out normalized, for example (M open the image picture frame and/sampling parameters) or (average/sampling parameters that M opens the image picture frame); Wherein, M is positive integer.If coordinate above-mentioned elimination surround lighting mechanism, normalization the first image picture frame and for normalization difference the first image picture frame and, average, normalization the second image picture frame of normalization first image picture frame average out to normalization difference the first image picture frame and for normalization difference the second image picture frame and, normalization second image picture frame average out to normalization difference the second image picture frame is average.
Information verification mechanism
In the present invention, need accurate image picture frame data owing to calculating physiologic information, the image picture frame data that verification 22 pairs of the unit said slave device 1 of described main device 2 transmits checks, gives up the sampled picture data when sampling occurring; Carry out interpolative operation with the recovery data when data loss occurring, use the situation of avoiding error detection.
Physiological characteristic is calculated
When lighting with respect to Different Light, the image picture frame that described imageing sensor 14 obtains includes physiologic information and mobile message simultaneously.Therefore, the second processing unit 23 described in the present invention (or described physiological characteristic detecting unit 232) at first needs after two kinds of information separated, can correctly calculate physiological characteristic.In the present invention, described the second processing unit 23 for example adopts independent component analytic approach (Independent Component Analysis, ICA) or blind source separation method (Blind Source Separation, BSS) with two kinds of information separated.
With reference to Fig. 3 and Fig. 6, at first with described the first image I of Fig. 3
1, I
3, I
5Be example, will about a plurality of the first image picture frames (M open the original image picture frame and, open the first image picture frame or normalization the first image picture frame through the M that eliminates surround lighting mechanism) image picture frame information be divided at least two parts and try to achieve respectively mean flow rate, for example image picture frame information SI
1Being divided into mean flow rate is B
1And B
1' two parts; Image picture frame information SI
3Being divided into mean flow rate is B
3And B
3' two parts; Image picture frame information SI
2N-1Being divided into mean flow rate is B
2N-1And B
2N-1' two parts (in other embodiments can more than two parts); Wherein, image picture frame information SI
1Be for example (I
1+ I
3+ ... I
19), (I
1+ I
3+ ... I
19)/10, (I
1+ I
3+ ... I
19)/sampling parameters, (I
1+ I
3+ ... I
19)/ (10 * sampling parameters); Image picture frame information SI
3Be for example (I
21+ I
23+ ... I
39), (I
21+ I
23+ ... I
39)/10, (I
21+ I
23+ ... I
39)/sampling parameters, (I
21+ I
23+ ... I
39)/(10 * sampling parameters);Then, utilize independent component analytic approach or blind source separation method to isolate the first mobile message and the first physiologic information (as shown in Figure 6), it all is shown as a brightness and changes line style.In the present invention, mobile message given up and utilized physiologic information to calculate physiological characteristic.Scrutablely be that because the sampling frequency of described imageing sensor 14 is far longer than pulse frequency, therefore the isolated physiologic information of institute can demonstrate light intensity with the line style (similar Fig. 1) of pulse variation; Isolated mobile message distributes and does not limit as shown in Figure 6.In addition, two parts cutting apart of described image picture frame are not defined as up and down two parts.In addition, due to the physiologic information that must calculate respectively two different wave lengths, above-mentioned separable programming is respectively for the first image picture frame information SI
1, SI
3, SI
5(corresponding the first light source igniting) and the second image picture frame information SI
2, SI
4, SI
6(corresponding secondary light source is lighted) carries out.
It must be emphasized that, the displacement of described finger 9 and contact condition are directly tried to achieve according to described the first image picture frame information and described the second image picture frame information by described the second processing unit 23 (or described movement/contact detection unit 231), do not need to calculate according to the mobile message after separating.Independent component analytic approach or blind source separation method are mainly used in mixed signal is separated, and disturb to eliminate the mobile signal that is caused.
In the present invention, described the second processing unit 23 (or described movement/contact detection unit 231) also calculates Pulse Rate according at least one threshold value and described the first brightness changes and/or described the second brightness changes comparative result.
The system frequency correction mechanism
Be generally the reduction system cost, but the lower RC oscillatory circuit of described clock pulse maker 19 use costs, and the precision of RC oscillatory circuit is lower and its oscillation frequency can be along with processing procedure and operating temperature and change; Also can use crystal oscillation circuit in other embodiments, there is no particular restriction.Need system frequency (wanting accurately when for example calculating Pulse Rate) more accurately during due to the calculating physiological characteristic, before said slave device 1 is dispatched from the factory, the preferred external light source with accurate flicker frequency that uses is pressed close to the surface of contact 13S of described touching control 13, so that the brightness of the described imageing sensor 14 described external light sources of sensing variation, with the benchmark as the oscillation frequency of adjusting described clock pulse maker 19.For example, can obtain in advance described clock pulse maker 19 under different temperatures and precisely the difference value between frequency with as the system frequency correction parameter, and be stored in described the first mnemon 17.When using system frequency, as long as utilize described system frequency correction parameter can obtain oscillation frequency accurately.
Park mode
Human-computer interface system of the present invention can enter park mode after an idle Preset Time.For example, when described the second processing unit 23 does not come close to or in contact with described touch surface 13S in the described finger 9 of Preset Time judgement, can enter park mode.
Physiological characteristic is given up mechanism
The second processing unit 23 of human-computer interface system of the present invention is displacement calculating amount and physiological characteristic simultaneously, yet accurate physiological characteristic is calculated preferably in the lower situation of displacement.Therefore, the present invention can judge in advance that whether described displacement is greater than preset value, if described displacement is greater than described preset value, the image picture frame that obtains of described imageing sensor 14 only is used for displacement calculating amount or judgement contact condition and is not used for calculating physiological characteristic, does not also respond by described expression unit 24 even perhaps calculate physiological characteristic.
The present invention proposes a kind of method that reflected light according to finger surface detects physiological characteristic, comprises the following step: use the light that provides the first wavelength and second wave length from device to finger, obtain described the first wavelength reflection of light light with the reflection of light light that generates a plurality of the first image picture frames and obtain described second wave length to generate a plurality of the second image picture frames, calculating and to export the first image picture frame information of described the first image picture frame and the second image picture frame information (step S of described the second image picture frame
11); And calculate contact condition, displacement and physiological characteristic (the step S of described finger according to described the first image picture frame information and described the second image picture frame information with main device
12).In the physiological characteristic detection method of present embodiment, described the first image picture frame information and described the second image picture frame information definition are as previously mentioned.In addition, before the detailed embodiment of each step of present embodiment has been specified in, therefore repeat no more.
Physiological characteristic detection method of the present invention can be passed through the skin surface of human body detected part to calculate physiological characteristic; Therefore, the finger 9 in the invention described above embodiment is changed into other detected part of human body and also can carry out measuring ability; Human-computer interface system of the present invention has noise reduction, province's frequency range, mistake verification, eliminates the mechanism such as surround lighting, park mode and system frequency correction.Described detected part is for example that known blood oxygen instrument is for detection of the body part of blood oxygen concentration.
In sum, the known optical finger mouse can not detect user's physiological characteristic, and the mode of blood oxygen instrument calculating blood oxygen concentration is incompatible on optics finger navigation because having the factors such as detected part that can't judge in moving.Therefore, the present invention also provides a kind of human-computer interface system (Fig. 2 A and 2B), it can detect user's physiological characteristic when detecting the finger displacement, and can effectively eliminate the mobile signal that causes and disturb and eliminate the environment light source impact, and have that system frequency is proofreaied and correct, mistake is verified, save frequency range, park mode and give up the mechanism of physiologic information.
Although the present invention discloses with aforementioned embodiments, yet this is not to limit the present invention, any the technical staff in the technical field of the invention without departing from the spirit and scope of the present invention, can make various changes or modifications.Therefore protection scope of the present invention should be with being as the criterion that appending claims was defined.
Claims (20)
1. human-computer interface system, for detection of displacement and the physiological characteristic of finger, described human-computer interface system comprises:
From installing, a plurality of the first image picture frames and a plurality of the second image picture frame, calculating and the output that provide two kinds of different wave lengths to light with the relatively described two kinds of different wave lengths of generation from the reflected light of described finger with the described finger that throws light on, reception reach about presetting the second image picture frame information of Zhang Suoshu the second image picture frame about the first image picture frame information of presetting Zhang Suoshu the first image picture frame; And
Main device calculates described displacement and described physiological characteristic according to described the first image picture frame information and described the second image picture frame information.
2. human-computer interface system according to claim 1 wherein saidly is mouse, telepilot, keyboard, optical distance measurement apparatus from device; Described main device is TV, projection arrangement, game machine system or computer system.
3. human-computer interface system according to claim 1, wherein said physiological characteristic comprises blood oxygen concentration and/or Pulse Rate.
4. human-computer interface system according to claim 1 wherein saidly also comprises from device:
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled lighting and extinguishing of described the first light source and described secondary light source;
Imageing sensor receives reflected light from described finger to generate described the first image picture frame and described the second image picture frame with sampling frequency; And
The first processing unit, calculating often, the described first image picture frame information of default Zhang Suoshu the first image picture frame reaches the often described second image picture frame information of default Zhang Suoshu the second image picture frame.
5. human-computer interface system according to claim 4, wherein said the first image picture frame information for the first image picture frame of default Zhang Suoshu the first image picture frame and, average, normalization the first image picture frame of the first image picture frame and or normalization the first image picture frame average; Described the second image picture frame information for the second image picture frame of default Zhang Suoshu the second image picture frame and, average, normalization the second image picture frame of the second image picture frame and or normalization the second image picture frame average.
6. human-computer interface system according to claim 4, wherein said light source control unit is controlled described the first light source and described secondary light source extinguished in the scheduled period, so that described imageing sensor obtains a plurality of bright the first image picture frames, a plurality of bright the second image picture frame and a plurality of dark image picture frame; Described the first processing unit is according to the difference of described bright the first image picture frame and described dark image picture frame and poor described the first image picture frame information and the described second image picture frame information calculated of described bright the second image picture frame and described dark image picture frame.
7. human-computer interface system according to claim 4, wherein said light source control unit controls described the first light source and described secondary light source lights in turn so that described imageing sensor receives the reflected light of described the first light source and described secondary light source in turn; Perhaps controlling described the first light source and described secondary light source lights simultaneously so that described imageing sensor receives the reflected light of described the first light source and described secondary light source simultaneously, and described imageing sensor comprises light filter, and this light filter is covered in the part of the sensing face of described imageing sensor.
8. human-computer interface system according to claim 1, wherein said main device also comprises:
Mnemon stores described the first image picture frame information and described the second image picture frame information that receive from said slave device;
Verify the unit, check sampling and the data loss excessively of described the first image picture frame information and described the second image picture frame information; And
The second processing unit calculates described displacement and described physiological characteristic according to described the first image picture frame information and described the second image picture frame information.
9. human-computer interface system according to claim 8, wherein said the second processing unit: every described first image picture frame information is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of utilizing the independent component analytic approach to analyze described every part of described the first image picture frame information changes in the hope of the first brightness; Every described second image picture frame information is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of utilizing the independent component analytic approach to analyze described every part of described the second image picture frame information changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
10. human-computer interface system according to claim 9, wherein said the second processing unit also calculate Pulse Rate according at least one threshold value and described the first brightness changes and/or described the second brightness changes comparative result.
11. human-computer interface system according to claim 9, wherein said main device also comprise the expression unit, this expression unit is in order to respond described displacement and described physiological characteristic; Described expression unit is display, cresset, seven bytes demonstration and/or audio units.
12. human-computer interface system according to claim 1, this human-computer interface system enters park mode after idle Preset Time.
13. human-computer interface system according to claim 1, wherein when described displacement during greater than preset value, described main device is given up described physiological characteristic.
14. human-computer interface system according to claim 1 wherein saidly also comprises mnemon, this mnemon stocking system frequency correction parameter from device.
15. human-computer interface system according to claim 1, wherein said main device also compare to judge contact condition to brightness and at least one threshold value of described the first image picture frame information and described the second image picture frame information.
16. human-computer interface system according to claim 1, wherein said main device calculates described displacement according to two described the first image picture frame information, described first an image picture frame information and described second an image picture frame information and two described the second image picture frame information.
17. a finger mouse system, this finger mouse system comprise:
Optical detection apparatus, this optical detection apparatus comprises:
The first light source sends the light of the first wavelength to described finger;
Secondary light source sends the light of second wave length to described finger;
Light source control unit is controlled lighting and extinguishing of described the first light source and described secondary light source;
Imageing sensor, the reflected light that receives from described finger with sampling frequency reaches with a plurality of the first image picture frames that generate relatively described the first light source igniting a plurality of the second image picture frames that relatively described secondary light source is lighted; With
Processing unit calculates and exports about the first image picture frame information of default Zhang Suoshu the first image picture frame and about presetting the second image picture frame information of Zhang Suoshu the second image picture frame; And
Main frame receives and checks described the first image picture frame information and described the second image picture frame information, and calculates described displacement and described physiological characteristic according to described the first image picture frame information and described the second image picture frame information.
18. finger mouse according to claim 17 system wherein when described main frame checks out that described the first image picture frame information and described the second image picture frame information were sampling, gave up sampled picture picture frame information; When described main frame checks out described the first image picture frame information and described the second image picture frame information loss, carry out interpolator.
19. finger mouse according to claim 17 system, wherein said main frame: every described first image picture frame information is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of utilizing the independent component analytic approach to analyze described every part of described the first image picture frame information changes in the hope of the first brightness; Every described second image picture frame information is divided into two parts at least and calculates the mean flow rate of every part, the described mean flow rate of utilizing the independent component analytic approach to analyze described every part of described the second image picture frame information changes in the hope of the second brightness; And change and described the second described physiological characteristic of brightness change calculations according to described the first brightness.
20. a human-computer interface system, this human-computer interface system comprises:
The finger mouse device provides a plurality of the first image picture frames and a plurality of the second image picture frame, calculating and the output that two kinds of different wave lengths are pointed to throw light on, reception is lighted with the relatively described two kinds of different wave lengths of generation from the reflected light of described finger to reach about presetting the second image picture frame information of Zhang Suoshu the second image picture frame about the first image picture frame information of presetting Zhang Suoshu the first image picture frame; And
Main frame, this main frame comprises:
Processing unit is according to described the first image picture frame information and described the second image picture frame information displacement calculating amount and physiological characteristic; With
The expression unit is in order to respond described displacement and described physiological characteristic.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110389525.5A CN103135801B (en) | 2011-11-30 | 2011-11-30 | Human-computer interface system and finger mouse system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110389525.5A CN103135801B (en) | 2011-11-30 | 2011-11-30 | Human-computer interface system and finger mouse system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103135801A true CN103135801A (en) | 2013-06-05 |
| CN103135801B CN103135801B (en) | 2016-01-20 |
Family
ID=48495730
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110389525.5A Active CN103135801B (en) | 2011-11-30 | 2011-11-30 | Human-computer interface system and finger mouse system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103135801B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267814A (en) * | 2014-09-25 | 2015-01-07 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN106019265A (en) * | 2016-05-27 | 2016-10-12 | 北京小鸟看看科技有限公司 | Multi-target positioning method and system |
| WO2017008420A1 (en) * | 2015-07-10 | 2017-01-19 | 深圳市汇顶科技股份有限公司 | Touch pressure detection device and method |
| WO2018112351A1 (en) * | 2016-12-15 | 2018-06-21 | ViviPulse, LLC | Wearable pulse waveform measurement system and method |
| JP7563450B2 (en) | 2019-10-15 | 2024-10-08 | コーニンクレッカ フィリップス エヌ ヴェ | High Dynamic Range Vital Signs Extraction |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090015558A1 (en) * | 2007-07-11 | 2009-01-15 | Chin-Yeh Hung | Mouse capable of detecting a pulse |
| TW201013472A (en) * | 2008-09-24 | 2010-04-01 | Kye Systems Corp | Computer input device of dual-core dual-coordinate output type, data input processing method of dual core type and sensing apparatus thereof |
| US20100123655A1 (en) * | 2008-11-14 | 2010-05-20 | Kye Systems Corp. | Optical trace detecting module |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
-
2011
- 2011-11-30 CN CN201110389525.5A patent/CN103135801B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090015558A1 (en) * | 2007-07-11 | 2009-01-15 | Chin-Yeh Hung | Mouse capable of detecting a pulse |
| TW201013472A (en) * | 2008-09-24 | 2010-04-01 | Kye Systems Corp | Computer input device of dual-core dual-coordinate output type, data input processing method of dual core type and sensing apparatus thereof |
| US20100123655A1 (en) * | 2008-11-14 | 2010-05-20 | Kye Systems Corp. | Optical trace detecting module |
| CN201569991U (en) * | 2009-12-04 | 2010-09-01 | 亚星健康科技有限公司 | Mouse for measuring oxygen concentration in blood |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267814A (en) * | 2014-09-25 | 2015-01-07 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104267814B (en) * | 2014-09-25 | 2019-02-05 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| WO2017008420A1 (en) * | 2015-07-10 | 2017-01-19 | 深圳市汇顶科技股份有限公司 | Touch pressure detection device and method |
| CN106019265A (en) * | 2016-05-27 | 2016-10-12 | 北京小鸟看看科技有限公司 | Multi-target positioning method and system |
| US10089749B2 (en) | 2016-05-27 | 2018-10-02 | Beijing Pico Technology Co., Ltd. | Method and system for locating a plurality of targets# |
| WO2018112351A1 (en) * | 2016-12-15 | 2018-06-21 | ViviPulse, LLC | Wearable pulse waveform measurement system and method |
| US10980428B2 (en) | 2016-12-15 | 2021-04-20 | ViviPulse, LLC | Wearable pulse waveform measurement system and method |
| JP7563450B2 (en) | 2019-10-15 | 2024-10-08 | コーニンクレッカ フィリップス エヌ ヴェ | High Dynamic Range Vital Signs Extraction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103135801B (en) | 2016-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI438658B (en) | User interface system and optical finger mouse system | |
| TWI489325B (en) | Optical finger mouse, electronic device and physiological characteristic detection device | |
| TWI451295B (en) | Optical finger mouse, mouse control module and physiological characteristic detection method thereof | |
| TWI476641B (en) | Remote controller and display system | |
| TWI475193B (en) | Optical distance measurement system and operation method thereof | |
| US9652036B2 (en) | Device, head mounted display, control method of device and control method of head mounted display | |
| CN103135801B (en) | Human-computer interface system and finger mouse system | |
| CN212391984U (en) | Display with optical sensor | |
| TWI474215B (en) | Keyboard module and display system | |
| CN103529929B (en) | Gesture recognition system and glasses capable of recognizing gesture actions | |
| TWI461972B (en) | Optical mouse and operating method thereof | |
| JP5834439B2 (en) | Head-mounted display device and method for controlling head-mounted display device | |
| US20140285404A1 (en) | Head-mounted display device and method of controlling head-mounted display device | |
| US9289159B2 (en) | User Identification method, physiological detection device and physiological detection method | |
| JP5953714B2 (en) | Device, head-mounted display device, device control method, and head-mounted display device control method | |
| CN103034342B (en) | Optics finger navigation, electronic installation and physiological characteristic pick-up unit | |
| CN103576857A (en) | Fast wake-up in gaze tracking system | |
| CN103425852A (en) | User recognition method, physiological detection device and physiological detection method | |
| CN105302379B (en) | Touch detection method and optical touch system thereof | |
| CN117215401A (en) | Hybrid pixel dynamic vision sensor tracking using IR and ambient light | |
| US20150248189A1 (en) | Touch Sensing Systems | |
| CN103135800B (en) | Optics finger navigation, mouse control module and physiological characteristic detection method thereof | |
| JP2009522681A (en) | Remote pointing device and method using image sensor | |
| CN103135772A (en) | Keyboard module and display system | |
| US9746915B1 (en) | Methods and systems for calibrating a device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |