CN109547706A - Glasses device and system - Google Patents
Glasses device and system Download PDFInfo
- Publication number
- CN109547706A CN109547706A CN201811408273.4A CN201811408273A CN109547706A CN 109547706 A CN109547706 A CN 109547706A CN 201811408273 A CN201811408273 A CN 201811408273A CN 109547706 A CN109547706 A CN 109547706A
- Authority
- CN
- China
- Prior art keywords
- data
- lens frame
- leg
- glasses
- spectacles
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 title claims abstract description 71
- 238000012545 processing Methods 0.000 claims abstract description 29
- 238000004891 communication Methods 0.000 claims abstract description 19
- 230000007613 environmental effect Effects 0.000 claims description 9
- 238000011946 reduction process Methods 0.000 claims description 2
- 238000003860 storage Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 14
- 210000001508 eye Anatomy 0.000 description 10
- 238000000034 method Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 210000003128 head Anatomy 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 210000005252 bulbus oculi Anatomy 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 241000209140 Triticum Species 0.000 description 2
- 235000021307 Triticum Nutrition 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004461 rapid eye movement Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- HEZMWWAKWCSUCB-PHDIDXHHSA-N (3R,4R)-3,4-dihydroxycyclohexa-1,5-diene-1-carboxylic acid Chemical compound O[C@@H]1C=CC(C(O)=O)=C[C@H]1O HEZMWWAKWCSUCB-PHDIDXHHSA-N 0.000 description 1
- 241001269238 Data Species 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000005622 photoelectricity Effects 0.000 description 1
- 230000036387 respiratory rate Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Remote Sensing (AREA)
- Computational Linguistics (AREA)
- Radar, Positioning & Navigation (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Eyeglasses (AREA)
Abstract
The embodiment of the present invention provides a kind of glasses device and system, which includes: lens frame and leg of spectacles, and lens frame is connect by interconnecting piece with leg of spectacles；Processor and memory connected to the processor, data collector and communication interface；Data collector is arranged in lens frame and/or leg of spectacles, by the storage of collected data into memory, carries out data processing to data so that the data in memory are sent in host computer by processor by communication interface.Through the above technical solutions, carrying out data acquisition using glasses, collected data are sent to host computer by glasses, carry out data processing by host computer, glasses device can effectively reduce kwh loss without participating in data processing work；Data collector promotes the cruising ability of glasses while meeting diversified functional requirement there are many settings in glasses.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of glasses device and systems.
Background technique
Currently, being more and more dissolved into people's lives with the development of intelligence wearing technology.For example, intelligence
Bracelet, intelligent glasses etc..
In the prior art, in order to meet user to the wearing demand of intelligent glasses, the volume and weight of intelligent glasses is not
Can be excessive, therefore have certain limitation requirement to battery capacity.Some intelligent glasses have multiple functions, for example are able to carry out ring
The acquisition of border data, and data processing (for example, spatial modeling) is carried out according to collected environmental data, wherein processor (ratio
Such as, CPU) carry out data processing when power consumption it is bigger, cause intelligent glasses be unable to satisfy for a long time continuation of the journey demand.
Based on this, a kind of scheme of Portable glasses system strong with multi-functional cruising ability is needed.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of glasses device and system, to meet user function diversification need
The scheme of the glasses system for portable demand of summing.
In a first aspect, the embodiment of the present invention provides a kind of glasses device, comprising: lens frame and leg of spectacles, the lens frame
It is connect by interconnecting piece with the leg of spectacles；
Processor and the memory being connected to the processor, data collector and communication interface；
The data collector is arranged in the lens frame and/or the leg of spectacles, and collected data storage is arrived
In the memory, so that the data in the memory are sent in host computer by processor by the communication interface
Data processing is carried out to the data.
Further, the data collector includes: the modelling component being arranged on the interconnecting piece, the modelling component
Including six degree of freedom depth camera and inertial measuring unit, the six degree of freedom depth camera and the inertial measuring unit
In vertically adjacent setting；
The six degree of freedom depth camera is for obtaining ambient image data；
The inertial measuring unit is used to obtain the pose data of the six degree of freedom depth camera；So as to the host computer
Spatial model is established according to the ambient image data and the pose data.
Further, the interconnecting piece of the glasses device includes: left interconnecting piece and right interconnecting piece；
The left interconnecting piece and the right interconnecting piece of the glasses device are symmetrically arranged the modelling component.
Further, the lens frame of the glasses device includes: left lens frame and right lens frame；
The data collector includes: left infrared camera and right infrared camera；
The left infrared camera is arranged in the left lens frame, and the right infrared camera is arranged in the right eyeglass
On frame；For obtaining biological data；
Wherein, the left vertical range of the bottom of the left infrared camera and the left lens frame, and the right side is infrared takes the photograph
As head is different from the right vertical range of bottom of the right lens frame.
Further, the data collector further include: color camera；The biological data includes: eye status data；
The colour imagery shot is arranged between the left lens frame and the right lens frame；
If the eye status data that the left infrared camera and/or the right infrared camera are got meets pre-
If trigger condition, then the processor controls the colour imagery shot and acquires image.
Further, the data collector further include: the first microphone, second microphone；First microphone is set
It sets in the bottom frame of the left lens frame, the second microphone is arranged in the bottom frame of the right lens frame, uses
In acquisition voice data, the data are acquired so that the processor controls the data collector according to the voice data.
Further, the leg of spectacles includes: the first leg of spectacles and secondary glasses leg；The data collector further include:
Third microphone, the 4th microphone；The third microphone is arranged on first leg of spectacles, the 4th microphone setting
On the secondary glasses leg；For acquiring environmental noise data, so that the processor is according to the environmental noise data pair
The voice data carries out noise reduction process.
Further, the communication interface further include: radio-frequency module；The radio-frequency module is arranged in the lens frame or institute
It states on leg of spectacles；The radio-frequency module includes WiFi unit, bluetooth unit and frequency modulation broadcasting unit.
Further, further includes: FPGA module；The processor is connect with the FPGA module, is used for described six certainly
Signal is carried out by degree depth camera, the left infrared camera and/or the right infrared camera, the colour imagery shot
Reason.
Second aspect, the embodiment of the present invention provide a kind of glasses system, the system comprises: eye as described in relation to the first aspect
Mirror device and host computer.
Glasses device provided in an embodiment of the present invention and system data collector can be arranged on the glasses device
In the lens frame and leg of spectacles of glasses, for example, by six degree of freedom depth camera, inertial measuring unit, infrared camera and
Low power consumption control device etc. is arranged in lens frame, and communication interface, microphone etc. are arranged on leg of spectacles.Further, lead to
It crosses communication interface and the collected ambient image data of data collector, inertial data and biological data etc. is sent to host computer
(for example, mobile phone, computer etc.), by host computer to various ambient image data, inertial data and the biological data etc. received
Carry out data processing (for example, generating data drawing list, spatial modeling etc.).Through the above technical solutions, carrying out data using glasses
Collected data are sent to host computer by acquisition, glasses, carry out data processing by host computer, glasses are without participating in data processing
Work, can effectively reduce kwh loss；There are many data collectors for setting in glasses, are meeting the same of diversified functional requirement
When, promote the cruising ability of glasses.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of glasses device control structure schematic diagram provided in an embodiment of the present invention；
Fig. 2 is the structural schematic diagram of the glasses device provided in the embodiment of the present invention；
Fig. 3 is a kind of six degree of freedom depth camera provided in an embodiment of the present invention and inertial measuring unit structural representation
Figure；
Fig. 4 is another glasses device control structure schematic diagram provided in an embodiment of the present invention；
Fig. 5 is the electrical block diagram of glasses device provided in an embodiment of the present invention；
Fig. 6 is a kind of glasses system schematic diagram provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
The term used in embodiments of the present invention is only to be not intended to be limiting merely for for the purpose of describing particular embodiments
The present invention.In the embodiment of the present invention and the "an" of singular used in the attached claims, " described " and "the"
It is also intended to including most forms, unless the context clearly indicates other meaning, " a variety of " generally comprise at least two, but not
It excludes to include at least one situation.
It should be appreciated that term "and/or" used herein is only a kind of incidence relation for describing affiliated partner, indicate
There may be three kinds of relationships, for example, A and/or B, can indicate: individualism A, exist simultaneously A and B, individualism B these three
Situation.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
Depending on context, word as used in this " if ", " if " can be construed to " ... when " or
" when ... " or " in response to determination " or " in response to detection ".Similarly, context is depended on, phrase " if it is determined that " or " such as
Fruit detection (condition or event of statement) " can be construed to " when determining " or " in response to determination " or " when detection (statement
Condition or event) when " or " in response to detection (condition or event of statement) ".
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
Include, so that commodity or system including a series of elements not only include those elements, but also including not clear
The other element listed, or further include for this commodity or the intrinsic element of system.In the feelings not limited more
Under condition, the element that is limited by sentence "including a ...", it is not excluded that in the commodity or system for including the element also
There are other identical elements.
In addition, the device type and type in following each embodiments are only a kind of citing, rather than considered critical.
Fig. 1 is glasses device control structure schematic diagram provided in an embodiment of the present invention, and Fig. 2 is provided in an embodiment of the present invention
The structural schematic diagram of glasses device, specifically includes that
Lens frame 21 and leg of spectacles 22, the lens frame 21 are connect by interconnecting piece 23 with the leg of spectacles 22；Processor
10 and the memory 11, data collector 12 and the communication interface 13 that are connect with the processor 10；The data collector 12
It is arranged in the lens frame 21 and/or the leg of spectacles 22, by the storage of collected data into the memory 11, so as to
The data in the memory 11 are sent in host computer by the communication interface 13 to the data by processor 10
Carry out data processing.
As shown in Figure 2, the outside of lens frame 21 is provided with interconnecting piece 23；Leg of spectacles 22 and the interconnecting piece 23 of lens frame 21 connect
It connects, leg of spectacles 22 extends towards the rear of lens frame 21.
As shown in Figure 1, data collector 12 is for being acquired environmental data, biological data etc..Data collector 12
In the storage to memory 11 of collected data.It should be noted that the processor 10 on glasses is not adopted to by data
The collected data of storage 12 carry out complicated data processing, but are sent to collected data by communication interface 13
Position machine, complicated data processing is carried out by host computer.In this way, it is possible to reduce the power consumption of glasses device, in the feelings of limited volume
Under condition, it is able to ascend the cruising ability of glasses device.In practical applications, under the premise of guaranteeing continuation of the journey demand, subtract as far as possible
Baby battery volume mitigates eyewear, user's carrying of being more convenient for.
In one or more embodiment of the invention, the data collector 12 includes: to be arranged in the interconnecting piece
Modelling component 121 on 23, the modelling component 121 include six degree of freedom depth camera 121a and inertial measuring unit
121b, the six degree of freedom depth camera 121a and the inertial measuring unit 121b are in vertically adjacent setting；It is described
Six degree of freedom depth camera 121a is for obtaining ambient image data；The inertial measuring unit 121b is for obtaining described six
The pose data of freedom degree depth camera 121a；So that the host computer is according to the ambient image data and the pose data
Establish spatial model.
If Fig. 3 is a kind of six degree of freedom depth camera provided in an embodiment of the present invention and inertial measuring unit structural representation
Figure.Six degree of freedom depth camera 121a mentioned here is for acquiring ambient image data, ambient image number mentioned here
According to the depth image data for being ambient enviroment.Pose data mentioned here are to acquire to obtain by inertial measuring unit 121b
Including the data relevant to position and posture such as direction, speed, position, height.It should be noted that deep in setting six degree of freedom
When spending camera 121a and inertial measuring unit 121b, need to guarantee to be located along the same line in vertical direction, in other words, water
Square to be not present difference.In this way when glasses are swung up and down, six degree of freedom depth camera 121a and inertial measuring unit
Horizontal angle of deviation between 121b is smaller or the angle of deviation is not present.
Based on the pose data got and depth image data, spatial model can be established.As can be seen from the foregoing, into
The power consumption of row data processing is bigger, needs outward to shift data processing power consumption, and in other words, the work of data processing is shifted
To host computer, glasses device is only responsible for acquisition and transmits these data, promotes the cruising ability of glasses device.
In one or more embodiment of the invention, the interconnecting piece 23 of the glasses device includes: left connection
Portion 231 and right interconnecting piece 232；The left interconnecting piece 231 of the glasses device and the right interconnecting piece 232 are symmetrically arranged
The modelling component 121.
In application scheme, in order to more accurate data, two groups of modelling components 121 can be set, in other words,
Each six degree of freedom depth camera 121a configures corresponding inertial measuring unit 121b.Also, each modelling component is adopted
The data collected are grouped as one group and carry out data processing.In this way, the six degree of freedom depth in each modelling component 121
All there is no horizontal angle of deviations between camera 121a and inertial measuring unit 121b.In every group of data, six degree of freedom depth
The precision of information that camera obtains can be higher, and the result for carrying out information integration is more accurate.In practical applications, in order to enable six
Freedom degree depth camera 121a can collect more depth image datas, in general, the six degree of freedom depth camera
The field angle of head 121a is 270 ° of angles, meanwhile, two six degree of freedom depth camera 121a are respectively provided to two companies in left and right
In socket part.
In one or more embodiment of the invention, the lens frame 21 of the glasses device includes: left eyeglass
Frame 211 and right lens frame 212；The data collector 12 includes: left infrared camera 122a and right infrared camera 122b；Institute
It states left infrared camera 122a to be arranged in the left lens frame 211, the right infrared camera 122b is arranged in the right mirror
On piece frame 212；For obtaining biological data；Wherein, the left infrared camera 122a and the bottom of the left lens frame 211
Left vertical range is different with the right vertical range of bottom of the right lens frame 212 from the right infrared camera 122b.
As shown in Figure 4, it can be seen that left infrared camera 122a is arranged in left 211 left frame of lens frame, right infrared photography
Head 122b is arranged in right 212 left frame of lens frame.Also, the bottom of left infrared camera 122a and the left lens frame 211
Left vertical range is different with right infrared camera 122b and the right vertical range of the bottom of the right lens frame 212, from
And can enable different infrared cameras collect different range eye information (including circumference of eyes skin letter
Breath), biological data is obtained according to different eye information processings, error caused by data processing can be reduced.
In one or more embodiment of the invention, the data collector 12 further include: colour imagery shot 123；
The biological data includes: eye status data；The setting of colour imagery shot 123 is in the left lens frame 211 and the right side
Between lens frame 212；If the eye that the left infrared camera 122a and/or the right infrared camera 122b are got
Status data meets preset trigger condition, then the processor 10 controls the colour imagery shot 123 and acquires image.
As shown in figure 4, colour imagery shot 123 is arranged between left lens frame 211 and right lens frame 212, obtained for shooting
Obtain color image.In order to enable the control colour imagery shot (RGB camera) that user is easier is taken pictures, can use left infrared
Camera 122a and/or right infrared camera 122b control colour imagery shot 123 is taken pictures.For example, it is assumed that preset trigger condition are as follows:
The continuous rapid eye movements of user are twice；The company of user is captured by left infrared camera 122a and/or right infrared camera 122b
Continuous blink movement twice, left infrared camera 122a and/or right infrared camera 122b send the data information captured
To processor 10, further, colour imagery shot 123 is controlled by processor 10 and shoots extraneous color image.It needs to illustrate
It is that eye status data mentioned here can be understood as eye related data, for example, blink movement, Rotation of eyeball movement, eye
Eyeball watches movement etc. attentively.Continuous rapid eye movements mentioned here twice, are illustrative only, and are not constituted to present techniques
The limitation of scheme.Further, by photoelectricity volume retouch based on principle, from infrared camera shoot face skin image sequence
In, the signal of pulse ingredient is extracted, and carry out signal processing using wavelet filtering, obtains volumetric blood pulse wave, further
Ground carries out energy spectrum analysis using Fourier transformation, and the relevant biological data such as heart rate value, respiratory rate, blood pressure is calculated.
In one or more embodiment of the invention, the data collector 12 further include: the first microphone 124a,
Second microphone 124b；The first microphone setting 124a is in the bottom frame of the left lens frame 211, second wheat
Gram wind 124b is arranged in the bottom frame of the right lens frame 212, for acquiring voice data, so as to the processor 10
The data collector 12, which is controlled, according to the voice data acquires the data.
As shown in Figure 4 it is found that the first microphone 124a and second microphone 124b that will be used to acquire user speech information
It is corresponding to be arranged in corresponding left and right lens frame.Specifically, the first microphone 124a is arranged in left lens frame
In 211 bottom frame, second microphone 124b is arranged in the bottom frame of right lens frame 212.By the way that microphone is set
It sets in bottom frame, so that microphone is closer apart from mouth portion, convenient for collecting clearly voice data.It is thus possible to root
According to the voice data of user, controls data collector 12 and acquire corresponding data.For example, user says the control language of " taking pictures "
Sound by the control voice collecting and issues processor 10 by microphone, and processor 10 is according to the voice content being resolved to, control
Other data collectors 12 work (for example, shooting coloured image) etc..
In one or more embodiment of the invention, the leg of spectacles includes: the first leg of spectacles 22a and secondary glasses
Leg 22b；The data collector 12 further include: third microphone 124c, the 4th microphone 124d；The third microphone 124c
It is arranged on the first leg of spectacles 22a, the 4th microphone 124b is arranged on the secondary glasses leg 22b；For adopting
Collect environmental noise data, so that the processor 10 carries out at noise reduction the voice data according to the environmental noise data
Reason.
In practical applications, it is often filled with various noises in environment, will affect acquisition and identification to user voice data.
In order to eliminate influence of the noise to voice data, it can install and be used for respectively on the first leg of spectacles 22a and secondary glasses leg 22b
The third microphone 124c and the 4th microphone 124d of acquisition noise.And accordingly realize ground to the active noise reduction of voice data at
Reason.It should be noted that in the present embodiment, the microphone for being used to acquire environmental noise data being arranged in leg of spectacles, is made
The microphone of these acquisition noises is obtained far from mouth, user speech is avoided to impact Noise Acquisition equipment.
In one or more embodiment of the invention, the communication interface 13 further include: radio-frequency module 14；It is described to penetrate
Frequency module 14 is arranged in the lens frame 21 or the leg of spectacles 22；The radio-frequency module includes WiFi unit, bluetooth unit
With frequency modulation broadcasting unit.
As shown in figure 4, radio-frequency module 14 is integrated into around processor 10 by centered on processor 10, from
And it can be received by integrated radio-frequency module 14, send data.For example, can be integrated in radio-frequency module 14 WiFi unit,
Bluetooth unit and frequency modulation broadcasting unit, it is thus possible to receive or send data by WiFi unit and network connection；It can be with
It is connect by bluetooth unit with relevant device (for example, mobile phone, earphone etc.), receives or send data；Frequency modulation can also be passed through
Radio unit (FM, Frequency Modulation), can be with broadcast listening information by the frequency modulation broadcasting unit.In addition, logical
Believe that interface 13 can also include USB interface, USB transmission data can be passed through.
In one or more embodiment of the invention, further includes: FPGA module 15；The processor 10 with it is described
FPGA module 15 connects, for red to the six degree of freedom depth camera 121a, the left infrared camera and/or the right side
Outer camera, the colour imagery shot 123 carry out signal processing.
As shown in figure 4, in practical applications, the signal that each data collector 12 is got is carried out integration processing.Example
Such as, by FPGA module 15 by six degree of freedom depth camera 121a, left infrared camera 122a and/or the right infrared photography
The acquired images information such as head 122b, the colour imagery shot 123 carry out signal processing, so as to according to required corresponding relationship
Acquired image data are sent to host computer.
In order to make it easy to understand, the embodiment of the present invention also provides a kind of electrical block diagram of glasses device, such as Fig. 5 institute
Show.In Fig. 5, CPU indicates processor, is mainly used for controlling the progress data acquisition such as data collector and communication interface and biography
It is defeated.DDR and EMMC module indicates memory, passes through data collector acquired image data and voice data for storing
Deng.Gas Gauge module indicates battery capacity detection module, and for monitoring battery capacity, avoiding battery from powering off suddenly causes to count
According to loss.PMU&Charger and DCDC/LDO module, for controlling the charging process of battery and for the process of system power supply.USB
Interface (communication interface), can be used for transmitting storing data.IR_LED and IR_Driver in figure is for cooperating IR camera
(indicating left infrared camera and right infrared camera) captures eyeball movement.6DOF camera in figure (take the photograph by six degree of freedom depth
As head) and double IMU (inertia measuring module) be used to obtain depth image data and pose data.RF_IC module (indicates that communication connects
Mouthful) it include 2.4GHZ WIFI, BT and FM function module, respectively indicate WiFi unit, bluetooth unit and frequency modulation broadcasting unit.By
As can be seen that 6DOF camera, IR camera and RGB camera (indicating colour imagery shot) while and FPGA module in figure
Connection, carries out integration processing to picture signal by FPGA.It further, further include 4 DMIC (the first microphone, the second wheat
Gram wind, third microphone, the 4th microphone) and 2 Speaker (loudspeaker), 4 DMIC be used to acquire the sound of user and environment
Sound, 2 Speaker are for playing the voice data got.Meanwhile the keys such as button are additionally provided with, it is used for control switch
Machine.
According to above-described embodiment it is found that on the glasses device, data collector can be arranged in the lens frame of glasses
On leg of spectacles, for example, by six degree of freedom depth camera, inertial measuring unit, infrared camera and low power consumption control device
Deng setting in lens frame, communication interface, microphone etc. are arranged on leg of spectacles.Further, it will be counted by communication interface
Host computer is sent to (for example, mobile phone, calculating according to the collected ambient image data of collector, inertial data and biological data etc.
Machine etc.), data processing (ratio is carried out to various ambient image data, inertial data and biological data received etc. by host computer
Such as, data drawing list, spatial modeling etc. are generated).Through the above technical solutions, carrying out data acquisition using glasses, glasses will be acquired
To data be sent to host computer, data processing is carried out by host computer, glasses can effectively subtract without participating in data processing work
Few kwh loss；There are many data collectors for setting in glasses, while meeting diversified functional requirement, promote the continuous of glasses
Boat ability.
Based on same thinking, as shown in fig. 6, the embodiment of the present invention also provides a kind of glasses system, which includes
Glasses device 61 described in above-described embodiment and host computer 62.
Specifically, the above-mentioned 61 collected data of institute of glasses device are sent to host computer 62, counted by host computer 62
According to processing, the workload of the CPU at 61 end of glasses device can be reduced in this way, can effectively reduce power consumption, promote glasses device 61
Length in cruise duration.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness
Labour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of required general hardware platform is added, naturally it is also possible to which reality is come in conjunction with by way of hardware and software
It is existing.Based on this understanding, substantially the part that contributes to existing technology can be to calculate in other words for above-mentioned technical proposal
The form of machine product embodies, and it wherein includes the meter of computer usable program code that the present invention, which can be used in one or more,
The computer journey implemented in calculation machine usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of sequence product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
General purpose computer, special purpose computer, Embedded Processor or other programmable coordinates are instructed to determine the processor of equipment to produce
A raw machine, so that being generated by the instruction that computer or other programmable coordinates determine that the processor of equipment executes for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable coordinates determine equipment with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions can also be loaded into computer or other programmable coordinates determine in equipment, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (10)
1. a kind of glasses device characterized by comprising
Lens frame and leg of spectacles, the lens frame are connect by interconnecting piece with the leg of spectacles；
Processor and the memory being connected to the processor, data collector and communication interface；
The data collector is arranged in the lens frame and/or the leg of spectacles, and collected data are stored to described
In memory, so that the data in the memory are sent in host computer by the communication interface to institute by processor
It states data and carries out data processing.
2. equipment according to claim 1, which is characterized in that the data collector includes: to be arranged in the interconnecting piece
On modelling component, the modelling component includes six degree of freedom depth camera and inertial measuring unit, and the six degree of freedom is deep
Camera and the inertial measuring unit are spent in vertically adjacent setting；
The six degree of freedom depth camera is for obtaining ambient image data；
The inertial measuring unit is used to obtain the pose data of the six degree of freedom depth camera；So as to the host computer according to
The ambient image data and the pose data establish spatial model.
3. equipment according to claim 2, which is characterized in that the interconnecting piece of the glasses device includes: left connection
Portion and right interconnecting piece；
The left interconnecting piece and the right interconnecting piece of the glasses device are symmetrically arranged the modelling component.
4. equipment according to claim 2, which is characterized in that the lens frame of the glasses device includes: left eyeglass
Frame and right lens frame；
The data collector includes: left infrared camera and right infrared camera；
The left infrared camera is arranged in the left lens frame, and the right infrared camera is arranged in the right lens frame
On；For obtaining biological data；
Wherein, the left vertical range of the bottom of the left infrared camera and the left lens frame, with the right infrared camera
It is different from the right vertical range of bottom of the right lens frame.
5. equipment according to claim 4, which is characterized in that the data collector further include: color camera；The life
Object data include: eye status data；
The colour imagery shot is arranged between the left lens frame and the right lens frame；
If the eye status data that the left infrared camera and/or the right infrared camera are got meets default touching
Clockwork spring part, then the processor controls the colour imagery shot and acquires image.
6. equipment according to any one of claim 4 or 5, which is characterized in that the data collector further include: first
Microphone, second microphone；
First microphone is arranged in the bottom frame of the left lens frame, and the second microphone is arranged in the right mirror
In the bottom frame of piece frame, for acquiring voice data, so that the processor controls the data according to the voice data
Collector acquires the data.
7. equipment according to claim 6, which is characterized in that the leg of spectacles includes: the first leg of spectacles and secondary glasses
Leg；The data collector further include: third microphone, the 4th microphone；
The third microphone is arranged on first leg of spectacles, and the 4th microphone is arranged in the secondary glasses leg
On；For acquiring environmental noise data, so that the processor carries out the voice data according to the environmental noise data
Noise reduction process.
8. equipment according to claim 1 or claim 7, which is characterized in that the communication interface further include: radio-frequency module；
The radio-frequency module is arranged in the lens frame or the leg of spectacles；The radio-frequency module includes WiFi unit, bluetooth
Unit and frequency modulation broadcasting unit.
9. equipment according to claim 6, which is characterized in that further include: FPGA module；
The processor is connect with the FPGA module, for the six degree of freedom depth camera, the left infrared photography
Head and/or the right infrared camera, the colour imagery shot carry out signal processing.
10. a kind of glasses system characterized by comprising glasses device as claimed in any one of claims 1-9 wherein and upper
Position machine.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811408273.4A CN109547706A (en) | 2018-11-23 | 2018-11-23 | Glasses device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811408273.4A CN109547706A (en) | 2018-11-23 | 2018-11-23 | Glasses device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109547706A true CN109547706A (en) | 2019-03-29 |
Family
ID=65849452
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811408273.4A Pending CN109547706A (en) | 2018-11-23 | 2018-11-23 | Glasses device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109547706A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110161723A (en) * | 2019-06-03 | 2019-08-23 | 梁勇 | A kind of mobile monitor identification glasses |
| CN113712539A (en) * | 2021-08-31 | 2021-11-30 | 刘宏图 | Intelligent healthy glasses for children |
| CN113855024A (en) * | 2021-11-05 | 2021-12-31 | 安徽医科大学附属巢湖医院 | Wearable equipment for all-weather evaluation of depression symptoms of depression patients |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103310683A (en) * | 2013-05-06 | 2013-09-18 | 深圳先进技术研究院 | Intelligent glasses and voice communication system and method basing on intelligent glasses |
| CN204883092U (en) * | 2015-09-10 | 2015-12-16 | 陈包容 | Intelligence glasses based on sight technique of tracking |
| CN105989357A (en) * | 2016-01-18 | 2016-10-05 | 合肥工业大学 | Human face video processing-based heart rate detection method |
| CN106101562A (en) * | 2016-08-16 | 2016-11-09 | 重庆交通大学 | A kind of camera installation taken pictures according to eye motion |
| CN106168855A (en) * | 2016-07-01 | 2016-11-30 | 北京麦哲科技有限公司 | A kind of portable MR glasses, mobile phone and MR glasses system |
| CN205900093U (en) * | 2016-06-30 | 2017-01-18 | 联想(北京)有限公司 | Make an uproar device and virtual reality equipment fall |
| CN106843491A (en) * | 2017-02-04 | 2017-06-13 | 上海肇观电子科技有限公司 | Smart machine and electronic equipment with augmented reality |
| CN106941549A (en) * | 2017-04-28 | 2017-07-11 | 苏州科技大学 | The communication device for mobile phone and its processing method of a kind of dual microphone noise reduction |
| CN107669253A (en) * | 2017-11-15 | 2018-02-09 | 中国科学院光电研究院 | Heart rate and respiratory rate measuring method based on optical spectrum imagers |
| CN209345275U (en) * | 2018-11-23 | 2019-09-03 | 歌尔智能科技有限公司 | Glasses device and system |
-
2018
- 2018-11-23 CN CN201811408273.4A patent/CN109547706A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103310683A (en) * | 2013-05-06 | 2013-09-18 | 深圳先进技术研究院 | Intelligent glasses and voice communication system and method basing on intelligent glasses |
| CN204883092U (en) * | 2015-09-10 | 2015-12-16 | 陈包容 | Intelligence glasses based on sight technique of tracking |
| CN105989357A (en) * | 2016-01-18 | 2016-10-05 | 合肥工业大学 | Human face video processing-based heart rate detection method |
| CN205900093U (en) * | 2016-06-30 | 2017-01-18 | 联想(北京)有限公司 | Make an uproar device and virtual reality equipment fall |
| CN106168855A (en) * | 2016-07-01 | 2016-11-30 | 北京麦哲科技有限公司 | A kind of portable MR glasses, mobile phone and MR glasses system |
| CN106101562A (en) * | 2016-08-16 | 2016-11-09 | 重庆交通大学 | A kind of camera installation taken pictures according to eye motion |
| CN106843491A (en) * | 2017-02-04 | 2017-06-13 | 上海肇观电子科技有限公司 | Smart machine and electronic equipment with augmented reality |
| CN106941549A (en) * | 2017-04-28 | 2017-07-11 | 苏州科技大学 | The communication device for mobile phone and its processing method of a kind of dual microphone noise reduction |
| CN107669253A (en) * | 2017-11-15 | 2018-02-09 | 中国科学院光电研究院 | Heart rate and respiratory rate measuring method based on optical spectrum imagers |
| CN209345275U (en) * | 2018-11-23 | 2019-09-03 | 歌尔智能科技有限公司 | Glasses device and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110161723A (en) * | 2019-06-03 | 2019-08-23 | 梁勇 | A kind of mobile monitor identification glasses |
| CN113712539A (en) * | 2021-08-31 | 2021-11-30 | 刘宏图 | Intelligent healthy glasses for children |
| CN113712539B (en) * | 2021-08-31 | 2023-11-14 | 刘宏图 | Intelligent healthy glasses for children |
| CN113855024A (en) * | 2021-11-05 | 2021-12-31 | 安徽医科大学附属巢湖医院 | Wearable equipment for all-weather evaluation of depression symptoms of depression patients |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN216083276U (en) | Wearable imaging device | |
| US10342428B2 (en) | Monitoring pulse transmissions using radar | |
| US10175753B2 (en) | Second screen devices utilizing data from ear worn device system and method | |
| US20170363885A1 (en) | Image alignment systems and methods | |
| CN110647865A (en) | Face gesture recognition method, device, equipment and storage medium | |
| WO2021013230A1 (en) | Robot control method, robot, terminal, server, and control system | |
| CN103869468B (en) | Information processing apparatus | |
| US20170109131A1 (en) | Earpiece 3D Sound Localization Using Mixed Sensor Array for Virtual Reality System and Method | |
| KR20150102026A (en) | Display update time reduction for a near-eye display | |
| US20230113647A1 (en) | Object measurement method, virtual object processing method, and electronic device | |
| WO2021147434A1 (en) | Artificial intelligence-based face recognition method and apparatus, device, and medium | |
| CN109547706A (en) | Glasses device and system | |
| CN109002164A (en) | It wears the display methods for showing equipment, device and wears display equipment | |
| US11240596B2 (en) | Systems and methods for directing audio output of a wearable apparatus | |
| CA2906629A1 (en) | Social data-aware wearable display system | |
| CN106648068A (en) | Method for recognizing three-dimensional dynamic gesture by two hands | |
| US11902677B2 (en) | Patch tracking image sensor | |
| EP4035348A1 (en) | Automated video capture and composition system | |
| CN111526476A (en) | Data transmission method, data transmission device, storage medium and terminal equipment | |
| WO2020264149A1 (en) | Fast hand meshing for dynamic occlusion | |
| US11610607B1 (en) | Video highlights with user viewing, posting, sending and exporting | |
| CN206161960U (en) | Virtual reality glasses | |
| CN209345275U (en) | Glasses device and system | |
| WO2022135272A1 (en) | Three-dimensional model reconstruction method, device, and storage medium | |
| CN206411610U (en) | A kind of bimanual input identifying system based on IOS terminals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |