CN213092014U

CN213092014U - Intelligent glasses and intelligent glasses system

Info

Publication number: CN213092014U
Application number: CN202021525060.2U
Authority: CN
Inventors: 张昆
Original assignee: Shenzhen Liandi Information Accessibility Co ltd
Current assignee: Shenzhen Liandi Information Accessibility Co ltd
Priority date: 2020-07-28
Filing date: 2020-07-28
Publication date: 2021-04-30
Anticipated expiration: 2030-07-28

Abstract

The utility model relates to an intelligence wearing equipment technical field, in particular to intelligence glasses and intelligent glasses system. The embodiment of the utility model provides intelligent glasses and an intelligent glasses system, which comprises a first camera, an audio acquisition module and an augmented reality display; the first camera is used for collecting images containing character information, the audio collection module is used for collecting audio data, and the augmented reality display is used for displaying a first target language text obtained according to the image information and a second target language text obtained according to the audio data. Therefore, the utility model discloses can show the first target language text that the person of wearing that translates into by the text information in the image information can read and understand; the utility model discloses can also show the second target language text after the audio data translation by the interlocutor, the event can show the pronunciation of interlocutor with the mode of the characters that the wearer can read and understand, consequently the wearer can understand the speech content of interlocutor through the mode of reading the characters.

Description

Intelligent glasses and intelligent glasses system

Technical Field

The utility model relates to an intelligence wearing equipment technical field, in particular to intelligence glasses and intelligent glasses system.

Background

Hearing impairment is a hearing impairment that is inaudible or inaudible due to congenital genetic or acquired factors. Due to the defect of auditory stimulation, the information acquisition of the hearing-impaired patients depends more on vision and touch sense, and comprehensive information combining audio and video is not easy to form. In the social process, the information acquired by the hearing-impaired patient is usually incomplete, so misunderstanding is easy to generate in the communication process, and the hearing-impaired patient is difficult to be really integrated into social life.

Hearing impaired patients typically communicate with others using sign language or hearing aids. However, most of the normal hearing people do not have the skill of using sign language and cannot communicate with the hearing-impaired patient through the sign language; in addition, when the hearing-impaired person communicates with the foreign person, even if the hearing-impaired person uses the hearing aid, the language of the foreign person may not be understood. Therefore, the hearing impaired has many difficulties in communicating with others.

SUMMERY OF THE UTILITY MODEL

In order to overcome the problem that the patient of hearing the barrier communicates with other people the difficulty, the utility model provides an intelligence glasses and intelligent glasses system can gather audio data and will show with augmented reality's mode according to the text message that audio data acquireed, makes the person of wearing can understand the words that other people said with the form of reading the characters.

In order to solve the technical problem, an embodiment of the utility model provides a following technical scheme:

in a first aspect, an embodiment of the present invention provides a pair of smart glasses, the smart glasses include:

a mirror frame;

the first camera is arranged on the mirror frame and is used for collecting images containing text information;

the audio acquisition module is used for acquiring audio data;

the communication module is used for sending the image information and the audio data, and receiving first character information obtained according to the image containing the character information and second character information obtained according to the audio data;

the display device is arranged on the mirror frame and is used for displaying the first text information and the second text information in an augmented reality mode;

and the controller is in communication connection with the first camera, the communication module, the audio acquisition module and the display device.

Optionally, the smart glasses further include a ranging sensor, the ranging sensor is in communication connection with the controller, and the ranging sensor is configured to measure a distance between the ranging sensor and an obstacle;

the distance measuring sensor comprises an ultrasonic distance measuring sensor, an infrared distance measuring instrument or a laser distance measuring sensor.

Optionally, the smart glasses further include a heart rate sensor and a step-counting sensor communicatively connected to the controller.

Optionally, the step-counting sensor includes an acceleration sensor, and the heart rate sensor includes a reflection-type photoelectric heart rate sensor.

Optionally, the smart glasses further include a second camera and an audio playing device, which are disposed on the glasses frame, and the second camera and the audio playing device are respectively in communication connection with the controller;

the second camera is used for collecting sign language information;

and the audio playing device is used for playing the target language voice obtained according to the sign language information.

Optionally, the smart glasses further comprise a bulb in communication connection with the controller, the bulb is mounted on the frame, and the bulb is used for illumination.

Optionally, the intelligent glasses further comprise a vibration motor, the vibration motor is in communication connection with the controller, and the vibration motor is used for reminding the user through vibration.

Optionally, the smart glasses further include an indicator light in communication connection with the controller, and the indicator light is at least used for indicating the starting states of the first camera and the audio acquisition module.

Optionally, the smart glasses further include a headband, the headband includes a first end and a second end, the first end and the second end are respectively connected to two sides of the frame, and the headband fixes the frame.

In a second aspect, an embodiment of the present invention provides an intelligent glasses system, where the intelligent glasses system includes a server and the intelligent glasses of the first aspect, and the server is in communication connection with the intelligent glasses;

the server is used for receiving the image containing the character information sent by the intelligent glasses and acquiring a first target language text based on the image containing the character information; and the number of the first and second groups,

the intelligent glasses are used for receiving the audio data sent by the intelligent glasses and converting the audio data into a second target language text.

The utility model discloses embodiment's beneficial effect is: different from the prior art, the embodiment of the utility model provides an intelligent glasses and an intelligent glasses system, which comprises a first camera, an audio acquisition module and an augmented reality display; the first camera is used for collecting images containing character information, the audio collection module is used for collecting audio data, and the augmented reality display is used for displaying a first target language text obtained according to the image information and a second target language text obtained according to the audio data. Therefore, the utility model discloses can show the first target language text that the person of wearing that translates by the text information in the image information can read and understand on the augmented reality display; the utility model discloses can also show the second target language text after the audio data translation by the interlocutor, the event can show the mode of the characters that the interlocutor's pronunciation can be read and understood with the wearer, consequently the wearer can understand the speaking content of interlocutor through the vision.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a schematic diagram of a hardware structure of smart glasses according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of smart glasses according to an embodiment of the present invention;

fig. 3 is a schematic mechanism diagram of a smart eyewear system according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the invention.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

The utility model provides intelligent glasses, which comprises a glass frame, a first camera, an audio acquisition module, an augmented reality display and a controller, wherein the first camera, the audio acquisition module, the augmented reality display and the controller are arranged on the glass frame, and the first camera is used for acquiring images containing text information; the audio acquisition module is used for acquiring audio data, and can be a headset; the augmented reality display is used for displaying a first target language text obtained according to the image information and displaying a second target language text obtained according to the audio data. Fig. 1 schematically shows a hardware structure of the smart glasses 100, and as shown in fig. 1, the controller 101 is communicatively connected to the first camera 102, the audio acquisition module 103, and the augmented reality display 104. The smart glasses 100 send the image containing the text information captured by the first camera 102 to the server, so that the server obtains the first target language text according to the text information in the image containing the text information.

For example, in the above example, when the text information included in the image information collected by the first camera is "Hello" and the language of the first target language is chinese, the server may analyze the text of "Hello" in the image information, translate "Hello" into "Hello", and send the text of "Hello" to the smart glasses, so that the smart glasses may display the text of "Hello" through the augmented reality display, and therefore, wearing without understanding english is able to read english with the smart glasses. In addition, when the voice information collected by the audio collection module is "Seeyou! "when the language of the second target language is Chinese, the smart glasses may convert the audio data" Seeyou! "send to server to cause server to send audio data" Seeyou! The text 'goodbye' is changed into the text 'goodbye', the 'goodbye' text is sent to the intelligent glasses, and the intelligent glasses can display the 'goodbye' text through the augmented reality display. Therefore, the embodiment of the utility model provides an intelligent glasses can help the wearing person who has the hearing impairment to understand the words that the interlocutor said through the form of reading the characters.

The embodiment of the present invention provides a language of the first target language text and the second target language text is a preset language of any form, for example, chinese, english, french or korean, etc.

In some embodiments, the smart eyewear 100 also includes a ranging sensor 105 communicatively coupled to the controller 101, the ranging sensor 105 being configured to measure a distance between the ranging sensor 105 and an obstacle. Optionally, the distance measuring sensor 105 includes at least one of an ultrasonic distance measuring sensor, an infrared distance meter, and a laser distance measuring sensor.

In some embodiments, the smart eyewear 100 also includes a heart rate sensor 106 communicatively connected to the controller 101. The heart rate sensor 106 is used for acquiring the heart rate condition of the intelligent glasses wearer, the heart rate is a professional term for describing a heart cycle and refers to the number of beats per minute of the heart, and the heart rate is an important index of physical health or not. Specifically, the heart rate sensor 106 may be a reflective photoelectric heart rate sensor, when the reflective photoelectric heart rate sensor contacts with the skin, infrared light with a wavelength of 960nm emitted by an infrared light emitting tube is reflected and enters an infrared receiving tube, at this time, the light intensity is weakened and the light intensity signal is in a pulsating change, and after photoelectric conversion, the output current of the infrared receiving tube is changed in the same rule, so that the extraction of the heart rate signal is realized.

In some embodiments, the smart glasses further include a step-counting sensor for counting the exercise status of the user, and specifically, the step-counting sensor may be an acceleration sensor, which is a sensor capable of measuring acceleration and converting the acceleration into a usable output signal. The acceleration sensor generally comprises a mass block, a damper, an elastic element, a sensitive element, an adjusting circuit and the like, and obtains an acceleration value by measuring the inertial force applied to the mass block and utilizing Newton's second law.

In some embodiments, the smart eyewear 100 also includes a reminder module 107, the reminder module 107 being communicatively coupled to the controller 101. The controller 101 stores a heart rate preset value and a step counting preset value, and when the controller 101 receives a heart rate real-time value acquired by the heart rate sensor 106 and a step counting real-time value acquired by the step counting sensor, the heart rate real-time value is compared with the heart rate preset value, the step counting real-time value is compared with the step counting preset value, and a comparison result is output; for example, based on the data provided by the heart rate sensor and the step-counting sensor, the reminder module 107 may issue a reminder such as a sedentary reminder, lack of exercise, or excessive exercise to prompt the wearer by comparing the data with a preset value. The reminding module 107 may be specifically a vibration motor and/or an audio device, wherein the vibration motor reminds the wearer by vibration, and the audio device reminds the user by making a sound. Specifically, the audio device may be a sound box or a stereo speaker.

In some embodiments, the smart glasses 100 further comprise an indicator light 108, the indicator light 108 is in communication with the controller 101, and the indicator light 108 may be an LED light. The indicator light 108 is at least used for indicating the working state of the first camera 102 and the audio acquisition module 103. For example, the indicator lights 108 may include a purple indicator light and a blue indicator light, wherein the purple indicator light is used to indicate the on state of the audio capture module; the blue indicator light is used to indicate the operating status of the first camera 102. For example, after the first camera 102 is turned on, when the first camera 102 is in a photographing state, the blue indicator light displays blue and is normally on; when the first camera 102 is in the recording condition, the blue indicator light shows blue flashing.

In some embodiments, the smart eyewear 100 further includes a light bulb 109 communicatively coupled to the controller 101, the light bulb 109 being mounted to the frame, the light bulb 109 being used for illumination, e.g., illumination that may be used at night or in low light environments during the day.

In some embodiments, the smart glasses further include a wireless communication module in communication connection with the controller, the wireless communication module is configured to wirelessly communicate with an external device, and the wireless communication module may specifically be a WIFI module or a bluetooth module.

In some implementations, in order to facilitate the interlocutor to understand the sign language used by the wearer, the smart glasses further include a second camera and an audio playing device which are in communication connection with the controller, the second camera and the audio playing device are arranged on the glasses frame, and the second camera is used for collecting sign language information. And after the sign language information is collected by the second camera, the audio playing equipment is used for playing the target language voice obtained according to the sign language information. In this embodiment, when the wearer of the smart glasses communicates with the interlocutor, the smart glasses can play the corresponding target language voice according to the sign language used by the wearer, so that the interlocutor who does not know the sign language can conveniently understand the meaning that the wearer wants to express. The audio playing device in this embodiment may specifically be a sound box or a speaker.

Referring to fig. 2, fig. 2 schematically illustrates a structure of smart glasses, and as shown in fig. 2, the smart glasses 200 further includes a headband 201, the headband 201 is mounted on the frame 202, the headband 201 includes a first end and a second end, and the first end and the second end are respectively connected to two sides of the frame 202, and the headband 201 is used for fixing the frame 202, and specifically, the frame 202 may be fixed on the head of a wearer by the headband 201.

Referring to fig. 3, fig. 3 schematically shows a structure of a smart glasses system, and as shown in fig. 3, the smart glasses system 300 includes a server 301 and smart glasses 302 provided in any embodiment of the present invention, and the smart glasses 302 are communicatively connected to the server 301. The server 301 may be configured to receive the image containing the text information collected and sent by the smart glasses 302, and the server 301 analyzes the text information in the image containing the text information to obtain the first target language text. For example, when the image containing the text information contains an "apple" word, the server 301 can analyze the "apple" word in the image to obtain an "apple" text; when the language of the first target language text is the chinese language, the server 301 directly sends the text data of "apple" to the smart glasses 302; when the language of the first target language text is English, the server translates Chinese apple into English apple according to the text data of apple, and sends the text data of apple to the intelligent glasses.

Further, in the above example, the server 301 may also receive audio data sent by the smart glasses 302, and convert the audio data into a second target language text. For example, when the server 301 receives the voice "apple" sent by the smart glasses 302, the voice "apple" may be exchanged into the text "applet" and the text "applet" may be sent to the smart glasses 302, so that the smart glasses 302 display the text "applet" in an augmented reality manner.

Optionally, in some embodiments, the server 301 may further receive sign language information sent by the smart glasses 302, convert the sign language information into target language voice, and send the target language voice to the smart glasses 302, so that the smart glasses 302 play the target language voice.

The embodiment of the present invention provides a language of the first target language text, the second target language text, and the target language voice is a preset language of any form, for example, english, french, korean, etc.

The embodiment of the utility model provides intelligent glasses and an intelligent glasses system, which comprises a first camera, an audio acquisition module and an augmented reality display; the first camera is used for collecting images containing character information, the audio collection module is used for collecting audio data, and the augmented reality display is used for displaying a first target language text obtained according to the image information and a second target language text obtained according to the audio data. Therefore, the utility model discloses can show the first target language text that the person of wearing that translates by the text information in the image information can read and understand on the augmented reality display; the utility model discloses can also show the second target language text after the audio data translation by the interlocutor, the event can show the mode of the characters that the interlocutor's pronunciation can be read and understood with the wearer, consequently the wearer can understand the speaking content of interlocutor through the vision. The event the embodiment of the utility model provides an intelligent glasses and intelligent glasses system can be for listening the barrier patient and communicate with other people and facilitate.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit it; within the idea of the invention, also technical features in the above embodiments or in different embodiments can be combined, steps can be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention.

Claims

1. A smart eyewear, comprising:

a mirror frame;

the audio acquisition module is used for acquiring audio data;

the augmented reality display is arranged on the picture frame and used for displaying a first target language text obtained according to the image containing the character information and displaying a second target language text obtained according to the audio data;

a controller in communication with the first camera, the audio acquisition module, and the augmented reality display.

2. The smart eyewear of claim 1, further comprising a ranging sensor in communication with the controller, the ranging sensor configured to measure a distance between the ranging sensor and an obstacle;

3. The smart eyewear of claim 1, further comprising a heart rate sensor and a step-counting sensor communicatively coupled to the controller.

4. The smart eyewear of claim 3, wherein the step-counting sensor comprises an acceleration sensor and the heart rate sensor comprises a reflective photoelectric heart rate sensor.

5. The smart glasses according to any one of claims 1-4, further comprising a second camera and an audio playing device disposed on the glasses frame, wherein the second camera and the audio playing device are respectively connected to the controller in communication;

the second camera is used for collecting sign language information;

6. The smart eyewear of claim 5 further comprising a light bulb communicatively coupled to the controller, the light bulb being mounted to the frame, the light bulb being configured to illuminate.

7. The smart glasses according to claim 5, further comprising a reminder module, the reminder module being communicatively connected to the controller, the reminder module being configured to remind a user.

8. The smart glasses of claim 5, further comprising an indicator light communicatively coupled to the controller, the indicator light configured to indicate at least an operating status of the first camera and the audio capture module.

9. The smart eyewear of claim 5 further comprising a headband, the headband comprising a first end and a second end, the first end and the second end being attached to respective sides of the frame, the headband configured to secure the frame.

10. A smart eyewear system comprising a server and smart eyewear according to any of claims 1-9, the server communicatively coupled to the smart eyewear;