CN106918908B - Intelligent operation guidance glasses - Google Patents
Intelligent operation guidance glasses Download PDFInfo
- Publication number
- CN106918908B CN106918908B CN201510990960.1A CN201510990960A CN106918908B CN 106918908 B CN106918908 B CN 106918908B CN 201510990960 A CN201510990960 A CN 201510990960A CN 106918908 B CN106918908 B CN 106918908B
- Authority
- CN
- China
- Prior art keywords
- glasses
- camera
- projector
- work guidance
- guidance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011521 glass Substances 0.000 title claims abstract description 44
- 210000001525 retina Anatomy 0.000 claims abstract description 9
- 230000009471 action Effects 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 9
- 238000012544 monitoring process Methods 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 6
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 229910052744 lithium Inorganic materials 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eyeglasses (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention is suitable for the field of operation guidance, and provides an intelligent operation guidance glasses, which comprises a glasses frame and further comprises: the camera is used for shooting operation scenes; the projector is connected with the camera and is used for converting the operation scene shot by the camera into a projection signal; a semi-transparent prism connected with the projector to focus the reflected light of the work operation scene and the projection signal to a retina of a human eye; the operation guidance module is respectively connected with the camera and the projector, converts an operation instruction into a projection signal through the projector and projects the projection signal to the semi-transparent prism so as to identify and analyze the operation scene. According to the intelligent operation instruction glasses, the operation staff can directly check the operation instruction books through the glasses, so that both hands are liberated, the error rate of operation while turning over the mobile phone is reduced, and the operation efficiency is improved.
Description
Technical Field
The invention belongs to the field of operation guidance, and particularly relates to intelligent operation guidance glasses.
Background
At present, the known method for checking the electronic operation instruction book is to scan a two-dimensional code by using a mobile phone, then read an instruction through a mobile phone screen,
however, since the main functions of the mobile phone are communication and entertainment, reading the work instruction book with the mobile phone is often interrupted by other applications on the mobile phone, which easily causes operation errors of the work operator, and for the work operation requiring both hands, it is very inconvenient to perform the work operation while turning over the work instruction book on the mobile phone, and the work efficiency is reduced.
Disclosure of Invention
The invention aims to provide intelligent operation instruction glasses, which aim to solve the problems that reading an operation instruction book by using a mobile phone is often interrupted by other application programs on the mobile phone, operation errors of an operation operator are easily caused, and operation operations which need to be performed by two hands are inconvenient and operation efficiency is reduced while turning over the operation instruction book on the mobile phone.
The invention is realized in this way, an intelligent operation guidance glasses, including the glasses frame, the intelligent operation guidance glasses also includes:
the camera is used for shooting operation scenes;
the projector is connected with the camera and is used for converting the operation scene shot by the camera into a projection signal;
a semi-transparent prism connected with the projector to focus the reflected light of the work operation scene and the projection signal to a retina of a human eye;
the operation guidance module is respectively connected with the camera and the projector, converts an operation instruction into a projection signal through the projector and projects the projection signal to the semi-transparent prism so as to identify and analyze the operation scene.
Preferably, the work instruction module includes:
a storage unit connected with the projector and used for storing the operation instruction book;
the image identification unit is connected with the camera and is used for identifying the operation equipment in the operation scene;
a sight tracking unit for tracking the current operation equipment according to the sight of human eyes;
and the image processing unit is respectively connected with the image recognition unit and the sight tracking unit so as to add the work instruction corresponding to the current work equipment to the work operation scene shot by the camera.
Preferably, the eye tracking unit comprises a scleral contact lens worn on a scleral lens of the human eye.
Preferably, the work instruction module includes:
a motion capture unit connected with the camera and used for capturing the operation motion of the operator in the operation scene;
and the motion recognition unit is connected with the motion capture unit to recognize whether the operation motion captured by the motion capture unit is correct or not.
Preferably, the operation guidance module further comprises an alarm unit connected with the action recognition unit for giving an alarm when the operation action is wrong.
Preferably, the alarm unit comprises a speaker for making voice alarm prompts.
Preferably, the intelligent operation guidance glasses further comprise a main control module which is respectively connected with the camera, the projector and the operation guidance module so as to comprehensively control the intelligent operation guidance glasses.
Preferably, the intelligent operation guidance glasses further comprise a wireless communication module which is connected with the main control module, wirelessly connected with a PC client or a mobile phone and bidirectionally communicated.
Preferably, the intelligent operation guidance glasses further comprise a power module externally connected with a power supply through a USB interface to input electric energy to supply power to the intelligent operation guidance glasses.
Preferably, the power module includes a power supply battery and a charging circuit for charging the power supply battery, and the charging circuit includes a USB interface for inputting electric energy by an external power supply.
Compared with the prior art, the invention has the beneficial effects that:
by providing the intelligent operation instruction glasses, an operator can directly check the operation instruction books through the glasses, so that both hands are liberated, the error rate of operation while turning over a mobile phone is reduced, and the operation efficiency is improved;
by arranging the image recognition unit and the sight tracking unit, the operation equipment in the operation scene can be recognized and the current operation equipment can be tracked according to the sight of human eyes, so that the operation guidance module can output an operation guidance corresponding to the current operation equipment and project the operation guidance to the retina of human eyes through a projector;
by arranging the motion capture unit and the motion recognition unit, whether the current operation of an operator is correct or not can be automatically judged;
by arranging the alarm unit, the alarm prompt can be carried out when the current operation of the operator is wrong, so that the operator can correct or remedy the wrong operation in time, and serious consequences caused by the misoperation are effectively avoided;
by arranging the power supply battery, the operation guide glasses are more portable, are not limited by the operation space caused by the length of a power line, and provide more comfortable operation experience for operators;
through setting up the wireless communication module who is connected with PC customer end or cell-phone for the operation instruction glasses can the wireless download operation instruction book that needs to use, and can upload operation personnel's operation step, so that relevant supervisory personnel carry out operation quality supervision.
Drawings
Fig. 1 is a block diagram of a basic structure of intelligent work guidance glasses according to an embodiment of the present invention;
fig. 2 is a specific structural block diagram of the intelligent work guidance glasses according to the embodiment of the present invention;
fig. 3 is a block diagram of a basic structure of intelligent work instruction glasses according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Fig. 1 is a basic structure block diagram of the intelligent work instruction glasses according to the embodiment of the present invention.
As shown in fig. 1, the intelligent work guidance glasses 100 provided by the embodiment of the present invention includes a glasses frame, and further includes a camera 10, a projector 20, a translucent prism 30, and a work guidance module 40.
The camera 10 is used to capture a job operation scene 200.
In this embodiment, the camera is a miniature electronic camera.
The projector 20 is connected to the camera 10 to convert a work operation scene captured by the camera 10 into a projection signal.
In this embodiment, the projector is a pico projector.
A semi-transparent prism 30 is connected to the projector 20 to focus the reflected light of the job operation scene and the projection signal onto a human eye retina 300.
In the specific application, the reflected light of the operation scene is irradiated on the semi-transparent reflecting surface of the semi-transparent prism, meanwhile, the projection signal of the projector is also projected on the semi-transparent reflecting surface of the semi-transparent prism, and the two light signals are focused through the semi-transparent reflecting surface of the semi-transparent prism and finally reflected on the retina of human eyes, so that the retina of human eyes can clearly see the projection content.
The work instruction module 40 is respectively connected with the camera 10 and the projector 20, and converts the work instruction into a projection signal through the projector 20 and projects the projection signal to the semi-transparent prism 30, so as to identify and analyze the work operation scene.
In a specific application, after the camera sends a shot operation scene to the projector, the operation instruction module also sends an operation instruction book corresponding to the operation equipment in the scene to the projector, and finally the operation instruction book is focused on an operation picture of human retina through the semi-transparent prism, wherein the picture is a picture added with the operation instruction book in an actual operation scene.
In a specific application, the expression form of the operation instruction book can be videos, pictures, characters, animations and the like.
In a specific application, the camera 10, the projector 20, the semi-transparent prism 30 and the operation guidance module 40 are all integrally arranged on the spectacle frame.
Fig. 2 is a specific structural block diagram of the intelligent work guidance glasses according to the embodiment of the present invention.
As shown in fig. 2, in the present embodiment, the work instruction module 40 specifically includes a storage unit 41, an image recognition unit 42, a line-of-sight tracking unit 43, an image processing unit 44, a motion capture unit 45, a motion recognition unit 46, and an alarm unit 47.
And a storage unit 41 connected to the projector 20 and storing a work instruction.
In a specific application, a user can store a job instruction book required to be used into a storage unit according to actual job requirements, wherein the storage unit can be any physical storage disk, and the storage unit can also be used for storing a standard appearance image of a job device.
And the image identification unit 42 is connected with the camera 10 and is used for identifying the working equipment in the working operation scene.
In the present embodiment, the image recognition unit recognizes the types of different job devices mainly by matching a job device in a real job operation scene with a standard appearance image of an operation device or a job device in a job guide stored in the storage unit.
And a sight tracking unit 43 for tracking the current working apparatus based on the human eye sight.
In a specific application, the eye tracking unit 43 comprises a scleral contact lens worn on a scleral lens of a human eye.
In a specific application, the gaze tracking unit may be a miniature gaze tracker.
An image processing unit 44 connected to the image recognition unit 42 and the line-of-sight tracking unit 43, respectively, to add a job instruction book corresponding to the current job device to the job operation scene captured by the camera 10.
In a specific application, the image processing unit may be an image processing chip in which a related image processing program is written.
And a motion capture unit 45 connected to the camera 10 for capturing an operation motion of the operator in the work operation scene.
In a specific application, the motion capture unit captures the motion of an operator in a work operation scene through a camera.
And a motion recognition unit 46 connected to the motion capture unit 45 to recognize whether the operation motion captured by the motion capture unit 45 is correct.
In a specific application, the action recognition unit judges whether the operation action is correct or not by comparing the operation action captured by the action capture unit with the operation action in the work instruction book video stored in the storage unit.
And the alarm unit 47 is connected with the action recognition unit 46 to give an alarm prompt when the operation action is wrong.
In a specific application, the alarm unit comprises a loudspeaker for carrying out voice alarm prompt.
Fig. 3 is a block diagram of a basic structure of intelligent work instruction glasses according to another embodiment of the present invention.
As shown in fig. 3, the intelligent work instruction glasses 100 provided in this embodiment, in addition to the camera 10, the projector 20, the semi-transparent prism 30 and the work instruction module 40 shown in fig. 1, further includes a main control module 50, a power supply module 60 and a wireless communication module 70 integrally disposed on the glasses frame.
And a main control module 50 connected to the camera 10, the projector 20, and the work guidance module 40, respectively, to comprehensively control the intelligent work guidance glasses 100.
In specific application, the main control module can be a micro single chip microcomputer.
And the power supply module 60 is connected with the main control module 50, is externally connected with a power supply through a USB interface, and supplies power to the intelligent operation guidance glasses by using input electric energy.
In a specific application, the power module comprises a power supply battery and a charging circuit for charging the power supply battery, wherein the charging circuit comprises a USB interface for inputting electric energy by an external power supply.
In this embodiment, a rechargeable lithium battery having a small volume is preferable.
The wireless communication module 70 is connected with the main control module 50, is wirelessly connected with the PC client or the mobile phone 400, performs two-way communication, and is used for downloading the operation instruction through the wireless network, transmitting the operation instruction to the storage unit in the operation instruction module through the main control module for storage, and simultaneously uploading the operation steps of the operator captured by the camera to the PC client or the mobile phone for the relevant operation supervisor to perform quality supervision on the operation of the operator according to the operation steps.
In particular applications, the wireless communication module may be any device based on short-range or long-range wireless communication technology.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (9)
1. An intelligent work guidance glasses, comprising a glasses frame, characterized in that the intelligent work guidance glasses further comprise:
the camera is used for shooting operation scenes;
the projector is connected with the camera and is used for converting the operation scene shot by the camera into a projection signal;
a semi-transparent prism connected with the projector to focus the reflected light of the work operation scene and the projection signal to a retina of a human eye;
the operation guidance module is respectively connected with the camera and the projector, converts an operation instruction into a projection signal through the projector and projects the projection signal to the semi-transparent prism so as to identify and analyze the operation scene;
after the camera sends the shot operation scene to the projector, the operation instruction module also sends an operation instruction book corresponding to the operation equipment in the operation scene to the projector, and the operation instruction book is focused on an operation picture of human retina through the semi-transparent prism and is a picture added with the operation instruction book in the operation scene;
the work guidance module includes:
the image identification unit is connected with the camera and is used for identifying the operation equipment in the operation scene;
a sight tracking unit for tracking the current operation equipment according to the sight of human eyes;
the image processing unit is respectively connected with the image recognition unit and the sight tracking unit so as to add the work instruction corresponding to the current work equipment to the work operation scene shot by the camera;
the intelligent work guidance glasses further comprise:
and the wireless communication module is wirelessly connected with the PC client or the mobile phone and is used for bidirectionally communicating, downloading the operation instruction book through a wireless network, uploading the operation steps of the operator shot by the camera to the PC client or the mobile phone so as to be supplied to relevant operation monitoring personnel, and monitoring the quality of the operation of the operator according to the operation steps.
2. The intelligent work guidance eyewear of claim 1 wherein the work guidance module further comprises:
and the storage unit is connected with the projector and used for storing the operation instruction book.
3. The intelligent work guidance glasses of claim 1 wherein the eye tracking unit comprises a scleral contact lens worn on a scleral lens of the human eye.
4. The intelligent work guidance eyewear of claim 1 wherein the work guidance module comprises:
a motion capture unit connected with the camera and used for capturing the operation motion of the operator in the operation scene;
and the motion recognition unit is connected with the motion capture unit to recognize whether the operation motion captured by the motion capture unit is correct or not.
5. The intelligent work guidance glasses according to claim 4, wherein the work guidance module further comprises an alarm unit connected to the action recognition unit to give an alarm when the operation action is wrong.
6. The intelligent work guidance glasses of claim 5 wherein the alarm unit comprises a speaker for audible alarm prompts.
7. The intelligent work guidance glasses according to claim 1, further comprising a main control module connected to the camera, the projector, and the work guidance module, respectively, to comprehensively control the intelligent work guidance glasses.
8. The intelligent work guidance glasses according to claim 1, further comprising a power module externally connected to the power supply through a USB interface to input electric power to power the intelligent work guidance glasses.
9. The intelligent work guidance glasses according to claim 8, wherein the power module comprises a power supply battery and a charging circuit for charging the power supply battery, and the charging circuit comprises a USB interface for inputting electric power from an external power source.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510990960.1A CN106918908B (en) | 2015-12-25 | 2015-12-25 | Intelligent operation guidance glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510990960.1A CN106918908B (en) | 2015-12-25 | 2015-12-25 | Intelligent operation guidance glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106918908A CN106918908A (en) | 2017-07-04 |
| CN106918908B true CN106918908B (en) | 2020-09-18 |
Family
ID=59459922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510990960.1A Active CN106918908B (en) | 2015-12-25 | 2015-12-25 | Intelligent operation guidance glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106918908B (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5402293B2 (en) * | 2009-06-22 | 2014-01-29 | ソニー株式会社 | Head-mounted display and image display method in head-mounted display |
| CN203101728U (en) * | 2012-11-27 | 2013-07-31 | 天津市天堰医教科技开发有限公司 | Head type display for assisting medical operation teaching |
| US9448407B2 (en) * | 2012-12-13 | 2016-09-20 | Seiko Epson Corporation | Head-mounted display device, control method for head-mounted display device, and work supporting system |
| JP6393986B2 (en) * | 2013-12-26 | 2018-09-26 | セイコーエプソン株式会社 | Head-mounted display device, image display system, and method for controlling head-mounted display device |
| CN104834384B (en) * | 2015-06-01 | 2017-10-13 | 凌亚 | Improve the device and method of exercise guidance efficiency |
| CN205281019U (en) * | 2015-12-25 | 2016-06-01 | 深圳市酷浪云计算有限公司 | Glasses are guideed in intelligence operation |
-
2015
- 2015-12-25 CN CN201510990960.1A patent/CN106918908B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106918908A (en) | 2017-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10674056B2 (en) | Wearable apparatus and method for capturing image data using multiple image sensors | |
| CN216083276U (en) | Wearable imaging device | |
| CN105141331B (en) | A kind of spectacle type communication device, system and method | |
| US20140118680A1 (en) | Electronic eyeglasses | |
| CN205176409U (en) | Industry intelligence glasses | |
| CN103873959B (en) | A kind of control method and electronic equipment | |
| CN105183156A (en) | Screen control method and apparatus | |
| CN110495819A (en) | Control method, robot, terminal, server and the control system of robot | |
| CN205334537U (en) | System and intelligent glasses with people's face, iris recognition function | |
| KR20130059827A (en) | Glasses type camera using by pupil tracker | |
| CN210090827U (en) | Portable AR glasses implementation system | |
| CN204948206U (en) | A kind of autofocus system based on eye tracking and wearable device thereof | |
| CN205281019U (en) | Glasses are guideed in intelligence operation | |
| US10288883B2 (en) | Head-mounted display | |
| CN109547706A (en) | Glasses device and system | |
| CN106918908B (en) | Intelligent operation guidance glasses | |
| JP6405878B2 (en) | Display device and control method of display device | |
| US20220224843A1 (en) | Smart eyeglasses for improving visual impairment and facilitating visual field tests | |
| CN105007424A (en) | Automatic focusing system, method and wearable device based on eye tracking | |
| CN116670618A (en) | Wearable electronic device receiving information from external wearable electronic device and operation method thereof | |
| CN207367237U (en) | A kind of optics motion capture system for VR photographies | |
| CN105301801A (en) | Intelligent spectacles | |
| CN107121885B (en) | Base of ray apparatus | |
| JP2018085595A (en) | Head-mounted display device and method for controlling the same | |
| CN221281331U (en) | Intelligent glasses and wearable interaction assembly |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |