WO2015081799A1 - 智能眼镜及控制方法 - Google Patents

智能眼镜及控制方法 Download PDF

Info

Publication number
WO2015081799A1
WO2015081799A1 PCT/CN2014/092232 CN2014092232W WO2015081799A1 WO 2015081799 A1 WO2015081799 A1 WO 2015081799A1 CN 2014092232 W CN2014092232 W CN 2014092232W WO 2015081799 A1 WO2015081799 A1 WO 2015081799A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart glasses
image
camera
user
eye
Prior art date
Application number
PCT/CN2014/092232
Other languages
English (en)
French (fr)
Inventor
全蕊
Original Assignee
全蕊
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 全蕊 filed Critical 全蕊
Publication of WO2015081799A1 publication Critical patent/WO2015081799A1/zh

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0127—Head-up displays characterised by optical features comprising devices increasing the depth of field
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Definitions

  • the invention relates to the technical field of wearable smart devices, in particular to a smart glasses and a control method.
  • smart glasses produced by companies including Google, Samsung, and Brothers usually include a frame on which a camera that is aligned with the viewing direction of the user's eyes (ie, toward the outside of the user) and associated circuitry connected to the camera are mounted.
  • Device ie, toward the outside of the user
  • the related circuit device is disposed in the main body, and includes a processor and a processor connected to the camera 11 to collect the camera. The image or video is processed.
  • the processor is also electrically coupled to a pico projector within a body, and a prism 12 is also disposed on the front side of the smart glasses as a virtual display.
  • the imaging principle of Google smart glasses is that after the processor performs image processing, the screen is projected onto the prism 12 by the pico projector, and the refraction surface of the prism 12 is used to refract the image to the human eye and focus on the retina.
  • the smart glasses further include a wireless module electrically connected to the processor, and the smart glasses can be wirelessly connected to the mobile phone, the wireless network, etc. through the wireless module.
  • the smart glasses further include an input portion through which a corresponding command is input through the button 13 or the sliding touch panel 14.
  • wired transmission devices which can transmit data through a wired connection with a mobile phone or a computer.
  • the main object of the present invention is to provide a smart glasses and a control method for the eye movements when the zoom control of the smart glasses toward the user's viewing direction or the zoom control of the images displayed by the smart glasses is provided. Big, pick up and control.
  • the invention provides a smart glasses, comprising a control component, further comprising: an image collecting device electrically connected to the control component and capable of detecting a state of the eye of the user; the eye state comprising an upper and lower eyelid distance;
  • the control unit is configured to control the zoom of the image displayed by the smart glasses display component or the zoom of the camera on the smart glasses toward the user viewing direction according to the detected size of the upper and lower eyelid distances.
  • the zoom of the image displayed by the smart glasses display component or the camera on the smart glasses facing the user's viewing direction can be controlled.
  • the zooming is realized according to the control of the smart glasses wearer through the enlargement and lifting of the eyes, the participation of the hand can be separated, the control is more convenient, and the user's hand can be released for other operations.
  • the image capturing device comprises a micro camera positioned on the support beam of the frame of the smart glasses and disposed toward the eye of the user.
  • the micro camera is arranged on the support beam of the frame of the smart glasses, which is simple and convenient.
  • the image capturing device comprises: a micro camera located in the main body of the smart glasses, a prism located on the lens side of the micro camera, and a prism having a refractive surface that refracts the image of the user's eye to the micro camera.
  • the light incident surface of the prism facing the user's eye, or the refractive surface in the prism is a curved structure.
  • the user's eye image is collected by means of a prism combined with a micro camera, and the micro camera can be placed in the main body of the smart glasses.
  • the light incident surface of the prism facing the user's eye, or the refractive surface in the prism may be curved as needed to expand the range of images captured.
  • the image capturing device comprises: a micro camera located in the main body of the smart glasses, an imaging fiber, the imaging fiber is mounted on the lens end of the micro camera at one end, and the support beam is mounted on the frame of the smart glasses at the other end. Up, set toward the user's eye.
  • one end of the frame of the smart glasses can be installed at one end according to the position.
  • the invention also provides a control method for a camera facing the user's viewing direction of the smart glasses, comprising:
  • the eye image including the upper eyelid and the lower eyelid
  • the distance between the upper and lower eyelids is between the above upper and lower limits, and the lens focal length of the camera stops adjusting.
  • the present invention also provides a method for controlling image display of a display component of smart glasses, comprising:
  • the eye image including the upper eyelid and the lower eyelid
  • the method further comprises: determining that the distance between the upper and lower eyelids is greater than the upper limit value or less than the lower limit value, and determining that the distance between the upper and lower eyelids is maintained beyond a certain time, This judgment is valid and the corresponding control is executed.
  • the method further includes: controlling the lens focal length of the camera or the image displayed by the display component to adjust to a default value when determining that the eye is in a specified state or action.
  • the method before the collecting the eye image of the smart glasses wearer, the method further includes: an initial configuration step of the upper and lower limits of the smart glasses wearer.
  • FIG. 1 is a first perspective view of a schematic diagram of a smart glasses applied by Google Inc.;
  • FIG. 2 is a second perspective view of the schematic diagram of the smart glasses applied by Google Inc.;
  • Figure 3 is a schematic diagram of smart glasses sold by Google Inc.
  • FIG. 4 is a schematic diagram of a smart glasses according to a first embodiment of the present invention, which is a partial structural view of the smart glasses corresponding to FIG. 2 from the direction of the wearer;
  • FIG. 5 is a schematic diagram of a second embodiment of the smart glasses corresponding to FIG. 2 according to the present invention.
  • FIG. 6 is a schematic view of a third embodiment of the smart glasses corresponding to FIG. 3 according to the present invention, which is a partial structural view of the smart glasses;
  • FIG. 7 is a schematic view of the eye state of the wearer of the smart glasses, (A) is the normal state of the eye, (B) is the state of the eye being enlarged, and (C) is the state of the eye being lifted;
  • 8(M) is the size of the image acquired or displayed corresponding to the eye-up state of FIG. 5(B), and (N) is the image size acquired or displayed corresponding to the eye-up state of FIG. 5(C); O) is the size of the image captured or displayed by default or initially.
  • the smart glasses of the present invention can be as shown in FIG. 1, 2 or 3, including a frame similar to a frame, and the frame 41 can be U-shaped.
  • the two arms 411 of the U-shaped frame form a clamping portion, so that the smart glasses can be clamped to the head, the support beam 412 of the U-shaped frame 41 is connected to the two arms 411, and the nose beam support 413 pieces in the middle of the support beam 412, the support beam A lens can be mounted below the 412 to make the overall look more like a pair of glasses.
  • a main body 42 is provided on one arm 411 of the frame forming the clamping portion, and the main body 42 has a processor or the like therein.
  • the main body 42 is adjacent to one end of the support beam 412, and is provided with a camera 11 facing the user's viewing direction (ie, facing the user's outer side). In order to distinguish the camera that collects the user's eye image as described later, the camera is referred to herein as an outward facing camera. 11.
  • the camera 11 can be a CCD or CMOS camera, and can be a zoom lens with a focus adjustable function. Sound playback components such as headphones and bone conduction headphones can also be provided.
  • An input component such as a control button 13, a touchpad 14, etc. may be disposed on the outer casing of the main body 42, and a microphone may be disposed, and a wireless module such as a WIFI module, a Bluetooth module, or the like may be disposed.
  • the body 42 extends below the smart eyeglass support beam 412, that is, into the field of view range portion, and is provided with a display member 12, such as a micro-screen, such as a micro-projection prism employed by Google Inc., such as a micro-projection member, so that the user can pass the display member. 12 Watch what the smart glasses display.
  • a display member 12 such as a micro-screen, such as a micro-projection prism employed by Google Inc., such as a micro-projection member, so that the user can pass the display member. 12 Watch what the smart glasses display.
  • the processor in the main body 42 is electrically connected to the outward facing camera 11, the input member, the display member 12, the sound playing unit, the microphone, and the wireless module.
  • the processor may receive an instruction from the input component, and control the image taken by the outward facing camera 11, or control the display component 12 to perform image display.
  • the displayed image may be an image taken from the outward facing camera 11 or may be obtained from the wireless module. Images obtained by other devices, or images stored by smart glasses.
  • the smart glasses of the present invention further include: an image capturing device that can detect the state of the eye of the user, and the captured image of the eye state should include the upper and lower eyelids of the wearer, which will be further described later.
  • the image capturing device may be a micro camera or other scanning device disposed toward the eye side of the user, for example, a partial structural view of the smart glasses as shown in FIG. 4, which may be disposed on the support beam 412 of the U-shaped frame 41,
  • the micro camera 211 disposed directly toward the user's eye direction is referred to as an inward camera for convenience of description.
  • the angle of the camera is set to be fine-tuned so as to adjust the camera angle when different people use it. It makes it possible to collect eye images better.
  • the inward camera can also be disposed inside the main body, and the eye image can be obtained by optical means, such as a prism.
  • optical means such as a prism.
  • a partial structure diagram of the smart glasses shown in FIGS. 5 and 6 can be on the prism 12.
  • the light incident surface of the corresponding second prism 221 facing the user's eye or the refractive surface of the second prism 221 may be a curved surface, such as a convex curved surface.
  • the optical mode may also be conducted through the imaging fiber, and the imaging fiber may be installed in the support beam 41.
  • One end of the imaging fiber is mounted on the lens end of the inward facing camera inside the main body, and the other end, that is, the image collecting end, can be mounted on the support beam 412 of the U-shaped frame 41 toward the user's eye direction, which can be shown by the micro camera 211 in FIG.
  • the end facing the user's eye direction is also assembled at an adjustable angle, which facilitates the adjustment of the eye image acquisition.
  • the lens assembled at one end of the user's eye direction can also be set as a curved lens, such as a convex lens. To capture a complete eye image.
  • the inward facing camera can be a CCD or CMOS camera module that is electrically connected to the processor within the body via a cable to provide the acquired eye image to the processor for processing.
  • the cable can be placed through the inner cavity of the support beam 412.
  • the inward facing camera is inside the body, it can be connected directly to the board.
  • the processor can control the focal length of the outward facing camera or control the size of the displayed image according to the distance between the upper eyelid 31 and the lower eyelid 32 in the acquired image, which will be described in detail below.
  • the acquired eye image should include an upper eyelid 31 and a lower eyelid 32.
  • the processor determines that the distance between the upper and lower eyelids is greater than a specific value, the example is referred to as an upper limit value, for example, 7(B) shows that when the user's eyes are widened, causing the upper and lower eyelid distances to exceed the upper limit value
  • the processor outputs an instruction, which may be used to control the adjustment of the focal length of the outward facing camera.
  • the command is used to control the focal length of the lens of the outward facing camera to enlarge the acquired image, as shown in Fig. 8(M), corresponding to the image acquired by adjusting the focal length of the lens toward the outer camera.
  • the focus adjustment can also include an adjustment of the digital zoom to amplify the acquired image. It can be seen that in this way, when the user wants to zoom outwards to zoom in on the acquired image, it is only necessary to widen the eyes to control the corresponding zoom.
  • the processor determines that the distance between the acquired upper and lower eyelids is less than a specific value, the example is referred to as a lower limit value, for example, the user shown in FIG. 7(C) is squinting and causing the upper and lower eyelid distance to be less than the lower limit value.
  • the processor outputs an instruction, which can be used to control the adjustment of the focal length of the outward facing camera.
  • the command is used to control the focal length of the lens facing the outer camera to reduce the captured image, as shown in FIG. 8 (N).
  • the corresponding image shown in this way adjusts the lens focal length of the camera facing the outer camera.
  • the focus adjustment includes physical focus adjustment, and may also include adjustment of the digital zoom to reduce the acquired image. It can be seen that in this way, when the user wants to zoom out of the external camera to reduce the captured image, it is only necessary to raise the eye to control the corresponding zoom.
  • the processor determines that the distance between the collected upper and lower eyelids is between the upper and lower limits, if the user's eyes as shown in FIG. 7(A) are in a normal state, stopping the lens focal length of the outward facing camera Adjustment. For example, when the user zooms in or out of the image, if the user thinks that the desired image multiple is reached, the normal eye state can be restored, and the lens focus is continuously adjusted.
  • the acquired eye image should include upper and lower eyelids.
  • the processor determines that the distance between the upper and lower eyelids is greater than a specific value, this example is referred to as an upper limit value, for example, the user shown in FIG. 7(B) is If the large eyes cause the upper and lower eyelid distances to exceed the upper limit value, the processor outputs an instruction, which may be used to control the enlargement of the image displayed by the display unit 12, as shown in FIG. 8(M). The image displayed after zooming in. It can be seen that, in this way, when the image that the user desires to display is enlarged, the corresponding display enlargement can be controlled only by widening the eyes.
  • the processor determines that the distance between the collected upper and lower eyelids is less than a specific value, the example is referred to as a lower limit value.
  • a specific value the example is referred to as a lower limit value.
  • the processor outputs an instruction, which can be used to control the image reduction displayed by the display unit 12, and correspondingly displays the image displayed after the mode is reduced as shown in FIG. 8(N). It can be seen that in this way, when the image that the user wishes to display is reduced, only the eyes need to be squinted.
  • the zoom control of the image is stopped. For example, when the user is in the process of zooming in or out of the image, if the user thinks that the desired image multiple is reached, the normal eye state can be restored as shown in FIG. 7(A), and the image zooming continues to be adjusted. .
  • FIG. 8(O) is a view showing an enlarged or reduced state of the captured or displayed image of FIG. 8(M) and FIG. 8(N), and FIG. 8(O) is an initial state. , or the size of the image captured or displayed in the default state.
  • the initial configuration step can be performed before the control is performed by the above method.
  • the user can perform blinking and blinking according to the prompts.
  • the smart glasses collect the distance between the upper and lower eyelids in the three states of the user's blink, big, and normal values, and generate a weighting process to generate upper and lower limits.
  • each initialization content may be separately stored for different users, for example, stored in a configuration file, so that the user can directly call the user's configuration file when using the next time.
  • the judgment time can be increased, for example, when the upper and lower eyelid distances are exceeded.
  • the above 2 seconds in this example is only an example.
  • the user can use the above control to make the collected or
  • the displayed image is enlarged, which will result in a decrease in the number of people in the displayed image, so that the corresponding recognition of the face and the like can greatly reduce the number of people to be queried, and achieve the accuracy of specifying the query object.
  • the position of the position in the image is further combined with the pupil to determine the object to be queried.
  • the corresponding object such as the recognition face and the object to be queried is further reduced, and the query of the specified object is further refined.
  • the corresponding corresponding control corresponding to the size of the eye opening can be exited. For example, by closing the eyes for more than 2 seconds, the exit is turned off, and at this time, the inward facing camera is turned off to save power.
  • the corresponding application related to the camera/image browsing is started again, the corresponding method of the present invention can also be activated again to reduce the power consumption of the smart glasses.
  • the position of the inward facing camera 211 or one end of the optical fiber in FIG. 4 may be mounted on the support beam 412 near the left eye or on the end of the main body 42 below the support beam 412, as shown in FIG.
  • the middle body 42 is near one end of the prism 12.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Eyeglasses (AREA)

Abstract

一种智能眼镜，包括控制部件，与控制部件电连接的、可检测用户眼部状态的图像采集装置；眼部状态包括上下眼睑距离；控制部件用于根据所检测的上下眼睑距离的大小控制智能眼镜显示部件（12）所显示图像的缩放、或智能眼镜上朝向用户观察方向的摄像头（11）的变焦。还提供了对智能眼镜的朝向用户观察方向的摄像头的控制方法，和对智能眼镜的显示部件图像显示的控制方法。该智能眼镜实现了在对智能眼镜朝向用户观察方向的摄像头变焦控制，或对智能眼镜显示的图像的缩放控制时，通过眼睛的睁大、眯起进行控制。

Description

智能眼镜及控制方法
技术领域
本发明涉及佩戴式智能设备技术领域，特别是指一种智能眼镜及控制方法。
背景技术
目前，包括谷歌公司、三星公司、兄弟公司等公司所生产的智能眼镜，通常包括框架，在框架上安装有与用户眼睛观察方向一致（即朝向用户外侧）的摄像头，以及连接该摄像头的相关电路器件。
下面以图1、图2、图3示出的谷歌公司的智能眼镜为例进行说明，所述相关电路器件设置于主体内，包括处理器、处理器与所述摄像头11连接，以将摄像头采集的图像或视频进行处理。处理器还与一主体内的微型投影仪电连接，在该智能眼镜的正面还设置棱镜12，作为虚拟显示屏。谷歌智能眼镜的成像原理是，处理器进行图像处理后，由微型投影仪把画面投射到棱镜12上，通过棱镜12中的折射面将画面折射投到人眼并聚焦在视网膜上。该智能眼镜还包括与处理器电连接的无线模块，通过无线模块，该智能眼镜可以与手机、无线网络等无线连接。该智能眼镜还包括输入部分，通过按键13或滑动触摸板14输入相应的指令。
其他公司的智能眼镜，有的还包括有线传输装置，可以与手机或电脑通过有线连接的方式传输数据。
对于目前的智能眼镜，当采集图像过程中对智能眼镜上的所述摄像头焦距或电子焦距进行控制调整（即实现实时采集的图像的放大、缩小）时，或对智能眼镜上的所显示的图像的大小缩放进行控制时，可采用滑动触摸、手势控制等方式，但都需要手的配合，如何能够进行上述控制时脱离手的参与，以更为简便的方式进行上述控制，是有待解决的问题。
发明内容
有鉴于此，本发明的主要目的在于提供一种智能眼镜及控制方法，以在对智能眼镜朝向用户观察方向的摄像头变焦控制，或对智能眼镜显示的图像的缩放控制时，可通过眼睛的睁大、眯起进行控制。
本发明提供了一种智能眼镜，包括控制部件，还包括：与控制部件电连接的、可检测用户眼部状态的图像采集装置；所述眼部状态包括上下眼睑距离；
所述控制部件用于根据所检测的上下眼睑距离的大小控制智能眼镜显示部件所显示图像的缩放、或智能眼镜上朝向用户观察方向的摄像头的变焦。
由上，智能眼镜佩戴者睁大或眯起眼睛时，可采集到上下眼睑的相应的距离，并据此控制智能眼镜显示部件所显示图像的缩放、或智能眼镜上朝向用户观察方向的摄像头的变焦，实现了根据智能眼镜佩戴者通过眼睛的睁大、眯起进行控制，可脱离手的参与，控制更为方便，且可释放出用户手以进行其他操作。
可选的，所述图像采集装置包括一微摄像头，位于智能眼镜的框架的支撑梁上，朝向用户眼部方向设置。
由上，在智能眼镜的框架的支撑梁上设置所述微摄像头，实现简便。
可选的，所述图像采集装置包括：位于智能眼镜的主体内的一微摄像头，位于该微摄像头镜头侧的棱镜，所述棱镜内具有将用户眼部图像折射至该微摄像头的折射面。
可选的，所述棱镜的面向用户眼部的光入射面，或棱镜内的所述折射面为曲面结构。
由上，通过棱镜结合微摄像头的方式采集用户眼部图像，可将微摄像头置于智能眼镜主体内。且可根据需要，将棱镜的面向用户眼部的光入射面，或棱镜内的所述折射面为曲面结构，以扩大其采集的图像范围。
可选的，所述图像采集装置包括：位于智能眼镜的主体内的一微摄像头，成像光纤，该成像光纤一端装配于所述微摄像头的镜头端，另一端安装于智能眼镜的框架的支撑梁上，朝向用户眼部方向设置。
由上，通过成像光纤，其一端可根据位置需要安装智能眼镜的框架的一端。
本发明还提供了一种对智能眼镜的朝向用户观察方向的摄像头的控制方法，包括：
采集智能眼镜佩戴者的眼部图像，该眼部图像包含上眼睑和下眼睑，
判断上下眼睑之间的距离大于一上限值，控制朝向用户观察方向的摄像头的镜头焦距以使所采集的图像放大；
判断上下眼睑之间的距离小于一下限值，控制所述摄像头的镜头焦距以使所采集的图像缩小；
判断上下眼睑之间的距离在上述上下限值之间，所述摄像头的镜头焦距停止调整。
由上，可实现根据所检测的智能眼镜佩戴者的上下眼睑距离的大小控制智能眼镜上朝向用户观察方向的摄像头的变焦，即根据智能眼镜佩戴者的眼睛的睁大、眯起进行所述控制。
本发明还提供了一种对智能眼镜的显示部件图像显示的控制方法 ，包括：
采集智能眼镜佩戴者的眼部图像，该眼部图像包含上眼睑和下眼睑，
判断上下眼睑之间的距离大于一上限值，控制智能眼镜显示部件所显示的图像放大；
判断上下眼睑之间的距离小于一下限值，控制所述显示部件所显示的图像缩小；
判断上下眼睑之间的距离在上述上下限值之间，所述显示部件所显示的图像缩放停止调整。
由上，可实现根据所检测的智能眼镜佩戴者的上下眼睑距离的大小控制智能眼镜显示部件所显示图像的缩放，即根据智能眼镜佩戴者的眼睛的睁大、眯起进行所述控制。
较佳的，还包括：所述判断上下眼睑之间的距离大于所述上限值或小于所述下限值时，还判断所述上下眼睑之间的所述距离维持超过特定时间时，认定此次判断有效，执行相应的控制。
由上，可以避免将智能眼镜佩戴者正常的眨眼、睁眼误识别为控制指令。
可选的，还包括：当判断眼睛为一指定状态或动作时，控制所述摄像头的镜头焦距或所述显示部件所显示的图像调整至默认值。
由上，可通过特定状态或动作快速恢复至默认值。
可选的，所述采集智能眼镜佩戴者的眼部图像之前还包括：对智能眼镜佩戴者的所述上下限的初始化配置步骤。
由上，可以适应不同人的眼部的大小状况、睁大、眯眼程度的习惯。
附图说明
图1为谷歌公司所申请智能眼镜的原理图的第一立体示意图；
图2为谷歌公司所申请智能眼镜的原理图的第二立体示意图；
图3为谷歌公司所销售的智能眼镜的示意图；
图4为本发明第一实施例的智能眼镜的示意图，是对应图2从佩戴者方向所示的智能眼镜的部分结构图；
图5为本发明对应图2的智能眼镜第二实施例的示意图，是智能眼镜的部分结构图；
图6为本发明对应图3的智能眼镜第三实施例的示意图，是智能眼镜的部分结构图；
图7为智能眼镜佩戴者眼睛状态示意图，（A）为眼睛正常状态，（B）为眼睛睁大状态，（C）为眼睛眯起状态；
图8中（M）为对应图5（B）眼睛睁大状态时所采集或显示的图像大小，（N）为对应图5（C）眼睛眯起状态时所采集或显示的图像大小；（O）为默认或初始时所采集或显示的图像大小。
具体实施方式
下面参见各个附图对本发明的智能眼镜进行详细说明。
如图1所示，本发明的智能眼镜可如图1、2或3所示的智能眼镜，包括一类似镜架的框架，框架41可为U型， U型框架的两支臂411形成夹持部，使智能眼镜可夹持于头部固定，U型框架41的支撑梁412连接两支臂411，支撑梁412中间具有鼻梁支撑413件，支撑梁412下方可安装镜片，以使整体看起来更近似眼镜。
于框架的形成夹持部的一支臂411上，设置有主体42，主体42内具有处理器等。主体42靠近支撑梁412的一端，设置有朝向用户观察方向（即朝向用户外侧）的摄像头11，为了与后文描述的采集用户眼部图像的摄像头进行区别，本文中称该摄像头为朝外摄像头11，该摄像头11可为CCD或CMOS摄像头，可为变焦镜头，具有焦距可调功能。还可设置有声音播放部件，如耳机、骨传导耳机。主体42的外壳上还可设置输入部件，如控制按键13、触摸板14等，还可设有麦克风，以及设置无线模块，如WIFI模块、蓝牙模块等。
在主体42延伸至智能眼镜支撑梁412下方，即进入视野范围区部分，设置有显示部件12，例如微屏幕，如谷歌公司所采用的微投影棱镜即微投影部件，以使得用户可以通过显示部件12观看智能眼镜所显示的内容。
上述主体42内的处理器与所述朝外摄像头11、输入部件、显示部件12、声音播放部件、麦克风、无线模块电连接。处理器可以接收来自输入部件的指令，以及控制朝外摄像头11采集图像，或者控制显示部件12进行图像显示，所显示的图像可以是来自朝外摄像头11采集的图像，也可以是通过无线模块从其他设备所获得的图像，或者是智能眼镜所存储的图像。
本发明所述的智能眼镜还包括：可检测用户眼部状态的图像采集装置，所采集的该眼部状态的图像应包含所佩戴者的上下眼睑，将在后文进一步描述。该图像采集装置可以是朝向用户眼部侧设置的微摄像头或其它扫描装置，例如，如图4所示的智能眼镜的部分结构图，可以是设置在U型框架41的支撑梁412上的、镜头直接朝向用户眼部方向设置的微摄像头211，为了描述方便，此处称为朝内摄像头，较佳的该摄像头的角度设置为可微调，以便于当不同人使用时，调整该摄像头角度以使其能够较好的采集眼部图像。
另外，该朝内摄像头也可以设置于主体内部，而通过光学的方式，如棱镜的方式来获取眼部图像，例如图5、6所示的智能眼镜的部分结构图，可以是与棱镜12上或下并排的第二棱镜221，其一端位于该微摄像头镜头光路一侧。相应的，为了取得整个眼部图像，对应的第二棱镜221朝向用户眼部一面的光入射面或第二棱镜221中的折射面可为曲面，例如凸出的曲面。
另外，所述光学方式也可以是通过成像光纤传导的方式，成像光纤可安装于支撑梁41内设置。成像光纤一端装配于主体内部的朝内摄像头的镜头端，另一端即图像采集端则可安装于U型框架41支撑梁412上朝向用户眼部方向设置，可与图4中微摄像头211所示位置相同，朝向用户眼部方向的一端也以可调角度的装配，便于对眼部图像的采集进行调整，朝向用户眼部方向的一端所装配的透镜也可以设置为曲面透镜，如凸面透镜，以捕获完整的眼部图像。
朝内摄像头可为CCD或CMOS摄像头模块，该模块通过排线电连接至主体内的处理器，从而将采集的眼部图像提供给处理器处理。当朝内摄像头位于支撑梁412上时，若与主体距离较远，可以通过支撑梁412内腔安放排线。当朝内摄像头位于主体内，则可直接连接到电路板上。
相应的，处理器则可以根据采集的图像中的上眼睑31和和下眼睑32之间的距离来控制朝外摄像头焦距或控制所显示图像的大小，下面进行详细说明。
下面，首先以根据采集的眼部图像应用于控制朝外摄像头焦距的调整为例进行说明：
其中，如图7所示，采集的所述眼部图像应包含上眼睑31和下眼睑32，当处理器判断上下眼睑之间的距离大于一特定值时，本例称为上限值，例如图7（B）示出的用户在睁大眼睛导致上下眼睑距离超过该上限值时，则处理器输出一指令，该指令可以是用来控制朝外摄像头焦距的调整，本例中，该指令用来控制朝外摄像头的镜头焦距以使所采集的图像放大，如图8（M）所示对应为该方式调整朝外摄像头的镜头焦距所采集的图像。不难理解，该焦距调整也可包括数字变焦的调整，使所采集的图像进行放大。可见，通过该方式，当用户希望朝外摄像头变焦以放大所采集的图像时，仅需睁大眼睛即可控制进行相应的变焦。
当处理器判断所采集的上下眼睑之间的距离小于一特定值时，本例称为下限值，例如图7（C）示出的用户在眯起眼睛导致上下眼睑距离小于该下限值，则处理器输出一指令，该指令可以是用来控制朝外摄像头焦距的调整，本例中，该指令用来控制朝外摄像头的镜头焦距以使所采集的图像缩小，如图8（N）所示对应为该方式调整朝外摄像头的镜头焦距所采集的图像。不难理解，该焦距调整包括物理焦距调整，也可包括数字变焦的调整，使所采集的图像进行缩小。可见，通过该方式，当用户希望朝外摄像头变焦以缩小所采集的图像时，仅需眯起眼睛即可控制进行相应的变焦。
当处理器判断所采集的上下眼睑之间的距离在上述上下限值之间时，如图7（A）示出的用户眼睛为正常状态时，则停止对所述朝外摄像头的镜头焦距的调整。例如，当用户在放大或缩小图像过程中，若用户认为达到其希望的图像倍数时，则可以恢复正常的眼睛状态，则停止所述镜头焦距的继续调整。
其中，还可以设置某指定的眼部状态或动作，例如眨眼三次，或某方式转动眼球，则使镜头焦距恢复默认状态。
下面，再以根据采集的眼部图像应用于控制所显示的图像的缩放为例进行说明：
同理，采集的所述眼部图像应包含上下眼睑，当处理器判断上下眼睑之间的距离大于一特定值时，本例称为上限值，例如图7（B）示出的用户在睁大眼睛导致上下眼睑距离超过该上限值，则处理器输出一指令，该指令可以是用来控制显示部件12所显示的图像的放大，如图8（M）所示对应为该方式控制放大后所显示的图像。可见，通过该方式，当用户希望显示的图像放大时，仅需睁大眼睛即可控制进行相应的显示放大。
当处理器判断所采集的上下眼睑之间的距离小于一特定值时，本例称为下限值，例如图7（C）所示用户在眯起眼睛导致上下眼睑距离小于该下限值，则处理器输出一指令，该指令可以是用来控制显示部件12所显示的图像缩小，如图8（N）所示对应为该方式控制缩小后所显示的图像。可见，通过该方式，当用户希望显示的图像缩小时，仅需眯起眼睛即可。
当处理器判断所采集的上下眼睑之间的距离在上述上下限值之间时，则停止对所述图像的缩放控制。例如，当用户在图像的放大或缩小控制过程中，若用户认为达到其希望的图像倍数时，则可以如图7（A）所示恢复正常的眼睛状态，则停止所述图像缩放的继续调整。
其中，还可以设置某指定的眼部状态或动作，例如眨眼三次，或某方式转动眼球，则使图像显示的大小恢复默认状态。
需要说明的是，示出图8（O）是为了说明图8（M）、图8（N）的所采集或所显示的图像放大、缩小状态，可以理解为图8（O）是初始状态，或默认状态时所采集或所显示的图像的大小。
另外，为了适应不同人的眼睛的大小状况、睁大、眯眼程度的习惯，可以在使用上述方式进行控制前，进行初始化配置步骤，通过初始化过程，用户可以根据提示进行睁眼、眯眼动作，智能眼镜采集该用户的眯眼、睁大、正常值三个状态时上下眼睑的距离，并进行一定加权处理后生成上下限值。另外，由于不同人的虹膜不同，因此，还可以针对不同用户分别进行各初始化内容的存储，例如以配置文件的方式存储，便于该用户下次使用时，可直接调用该用户的配置文件使用。
另外，正常的眨眼、或正常睁眼时，上下眼睑的距离会发生明显变化，为了避免将正常的眨眼、睁眼误识别为控制指令，可增加判断时间，如在判断上下眼睑距离超过所述上限值，或低于下限值且保持特定时间，如不小于2秒时，则认为该上下眼睑距离有效（即此次睁大眼睛或眯起眼睛为有效控制），执行相应的控制；若低于2秒时，则认为是这种睁眼、闭眼过程中的眼部变化为无效，过滤掉这类眼部状态情况。本例中的上述2秒仅为一个例子。
下面再将本发明的具体应用举一实施例进行说明，当用户参加会议面前有很多人，希望有指定的查看某些或某个人的信息时，其便可以通过上述控制，使所采集或所显示的图像放大，这将导致所显示的图像中的人数会减少，从而相应的识别面孔等应用可以大大的减少了要查询的人，实现了查询对象的指定性的精确。并且，其还可以进一步进行图像显示放大后，进一步结合瞳孔看图像里的位置的定位，确定其所要查询的对象。如上，相应的识别面孔等应用所查询对象进一步会大大减少，进一步精确了指定对象的查询。且，对降低功耗等也有益处。
当退出使用摄像头模式，如摄像、拍照功能，或退出图像浏览功能时，则可退出对应的通过眼睛睁开的大小对应的相应的控制。例如通过闭眼2秒钟以上表示退出，此时关闭朝内的摄像头，以省电。当相应的与摄像头/图像浏览相关的应用再次启动时，则可也再次启动本发明对应的方法，以降低智能眼镜的功耗。
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内，例如图4中的安装朝内摄像头211或光纤一端的位置，也可以安装于靠近左眼的支撑梁412上，或者安装于主体42位于支撑梁412下方的一端，如图3中主体42靠近棱镜12的一端。

Claims (10)

  1. 一种智能眼镜，包括控制部件，其特征在于，还包括：与控制部件电连接的、可检测用户眼部状态的图像采集装置；所述眼部状态包括上下眼睑距离；
    所述控制部件用于根据所检测的上下眼睑距离的大小控制智能眼镜显示部件（12）所显示图像的缩放、或智能眼镜上朝向用户观察方向的摄像头（11）的变焦。
  2. 根据权利要求1所述的智能眼镜，其特征在于，
    所述图像采集装置包括一微摄像头（211），位于智能眼镜的框架（41）的支撑梁（412）上，朝向用户眼部方向设置。
  3. 根据权利要求1所述的智能眼镜，其特征在于，所述图像采集装置包括：位于智能眼镜的主体（42）内的一微摄像头，位于该微摄像头镜头侧的棱镜（221），所述棱镜（221）内具有将用户眼部图像折射至该微摄像头的折射面。
  4. 根据权利要求3所述的智能眼镜，其特征在于，所述棱镜（221）的面向用户眼部的光入射面，或棱镜（221）内的所述折射面为曲面结构。
  5. 根据权利要求1所述的智能眼镜，其特征在于，所述图像采集装置包括：位于智能眼镜的主体（42）内的一微摄像头，成像光纤，该成像光纤一端装配于所述微摄像头的镜头端，另一端安装于智能眼镜的框架（41）的支撑梁（412）上，朝向用户眼部方向设置。
  6. 一种对智能眼镜的朝向用户观察方向的摄像头的控制方法，其特征在于，包括：
    采集智能眼镜佩戴者的眼部图像，该眼部图像包含上眼睑和下眼睑，
    判断上下眼睑之间的距离大于一上限值，控制朝向用户观察方向的摄像头的镜头焦距以使所采集的图像放大；
    判断上下眼睑之间的距离小于一下限值，控制所述摄像头的镜头焦距以使所采集的图像缩小；
    判断上下眼睑之间的距离在上述上下限值之间，所述摄像头的镜头焦距停止调整。
  7. 一种对智能眼镜的显示部件图像显示的控制方法 ，其特征在于，包括：
    采集智能眼镜佩戴者的眼部图像，该眼部图像包含上眼睑和下眼睑，
    判断上下眼睑之间的距离大于一上限值，控制智能眼镜显示部件所显示的图像放大；
    判断上下眼睑之间的距离小于一下限值，控制所述显示部件所显示的图像缩小；
    判断上下眼睑之间的距离在上述上下限值之间，所述显示部件所显示的图像缩放停止调整。
  8. 根据权利要求6或7所述的控制方法，其特征在于，还包括：
    所述判断上下眼睑之间的距离大于所述上限值或小于所述下限值时，还判断所述上下眼睑之间的所述距离维持超过特定时间时，认定此次判断有效，执行相应的控制。
  9. 根据权利要求6或7所述的方法，其特征在于，还包括：
    当判断眼睛为一指定状态或动作时，控制所述摄像头的镜头焦距或所述显示部件所显示的图像调整至默认值。
  10. 根据权利要求6或7所述的控制方法，其特征在于，所述采集智能眼镜佩戴者的眼部图像之前还包括：
    对智能眼镜佩戴者的所述上下限的初始化配置步骤。
PCT/CN2014/092232 2013-12-04 2014-11-26 智能眼镜及控制方法 WO2015081799A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310645887.5A CN103698904B (zh) 2013-12-04 2013-12-04 智能眼镜及控制方法
CN201310645887.5 2013-12-04

Publications (1)

Publication Number Publication Date
WO2015081799A1 true WO2015081799A1 (zh) 2015-06-11

Family

ID=50360488

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092232 WO2015081799A1 (zh) 2013-12-04 2014-11-26 智能眼镜及控制方法

Country Status (2)

Country Link
CN (1) CN103698904B (zh)
WO (1) WO2015081799A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109815778A (zh) * 2017-11-20 2019-05-28 上海真曦通信技术有限公司 一种基于眼部特征的身份识别电子系统
CN110572619A (zh) * 2019-09-25 2019-12-13 冀成 一种视力辅助工具

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103885206B (zh) * 2014-04-14 2015-06-03 苏州峰通光电有限公司 智能眼镜
CN104112248A (zh) * 2014-07-15 2014-10-22 河海大学常州校区 一种基于图像识别技术的智能生活提醒系统及方法
WO2016025664A1 (en) * 2014-08-13 2016-02-18 Ho Patrick C Prescription lenses for smart eyewear
CN105446579B (zh) * 2014-08-13 2019-03-29 联想(北京)有限公司 一种控制方法及便携式电子设备
CN105589197A (zh) * 2014-10-20 2016-05-18 深圳市亿思达科技集团有限公司 可以调节显示图像的间距的智能眼镜
CN104656257A (zh) * 2015-01-23 2015-05-27 联想(北京)有限公司 信息处理方法及电子设备
CN104635357B (zh) * 2015-03-07 2017-03-01 河南机电职业学院 一种可穿戴智能眼镜
WO2016149956A1 (zh) * 2015-03-22 2016-09-29 谢培树 电子眼镜
CN104793749B (zh) * 2015-04-30 2018-11-30 小米科技有限责任公司 智能眼镜及其控制方法、装置
CN104865712B (zh) * 2015-06-11 2017-03-22 武汉目明乐视健康科技有限公司 儿童智能健康眼镜
CN105959631B (zh) * 2016-05-20 2019-03-01 武汉中谷高科电子系统工程有限公司 一种多媒体智能终端远程监视控制设备
CN106657766A (zh) * 2016-10-19 2017-05-10 广东欧珀移动通信有限公司 照相机的对焦调整方法、装置及智能终端
CN106873157A (zh) * 2016-12-28 2017-06-20 广州途威慧信息科技有限公司 一种基于眼球情况的智能虚拟眼镜控制方法
CN107105161A (zh) * 2017-04-27 2017-08-29 深圳市元征科技股份有限公司 变焦倍数调整方法及装置
CN107065193A (zh) * 2017-05-27 2017-08-18 罗德强 一种用于近眼显示的光学设备
CN108833832B (zh) * 2018-06-20 2021-03-02 王学军 一种眼镜摄录仪及摄录方法
JP7240996B2 (ja) * 2019-09-18 2023-03-16 株式会社トプコン アイウェア装置を用いた測量システムおよび測量方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2498505A1 (en) * 2005-02-25 2006-08-25 Symagery Microsystems Inc. Hands-free data acquisition system
CN202159199U (zh) * 2011-07-25 2012-03-07 金宇 一种基于眨眼特征提取控制拍摄的眼镜
CN103209287A (zh) * 2013-03-11 2013-07-17 张国柱 一种调控摄像机镜头的摄像方法和专用摄像机及专用眼镜框
CN203164515U (zh) * 2013-04-12 2013-08-28 北京印刷学院 一种智能眼镜

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101285941A (zh) * 2008-05-14 2008-10-15 熊克明 一种与手机或移动多媒体影音互动的视频眼镜及互动方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2498505A1 (en) * 2005-02-25 2006-08-25 Symagery Microsystems Inc. Hands-free data acquisition system
CN202159199U (zh) * 2011-07-25 2012-03-07 金宇 一种基于眨眼特征提取控制拍摄的眼镜
CN103209287A (zh) * 2013-03-11 2013-07-17 张国柱 一种调控摄像机镜头的摄像方法和专用摄像机及专用眼镜框
CN203164515U (zh) * 2013-04-12 2013-08-28 北京印刷学院 一种智能眼镜

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109815778A (zh) * 2017-11-20 2019-05-28 上海真曦通信技术有限公司 一种基于眼部特征的身份识别电子系统
CN110572619A (zh) * 2019-09-25 2019-12-13 冀成 一种视力辅助工具

Also Published As

Publication number Publication date
CN103698904A (zh) 2014-04-02
CN103698904B (zh) 2014-12-10

Similar Documents

Publication Publication Date Title
WO2015081799A1 (zh) 智能眼镜及控制方法
WO2016176959A1 (zh) 一种基于眼球追踪技术的显示屏多屏控制方法及系统
WO2016086440A1 (zh) 针对全盲人群的可穿戴式引导设备
CN205720872U (zh) 具有瞳孔追踪功能的虚拟现实眼镜
WO2015051660A1 (zh) 头戴式立体显示器
JP2016523122A (ja) 移動式の前眼部及び後眼部検眼のためのモジュール式レンズアダプタ
CN205942153U (zh) 一种医疗智能眼镜
WO2016200102A1 (ko) 카메라의 초점을 변경하는 방법 및 장치
WO2019001575A1 (zh) 可穿戴显示器
WO2015180217A1 (zh) 通讯帽子
WO2018052231A1 (ko) 플렉서블 디스플레이를 포함하는 전자 장치
WO2018117443A1 (ko) 클라우드 연동형 시기능 강화 웨어러블 디바이스 시스템
CN204807842U (zh) 智能眼镜
CN113301247B (zh) 一种摄像设备、其控制方法以及存储介质
JP2015149552A (ja) ウェアラブル型電子機器
WO2021107527A1 (ko) 다기능 증강현실 글라스, 모듈화된 증강현실 글라스 및 헤드모션감지 증강현실 글라스
WO2016035952A1 (ko) 이미지 처리 디바이스 및 그 이미지 처리 방법
CN202515636U (zh) 耳鼻检测仪
CN205826994U (zh) 一种多功能电子智能眼镜
WO2014201987A1 (zh) 头盔装置
KR100846355B1 (ko) 두부 장착식 디스플레이 장치의 시력 보조 방법 및 그 두부장착식 디스플레이 장치
WO2018018357A1 (zh) Vr图像拍摄装置及其基于移动终端的vr图像拍摄系统
CN203986289U (zh) 一种带分体棱镜的通讯帽子
CN212694166U (zh) 一种头戴式显示设备
US10176726B2 (en) Handheld, portable vision aid device and vision aid system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14868371

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14868371

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 14868371

Country of ref document: EP

Kind code of ref document: A1