CN106293100A - Method for determining sight focal point in virtual reality equipment and virtual reality equipment - Google Patents

Method for determining sight focal point in virtual reality equipment and virtual reality equipment Download PDF

Info

Publication number
CN106293100A
CN106293100A CN201610719719.XA CN201610719719A CN106293100A CN 106293100 A CN106293100 A CN 106293100A CN 201610719719 A CN201610719719 A CN 201610719719A CN 106293100 A CN106293100 A CN 106293100A
Authority
CN
China
Prior art keywords
eye
user
image
information
based
Prior art date
Application number
CN201610719719.XA
Other languages
Chinese (zh)
Inventor
黄俊岚
Original Assignee
上海与德通讯技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海与德通讯技术有限公司 filed Critical 上海与德通讯技术有限公司
Priority to CN201610719719.XA priority Critical patent/CN106293100A/en
Publication of CN106293100A publication Critical patent/CN106293100A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Abstract

The embodiment of the invention discloses a method for determining a sight focal point in virtual reality equipment and the virtual reality equipment. The method includes the steps that when it is determined that a user watches a display image on display equipment, infrared rays are emitted to the eyeballs of the user based on an infrared transmitter; an image acquisition module acquires the infrared rays reflected by the eyeballs of the user, and a current eye image of the user is formed; a processor acquires the eye image, and current sight focal point information of the user is determined based on the eye image and preset eye parameter information. By means of the determination method, when the user watches the virtual reality image, the current sight focal point, on the virtual reality image, of the user is determined in real time, the virtual reality equipment can improve several interactive functions based on the determined sight focal point, and the purpose of improving the user experience of the virtual reality equipment is improved.

Description

虚拟现实设备中视线焦点的确定方法及虚拟现实设备 Virtual reality device and method for determining the focus of attention of the virtual reality equipment

技术领域 FIELD

[0001] 本发明实施例涉及虚拟现实技术领域,尤其涉及虚拟现实设备中视线焦点的确定方法及虚拟现实设备。 [0001] Example embodiments relate to virtual reality Technical Field The present invention particularly relates to a method for determining the focus of attention of the virtual reality devices and virtual reality equipment.

背景技术 Background technique

[0002] 虚拟现实(Virtual Reality,VR)设备是与虚拟现实技术领域相关的硬件产品,VR 技术是综合利用计算机图形系统和现实中各种接口设备,在计算机上生成可交互的沉浸式环境的技术。 [0002] VR (Virtual Reality, VR) equipment is related to the field of virtual reality technology hardware products, VR technology is the utilization of a computer graphics system and the reality of a variety of interface devices, generate immersive interactive environment on a computer technology. 随着科技的不断发展,VR技术正在普及,现有的VR设备一般为头戴式设备,通过将VR设备戴在头上用户可以体验到身临其境的感觉。 With the continuous development of technology, VR technology is universal, existing VR equipment is generally headsets, you can experience by VR device worn on the user's head to the immersive feel.

[0003] 现有的虚拟现实设备有多种类型,图1为现有的一种虚拟现实设备的结构示意图, 如图1所示,该种虚拟现实设备主要包括:外壳10、设置在外壳10内的显示设备11、相对显示设备11更靠近人眼设置的光学成像设备12、设置在外壳10内壁不影响人眼视线的电池13和处理器14,以及缓冲框15。 [0003] Existing devices have multiple types of virtual reality, FIG. 1 is a schematic structural diagram of a conventional virtual reality apparatus, shown in Figure 1, the kind of virtual reality apparatus including: a housing 10, disposed in the housing 10 in the display device 11, display device 11 relatively closer to the human eye is provided an optical imaging apparatus 12 and the processor 13 is provided in the inner wall of the housing 10 does not affect the human eye sight batteries 14, 15 and a buffer block. 其中,显示设备11包括对应左右眼设置的两个显示面板,光学成像设备12包括对应左右眼设置的两个透镜,光学成像设备12将显示设备11上的内容投射到人眼中,缓冲框15可以与人脸外形接触,避免外界光线进入。 Wherein the display device comprises two display panels 11, left and right eyes corresponding to the optical image forming apparatus 12 includes two lenses provided corresponding to left and right eyes provided, the optical imaging device 12 displays the content on the device 11 is projected to the eyes, the buffer block 15 can be shape contacting with the face to prevent entry of ambient light.

[0004] 一般地,VR设备主要为用户提供了视听体验,因此,可以基于用户观看虚拟现实图像时视线焦点的变化来对VR设备交互功能进行一些改进,但是,目前的VR设备并不具有确定用户视线焦点的功能。 [0004] In general, VR equipment, mainly to provide users with audio-visual experience, so you can watch the change in the focus of attention based on the user to make some improvements to the VR device interaction function virtual reality image, however, the current VR device does not have to determine the focus of attention of the user function.

发明内容 SUMMARY

[0005] 本发明实施例提供了虚拟现实设备中视线焦点的确定方法及虚拟现实设备,以用于在虚拟现实设备中确定用户观看显示图像时落在显示设备上的视线焦点。 Embodiment provides a method for determining the focus of attention of the virtual reality devices and virtual reality devices [0005] In the present invention, for determining the focus of attention on a user viewing the display device displaying an image falls in a virtual reality device.

[0006] -方面,本发明实施例提供了一种虚拟现实设备,该虚拟现实设备包括:外壳,设置在外壳内的显示设备、处理器、电池和光学成像设备,以及缓冲框,还包括: [0006] - aspect, embodiments of the present invention provides a virtual reality device, the virtual reality apparatus comprising: a housing, a display device, a processor, a battery, and an optical imaging apparatus, and a buffer block within the housing, further comprising:

[0007]红外线发射器和图像采集模块; [0007] The infrared emitter and an image acquisition module;

[0008]所述红外线发射器,安装于所述缓冲框上,用于发射红外光线; [0008] The infrared emitter mounted on the frame buffer, for emitting infrared light;

[0009]所述图像采集模块,安装于所述缓冲框上,且安装位置与所述红外线发射器的安装位置成轴对称,用于采集人眼反射后的红外光线并形成眼部图像。 [0009] The image acquisition module, mounted on the frame buffer, and the installation position of the infrared emitter is axisymmetric, an infrared ray reflected the human eye, and capture an image forming eye.

[0010] 另一方面,本发明实施例提供了一种虚拟现实设备中视线焦点的确定方法,采用本发明实施例提供的虚拟现实设备执行,包括: [0010] In another aspect, embodiments of the present invention provides a method for determining the focus of attention in a virtual reality device, using a virtual reality apparatus performs according to an embodiment of the present invention, comprising:

[0011] 在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线; [0011] In determining the user views the image displayed on the display device emits infrared rays to an infrared emitter based on the eyeball of the user;

[0012] 基于图像采集模块采集经用户眼球反射后的红外光线,形成用户当前的眼部图像; [0012] After collecting the infrared light reflected by the eyeball of the user based on the image collecting module, the user's current eye image is formed;

[0013] 处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息。 [0013] The image processor obtains the eye, and the image of the eye based on pre-ocular parameter information to determine the user's current focus of attention information.

[0014]本发明实施例中提供的虚拟现实设备中视线焦点的确定方法及虚拟现实设备。 [0014] The method of determining a virtual reality apparatus provided in the embodiment embodiment of the present invention, the focus of attention and virtual reality equipment. 在虚拟现实设备中,当确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线;然后基于图像采集模块采集经用户眼球反射后红外光线,形成用户当前的眼部图像;处理器获取该眼部图像,并基于该眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息。 In the virtual reality apparatus, when it is determined that the user views the image displayed on the display device, transmitting an infrared emitter based on the infrared light to the eyeball of the user; then, after collecting reflected by the eyeball of the user based on the infrared ray image acquisition module, the user's current eye image formed ; processor obtaining the eye image, and the eye image based on the parameter information determining the predetermined eye line of sight of the user's current focus information. 利用该方法,能够在用户观看虚拟现实图像时,实时确定用户当前落在虚拟现实图像上的视线焦点,使得虚拟现实设备能够基于所确定的视线焦点进行一些交互功能的改进,达到提升虚拟现实设备用户体验的目的。 With this method, when virtual reality images can be viewed at the user, in real-time to determine the user's current focus of attention falls on the virtual reality images, virtual reality devices to make improvements based on some of the interactive features of the determined focus of attention, to enhance virtual reality devices the purpose of the user experience.

附图说明 BRIEF DESCRIPTION

[0015]图1为现有的一种虚拟现实设备的结构不意图; [0015] FIG. 1 is a conventional virtual reality a device structure is not intended;

[0016] 图2为本发明实施例一提供的一种虚拟现实设备的结构示意图; [0016] FIG. 2 configuration diagram of a virtual reality device according to a first embodiment of the present invention;

[0017] 图3为本发明实施例二提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图; [0017] Figure 3 flow diagram of a method of determining the real focus of attention of the virtual device according to a second embodiment of the invention;

[0018] 图4为本发明实施例三提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图; [0018] FIG. 4 schematic flowchart of a method for determining the real focus of attention of the virtual device according to a third embodiment of the invention;

[0019] 图5为本发明实施例四提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图。 [0019] Figure 5 flow diagram of a method of determining the real focus of attention of the virtual device according to a fourth embodiment of the present invention.

具体实施方式 Detailed ways

[0020] 下面结合附图和实施例对本发明作进一步的详细说明。 Drawings and embodiments of the present invention will be further described in detail [0020] below in conjunction. 可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。 It will be appreciated that the specific embodiments described herein are merely to illustrate the invention, not limitation of the invention. 另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。 Also to be noted also that, for convenience of description, the accompanying drawings illustrate only some, but not all of the structure associated with the present invention.

[0021] 实施例一 [0021] Example a

[0022] 图2为本发明实施例一提供的一种虚拟现实设备的结构示意图,基于该虚拟现实设备可以实现视线焦点的确定。 [0022] FIG. 2 configuration diagram of a virtual reality device according to a first embodiment of the present invention may be implemented is determined based on the focus of attention of the virtual reality device. 如图2所示,本发明实施例提供虚拟现实设备包括:外壳20、 设置在外壳20内的显示设备21、相对显示设备21更靠近人眼设置的光学成像设备22、设置在外壳20内壁不影响人眼视线的电池23和处理器24,以及缓冲框25,此外,该虚拟现实设备还包括:红外线发射器26和图像采集模块27。 As shown, an embodiment of a virtual reality apparatus of the present invention include 2: housing 20, disposed within the housing 20, a display device 21, an optical imaging device relative to the display device 21 is disposed closer to the human eye 22, disposed not on the inner wall of the housing 20 Effect of the human eye sight battery 23 and processor 24, frame buffer 25 and, in addition, the virtual reality device further comprises: an infrared emitter 26 and an image acquisition module 27.

[0023]其中,红外线发射器26,安装于所述缓冲框25上,用于发射红外光线; [0023] wherein the infrared emitters 26 mounted to the frame buffer 25 for emitting infrared light;

[0024]图像采集模块27,安装于所述缓冲框25上,且安装位置与所述红外线发射器的安装位置成轴对称,用于采集人眼反射后的红外光线并形成眼部图像。 [0024] The image acquisition module 27, mounted to the frame buffer 25, and the installation position of the infrared emitter is axisymmetric, an infrared ray reflected the human eye, and capture an image forming eye.

[0025]在本实施例中,图像采集模块27的安装位置与红外线发射器26的安装位置成轴对称的原因在于:图像采集模块27用于采集人眼反射后的红外光线,并基于所采集的红外光线形成眼部图像,所以与红外线发射器26对称安装,可以更好的吸收人眼反射后的红外光线,进而保证所述眼部图像的成像质量。 Cause [0025] In the present embodiment, the image acquisition module mounting location 27 of infrared emitters 26 mounted position axisymmetric in that: the infrared image acquisition module 27 for collecting light after reflection eye, and based on the collected infrared light is formed eye image, the infrared emitter mounted symmetrically and 26, can better absorb the infrared ray reflected the human eye, thereby ensuring imaging quality of the eye image.

[0026]在本实施例中,红外线发射器26以及图像采集模块27的数量可以为一个或两个, 但红外线发射器26以及图像采集模块27在虚拟现实设备中为一一对应的关系。 Embodiment, the number 26 and 27 may be one or two, but 27 to one correspondence between the image acquisition module infrared emitter 26 and infrared emitter image acquisition module in a virtual reality device, [0026] in the present embodiment. 需要说明的是,当虚拟现实设备中所安装红外线发射器26以及图像采集模块27的数量均为一个时,对红外线发射器26以及图像采集模块27的安装位置有所限定,此时,红外线发射器26以及图像采集模块27可以优选的安装在缓冲框25的处于双眼中间的位置处,且红外线发射器26以及图像采集模块27的安装位置上下对称;当虚拟现实设备中所安装红外线发射器26以及图像采集模块27的数量均为两个时,可以将红外线发射器26以及图像采集模块27与双眼对应设置,即,可以在缓冲框25与每只眼睛对应的上下或左右的位置处对称安装红外线发射器26以及图像采集模块27。 Incidentally, when a virtual reality device as infrared emitter 26 and an image acquisition module 27 are mounted a number of time, the mounting position of the infrared emitter 26 and an image acquisition module 27 has been defined, at this time, infrared emission 26 and an image acquisition module 27 may preferably be installed at a location in the eye in the middle of the buffer block 25 and an infrared transmitter 26 and symmetric vertical image acquisition module mounting position 27; when a virtual reality apparatus as an infrared emitter mounted 26 and an image acquisition module 27 are the number two, may be an infrared emitter 26 and an image acquisition module 27 provided in correspondence with the eyes, i.e., at the position of the buffer block 25 can each eye corresponding to the left and right or symmetrically up and down infrared emitter 26 and an image acquisition module 27.

[0027] 图2中以一个红外线发射器26和对称安装的一个图像采集模块27为例;在本实施例中,虚拟显示设备中所安装红外线发射器26和图像采集模块27的数量并不会对虚拟现实设备的工作效率造成很大影响。 In [0027] In FIG 2 an infrared emitter 26 and a symmetrically image acquisition module 27 of an example; in the present embodiment, the virtual display device 26 and infrared emitter mounted image acquisition module 27 and not the number of a great impact on the efficiency of virtual reality device.

[0028] 进一步的,图像采集模块27为可捕捉红外光线的摄像头。 [0028] Further, the image acquisition module 27 of the camera can capture the infrared light.

[0029] 在本实施例中,基于该摄像头,可以捕捉反射后的红外光线,而该摄像头有可能对其他波长的光线并不敏感。 [0029] In the present embodiment, based on the camera can capture the reflected infrared light, which may not have a camera sensitive to light of other wavelengths.

[0030] 进一步的,红外线发射器26通过导线与电池23相连,电池23向红外线发射器26提供电源。 [0030] Further, the infrared transmitter 26 via a line connected to the battery 23, the battery 23 supplies power to the infrared transmitter 26.

[0031]进一步的,图像采集模块27通过数据总线与处理器24相连,处理器24用于对图像采集模块27采集的图像数据进行处理。 [0031] Further, the image pickup module 27 is connected through a data bus 24 and a processor 24 for image data collected by the image pickup module 27 for processing.

[0032]本发明实施例以提供的一种虚拟现实设备,与现有的虚拟现实设备相比,增加了红外线发射器和图像采集模块。 Example [0032] The present invention provides in a virtual reality device, and virtual reality as compared with the conventional apparatus, increasing the infrared transmitter and an image acquisition module. 利用该虚拟现实设备,能够通过实时红外线发射器向人眼发射红外光线,并能够通过图像采集模块采集经人眼反射后的红外光线形成实时的眼部图像,基于该眼部图像能够确定用户落在显示设备上的视线焦点,由此为虚拟现实设备交互功能的提供改进基础,进而提升了虚拟现实设备的用户体验。 The use of virtual reality device, capable of emitting infrared light to a human eye in real time by an infrared transmitter, and capable of forming a real image of the eye acquired by the infrared light reflected by the eye image acquisition module, the user can determine which colonies eye image based on the focus of attention on the display device, thereby improving the basis of virtual reality devices to provide interactive features, thereby enhancing the user experience of virtual reality devices.

[0033] 实施例二 [0033] Second Embodiment

[0034] 图3为本发明实施例二提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图。 [0034] Figure 3 flow diagram of a method of determining the real focus of attention of the virtual device according to a second embodiment of the invention. 该确定方法适用于对虚拟现实设备中用户观看虚拟现实图像时的视线焦点进行确定的情况,可以由本发明实施例一提供的虚拟现实设备执行,主要基于虚拟现实设备中设定的软件和/或硬件实现。 This determination method is applicable to the focus of attention during the viewing virtual reality image of the virtual reality device user determination, the execution of the virtual reality device according to a first may be implemented by the present invention, based primarily on virtual reality device set in the software and / or hardware implementation.

[0035] 如图3所示,本发明实施例二提供的一种虚拟现实设备中视线焦点的确定方法,具体包括如下操作: [0035] As shown in FIG. 3, a method for determining the focus of attention in a virtual reality apparatus according to a second embodiment of the present invention, includes the following operations:

[0036] S301、在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线。 [0036] S301, it is determined that the user views the image displayed on the display device, emitting infrared light to an infrared emitter based on the eyeball of the user.

[0037] 在本实施例中,在用户佩戴VR设备后,可以通过VR设备中的光学成像设备观看到显示设备上的显示图像,因此,在确定用户观看显示设备上的显示图像时,可以启动安装于缓冲框上的红外线发射器,然后基于红外线发射器向用户眼球发射红外光线。 [0037] In the present embodiment, after the user wears the VR device, can be viewed through the VR device, an optical imaging device to the image displayed on the display device, therefore, in determining the user views the image displayed on the display device, may initiate infrared emitter mounted to the frame buffer, and then based on the infrared emitter emits infrared light to the eyeball of the user.

[0038] 在本实施例中,基于红外光线的特性可知,红外光线不会对用户眼睛造成伤害,同时也不会影响用户观看显示设备上的显示图像,且红外光线在暗环境下更容易成像。 [0038] In the present embodiment, based on characteristics of the infrared ray can be seen, the infrared light does not cause harm to the user's eyes, but it will not affect the user views the image displayed on the display device, and the infrared light more easily imaged in a dark environment . 因此, 可以通过红外线发射器向用户眼球发射的红外光线,以使图像采集模块产生更好的用户眼部图像。 Thus, the infrared rays by the infrared transmitter transmits the user's eye, so that the image acquisition module generates a better user eye image.

[0039] S302、基于图像采集模块采集经用户眼球反射后的红外光线,形成用户当前的眼部图像。 [0039] S302, the image acquisition module based on the infrared light reflected by the eyeball of the user, the user's current eye image is formed.

[0040]在本实施例中,所述图像采集模块主要用于采集经用户反射后的红外光线,由此可以基于所采集的红外光线实时的形成用户当前的眼部图像。 [0040] In the present embodiment, the image acquisition module for collecting infrared rays after reflection by the user, whereby the user's current eye image formed in real time based on the collected infrared rays. 具体的,所述图像采集模块可以看作一个感光器件,主要基于所吸收的光形成对应的图像,此外所述图像采集模块可优选的设置成一个具有捕捉红外光线功能的感光摄像头,以使所述图像采集模块仅能够采集红外光线,由此基于所吸收的红外光线形成用户的眼部图像。 Specifically, the image acquisition module may be regarded as a sensing device, an image corresponding to the major form based on the absorbed light, in addition to the image acquisition module is preferably arranged to capture an infrared ray camera having a photosensitive function, so that the said image acquisition module can collect only the infrared light, thereby forming an image of the user's eye based on the infrared light absorbed. 具体的,所述眼部图像具体可理解为包括用户双眼眼球信息的图像。 Specifically, the image of the eye specifically understood to include the user information of the eyeball image eyes.

[0041]在本实施例中,所述红外线发射器和图像采集模块均安装于VR设备的缓冲框上, 且根据所具有红外线发射器和图像采集模块的数量不同,在所述缓冲框上的安装位置就不相同,示例性的,假设VR设备中分别具有两个红外线发射器和图像采集模块,则可以在缓冲框的与用户每只眼睛对应的位置上安装一个红外线发射器并相应的对称安装一个图像采集模块,以用户左眼为例,可以在缓冲框的与用户左眼对应的上边框处安装一个红外线发射器,在与上边框对称的下边框处安装一个图像采集模块。 [0041] In the present embodiment, the infrared emitter and an image acquisition module are mounted on a frame buffer device VR, and the infrared emitters and the number of image acquisition modules having different frame on the buffer the mounting position is not the same, exemplary, it is assumed VR device has two infrared emitters and image capture module, may be installed an infrared emitter and in a position symmetrically corresponding to each eye of the user corresponding to the frame buffer an image acquisition module mounted to the user's left, for example, an infrared emitter may be mounted on the user's left border of the corresponding frame buffer, an image acquisition module mounted in the frame at the lower and the upper border of symmetry. 需要说明的是,本实施例中仅描述了红外线发射器及图像采集模块的一种安装方式,但对二者的安装并不局限于此种方式,只要所述红外线发射器向用户眼球发射的红外光线能精确地反射给图像采集模块形成用户眼部图像即可。 Incidentally, the present embodiment only describes a mounting infrared transmitter and an image acquisition module, but the installation of this embodiment is not limited to two as long as the infrared transmitter transmits the user eyeball infrared light can be accurately reflected to the image capture module to form a user eye image.

[0042] S303、处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息。 [0042] S303, the processor obtaining the eye image, and the image of the eye based on pre-ocular parameter information to determine the user's current focus of attention information.

[0043]在本实施例中,步骤S302中基于图像采集模块形成用户当前的眼部图像之后,需要将所述眼部图像发送给VR设备的处理器,通过所述处理器才能实现对用户当前视线焦点的确定。 After [0043] In the present embodiment, step S302 is formed based on a user's current image acquisition module eye image, the image of the eye needs to be sent to the processor VR device, the user can be achieved by the current processor determine the focus of attention. 在本实施例中,所述视线焦点具体可理解为用户观看显示设备上的显示图像,眼光聚焦在所述显示图像上的具体位置。 In the present embodiment, the focus of attention specifically understood to display image viewed by the user on the display device, the specific position of the eyes focus on the image in the display.

[0044] 在本实施例中,在处理器获取所述眼部图像后,可以基于所述眼部图像中所包含的数据信息以及预先获得的眼部参数信息来确定用户当前的视线焦点信息。 [0044] In the present embodiment, after obtaining the eye image, may determine the user's current focus of attention information based on the data information contained in the image of the eye and the ocular parameter information obtained in advance in a processor. 一般地,所述视线焦点信息无法用一个准确地具体值来描述,通常可以基于用户当前的视线角度及虚拟现实图像上的视线焦点到用户双眼中间的视线距离来表示;还可以基于用户双眼眼球观看显示图像时分别形成的视线角度来表示。 Generally, the information can not be the focus of attention accurately described by a particular value, typically based on the user's current line of sight angle and the focus of attention in the virtual reality image to the user of the binocular sight distance to the intermediate representation; may also be based on a user binocular eye sight viewing angles are formed when the display image is represented.

[0045] 本发明实施例二提供的一种虚拟现实设备中视线焦点的确定方法,在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线;然后基于图像采集模块采集经用户眼球反射后红外光线,形成用户当前的眼部图像;处理器获取该眼部图像,并基于该眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息。 A method for determining the focus of attention in a virtual reality apparatus according to a second embodiment [0045] The present invention, in determining the user viewing the image displayed on the display device, based on infrared transmitter to emit infrared light towards the eyeball user; then, based on image acquisition module after capturing the infrared light reflected eyeball of the user, the user's current eye image is formed; processor obtaining the eye image, and the eye image based on the parameter information determining the predetermined eye line of sight of the user's current focus information. 利用该方法,能够在用户观看虚拟现实图像时,实时确定用户当前落在虚拟现实图像上的视线焦点, 使得虚拟现实设备能够基于所确定的视线焦点进行一些交互功能的改进,达到提升虚拟现实设备用户体验的目的。 With this method, when virtual reality images can be viewed at the user, in real-time to determine the user's current focus of attention falls on the virtual reality images, virtual reality devices to make improvements based on some of the interactive features of the determined focus of attention, to enhance virtual reality devices the purpose of the user experience.

[0046] 实施例三 [0046] Example three

[0047] 图4为本发明实施例三提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图。 [0047] FIG. 4 schematic flowchart of a method for determining the real focus of attention of the virtual device according to a third embodiment of the invention. 本发明实施例三以上述实施例二为基础进行优化,在本实施例中,该确定方法还优化增加了:设置确定视线焦点信息所需的眼部参数信息。 According to a third embodiment of the present invention, the above second embodiment as the basis for the optimization, in the present embodiment, the determination method also increases the optimization: setting parameter information required for determining the eye gaze focus information.

[0048] 进一步的,所述设置确定视线焦点信息所需的眼部参数信息,具体包括: [0048] Further, the setting parameter information required for the eye gaze determining focus information comprises:

[0049] 确定用户眼球的标准瞳距,所述瞳距指用户左眼眼球中心到右眼眼球中心的距离;确定用户眼球的至少一个测试瞳距,并基于所述标准瞳距确定每个测试瞳距所对应的眼球直径测试值;基于所述至少一个眼球直径测试值确定用户眼球的眼球直径标准值,并将所述眼球直径标准值记为眼部参数信息。 [0049] The criteria to determine the user's eye pupil distance, the distance of the user's left eye pupil distance center to center of the right eye eyeball; eyeball of the user to determine at least one IPD test, and each test is determined based on the standard interpupillary the IPD value corresponding to the diameter of the test eye; test value of at least one eye diameter diameter standard value is determined based on the eyeball of the user of the eye and the eye diameter standard value parameter information recorded as the eye.

[0050] 在上述优化的基础上,所述处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息,具体包括:处理器获取用户当前的眼部图像,并基于所述眼部图像确定与用户双眼眼球对应的垂直位移差和水平位移差,其中,所述垂直位移差和水平位移差基于眼球中心当前所处位置与平视时眼球中心所处位置获得; 基于所述垂直位移差、水平位移差以及所述眼部参数信息,确定用户观看显示图像时双眼眼球对应的垂直视线角度和水平视线角度;基于双眼眼球对应的垂直视线角度和水平视线角度,确定双眼眼球对应的视线角度,并将双眼眼球对应的视线角度确定为用户当前的视线焦点信息。 [0050] Based on the above optimization on, the processor obtains the eye image, and the user's current focus of attention of the eye is determined based on image information and parameter information predetermined eye, comprises: a processor obtaining when the user's current eye image, and determine the user corresponding to the vertical displacement of binocular eye difference and horizontal displacement of the eye based on the difference image, wherein the differential vertical displacement and horizontal displacement based on the difference between the current position of the eye center and head eyeball center location obtained; based on the difference in vertical displacement, horizontal displacement difference and the ocular parameter information, determines the vertical angle of the line of sight and line of sight horizontal viewing angle of a display image when the user's eyes corresponding to the eye; eyes based on the vertical line of sight corresponding to the eye angle and the horizontal angle of the line of sight, determines the angle of sight corresponding to the eye eyes, both eyes and determines the angle of the line of sight corresponding to the eye's line of sight for the user's current focus information.

[0051] 如图4所示,本发明实施例三提供的一种虚拟现实设备中视线焦点的确定方法,具体包括如下操作: [0051] As shown in FIG 4, a method for determining the focus of attention in a virtual reality apparatus according to a third embodiment of the present invention, includes the following operations:

[0052]在本实施例中,步骤S401至S403给出了其中一种设置眼部参数信息的具体操作步骤。 [0052] In the present embodiment, steps S401 to S403 is given one ocular parameter settings specific steps.

[0053] S401、确定用户眼球的标准瞳距,所述瞳距指用户左眼眼球中心到右眼眼球中心的距离。 [0053] S401, the user determines the standard interpupillary distance of the eye, the user's left eye pupil distance means a distance center to center of the right eye.

[0054]在本实施例中,可以首先确定用户眼球的标准瞳距。 [0054] In the present embodiment, the user may first determine the standard interpupillary distance of the eye. 具体的,可以在所述VR设备的显示设备上显示一个测试图像,并将所述测试图像的图像焦点设置在距离用户双眼中心处无穷远(即,能有多远就设置多远)的位置上,且所述图像焦点与用户眼睛平视时处于同时水平面上;然后提示用户观看所述测试图像的图像焦点,并保持该观看状态直到图像采集模块通过所反射的红外光线获取到该观看状态对应的眼部图像;最终,处理器可以基于所获取的眼部图像确定用户此时的标准瞳距,可将所述标准瞳距表示为D。 Specifically, a test image may be displayed on a display device of the VR device, the focus and the image of the test image from the user is provided at the center of both eyes infinity (i.e., is set to have a far far) position on, and the image focal point in the eye level of the user while the horizontal plane; then prompts the user views the image focal point of the test image, and holds the state until the viewing image acquisition module acquires the viewing state by corresponding to the infrared light reflected eye image; eventually, the processor may determine that the user at this time based on the standard interpupillary distance of the acquired eye image, the standard interpupillary distance may be represented as D.

[0055] S402、确定用户眼球的至少一个测试瞳距,并基于所述标准瞳距确定每个测试瞳距所对应的眼球直径测试值。 [0055] S402, the user determines the at least one test eye pupil distance, and the eye diameter of the test criteria to determine IPD value corresponding to each test based IPD.

[0056]在本实施例中,基于上述步骤S401设置的无穷远的图像焦点获得了用户的标准瞳距,之后,可以在用户眼睛平视时的水平面上不断调整测试图像的图像焦点,由此获得图像焦点到用户双眼中心的至少一个距离值,并基于图像采集模块获得每个距离值时所对应的用户眼部图像,处理器可以对所述至少一张眼部图像进行处理,获得与所述至少一张眼部图像对应的瞳距,并将所述瞳距标记为测试瞳距;最后,可以基于所述标准瞳距以及设定的眼球直径计算公式确定与各测试瞳距相对应的眼球直径测试值。 [0056] In the present embodiment, an image based on the focus setting step S401 infinity is obtained IPD standard user, then, may be the horizontal plane when the eye level of the user to constantly adjust the focus of the image of the test image, thereby obtaining center-focus image to the eyes of the user at least one distance value, and each distance value is obtained based on the image acquisition module eye image corresponding to the user, the processor may process the at least one eye image, obtained with the eye image corresponding to the at least one IPD, and the interpupillary distance IPD test mark; Finally, the interpupillary distance can be determined corresponding to each test eye and the eye pupil distance based on the standard diameter set by the calculation formula diameter of the test values. 在本实施例中,所述眼球直径的计算公式设定为: In the present embodiment, the eyeball is calculated diameter is set to:

Figure CN106293100AD00081

其中,L表示当前图像焦点与用户双眼中心的距离值,4表示距离值为L时对应的眼球直径测试值,Dl表示距离值为L时基于所对应眼部图像测得的测试瞳距值,D表示所测得的标准瞳距。 Wherein, L represents the current value of the image focal point from the center of the eyes of the user, the value of 4 indicates the eye diameter of the test value corresponding to the distance L, based on testing IPD value Dl represents the eye image corresponding to the measured value of the distance L, D represents the standard interpupillary distance measured.

[0057]示例性的,可以在用户眼睛平视时的水平面上不断调整测试图像的图像焦点,所获得的图像焦点到用户双眼中心的距离值可分别为10米、5米、3米、2米以及1米,由此可形成与上述距离值相对应的眼部图像,并测得与所述距离值对应的测试瞳距,所述测试瞳距可分别表示为。 [0057] An exemplary, can be a horizontal plane when the user eye level constantly adjust focus image of the test image, the image focus of the obtained distance value to the user eyes and the center may be 10 m, 5 m, respectively, 3 m, 2 m and 1 m, thereby forming eye image and the corresponding distance value, and the measured distance value corresponding to said test pupillary distance, the interpupillary distance can be expressed as test. ^、^、^、出以及口^然后基于所述眼球直径计算公式可确定相应的眼球直径测试值分别为(110、(15、(13、(12以及(11。 ^, ^, ^, ^ And an outlet and a diameter of the eye based on the calculated position can be determined diameter of the test values ​​of the eye (110, (15, (13, (12 and (11.

[0058] S403、基于所述至少一个眼球直径测试值确定用户眼球的眼球直径标准值,并将所述眼球直径标准值记为眼部参数信息。 [0058] S403, at least a diameter of the eye diameter of the test-value determination reference value based on the eyeball of the user of the eye and the eye diameter standard value parameter information recorded as the eye.

[0059] 在本实施例中,可以基于上述所得到的至少一个眼球直径测试值求平均值,由此得到所述眼球直径标准值,且可将所述眼球直径标准值标记为所述眼部参数信息。 [0059] In the present embodiment, based on the at least one eye may find the value of the diameter of the test mean values ​​obtained, whereby the diameter of the eyeball standard value, and the eye diameter can be marked as the standard value of the eye Parameter information. 示例性的,接上述示例,在确定出所述眼球直径测试值(^、(^、(^、山以及山之后河将所述眼球直径标准值为d = (dio+d5+d3+d2+di) /5。 Exemplary, then the above-described example, after determining the value of the diameter of the test eye (^ (^ (^, r mountain and mountain standard value of the eye diameter d = (dio + d5 + d3 + d2 + di) / 5.

[0060] 需要说明的是,所述眼球直径标准值的计算并不局限所参与眼球直径测试值的个数,计算时所用的眼球直径测试值越多,所确定出的眼球直径标准值越准确,但考虑到计算时的资源占用通常将眼球直径测试值的个数优选在5至10的范围内。 [0060] Incidentally, the calculated value of the standard diameter of the eye is not limited to the number of eye diameter of the test values ​​are involved, the more the diameter of the test eye with the calculated value, the determined standard value, the more accurate eyeball diameter , the resource consumption is calculated taking into account the diameter of the eye will generally preferable that the number of test values ​​in the range of 5 to 10.

[0061] 在完成上述眼部参数信息的设置之后,可以基于下述步骤实时的确定用户观看显示设备上显示图像时的视线焦点信息。 [0061] After completion of setting the ocular parameter information, in real time to determine the focus of attention the user views the display image information on a device based on the following steps.

[0062] S404、在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线。 [0062] S404, it is determined that the user views the image displayed on the display device emits infrared rays to an infrared emitter based on the eyeball of the user.

[0063]示例性的,可以启动安装在VR设备缓冲框上的红外线发射器,实时的向用户眼球发射红外光线。 [0063] Exemplary, can activate the infrared emitter mounted on a frame buffer device VR, infrared light to transmit real-time user eye.

[0064] S405、基于图像采集模块采集经用户眼球反射后的红外光线,形成用户当前的眼部图像。 [0064] S405, the image acquisition module based on the infrared light reflected by the eyeball of the user, the user's current eye image is formed.

[0065]示例性的,所述图像采集模块可以实时的采集用户眼球反射后的红外光线,形成用户当前的眼部图像。 [0065] Exemplary, the image acquisition module in real time of collection of the reflected infrared light eyeball of the user, the user's current eye image is formed.

[0066] S406、处理器获取用户当前的眼部图像,并基于所述眼部图像确定与用户双眼眼球对应的垂直位移差和水平位移差。 [0066] S406, the processor acquires the user's current eye image, and the image of the eye with the user determines the corresponding vertical displacement of binocular eye difference and horizontal displacement based on the difference.

[0067] 在本实施例中,处理器可以基于所获取的眼部图像确定所需的眼部数据信息,此时需要确定的眼部数据信息是当前与用户左眼和右眼分别对应的垂直位移差和水平位移差。 [0067] In the present embodiment, information required data processor eye may be determined based on the acquired eye image, data at this time whether the eye is perpendicular to the current user's left and right eyes respectively displacement difference and horizontal displacement difference.

[0068] 在本实施例,所述垂直位移差和水平位移差基于眼球中心当前所处位置与平视时眼球中心所处位置获得。 [0068] In the present embodiment, the difference in vertical displacement and horizontal displacement difference between the current location and the location is obtained when the head center of the eye based on the eyeball center. 具体的,确定用户平视时眼球中心所在位置的位置点,并确定眼球中心当前所处位置的当前位置点,对上述两位置点进行连线,并将所述眼球中心当前位置点投影到平视时眼球中心所在位置的平面上,形成投影点,之后量测眼球中心当前位置点与所述投影点形成的位移差,记作垂直位移差;同时量测所述投影点到平视时眼球中心位置点形成的位移差,记作水平位移差。 Specifically, it is determined that the user's head position of the eyeball center position is located, and determines the current location of the current position of the eyeball center point, the position of the above two connection points, and the center of the eyeball to the current position of the head when the projected point the plane where the center position of the eyeball to form a projection point, after measuring the displacement of the eyeball center position of the current point and the projection points formed by the difference, referred to as vertical displacement difference; while measuring the eyeball center location point when projected point head forming displacement difference, referred to as a horizontal displacement difference.

[0069] 需要说明的是,上述垂直位移差和水平位移差的量测方法适用于用户的双眼,最终可分别获得用户左眼和右眼分别对应的垂直位移差和水平位移差。 [0069] Incidentally, the above-described difference in vertical displacement and horizontal displacement difference measuring method is suitable for the user's eyes, the final user can be obtained, respectively left and right eyes respectively corresponding to the difference between the vertical displacement and horizontal displacement difference.

[0070] S407、基于所述垂直位移差、水平位移差以及所述眼部参数信息,确定用户观看显示图像时双眼眼球对应的垂直视线角度和水平视线角度。 [0070] S407, based on the difference in vertical displacement, horizontal displacement difference and the ocular parameter information, determines the vertical angle of the line of sight and line of sight horizontal viewing angle of a display image when the user's eyes corresponding to the eyeball.

[0071] 在本实施例中,所述眼部参数信息主要包括所述眼球直径标准值,其中,所述眼球直径标准值包括对应于左眼和右眼的眼球直径标准值。 [0071] In the present embodiment, the ocular parameter information including a standard value of the diameter of the eye, wherein the eye diameter standard value includes the standard value corresponds to the diameter of the left and right eye. 之后,基于所确定的用户左眼和右眼分别对应的垂直位移差和水平位移差,根据所述视线角度计算公式 Then, based on the determined left and right eyes of a user corresponding to each difference between the vertical displacement and horizontal displacement difference, calculated according to the angle of sight

Figure CN106293100AD00091

,其中,a表示水平或垂直视线角度值,A h表示量测获得的位移差(水平位移差或垂直位移差), d表示眼球直径标准值,来计算与双眼眼球对应的垂直视线角度和水平视线角度。 Wherein, a represents the horizontal or vertical line of sight angle value, A h represents the displacement measurement obtained by a difference (horizontal displacement difference or vertical displacement difference), D represents the eye diameter of the standard value, to calculate the binocular eye corresponding to the vertical line of sight angle and horizontal sight angle.

[0072] S408、基于双眼眼球对应的垂直视线角度和水平视线角度,确定双眼眼球对应的视线角度,并将双眼眼球对应的视线角度确定为用户当前的视线焦点信息。 [0072] S408, based on the vertical angle and a horizontal visual line of sight corresponding to the eye binocular angle, determining the angle of sight corresponding to the eye eyes, both eyes and determines the angle of the line of sight corresponding to the eye's line of sight for the user's current focus information.

[0073]在本实施例中,步骤S407所确定的各眼球对应的垂直视线角度和水平视线角度并不能直接作为最终的视线焦点信息,还需要对所述垂直视线角度和水平视线角度进行矢量和计算,最终可以为每只眼均确定出一个相应的视线角度值,所确定出的与双眼眼球对应的视线角度值才可作为用户当前的视线焦点信息。 [0073] In the present embodiment, the vertical and horizontal angle of the line of sight of each eye gaze angle determined in step S407 and corresponding to the line of sight can not be directly used as a final focus information, but also needs to be a vector perpendicular to the horizontal line of sight and line of sight angle and the angle calculated, the final average is determined for each eye may be a value corresponding to the angle of sight, the determined sight angle value corresponding to the eye before the eyes as the user's current focus of attention information.

[0074] 在本实施例中,基于所述视线焦点信息就可以确定所述视线焦点在显示图像中的具体所在位置。 [0074] In the present embodiment, based on the sight line information can be determined that the focus location of the specific focus of attention in the display image. 其中,所述视线焦点在显示图像中的具体位置可用于虚拟现实设备进行其他交互功能的改进。 Wherein the focus of attention in the display image of the specific position for the virtual reality device to improve other interactive features.

[0075] 本发明实施例三提供的一种虚拟现实设备中视线焦点的确定方法,优化增加了眼部参数信息的设置过程,基于该过程计算了眼球直径标准值,并将眼球直径标准值确定为所需的眼部参数信息;同时还具体化了用户视线焦点信息的确定过程,该确定过程基于当前所获取的眼部图像和预设的眼部参数信息确定用户当前的视线焦点信息。 [0075] A method for determining the focus of attention in a virtual reality apparatus according to a third embodiment of the present invention, the optimization process of increasing the ocular parameter setting information based on the process calculates the value of the standard diameter of the eye, and the eye diameter is determined standard value parameter information required for the eye; also embodied the process of determining the focus of attention the user information, the determination process based on the acquired eye image of the current and the preset parameter eye gaze information to determine the user's current focus information. 利用该确定方法,能够在用户观看虚拟现实图像时,实时确定用户当前落在虚拟现实图像上的视线焦点, 使得虚拟现实设备能够基于所确定的视线焦点进行一些交互功能的改进,达到提升虚拟现实设备用户体验的目的。 When using this method for determining able to view the images in virtual reality user, real-time to determine the user's current focus of attention falls on the virtual reality images, virtual reality devices to make improvements based on some of the interactive features of the determined focus of attention, to enhance virtual reality the purpose device user experience.

[0076] 实施例四 [0076] Fourth Embodiment

[0077] 图5为本发明实施例四提供的一种虚拟现实设备中视线焦点的确定方法的流程示意图。 [0077] Figure 5 flow diagram of a method of determining the real focus of attention of the virtual device according to a fourth embodiment of the present invention. 本发明实施例四以上述实施例二为基础进行优化,在本实施例中,该确定方法还优化增加了:设置确定视线焦点信息所需的眼部参数信息。 Embodiments of the present invention is carried out in the above-mentioned four according to the second embodiment is based on optimization, in the present embodiment, the determination method also increases the optimization: setting parameter information required for determining the eye gaze focus information.

[0078] 在上述优化的基础上,所述设置确定视线焦点信息所需的眼部参数信息,具体包括:在显示设备上显示已知视线焦点信息的焦点图像,并基于图像采集模块形成用户观看所述焦点图像时对应的用户眼部图像;基于所述用户眼部图像,确定用户当前的眼部参数值;将所述眼部参数值与所述视线焦点信息形成的二元信息记录在设定的眼部参数信息表中,其中,所述眼部参数信息表包括至少一条二元信息。 [0078] Based on the above optimization on the setting parameter information required for the eye gaze determining focus information comprises: displaying a known focus of attention focus image information on a display device, and the user views the formed image acquisition module based corresponding to the focal point of the image of the user image of the eye; eye image based on the user, the user determines parameter values ​​of the current eye; the binary information of the ocular parameter value and the focus of attention in the record set information formed ocular parameter set information table, wherein the ocular parameter information table includes information on at least one two yuan.

[0079]进一步的,所述处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息,具体包括:处理器获取用户当前的眼部图像,并基于所述眼部图像确定对应的当前眼部参数值;基于设定的匹配要求在所述眼部参数信息表中查找与所述当前眼部参数值相匹配的眼部参数值;将与所述眼部参数值对应的视线焦点信息确定为用户当前对应的视线焦点信息。 [0079] Further, the image processor obtains the eye, and the user's current focus of attention of the eye is determined based on image information and parameter information predetermined eye, comprises: a processor acquiring the current user's eye portion of the image, and determines the current parameter value corresponding to the eye based on the image of the eye; find matching requirements based on the set parameter values ​​to the current eye ocular parameter matches the value in the ocular parameter information table ; focus the sight line information of the eye corresponding parameter values ​​determined to be the focus of attention of the user information corresponding to the current.

[0080] 需要说明的是,本发明实施例四提供的视线焦点的确定方法与上述实施例三提供的确定方法为两种并列的实现方法,即,本实施例四相当于描述了确定方法的另一种具体实施方式。 [0080] Incidentally, the focus of attention determination method according to a fourth embodiment of the present invention and the above-described determination method according to a third embodiment of the parallel two methods, i.e., according to a fourth embodiment of the present corresponding to the determination method described another specific embodiment.

[0081] 如图5所示,本发明实施例四提供的一种虚拟现实设备中视线焦点的确定方法,具体包括如下操作: [0081] 5, the method of determining the focus of attention in a virtual reality apparatus according to a fourth embodiment of the present invention, includes the following operations:

[0082]在本实施例中,步骤S501至步骤S503为另外一种设置眼部参数信息的实现方法, 本实施例中所设置的眼部参数信息与上述实施例三所设置的眼部参数信息相比,所包括的具体内容并不相同。 [0082] In the present embodiment, step S501 to step S503 to implement another method of setting parameter information eye, ocular parameter information ocular parameter information in the above-mentioned embodiments provided according to the present embodiment provided three compared included specific content is not the same.

[0083] S501、在显示设备上显示已知视线焦点信息的焦点图像,并基于图像采集模块形成用户观看所述焦点图像时对应的用户眼部图像。 [0083] S501, a known focus of attention focus image displaying information on a display device, and forms an image corresponding to the user viewing the user's eye when the focus image based on the image acquisition module.

[0084] 在本实施例中,可以以设定的播放规则在VR设备的显示设备上显示已知视线焦点信息的焦点图像。 [0084] In the present embodiment, the display may be known in the focus of attention focus image information on a display device VR device to play the rule set. 示例性,所设定的播放规则可以描述为:以平视时眼球中心所在位置点为基点,将与所述基点在上下左右各个方位均成100°的视线角度范围确定为视角界定范围, 在所述视角界定范围内以不同的对焦距离来显示已知视线角度信息的焦点图像。 Example, rule set playback can be described as: In the eyeball center location when the head base point, the point with the respective vertical and horizontal orientations are in line of sight to an angular range of 100 ° angle of view is determined as the range defined in the defining said inner viewing angle range different focal distances are known sight line focus image display angle information.

[0085]在本实施例中,对于所显示的具有不同视线角度信息的焦点图像,均可以基于图像采集模块形成用户观看所述焦点图像时对应的用户眼部图像。 [0085] In the present embodiment, the focus for images having different angles of sight of the displayed information, a user can be formed corresponding to the user viewing eye image based on the image when the focus image acquisition module. 在本实施例中,所述视线焦点信息具体可包括与双眼眼球对应的视线角度值。 In the present embodiment, the focus of attention can include information specifically binocular eye sight and an angle value corresponding to. 因此,可以理解的是,最终所获得的用户眼部图像至少为一张,每一张用户眼部图像对应一个已知视线角度信息的焦点图像,且每张用户眼部图像对应的已知视线角度信息应该保证所取的值不同。 Thus, it is understood that the user's eye finally obtained image of at least one per eye image corresponding to a user a visual line angle information known focus image, and an image corresponding to each user known eye gaze angle information should ensure that different values ​​taken.

[0086] S502、基于所述用户眼部图像,确定用户当前的眼部参数值。 [0086] S502, the eye image of the user is determined based on the current parameter value of the user's eye.

[0087]在本实施例中,对于步骤501所确定出的任一张用户眼部图像而言,都可以基于处理器确定出与所述用户眼部图像相对应的眼部参数值。 [0087] In the present embodiment, a user to any of the eye image determined in step 501, the processor may be based on the determined parameter value with the ocular eye image corresponding to the user.

[0088] 进一步的,所述眼部参数值包括:双眼眼球中心分别到相应两眼角的距离以及双眼眼球中心与眼角连线的位置关系。 [0088] Further, the ocular parameter values ​​comprising: the eyes are the eyeball center to the corresponding distance between the two eyes and the position relationship between the center of the eye binocular eye connection.

[0089] 一般的,每只眼均相应的存在两个眼角,且基于用户眼部图像处理器可以对两个眼角位置进行识别,并确定出对应的位置点。 [0089] In general, each eye are present two respective corner, and two of the corner can be identified based on the user positions the eye image processor, and determines the position corresponding to the point. 在本实施例中,所述双眼眼球中心分别到相应两眼角的距离具体可理解为:左眼和右眼的眼球中心分别到对应两眼角位置点的距离。 In the present embodiment, the center of each eye to eye distance corresponding to two corners understood as specifically: left and right eyes respectively to the eyeball center position of a point corresponding to two corner distance.

[0090] 在本实施例中,在对确定出左右眼各自对应两眼角的位置点之后,可以对各自对应的两眼角位置点进行连线,之后可以确定左眼眼球中心及右眼眼球中心到相应眼角连线的位置关系。 [0090] In the present embodiment, after the determination of the position of the point corresponding to the respective left and right eyes of the two eyes, the line connecting the two corners may be a position corresponding to each point, it may be determined after the left-eye and right-eye eyeball center to center the positional relationship between the respective corner connection. 示例性的,以左眼眼球为例,可以确定左眼眼球中心是处于对应眼角连线的上方还是处于对应眼角连线的下方,所确定出的方位关系即可作为左眼眼球中心与眼角连线的位置关系。 Exemplary, an example to the left eye, the left eye may be determined corresponding to the eyeball center is located above the lower corner of the corresponding connection or in connection corner, the orientation relationship can be determined as the left-eye and attached eyeball center the positional relationship between lines.

[0091] S503、将所述眼部参数值与所述视线焦点信息形成的二元信息记录在设定的眼部参数信息表中,其中,所述眼部参数信息表包括至少一条二元信息。 [0091] S503, the information recording dihydric the ocular parameter value with the sight line of the eye focus information formed parameter set information table in which the ocular parameter information table includes information on at least one two yuan .

[0092] 在本实施例中,由于所述眼部参数值基于所述用户眼部图像确定,而用户眼部图像基于已知的视线焦点信息对应的焦点图像确定,因此,所述眼部参数值与所述视线焦点信息存在一一对应的关系,由此可将存在一一对应关系的眼部参数值和视线焦点信息作为一条二元信息记录于设定的眼部参数信息表中。 [0092] In the present embodiment, since the value of the ocular parameter eye image determination based on the user, the user aware of the eye image information corresponding to the focus of attention focus image is determined based on, therefore, the ocular parameter presence information value and the focus of attention-one relationship, whereby there will be the focus of attention ocular parameter values ​​and one corresponding relationship information as a two yuan ocular parameter information table in the information recording medium is set.

[0093] 在本实施例中,可以基于步骤S501确定出更多的用户脸部图像,从而可以基于步骤S502可以为上述多个用户脸部图像确定出相应的眼部参数值,进而可以形成多条二元信息,由此可以形成包含至少一条二元信息的眼部参数信息表。 [0093] In the present embodiment, step S501 may be determined based on more user's face image, which can be determined corresponding to a plurality of ocular parameter values ​​for the user's face image based on the above-described step S502, in turn, may form a multi- Article two yuan information, whereby information may be formed ocular parameter table information includes at least one two yuan. 可以理解的是,本实施例中确定的眼部参数信息表具体可作为基于眼部参数值确定对应视线焦点信息的参照表,因此所述眼部参数信息表中包含二元信息的条数越多,则基于所述眼部参数信息表确定出的视线焦点信息就越精确。 It will be appreciated that the embodiment of the ocular parameter information table determined in this particular embodiment as ocular parameter value determination reference table corresponding to the information focus of attention, and therefore of the eye comprising a binary parameter information table based on the number of pieces of information, more ocular parameters based on the information of the table to determine the more accurate information about the focus of attention.

[0094] S504、在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线。 [0094] S504, it is determined that the user views the image displayed on the display device emits infrared rays to an infrared emitter based on the eyeball of the user.

[0095]示例性的,可以启动安装在VR设备缓冲框上的红外线发射器,实时的向用户眼球发射红外光线。 [0095] Exemplary, can activate the infrared emitter mounted on a frame buffer device VR, infrared light to transmit real-time user eye.

[0096] S505、基于图像采集模块采集经用户眼球反射后的红外光线,形成用户当前的眼部图像。 [0096] S505, the image acquisition module based on the infrared light reflected by the eyeball of the user, the user's current eye image is formed.

[0097]示例性的,所述图像采集模块可以实时的采集用户眼球反射后的红外光线,形成用户当前的眼部图像。 [0097] Exemplary, the image acquisition module in real time of collection of the reflected infrared light eyeball of the user, the user's current eye image is formed.

[0098] S506、处理器获取用户当前的眼部图像,并基于所述眼部图像确定对应的当前眼部参数值。 [0098] S506, the processor acquires the user's current eye image, and based on the current value of the ocular parameter corresponding to the determined eye image.

[0099] 示例性的,基于当前所获取的眼部图像,可以确定左眼和右眼对应的当前眼部参数值。 [0099] An exemplary, based on the acquired image of the current eye, the eye may be determined current parameter value corresponding to the left and right eyes. 示例性的,以右眼为例,所述当前眼部参数值具体包括:右眼眼球中心到相应两眼角的当前距离,以及右眼眼球中心与眼角连线的当前位置关系。 Exemplary, the right eye, for example, the current value of the ocular parameter comprises: right eye corresponding to the distance to the center of the two eyes, and the positional relationship between the current right-eye connection with the center of the eye.

[0100] S507、基于设定的匹配要求在所述眼部参数信息表中查找与所述当前眼部参数值相匹配的眼部参数值。 [0100] S507, based on the set value of the parameter matching requirements lookup eye ocular parameter values ​​and the current match in the ocular parameter information table.

[0101] 在本实施例中,由于所述眼部参数信息表中所包含的二元信息的条数有限,无法包含视角界定范围内与各视线角度信息相对应的眼部参数值,因此,可以基于设定的匹配要求来对当前眼部参数值进行匹配操作。 [0101] In the present embodiment, due to the limited number of the ocular parameter information contained in the table of binary information, the eye can not contain the parameter values ​​define the scope of the angle of view information each corresponding to the angle of sight, therefore, matching operation can be performed on the ocular parameter values ​​based on the current set of matching requirements.

[0102] 示例性的,所述匹配要求的设定可以是如果当前眼部参数值与眼部参数信息表中的任一个眼部参数值之间的误差处于设定范围内,则可认为所述当前眼部参数值与该眼部参数值相匹配。 [0102] Exemplary, the matching requirements can be set if any of the current value of the ocular parameter ocular parameter information table, a parameter value of the error between the eye is within the set range, it may be considered the said current parameter values ​​match the eye with the ocular parameter values.

[0103] S508、将与所述眼部参数值对应的视线焦点信息确定为用户当前对应的视线焦点fg息。 [0103] S508, the focus of attention of the eye information corresponding to the determined parameter value corresponding to the user's current focus of attention fg interest.

[0104] 在本实施例中,在眼部参数信息表中确定出与所述当前眼部参数值相匹配的眼部参数值之后,就可以获取与所述眼部参数值组成二元信息的视线焦点信息,由此可以将所述视线焦点信息确定为用户当前对应的视线焦点信息。 [0104] In the present embodiment, after determining the parameter value and the current eye ocular parameter values ​​that match the parameter information table in the eye, the eye can acquire information of parameter values ​​consisting of two yuan the focus of attention information, whereby information may be determined to be the focus of attention focus of attention the user information corresponding to the current.

[0105] 本发明实施例四提供的一种虚拟现实设备中视线焦点的确定方法,优化增加了眼部参数信息的设置过程,基于该过程形成了包括眼部参数信息与视线焦点信息形成了眼部参数信息表;同时还具体化了用户视线焦点信息的确定过程,该确定过程基于当前所获取的眼部图像和预设的眼部参数信息表确定了用户当前的视线焦点信息。 A method for determining the focus of attention in a virtual reality apparatus according to a fourth embodiment [0105] of the present invention, the optimization process is provided to increase the ocular parameter information based on the process of forming the ocular parameter information includes information forms the focus of attention of the eye parameter information table unit; also embodied the process of determining the focus of attention the user information, the determination process based on the acquired eye image of the current and a preset information table determined eye parameters of the current focus of attention of the user information. 利用该确定方法, 能够在用户观看虚拟现实图像时,实时确定用户当前落在虚拟现实图像上的视线焦点,使得虚拟现实设备能够基于所确定的视线焦点进行一些交互功能的改进,达到提升虚拟现实设备用户体验的目的。 When using this method for determining able to view the images in virtual reality user, real-time to determine the user's current focus of attention falls on the virtual reality images, virtual reality devices to make improvements based on some of the interactive features of the determined focus of attention, to enhance virtual reality the purpose device user experience.

[0106] 注意,上述仅为本发明的较佳实施例及所运用技术原理。 [0106] Note that, examples, and techniques using the principles described above is only the preferred embodiment of the present invention. 本领域技术人员会理解, 本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、 重新调整和替代而不会脱离本发明的保护范围。 Those skilled in the art will appreciate, the present invention is not limited to the particular embodiments described herein, the skilled person that various obvious changes, and substitutions without readjustment departing from the scope of the present invention. 因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。 Thus, while the above embodiments of the present invention has been described in detail, but the present invention is not limited to the above embodiments, without departing from the spirit of the present invention may further comprise additional other equally effective embodiments, the present invention by the scope of the appended claims range determination.

Claims (11)

1. 一种虚拟现实设备,包括:外壳,设置在外壳内的显示设备、处理器、电池和光学成像设备,以及缓冲框,其特征在于,还包括: 红外线发射器和图像采集模块; 所述红外线发射器,安装于所述缓冲框上,用于发射红外光线; 所述图像采集模块,安装于所述缓冲框上,且安装位置与所述红外线发射器的安装位置成轴对称,用于采集人眼反射后的红外光线并形成眼部图像。 A virtual reality apparatus, comprising: a housing, a display device disposed within the housing, a processor, a battery, and an optical imaging apparatus, and a buffer block, characterized by, further comprising: an infrared emitter and an image acquisition module; the infrared emitter mounted on the frame buffer, for emitting infrared light; the image acquisition module, mounted on the frame buffer, and the position to the installation position of the infrared emitter axis of symmetry, for after collecting the infrared light reflected to the human eye, and the eye image is formed.
2. 根据权利要求1所述的虚拟现实设备,其特征在于,所述图像采集模块为可捕捉红外光线的摄像头。 The virtual reality device according to claim 1, wherein the image acquisition module to capture infrared light camera.
3. 根据权利要求1所述的方法,其特征在于,所述红外线发射器通过导线与所述电池相连,所述电池向所述红外线发射器提供电源。 3. The method according to claim 1, characterized in that said infrared transmitter is connected by wires to the battery, the battery providing power to the infrared transmitter.
4. 根据权利要求1-3任一所述的虚拟现实设备,其特征在于,所述图像采集模块通过数据总线与所述处理器相连,所述处理器用于对所述图像采集模块采集的图像数据进行处理。 4. A virtual reality apparatus according to claim any one of claims 1-3, characterized in that the image acquisition module through a data bus coupled to the processor, the image processor for the acquisition of the image acquisition module data processing.
5. -种虚拟现实设备中视线焦点的确定方法,其特征在于,采用权利要求1-4任一所述的虚拟现实设备执行,包括: 在确定用户观看显示设备上的显示图像时,基于红外线发射器向用户眼球发射红外光线; 基于图像采集模块采集经用户眼球反射后的红外光线,形成用户当前的眼部图像; 处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息。 5. - The method of determining the kind of virtual reality in the focus of attention of the apparatus, characterized in that a virtual reality device according to 1-4 perform, including the use of claim: determining when the user views the image displayed on the display device, based on infrared transmitter transmits an infrared light to a user of the eye; the collected infrared light is reflected by the eyeball of the user based on the image collecting module, the user's current eye image is formed; processor acquiring the eye image, and the image of the eye based on pre-set ocular parameter information to determine the user's current focus of attention information.
6. 根据权利要求5所述的方法,其特征在于,还包括:设置确定视线焦点信息所需的眼部参数信息。 6. The method according to claim 5, characterized in that, further comprising: setting parameter information required for determining the eye gaze focus information.
7. 根据权利要求6所述的方法,其特征在于,所述设置确定视线焦点信息所需的眼部参数信息,具体包括: 确定用户眼球的标准瞳距,所述瞳距指用户左眼眼球中心到右眼眼球中心的距离; 确定用户眼球的至少一个测试瞳距,并基于所述标准瞳距确定每个测试瞳距所对应的眼球直径测试值; 基于所述至少一个眼球直径测试值确定用户眼球的眼球直径标准值,并将所述眼球直径标准值记为眼部参数信息。 7. The method according to claim 6, wherein, the setting parameters that are required to determine the eye gaze focus information comprises: determining a user's eye standard IPD, IPD refers to the user's left eye from the center of the eyeball center to the right eye; the user is determined at least one test eye pupil distance, and determining the diameter of the test values ​​for each test eye pupil distance based on the corresponding standard IPD; determining at least one eye based on the diameter of the test values standard diameter value eye eyeball of the user, and the eye diameter standard value parameter information recorded as the eye.
8. 根据权利要求7所述的方法,其特征在于,所述处理器获取所述眼部图像,并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息,具体包括: 处理器获取用户当前的眼部图像,并基于所述眼部图像确定与用户双眼眼球对应的垂直位移差和水平位移差,其中,所述垂直位移差和水平位移差基于眼球中心当前所处位置与平视时眼球中心所处位置获得; 基于所述垂直位移差、水平位移差以及所述眼部参数信息,确定用户观看显示图像时双眼眼球对应的垂直视线角度和水平视线角度; 基于双眼眼球对应的垂直视线角度和水平视线角度,确定双眼眼球对应的视线角度, 并将双眼眼球对应的视线角度确定为用户当前的视线焦点信息。 8. The method according to claim 7, wherein said image processor obtains the eye, and the image of the eye based on pre-ocular parameter information to determine the user's current focus of attention information, particularly comprising: a processor acquiring the current user's eye image, and a difference based on a vertical displacement and horizontal displacement of the eye binocular eye image corresponding to a user determined difference, wherein the difference in vertical displacement and horizontal displacement of the center of the current based on the difference of the eye obtaining a position eyeball center location planar view; based on the difference in vertical displacement, horizontal displacement difference and the ocular parameter information, determines the vertical angle of the line of sight and line of sight horizontal viewing angle of a display image when the user's eyes corresponding to the eyeball; based on binocular vertical and horizontal visual line of sight angle corresponding to the angle of the eye to determine eye gaze angle corresponding to the eyes, and the eyes of the eye to determine an angle corresponding to the line of sight for the user's current focus of attention information.
9. 根据权利要求6所述的方法,其特征在于,所述设置确定视线焦点信息所需的眼部参数信息,具体包括: 在显示设备上显示已知视线焦点信息的焦点图像,并基于图像采集模块形成用户观看所述焦点图像时对应的用户眼部图像; 基于所述用户眼部图像,确定用户当前的眼部参数值; 将所述眼部参数值与所述视线焦点信息形成的二元信息记录在设定的眼部参数信息表中,其中,所述眼部参数信息表包括至少一条二元信息。 9. The method according to claim 6, wherein, the setting parameters that are required to determine the eye gaze focus information comprises: displaying a known focus of attention focus image information on a display device, and based on the image collecting user module is formed corresponding to the user viewing eye image when the focus image; eye image based on the user to determine the current parameter value of the user's eye; the ocular parameter value and the focus of attention information formed two eye meta information is recorded in the parameter set information table in which the ocular parameter information table includes information on at least one two yuan.
10. 根据权利要求9所述的方法,其特征在于,所述视线焦点信息包括:与双眼眼球对应的视线角度; 所述眼部参数值包括:双眼眼球中心分别到相应两眼角的距离以及双眼眼球中心与眼角连线的位置关系。 10. The method according to claim 9, wherein said visual line focus information comprising: a binocular eye sight angle corresponding to; the ocular parameter values ​​comprising: the eyes are the eyeball center distance corresponding to two corners of the eyes, and eye center and eye connection location relationship.
11. 根据权利要求9-10任一所述的方法,其特征在于,所述处理器获取所述眼部图像, 并基于所述眼部图像及预设的眼部参数信息确定用户当前的视线焦点信息,具体包括: 处理器获取用户当前的眼部图像,并基于所述眼部图像确定对应的当前眼部参数值; 基于设定的匹配要求在所述眼部参数信息表中查找与所述当前眼部参数值相匹配的眼部参数值; 将与所述眼部参数值对应的视线焦点信息确定为用户当前对应的视线焦点信息。 11. The method according to any of claims 9-10, wherein said processor obtains the eye image, and determines based on the user's current line of sight of the eye image and pre-ocular parameter information focus information comprises: acquiring the current user processor eye image, and based on the current value of the ocular parameter corresponding to the determined eye image; Find the ocular parameter in the table based on the set information matching requirements said ocular parameter values ​​of the current parameter value matches the eye; sight line focus information corresponding to the parameter value is determined as the eye sight line focus information corresponding to the current user.
CN201610719719.XA 2016-08-24 2016-08-24 Method for determining sight focal point in virtual reality equipment and virtual reality equipment CN106293100A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610719719.XA CN106293100A (en) 2016-08-24 2016-08-24 Method for determining sight focal point in virtual reality equipment and virtual reality equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610719719.XA CN106293100A (en) 2016-08-24 2016-08-24 Method for determining sight focal point in virtual reality equipment and virtual reality equipment

Publications (1)

Publication Number Publication Date
CN106293100A true CN106293100A (en) 2017-01-04

Family

ID=57615217

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610719719.XA CN106293100A (en) 2016-08-24 2016-08-24 Method for determining sight focal point in virtual reality equipment and virtual reality equipment

Country Status (1)

Country Link
CN (1) CN106293100A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108490611A (en) * 2018-03-26 2018-09-04 京东方科技集团股份有限公司 Refraction adjustment method and device for augmented reality device and augmented reality device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103429139A (en) * 2011-03-18 2013-12-04 Smi创新传感技术有限公司 Spectacle device with an adjustable field of view and method
CN103472909A (en) * 2012-04-10 2013-12-25 微软公司 Realistic occlusion for a head mounted augmented reality display
CN105188516A (en) * 2013-03-11 2015-12-23 奇跃公司 System and method for augmented and virtual reality
CN105718046A (en) * 2014-12-23 2016-06-29 联发科技股份有限公司 Head-Mount Display for Eye Tracking based on Mobile Device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103429139A (en) * 2011-03-18 2013-12-04 Smi创新传感技术有限公司 Spectacle device with an adjustable field of view and method
CN103472909A (en) * 2012-04-10 2013-12-25 微软公司 Realistic occlusion for a head mounted augmented reality display
CN105188516A (en) * 2013-03-11 2015-12-23 奇跃公司 System and method for augmented and virtual reality
CN105718046A (en) * 2014-12-23 2016-06-29 联发科技股份有限公司 Head-Mount Display for Eye Tracking based on Mobile Device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108490611A (en) * 2018-03-26 2018-09-04 京东方科技集团股份有限公司 Refraction adjustment method and device for augmented reality device and augmented reality device

Similar Documents

Publication Publication Date Title
US9256987B2 (en) Tracking head movement when wearing mobile device
EP2638693B1 (en) Automatic variable virtual focus for augmented reality displays
CN102928979B (en) Mixed reality display to adjust for interpupillary distance aligned
EP3011419B1 (en) Multi-step virtual object selection
AU2011205223C1 (en) Physical interaction with virtual objects for DRM
CA2820950C (en) Optimized focal area for augmented reality displays
JP5414946B2 (en) Head-mounted display and the position deviation adjustment method thereof
US9304319B2 (en) Automatic focus improvement for augmented reality displays
US20040238732A1 (en) Methods and systems for dynamic virtual convergence and head mountable display
US8416289B2 (en) Light-field display
US9401050B2 (en) Recalibration of a flexible mixed reality device
JP6144681B2 (en) Head-mounted display with the iris scan profiling function
US9122321B2 (en) Collaboration environment using see through displays
US9891435B2 (en) Apparatus, systems and methods for providing motion tracking using a personal viewing device
CN103091843B (en) Through display brightness control
US20140152558A1 (en) Direct hologram manipulation using imu
CN103443742B (en) System and method for gaze and gesture interface
US20160033770A1 (en) Head-mounted display device, control method of head-mounted display device, and display system
US9727132B2 (en) Multi-visor: managing applications in augmented reality environments
US20130050642A1 (en) Aligning inter-pupillary distance in a near-eye display system
JP3089306B2 (en) Stereoscopic imaging and display device
US20130342572A1 (en) Control of displayed content in virtual environments
US9265414B2 (en) Methods and systems for measuring interpupillary distance
US20140006026A1 (en) Contextual audio ducking with situation aware devices
US20080130950A1 (en) Eye gaze tracker system and method

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination