WO2017012360A1 - Method for response of virtual reality display device to operation of peripheral device - Google Patents

Method for response of virtual reality display device to operation of peripheral device Download PDF

Info

Publication number
WO2017012360A1
WO2017012360A1 PCT/CN2016/076497 CN2016076497W WO2017012360A1 WO 2017012360 A1 WO2017012360 A1 WO 2017012360A1 CN 2016076497 W CN2016076497 W CN 2016076497W WO 2017012360 A1 WO2017012360 A1 WO 2017012360A1
Authority
WO
WIPO (PCT)
Prior art keywords
range
current position
response
coordinate
position coordinates
Prior art date
Application number
PCT/CN2016/076497
Other languages
French (fr)
Chinese (zh)
Inventor
张大为
龙寿伦
李刚
张丰学
熊旭
Original Assignee
深圳多新哆技术有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳多新哆技术有限责任公司 filed Critical 深圳多新哆技术有限责任公司
Publication of WO2017012360A1 publication Critical patent/WO2017012360A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to the field of virtual reality technologies, and in particular, to a method for a virtual reality display device to respond to operation of a peripheral device.
  • VR Virtual Reality
  • VR glasses are a special device for realizing virtual reality environments.
  • the image of the stereoscopic video is decomposed into two left and right viewing angles, so that the two images enter the left and right glasses of the user through the VR glasses, so that the two eyes respectively see the two angles of the image, and are synthesized by the brain.
  • a stereoscopic image is formed, which shows a coherent three-dimensional image, which enables the user to have a strong "immersive" feeling.
  • the peripheral device is added to enable the user to interact with the image in the virtual reality through the peripheral device.
  • the interaction refers to a 2D input of the peripheral device, which can be correspondingly expressed on the real device, that is, in the stereoscopic image of the virtual reality display device, as the position coordinates reported by the peripheral device move in the real space,
  • the response position coordinates of the position coordinates also move accordingly.
  • the peripheral device is a mouse
  • the position of the mouse arrow displayed on the virtual reality display device is also moved accordingly, thereby implementing some "in the virtual reality stereo image”. Confirm or "cancel" and other operations.
  • the response position coordinates of the 2D input may jump from the rightmost side of the screen to the leftmost side or from the leftmost side in the virtual reality stereo image. At the far right, this irregular jump affects the user's visual experience and gives the user an uncomfortable feeling.
  • the embodiment of the present invention provides a method for the operation of the virtual reality display device in response to the operation of the peripheral device. To solve the above technical problem, the embodiment of the present invention discloses the following technical solution:
  • a method for a virtual reality display device to respond to operation of a peripheral device comprising two display screens, each of the display screens corresponding to a portion of a total interaction range, the method comprising:
  • Obtaining a current position coordinate of the peripheral device converting the current position coordinate by using a conversion manner corresponding to the predetermined condition to obtain a response position coordinate within a specified range, wherein the specified range is the two display screens Specifying a corresponding interaction range in the display screen; performing position interaction according to the response position coordinates.
  • the step of converting the current position coordinates comprises:
  • one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py).
  • the rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range.
  • the area outside the range is the second range;
  • the step of converting the current position coordinates comprises:
  • one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py).
  • the rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range.
  • the area outside the range is the second range;
  • the converting the current position coordinates by using a conversion manner corresponding to the predetermined condition, and obtaining the response position coordinates within the specified range further includes:
  • the step of converting the current location coordinates according to the current location coordinates and the previous location coordinates comprises:
  • one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py).
  • the rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range.
  • the area outside the range is the second range;
  • the maximum abscissa of the second range is taken as the abscissa of the response position
  • the ordinate of the current position is taken as the ordinate of the response position.
  • the step of converting the current location coordinates according to the current location coordinates and the previous location coordinates comprises:
  • one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py).
  • the rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range.
  • the area outside the range is the second range;
  • the minimum abscissa of the first range is taken as the abscissa of the response position
  • the ordinate of the current position coordinate is taken as the ordinate of the response position.
  • the step before the acquiring the current location coordinates of the peripheral device further includes:
  • the virtual reality display device responds to the operation of the peripheral device by performing coordinate conversion on the current position coordinates of the acquired peripheral device, thereby obtaining the coordinate of the response position within the specified range, thereby enabling
  • the virtual reality display device is capable of interacting with the peripheral device's response position coordinates in response to the peripheral device operation.
  • the converted response position coordinates are limited to a specified range in the interaction range, which can prevent the current position coordinates from interacting with the virtual reality display device, and the response position coordinates of the 2D input jump in the stereoscopic image of the display device, thereby overcoming The response position coordinates of the 2D input jump to give the user an uncomfortable feeling during the virtual reality experience.
  • FIG. 1 is a schematic flowchart of a method for a virtual reality display device to respond to operation of a peripheral device according to an embodiment of the present application
  • FIG. 2 is a flowchart of another method for operating a virtual reality display device in response to a peripheral device according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of interaction range division on a virtual reality display device according to the present application.
  • FIG. 4 is a schematic diagram of movement of a 2D input position within a first range and a second range
  • FIG. 5 is a specific flowchart of converting a current location coordinate in a method for operating a virtual reality display device in response to a peripheral device according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of converting current position coordinates into coordinates in a first range according to an embodiment of the present application
  • FIG. 7 is a schematic diagram of converting current position coordinates into coordinates in a second range according to an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of another method for responding to operation of a peripheral device by a virtual reality display device according to an embodiment of the present disclosure
  • FIG. 9 is a schematic diagram of a coordinate position position conversion of a control position of a 2D input according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of another control position coordinate position conversion for controlling 2D input according to the embodiment.
  • FIG. 1 is a flowchart of a method for a virtual reality display device to respond to operation of a peripheral device, the virtual reality display device being applied to a virtual reality simulation environment, for example, VR (Virtual Reality) glasses, according to an embodiment.
  • a virtual reality simulation environment for example, VR (Virtual Reality) glasses
  • the peripheral device interacts with the virtual reality display device through the 2D input.
  • a cursor arrow, a mouse instruction arrow, and the like displayed on a stereoscopic image screen of the VR glasses are input through the peripheral device 2D.
  • the steps of the method for the virtual reality display device to respond to the operation of the peripheral device include:
  • step 101 the current position coordinates of the peripheral device are obtained.
  • step 101 before the acquiring the current location coordinates of the peripheral device, the method further includes:
  • Step 1011 Connect the peripheral device and the virtual reality display device, so that the location coordinates reported by the peripheral device can interact with the virtual reality display device.
  • the peripheral device includes a mouse, a keyboard, a game controller, etc., and is connected to the virtual reality display device, so that the peripheral device can input a 2D event on the virtual reality display device to enhance the experience effect of the virtual reality.
  • the peripheral device is connected to the virtual reality display device including, but not limited to, a cable, Bluetooth or WIFI connection.
  • Step 1012 determining a current position coordinate of the peripheral device.
  • the virtual reality display device further includes a central processing unit for identifying and determining current position coordinates reported by the peripheral device.
  • a central processing unit on a PCB can analyze and determine the current position coordinates of the peripheral device within its range of motion, as well as the current position coordinates.
  • the step of acquiring the current location coordinates includes: the central processing unit represents the spatial extent of the peripheral device activity as an area with a coordinate system, and the position of the current peripheral device in the coordinate system region as the current location Coordinates and report the current position coordinates to the central processing unit.
  • step 102 the current position coordinates are converted by using a conversion manner corresponding to a predetermined condition to obtain response position coordinates within a specified range, wherein the specified range is the two display screens. Specifies the corresponding interaction range described in the display.
  • the virtual reality display device includes two display screens, each of the display screens corresponding to a portion of all interaction ranges, the specified range being the corresponding display screen of the two display screens.
  • the scope of interaction For example, in the VR glasses, the acquired current position coordinates are determined according to the position of the current position coordinates, and the coordinate of the response position obtained by converting the current position coordinates is within a specified range, and the specified range may be the left of the VR glasses. Display or right display.
  • the predetermined condition includes converting the current position coordinates into a preset one of two display screens, the interaction range being a range of display screens on the virtual reality display device.
  • Step 103 Perform position interaction according to the response position coordinates.
  • the location interaction refers to a 2D input of the peripheral device, which can be correspondingly expressed on the real device, that is, in the stereoscopic image of the virtual reality display device, as the position coordinates reported by the peripheral device move in the real space.
  • the response position coordinates of the position coordinates also move accordingly.
  • the peripheral device held by the user is Gamepad
  • the position of the mouse pointer displayed in the stereoscopic image can also be moved to "confirm” Or “cancel” the position of the operation button, which is convenient for the user to select the operation.
  • the location interaction further includes displaying text information on the display device of the virtual reality through a peripheral device such as a keyboard.
  • the interaction further includes: connecting, by the peripheral device, the display device, the current position coordinates reported by the peripheral device, and then responding to the display device, and causing the converted response position coordinates to follow Set the input condition of the device to change accordingly.
  • the virtual reality display device provided by the present application responds to the operation of the peripheral device by performing coordinate conversion on the current position coordinates of the acquired peripheral device to obtain the coordinate of the response position within the specified range, thereby enabling the virtual reality display device to respond.
  • the peripheral device operates to interact with the response location coordinates of the peripheral device.
  • the converted response position coordinates are limited to a specified range in the interaction range, which can prevent the current position coordinates from interacting with the virtual reality display device, and the response position coordinates of the 2D input jump in the stereoscopic image of the display device, thereby overcoming The response position coordinates of the 2D input jump to give the user an uncomfortable feeling during the virtual reality experience.
  • the response position coordinate of the 2D input exceeds the interaction range of any one of the display screens, so that the response position coordinates of the displayed 2D input are displayed on the left and right side of the stereoscopic image screen.
  • the virtual reality display device is a VR glasses, and the interaction area of the left and right display screens on the VR glasses can be represented by a coordinate system.
  • the display screen of the virtual reality display device is a The two-dimensional coordinate system takes the upper left of the display screen as the origin (0,0), the horizontal direction of the screen is the x-axis, the vertical direction is the y-axis, and the x-axis maximum and the y-axis maximum of the screen are respectively Expressed as Px and Py.
  • the rectangular interaction range of the virtual reality display device is obtained by using one vertex of the diagonal of the display screen as the coordinate origin (0, 0), the other vertex as (Px, Py), and one edge on the x-axis, wherein the origin is (0,0) is a vertex, the other vertex is (Px/2, Py), a rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded within the interaction range
  • the area other than the second range, any of the response position coordinates in the display screen can be represented in the interaction range.
  • the first range and the second range represent two left and right display screens of the VR glasses.
  • the left and right display screens in VR glasses correspond to two different angles of video images.
  • Two different angles of image are combined into the brain to synthesize a stereo image.
  • Each of the display screens corresponds to a portion of all interaction ranges, and the 2D input positions on each of the display screens of the VR glasses are respectively displayed on the synthesized stereoscopic image display screen, for example, in the first range.
  • the position of the 2D input is located in the upper left corner, and the coordinate of the response position of the 2D input is also displayed in the upper left corner on the synthesized display screen; similarly, the 2D input position in the second range is also on the synthesized display screen.
  • the display position of the response position coordinates in response to the 2D input is the same.
  • the coordinate of the response position by the interaction of the 2D input is displayed on the rightmost side of the stereoscopic image screen seen by the user.
  • the coordinate position of the 2D input displayed on the stereoscopic image is from the top of the screen.
  • the right side jumps to the leftmost side, and the movement from the first range to the second range causes the response position coordinate of the 2D input to jump from the rightmost side to the left side in the stereoscopic image screen, or jumps from the left side.
  • the phenomenon to the right side gives the user an uncomfortable feeling when interacting in the virtual reality environment, and even causes dizziness, which affects the user's visual experience.
  • step 102 the step of converting the current location coordinates further includes:
  • Step 1021 Acquire a rectangular interaction range of the virtual reality display device.
  • One vertex of the diagonal of the interaction range is a coordinate origin (0, 0)
  • another vertex is A (Px, Py)
  • one edge is on the x-axis.
  • the other edge is on the y-axis, where the origin (0,0) is a vertex, the other vertex is B(Px/2,Py), and the rectangular region formed by an edge on the x-axis is the first range.
  • the area other than the first range within the interaction range is the second range.
  • the display screen of the virtual reality display device divides the interaction range according to the foregoing embodiment, the first range is equal to the area of the second range, and the two ranges respectively represent two display screens on the virtual reality device, for example As shown in FIG. 3, the first range represents the left lens display screen in the VR glasses, and the second range represents the right lens display screen in the VR glasses.
  • Step 1022 Determine whether the current location coordinate is within the first range.
  • the display device After obtaining the current location coordinates of the peripheral device, the display device determines whether the current location coordinate meets a preset condition, and further determines an interaction range of the current location coordinate on the display device.
  • Step 1023 if yes, that is, when the current position coordinate is within the first range of the interaction range, the current position coordinate is taken as the response position coordinate.
  • Step 1024 if not, the maximum abscissa of the first range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position.
  • step 1025 the coordinates of the response position within the specified range are obtained.
  • the current position coordinate of the peripheral device is acquired as (x0, y0), and it is determined whether the current position coordinate (x0, y0) is within the first range, if Yes, the current position coordinate (x0, y0) is used as the response position coordinate (x0, y0), and the response position coordinate is displayed on the display screen of the virtual reality display device.
  • the current position coordinate (x0, y0) is converted, specifically In order to convert the abscissa x0 of the current position coordinate (x0, y0) into the maximum abscissa Px/2 in the first range, and obtain the ordinate y0 of the current position as the ordinate of the response position.
  • the response position coordinates are (Px/2, y0), and the converted response position coordinates (Px/2, y0) are interactively responded.
  • the method provided in the foregoing embodiment determines the current position coordinates obtained by the method, and converts the current position coordinates according to the result of the determination, so that the converted response position coordinates are within a specified range, thereby preventing peripheral devices and
  • the 2D input appears on the display screen when the display device interacts, the response position coordinate of the 2D input moves from the first range to the second range, or moves from the second range to the first range.
  • the response position corresponding to the 2D input on each display screen can also be reflected in the same position on the display screen of the stereo image.
  • the mouse pointer displayed in the upper left corner of the first range or the upper left corner of the second range corresponds to the same mouse pointer displayed in the upper left corner of the display screen. Converting the acquired current position coordinates into the response position coordinates within the specified range enables the position of the 2D input to be reflected on the corresponding position on the display screen, thereby realizing the virtual reality display device to interact with the peripheral device.
  • the step of converting the current position coordinates of the acquired peripheral device into the response position coordinates in the second range includes:
  • Step 1026 Determine whether the current position coordinate is within the second range.
  • the interaction range of the virtual reality is first divided, and the detailed division steps and Step 1021 is the same, and the interaction range of the left and right display screens of the VR glasses is divided into a first range and a second range.
  • Step 1027 If yes, the current position coordinate is taken as the response position coordinate.
  • the acquired current position coordinate is (x1, y1), and when located within the second range, the response position coordinate is determined to be (x1, y1), which is the same as the acquired current position coordinate (x1, y1).
  • Step 1028 If not, the minimum abscissa of the second range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position.
  • the minimum abscissa Px/2 of the second range is taken as the abscissa of the response position
  • the ordinate y1 of the current position is taken as the ordinate of the response position.
  • Step 1025 The coordinate of the response position within the specified range is (Px/2, y1).
  • the current position coordinate is converted to obtain a response position coordinate within a specified range, and the response position coordinate is located in the second range, preventing the current position coordinate from the second range.
  • the response position coordinates of the 2D input cause a jump phenomenon on the display screen.
  • step 102 the conversion of the current position coordinates is performed by using a conversion manner corresponding to a predetermined condition, and the coordinate of the response position within the specified range is obtained.
  • Step 201 Acquire a previous position coordinate of the current position coordinate.
  • the method and the step of acquiring the previous position coordinates are the same as the foregoing method of acquiring the current position coordinates.
  • Step 202 Convert the current position coordinate according to the current position coordinate and the previous position coordinate.
  • Step 203 Obtain a coordinate of the response position within a specified range
  • the virtual reality display device acquires the current position coordinates and the previous position coordinates reported by the peripheral device, and determines this The position of the two coordinates.
  • the step of converting the current position coordinates is: taking the maximum abscissa of the second range as the abscissa of the response position, and the ordinate of the current position as the vertical position of the response position coordinate.
  • the current position coordinate of the peripheral device is P1 (x1, y1)
  • the obtained previous position coordinate is P2 (x2, y2)
  • the current position coordinate P1 (X1, y1) is located in the second range
  • the previous position coordinate P2 (x2, y2) is located in the first range
  • the current position coordinate P1 (x1, y1) is converted to obtain a response position coordinate P3 ( X3, y3), such that the abscissa x3 of the response position is the maximum abscissa Px within the two ranges
  • the ordinate y3 is the same as the ordinate y1 of the current position coordinate P1, and the coordinate of the response position is P3 (Px, Y1).
  • the interactive 2D input position moves from the first range to the second range according to the positions of the two coordinates. If yes, converting the current position coordinates such that the converted response position coordinates are within a specified range (ie, within the second range), preventing movement of the 2D input position from the first range to the second range.
  • the response position coordinate of the 2D input reflected on the display screen jumps from the rightmost side of the display screen to the leftmost side, thereby preventing the display device from interacting with the peripheral device, the response position coordinate of the 2D input is in the display screen. Jumping affects the user's experience.
  • the minimum abscissa of the first range is taken as the abscissa of the response position
  • the ordinate of the current position coordinate is taken as the ordinate of the response position.
  • the current position coordinate of the peripheral device is obtained as P1 (x1, y1), and the acquired previous position coordinate is P2 (x2, y2), and the current position coordinate is determined.
  • P1(x1, y1) is located in the first range
  • the previous position coordinate P2(x2, y2) is located in the second range
  • the current position coordinate P1(x1, y1) is converted to obtain a response.
  • the position coordinate P3 (x3, y3) is such that the abscissa x3 of the response position is the minimum abscissa 0 in the first range, and the ordinate y3 is the same as the ordinate y1 of the current position coordinate P1, and the coordinate of the response position is obtained. Is P3(0, y1).
  • the current position coordinate and the previous position coordinate are obtained, and according to the positions of the two coordinates, whether the interactive 2D input position is moved from the second range to the first range, and if so, Converting the current position coordinates such that the converted response position coordinates are within a specified range (ie, the first Within a range), when the 2D input position is prevented from moving from the second range to the first range, the response position coordinate of the 2D input jumps from the rightmost side to the leftmost side of the display screen.
  • a specified range ie, the first Within a range
  • Specific application example 3 when the acquired current position coordinate and the previous position coordinate are both in the same range, that is, both in the first range or in the second range, The acquired current position coordinate is used as the response position coordinate, and the interaction event is responded according to the response position coordinate.
  • the ordinate range of the 2D input position is determined from the coordinate origin to the maximum ordinate Py in the interaction range between the virtual reality display device and the peripheral device, the aforementioned current position coordinate is converted, and only the current position coordinate is The abscissa is converted, and the ordinate is the ordinate of the current position obtained. If the display device and the peripheral device do not set the interaction range of the ordinate of the 2D input position, the active range of the ordinate of the response position of the 2D input needs to be set between the minimum ordinate and the maximum ordinate within the interaction range. .

Abstract

Disclosed is a method for response of a virtual reality display device to an operation of a peripheral device. The virtual reality display device comprises two display screens, each display screen corresponding to part of the whole interaction range. The method comprises: obtaining current position coordinates of a peripheral device; converting the current position coordinates by using a conversion mode corresponding to a predetermined condition, to obtain response position coordinates within a specified range; and performing position interaction according to the response position coordinates. According to the method, coordinate conversion is performed on current position coordinates, so that obtained response position coordinates can respond to a peripheral device; meanwhile, the converted response position coordinates are limited to a specified range within the interaction range, so that the 2D input response position coordinates can be prevented from jumping in a stereoscopic image of a display device when the current position coordinates interact with the virtual reality display device.

Description

一种虚拟现实显示设备响应外设设备操作的方法Method for responding to operation of peripheral device by virtual reality display device
本申请要求于2015年7月22日提交中国专利局、申请号为201510433732.4、发明名称为“一种虚拟现实显示设备响应外设设备操作的方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese Patent Application filed on July 22, 2015, the Chinese Patent Office, Application No. 201510433732.4, entitled "A method for the operation of a virtual reality display device in response to peripheral devices", the entire contents of which are The citations are incorporated herein by reference.
技术领域Technical field
本发明涉及虚拟现实技术领域,特别是涉及一种虚拟现实显示设备响应外设设备操作的方法。The present invention relates to the field of virtual reality technologies, and in particular, to a method for a virtual reality display device to respond to operation of a peripheral device.
背景技术Background technique
VR(Virtual Reality,虚拟现实)技术是指利用计算机生成一种模拟环境,并通过多种专用设备使用户“投入”到该环境中,实现用户与该环境直接进行自然交互的技术。虚拟现实显示设备中,VR眼镜就是实现虚拟现实环境的一种专用设备。在VR眼镜中,把立体视频的影像分解为左右两个观察角度的画面,让两个画面通过VR眼镜分别进入用户的左右眼镜,这样两个眼睛分别看到两个角度的画面,经过大脑合成就形成了立体影像,展现出一幅幅连贯的立体画面,使用户能产生强烈的"身临其境"感。VR (Virtual Reality) technology refers to the use of a computer to generate a simulation environment, and through a variety of specialized devices to enable users to "invest" into the environment, enabling users to directly interact with the environment. In virtual reality display devices, VR glasses are a special device for realizing virtual reality environments. In VR glasses, the image of the stereoscopic video is decomposed into two left and right viewing angles, so that the two images enter the left and right glasses of the user through the VR glasses, so that the two eyes respectively see the two angles of the image, and are synthesized by the brain. A stereoscopic image is formed, which shows a coherent three-dimensional image, which enables the user to have a strong "immersive" feeling.
现有技术中,为增强用户的体验效果,增加外设设备使得用户能够通过该外设设备与虚拟现实中的影像进行交互。所述交互是指通过外设设备的2D输入,能够在现实设备上相应地表达,即随着外设设备上报的位置坐标在现实空间中的移动,使得在虚拟现实显示设备的立体影像中,该位置坐标的响应位置坐标也随之相应地移动。例如,当外设设备为鼠标时,通过移动该鼠标的位置,相应地在虚拟现实显示设备上显示的鼠标箭头的位置也随着移动,进而可实现在虚拟现实的立体影像中执行某些“确认”或“取消”等操作。In the prior art, in order to enhance the user experience, the peripheral device is added to enable the user to interact with the image in the virtual reality through the peripheral device. The interaction refers to a 2D input of the peripheral device, which can be correspondingly expressed on the real device, that is, in the stereoscopic image of the virtual reality display device, as the position coordinates reported by the peripheral device move in the real space, The response position coordinates of the position coordinates also move accordingly. For example, when the peripheral device is a mouse, by moving the position of the mouse, the position of the mouse arrow displayed on the virtual reality display device is also moved accordingly, thereby implementing some "in the virtual reality stereo image". Confirm or "cancel" and other operations.
但是,外设设备在与虚拟现实显示设备进行交互时,2D输入的响应位置坐标在虚拟现实的立体影像中会发生从屏幕画面的最右侧跳跃到最左侧,或者从最左侧跳跃到最右侧的现象,这种无规则的跳跃影响了用户的视觉体验效果,给用户带来不舒服的感受。 However, when the peripheral device interacts with the virtual reality display device, the response position coordinates of the 2D input may jump from the rightmost side of the screen to the leftmost side or from the leftmost side in the virtual reality stereo image. At the far right, this irregular jump affects the user's visual experience and gives the user an uncomfortable feeling.
发明内容Summary of the invention
本申请实施例中提供了一种虚拟现实显示设备响应外设设备操作的方法,为了解决上述技术问题,本发明实施例公开了如下技术方案:The embodiment of the present invention provides a method for the operation of the virtual reality display device in response to the operation of the peripheral device. To solve the above technical problem, the embodiment of the present invention discloses the following technical solution:
一种虚拟现实显示设备响应外设设备操作的方法,所述虚拟现实显示设备包括两个显示屏,每一个所述显示屏与全部交互范围的一部分相对应,所述方法包括:A method for a virtual reality display device to respond to operation of a peripheral device, the virtual reality display device comprising two display screens, each of the display screens corresponding to a portion of a total interaction range, the method comprising:
获取外设设备的当前位置坐标;采用与预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标,其中,所述指定范围为所述两个显示屏中指定显示屏所述对应的交互范围;根据所述响应位置坐标进行位置交互。Obtaining a current position coordinate of the peripheral device; converting the current position coordinate by using a conversion manner corresponding to the predetermined condition to obtain a response position coordinate within a specified range, wherein the specified range is the two display screens Specifying a corresponding interaction range in the display screen; performing position interaction according to the response position coordinates.
优选的,对所述当前位置坐标进行转换的步骤包括:Preferably, the step of converting the current position coordinates comprises:
获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
判断所述当前位置坐标是否在所述第一范围内;如果是,将所述当前位置坐标作为所述响应位置坐标;如果否,将所述第一范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。Determining whether the current position coordinate is within the first range; if yes, using the current position coordinate as the response position coordinate; if not, using the maximum horizontal coordinate of the first range as the response position The abscissa, the ordinate of the current position is taken as the ordinate of the response position.
优选的,对所述当前位置坐标进行转换的步骤包括:Preferably, the step of converting the current position coordinates comprises:
获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
判断所述当前位置坐标是否在所述第二范围内;如果是,将所述当前位置坐标作为所述响应位置坐标;如果否,将所述第二范围的最小横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。Determining whether the current position coordinate is within the second range; if yes, using the current position coordinate as the response position coordinate; if not, using the minimum horizontal coordinate of the second range as the response position The abscissa, the ordinate of the current position is taken as the ordinate of the response position.
优选的,所述采用与预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标还包括:Preferably, the converting the current position coordinates by using a conversion manner corresponding to the predetermined condition, and obtaining the response position coordinates within the specified range further includes:
获取所述当前位置坐标的前次位置坐标;根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换;得到位于指定范围内的响应位置坐标。Obtaining a previous position coordinate of the current position coordinate; converting the current position coordinate according to the current position coordinate and the previous position coordinate; obtaining a response position coordinate within a specified range.
优选的,根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换的步骤包括: Preferably, the step of converting the current location coordinates according to the current location coordinates and the previous location coordinates comprises:
获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
当所述当前位置坐标位于所述第二范围内,且所述前次位置坐标位于所述第一范围内时,将所述第二范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。When the current position coordinate is located in the second range, and the previous position coordinate is located in the first range, the maximum abscissa of the second range is taken as the abscissa of the response position, The ordinate of the current position is taken as the ordinate of the response position.
优选的,根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换的步骤包括:Preferably, the step of converting the current location coordinates according to the current location coordinates and the previous location coordinates comprises:
获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
当所述当前位置坐标位于所述第一范围内,且所述前次位置坐标位于所述第二范围内时,将所述第一范围的最小横坐标作为所述响应位置的横坐标,所述当前位置坐标的纵坐标作为所述响应位置的纵坐标。When the current position coordinate is located in the first range, and the previous position coordinate is located in the second range, the minimum abscissa of the first range is taken as the abscissa of the response position, The ordinate of the current position coordinate is taken as the ordinate of the response position.
优选的,在所述获取外设设备的当前位置坐标之前的步骤还包括:Preferably, the step before the acquiring the current location coordinates of the peripheral device further includes:
连接所述外设设备与所述虚拟现实显示设备;确定所述外设设备的当前位置坐标。Connecting the peripheral device to the virtual reality display device; determining a current location coordinate of the peripheral device.
由以上技术方案可见,本申请提供的一种虚拟现实显示设备响应外设设备操作的方法,通过将获取的外设设备的当前位置坐标进行坐标转换,得到位于指定范围内响应位置坐标,进而使虚拟现实显示设备能够响应外设设备操作,实现与外设设备的响应位置坐标相交互。并且,转换后的响应位置坐标被限制在交互范围中的指定范围内,能够防止当前位置坐标在与虚拟现实显示设备交互时,2D输入的响应位置坐标在显示设备的立体影像中发生跳跃,克服了2D输入的响应位置坐标发生跳跃给用户在虚拟现实体验时带来的不舒服的感受。It can be seen from the above technical solution that the virtual reality display device provided by the present application responds to the operation of the peripheral device by performing coordinate conversion on the current position coordinates of the acquired peripheral device, thereby obtaining the coordinate of the response position within the specified range, thereby enabling The virtual reality display device is capable of interacting with the peripheral device's response position coordinates in response to the peripheral device operation. Moreover, the converted response position coordinates are limited to a specified range in the interaction range, which can prevent the current position coordinates from interacting with the virtual reality display device, and the response position coordinates of the 2D input jump in the stereoscopic image of the display device, thereby overcoming The response position coordinates of the 2D input jump to give the user an uncomfortable feeling during the virtual reality experience.
附图说明DRAWINGS
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。 In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it will be apparent to those skilled in the art that In other words, other drawings can be obtained based on these drawings without paying for creative labor.
图1为本申请实施例提供的一种虚拟现实显示设备响应外设设备操作的方法的流程示意图;FIG. 1 is a schematic flowchart of a method for a virtual reality display device to respond to operation of a peripheral device according to an embodiment of the present application;
图2为本申请实施例提供的另一种虚拟现实显示设备响应外设设备操作方法的流程图;FIG. 2 is a flowchart of another method for operating a virtual reality display device in response to a peripheral device according to an embodiment of the present disclosure;
图3为本申请提供的一种在虚拟现实显示设备上交互范围划分的示意图;FIG. 3 is a schematic diagram of interaction range division on a virtual reality display device according to the present application; FIG.
图4为2D输入位置在第一范围和第二范围内移动的示意图;4 is a schematic diagram of movement of a 2D input position within a first range and a second range;
图5为本申请实施例提供的一种虚拟现实显示设备响应外设设备操作的方法中对当前位置坐标进行转换的具体流程图;FIG. 5 is a specific flowchart of converting a current location coordinate in a method for operating a virtual reality display device in response to a peripheral device according to an embodiment of the present disclosure;
图6为本申请实施例提供的一种将当前位置坐标转换为第一范围内的坐标的示意图;FIG. 6 is a schematic diagram of converting current position coordinates into coordinates in a first range according to an embodiment of the present application;
图7为本申请实施例提供的一种将当前位置坐标转换为在第二范围内的坐标的示意图;FIG. 7 is a schematic diagram of converting current position coordinates into coordinates in a second range according to an embodiment of the present application; FIG.
图8为本申请实施例提供的另一种虚拟现实显示设备响应外设设备操作的方法的流程示意图;FIG. 8 is a schematic flowchart of another method for responding to operation of a peripheral device by a virtual reality display device according to an embodiment of the present disclosure;
图9为本实施例提供的一种控制2D输入的响应位置坐标位置转换的示意图;FIG. 9 is a schematic diagram of a coordinate position position conversion of a control position of a 2D input according to an embodiment of the present invention; FIG.
图10为本实施例提供的另一种控制2D输入的响应位置坐标位置转换的的示意图。FIG. 10 is a schematic diagram of another control position coordinate position conversion for controlling 2D input according to the embodiment.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本申请中的技术方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。The technical solutions in the embodiments of the present application are clearly and completely described in the following, in which the technical solutions in the embodiments of the present application are clearly and completely described. The embodiments are only a part of the embodiments of the present application, and not all of them.
图1是根据一实施例提供的一种虚拟现实显示设备响应外设设备操作的方法的流程图,所述虚拟现实显示设备应用于虚拟现实的模拟环境中,例如,VR(虚拟现实)眼镜,头戴式VR显示设备等。其中,所述外设设备通过2D输入是实现与该虚拟现实显示设备相交互。例如,通过外设设备2D输入,显示在VR眼镜的立体影像画面中的光标箭头、鼠标指示箭头等。如图1所示,虚拟现实显示设备响应外设设备操作的方法的步骤包括: 1 is a flowchart of a method for a virtual reality display device to respond to operation of a peripheral device, the virtual reality display device being applied to a virtual reality simulation environment, for example, VR (Virtual Reality) glasses, according to an embodiment. Head-mounted VR display devices, etc. The peripheral device interacts with the virtual reality display device through the 2D input. For example, a cursor arrow, a mouse instruction arrow, and the like displayed on a stereoscopic image screen of the VR glasses are input through the peripheral device 2D. As shown in FIG. 1, the steps of the method for the virtual reality display device to respond to the operation of the peripheral device include:
步骤101中,获取外设设备的当前位置坐标。In step 101, the current position coordinates of the peripheral device are obtained.
如图2所示,在步骤101中,在所述获取外设设备的当前位置坐标之前还包括:As shown in FIG. 2, in step 101, before the acquiring the current location coordinates of the peripheral device, the method further includes:
步骤1011,连接所述外设设备与所述虚拟现实显示设备,使所述外设设备上报的位置坐标能够与所述虚拟现实显示设备相交互。Step 1011: Connect the peripheral device and the virtual reality display device, so that the location coordinates reported by the peripheral device can interact with the virtual reality display device.
其中,所述外设设备包括鼠标、键盘、游戏手柄等,通过与虚拟现实显示设备相连接,使得通过外设设备能够在虚拟现实显示设备上输入2D事件,以增强虚拟现实的体验效果。所述外设设备与虚拟现实显示设备相连接包括但不限于线缆、蓝牙或WIFI连接。The peripheral device includes a mouse, a keyboard, a game controller, etc., and is connected to the virtual reality display device, so that the peripheral device can input a 2D event on the virtual reality display device to enhance the experience effect of the virtual reality. The peripheral device is connected to the virtual reality display device including, but not limited to, a cable, Bluetooth or WIFI connection.
步骤1012,确定所述外设设备的当前位置坐标。 Step 1012, determining a current position coordinate of the peripheral device.
所述虚拟现实显示设备还包括中央处理单元,该中央处理单元用于识别和确定该外设设备上报的当前位置坐标。例如,在VR眼镜中,PCB板上的中央处理单元能够分析和确定,外设设备在其活动范围内的当前位置坐标,以及获取所述当前位置坐标。所述获取当前位置坐标的步骤包括:中央处理单元将所述外设设备活动的空间范围表示为带有坐标系的区域,将当前外设设备在所述坐标系区域的位置作为所述当前位置坐标,并将该当前位置坐标上报给所述中央处理单元。The virtual reality display device further includes a central processing unit for identifying and determining current position coordinates reported by the peripheral device. For example, in VR glasses, a central processing unit on a PCB can analyze and determine the current position coordinates of the peripheral device within its range of motion, as well as the current position coordinates. The step of acquiring the current location coordinates includes: the central processing unit represents the spatial extent of the peripheral device activity as an area with a coordinate system, and the position of the current peripheral device in the coordinate system region as the current location Coordinates and report the current position coordinates to the central processing unit.
根据图1所示,步骤102,采用与预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标,其中,所述指定范围为所述两个显示屏中指定显示屏所述对应的交互范围。According to FIG. 1 , in step 102, the current position coordinates are converted by using a conversion manner corresponding to a predetermined condition to obtain response position coordinates within a specified range, wherein the specified range is the two display screens. Specifies the corresponding interaction range described in the display.
在步骤102中,所述虚拟现实显示设备包括两个显示屏,每一个所述显示屏与全部交互范围的一部分相对应,所述指定范围为所述两个显示屏中指定显示屏所述对应的交互范围。例如在VR眼镜中,获取的当前位置坐标,根据所述当前位置坐标的位置,确定将该当前位置坐标进行转换后得到的响应位置坐标位于指定范围内,所述指定范围可以是VR眼镜的左显示屏或者右显示屏。所述预定条件包括将所述当前位置坐标转换为两个显示屏中的一个预设的显示屏中,所述交互范围为在虚拟现实显示设备上的显示画面的范围。In step 102, the virtual reality display device includes two display screens, each of the display screens corresponding to a portion of all interaction ranges, the specified range being the corresponding display screen of the two display screens. The scope of interaction. For example, in the VR glasses, the acquired current position coordinates are determined according to the position of the current position coordinates, and the coordinate of the response position obtained by converting the current position coordinates is within a specified range, and the specified range may be the left of the VR glasses. Display or right display. The predetermined condition includes converting the current position coordinates into a preset one of two display screens, the interaction range being a range of display screens on the virtual reality display device.
步骤103,根据所述响应位置坐标进行位置交互。Step 103: Perform position interaction according to the response position coordinates.
所述位置交互是指通过外设设备的2D输入,能够在现实设备上相应地表达,即随着外设设备上报的位置坐标在现实空间中的移动,使得在虚拟现实显示设备的立体影像中,该位置坐标的响应位置坐标也随之相应地移动。例如用户手持的外设设备为 游戏手柄,当虚拟现实显示设备需要用户来对立体影像画面中“确认”或者“取消”进行选择操作时,通过移动游戏手柄,显示在该立体影像中的鼠标指针的位置也能够移动到“确认”或者“取消”操作键的位置,便于用户进行操作选择。此外,所述位置交互还包括通过外设设备例如键盘输入文字信息显示在所述虚拟现实的显示设备上。The location interaction refers to a 2D input of the peripheral device, which can be correspondingly expressed on the real device, that is, in the stereoscopic image of the virtual reality display device, as the position coordinates reported by the peripheral device move in the real space. The response position coordinates of the position coordinates also move accordingly. For example, the peripheral device held by the user is Gamepad, when the virtual reality display device requires the user to select "confirm" or "cancel" in the stereoscopic image screen, by moving the gamepad, the position of the mouse pointer displayed in the stereoscopic image can also be moved to "confirm" Or "cancel" the position of the operation button, which is convenient for the user to select the operation. In addition, the location interaction further includes displaying text information on the display device of the virtual reality through a peripheral device such as a keyboard.
所述交互还包括通过外设设备和显示设备相互间的连接关系,使外设设备上报的当前位置坐标通过转换后,响应于所述显示设备上,并且使得经过转换后的响应位置坐标跟随外设设备的输入情况发生相应的改变。The interaction further includes: connecting, by the peripheral device, the display device, the current position coordinates reported by the peripheral device, and then responding to the display device, and causing the converted response position coordinates to follow Set the input condition of the device to change accordingly.
本申请提供的一种虚拟现实显示设备响应外设设备操作的方法,通过将获取的外设设备的当前位置坐标进行坐标转换,得到位于指定范围内响应位置坐标,进而使虚拟现实显示设备能够响应外设设备操作,实现与外设设备的响应位置坐标相交互。并且,转换后的响应位置坐标被限制在交互范围中的指定范围内,能够防止当前位置坐标在与虚拟现实显示设备交互时,2D输入的响应位置坐标在显示设备的立体影像中发生跳跃,克服了2D输入的响应位置坐标发生跳跃给用户在虚拟现实体验时带来的不舒服的感受。The virtual reality display device provided by the present application responds to the operation of the peripheral device by performing coordinate conversion on the current position coordinates of the acquired peripheral device to obtain the coordinate of the response position within the specified range, thereby enabling the virtual reality display device to respond. The peripheral device operates to interact with the response location coordinates of the peripheral device. Moreover, the converted response position coordinates are limited to a specified range in the interaction range, which can prevent the current position coordinates from interacting with the virtual reality display device, and the response position coordinates of the 2D input jump in the stereoscopic image of the display device, thereby overcoming The response position coordinates of the 2D input jump to give the user an uncomfortable feeling during the virtual reality experience.
将响应位置坐标限制在指定的范围内,所述指定范围为与VR眼镜的两个显示屏中的任意一个显示屏相交互的活动范围,以防止当前位置坐标在与虚拟现实显示设备交互时,2D输入的响应位置坐标超出其中任一个显示屏的交互范围,使显示的2D输入的响应位置坐标在立体影像画面中呈现出的左右侧跳跃的现象。Limiting the response position coordinates to a specified range, which is an active range that interacts with any of the two display screens of the VR glasses to prevent the current position coordinates from interacting with the virtual reality display device, The response position coordinate of the 2D input exceeds the interaction range of any one of the display screens, so that the response position coordinates of the displayed 2D input are displayed on the left and right side of the stereoscopic image screen.
在一具体实施例中,虚拟现实显示设备为VR眼镜,在VR眼镜上的左右两个显示屏的交互区域可以通过坐标系表示,如图3所示,虚拟现实显示设备的显示屏幕画面是一个二维坐标系,以该显示屏幕画面的左上方为原点(0,0),屏幕画面的横向方向为x轴、竖向方向为y轴,屏幕画面的x轴最大值和y轴最大值分别表示为Px和Py。因此获取虚拟现实显示设备的矩形交互范围为以显示画面对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围,显示画面中任何一个响应位置坐标都可以用表示在所述交互范围中。In a specific embodiment, the virtual reality display device is a VR glasses, and the interaction area of the left and right display screens on the VR glasses can be represented by a coordinate system. As shown in FIG. 3, the display screen of the virtual reality display device is a The two-dimensional coordinate system takes the upper left of the display screen as the origin (0,0), the horizontal direction of the screen is the x-axis, the vertical direction is the y-axis, and the x-axis maximum and the y-axis maximum of the screen are respectively Expressed as Px and Py. Therefore, the rectangular interaction range of the virtual reality display device is obtained by using one vertex of the diagonal of the display screen as the coordinate origin (0, 0), the other vertex as (Px, Py), and one edge on the x-axis, wherein the origin is (0,0) is a vertex, the other vertex is (Px/2, Py), a rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded within the interaction range The area other than the second range, any of the response position coordinates in the display screen can be represented in the interaction range.
其中,所述第一范围和第二范围,代表VR眼镜的左、右两个显示屏。在VR眼镜中的左、右两个显示屏分别对应两个不同角度的视频影像,用户佩戴VR眼镜时, 将两个不同角度的影像经过大脑合成了立体影像。每一个所述显示屏与全部交互范围的一部分相对应,且在VR眼镜的每个显示屏上的2D输入位置分别且对应地显示在合成的立体影像显示画面上,例如在第一范围内的2D输入的位置位于左上角,则在合成的显示画面上该2D输入的响应位置坐标也显示在左上角;同理地,在第二范围内的2D输入位置也与在合成的显示画面上的响应于该2D输入的响应位置坐标的显示位置相同。Wherein, the first range and the second range represent two left and right display screens of the VR glasses. The left and right display screens in VR glasses correspond to two different angles of video images. When users wear VR glasses, Two different angles of image are combined into the brain to synthesize a stereo image. Each of the display screens corresponds to a portion of all interaction ranges, and the 2D input positions on each of the display screens of the VR glasses are respectively displayed on the synthesized stereoscopic image display screen, for example, in the first range. The position of the 2D input is located in the upper left corner, and the coordinate of the response position of the 2D input is also displayed in the upper left corner on the synthesized display screen; similarly, the 2D input position in the second range is also on the synthesized display screen. The display position of the response position coordinates in response to the 2D input is the same.
如果在第一范围内右侧有2D输入,则通过交互该2D输入的响应位置坐标显示在用户看到的立体影像画面的最右侧。如图4所示,当该2D输入的响应位置坐标在交互时,从所述第一范围移动到第二范围内时,显示在立体影像画面的是该2D输入的响应位置坐标从画面的最右侧跳跃到了最左侧,这种从第一范围移动到第二范围导致在立体影像画面中显示出该2D输入的响应位置坐标从最右侧跳跃到左侧的现象,或者从左侧跳跃到右侧的现象,给用户在虚拟现实环境交互时带来不舒服的感受,甚至发生眩晕,影响用户的视觉体验效果。If there is a 2D input on the right side of the first range, the coordinate of the response position by the interaction of the 2D input is displayed on the rightmost side of the stereoscopic image screen seen by the user. As shown in FIG. 4, when the response position coordinates of the 2D input are moved from the first range to the second range when interacting, the coordinate position of the 2D input displayed on the stereoscopic image is from the top of the screen. The right side jumps to the leftmost side, and the movement from the first range to the second range causes the response position coordinate of the 2D input to jump from the rightmost side to the left side in the stereoscopic image screen, or jumps from the left side. The phenomenon to the right side gives the user an uncomfortable feeling when interacting in the virtual reality environment, and even causes dizziness, which affects the user's visual experience.
具体地,如图5所示,在步骤102中,对所述当前位置坐标进行转换的步骤还包括:Specifically, as shown in FIG. 5, in step 102, the step of converting the current location coordinates further includes:
步骤1021:获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为A(Px,Py),一条边在x轴上,另一条边在y轴上,其中,以原点(0,0)为一个顶点,另一个顶点为B(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围。Step 1021: Acquire a rectangular interaction range of the virtual reality display device. One vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is A (Px, Py), and one edge is on the x-axis. The other edge is on the y-axis, where the origin (0,0) is a vertex, the other vertex is B(Px/2,Py), and the rectangular region formed by an edge on the x-axis is the first range. And the area other than the first range within the interaction range is the second range.
如前述实施例对虚拟现实显示设备的显示屏幕画面划分交互范围,所述第一范围与所述第二范围的面积大小相等,且两个范围分别表示虚拟现实设备上的两个显示屏,例如图3所示,该第一范围表示VR眼镜中的左镜片显示屏,第二范围表示VR眼镜中的右镜片显示屏。The display screen of the virtual reality display device divides the interaction range according to the foregoing embodiment, the first range is equal to the area of the second range, and the two ranges respectively represent two display screens on the virtual reality device, for example As shown in FIG. 3, the first range represents the left lens display screen in the VR glasses, and the second range represents the right lens display screen in the VR glasses.
步骤1022:判断所述当前位置坐标是否在所述第一范围内。Step 1022: Determine whether the current location coordinate is within the first range.
所述显示设备获取外设设备的当前位置坐标后,判断所述当前位置坐标是否符合预设条件,进而确定所述当前位置坐标在所述显示设备上的交互范围。After obtaining the current location coordinates of the peripheral device, the display device determines whether the current location coordinate meets a preset condition, and further determines an interaction range of the current location coordinate on the display device.
步骤1023,如果是,即当前位置坐标在所述交互范围的第一范围内时,将所述当前位置坐标作为所述响应位置坐标。 Step 1023, if yes, that is, when the current position coordinate is within the first range of the interaction range, the current position coordinate is taken as the response position coordinate.
步骤1024,如果否,将所述第一范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。 Step 1024, if not, the maximum abscissa of the first range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position.
步骤1025,得到位于指定范围内的响应位置坐标。In step 1025, the coordinates of the response position within the specified range are obtained.
在一个应用的实施例中,如图6所示,获取外设设备的当前位置坐标为(x0,y0),判断所述当前位置坐标(x0,y0)是否在所述第一范围内,如果是,将该当前位置坐标(x0,y0)作为响应位置坐标(x0,y0),并将该响应位置坐标显示在所述虚拟现实显示设备的显示画面上。In an embodiment of the application, as shown in FIG. 6, the current position coordinate of the peripheral device is acquired as (x0, y0), and it is determined whether the current position coordinate (x0, y0) is within the first range, if Yes, the current position coordinate (x0, y0) is used as the response position coordinate (x0, y0), and the response position coordinate is displayed on the display screen of the virtual reality display device.
如图7所示,当所述当前坐标位置(x0,y0)位于所述第一范围外,而在所述第二范围内时,对所述当前位置坐标(x0,y0)进行转换,具体为,将所述当前位置坐标(x0,y0)的横坐标x0转换为第一范围内最大横坐标Px/2,将所述当前位置的纵坐标y0作为所述响应位置的纵坐标,得到的响应位置坐标为(Px/2,y0),在该转换后的响应位置坐标(Px/2,y0)进行交互响应。As shown in FIG. 7, when the current coordinate position (x0, y0) is outside the first range and within the second range, the current position coordinate (x0, y0) is converted, specifically In order to convert the abscissa x0 of the current position coordinate (x0, y0) into the maximum abscissa Px/2 in the first range, and obtain the ordinate y0 of the current position as the ordinate of the response position. The response position coordinates are (Px/2, y0), and the converted response position coordinates (Px/2, y0) are interactively responded.
上述实施例提供的方法,通过对获取的当前位置坐标进行判断,并根据判断的结果,对所述当前位置坐标进行转换,使转换后的响应位置坐标位于指定的范围内,防止外设设备与显示设备相交互时,2D输入的响应位置坐标从所述第一范围移动到所述第二范围,或者从所述第二范围移动到所述第一范围时,在显示画面上出现该2D输入的响应位置坐标从一侧跳跃到另一侧的现象,克服了2D输入的响应位置坐标在显示画面的跳跃而给用户带来不舒适的问题。The method provided in the foregoing embodiment determines the current position coordinates obtained by the method, and converts the current position coordinates according to the result of the determination, so that the converted response position coordinates are within a specified range, thereby preventing peripheral devices and The 2D input appears on the display screen when the display device interacts, the response position coordinate of the 2D input moves from the first range to the second range, or moves from the second range to the first range The phenomenon that the response position coordinates jump from one side to the other side overcomes the problem that the response position coordinates of the 2D input jump in the display screen and bring discomfort to the user.
由于前述第一范围和第二范围分别表示VR眼镜的两个显示屏,即每个显示屏均能够完整地显示虚拟现实画面的立体影像,所以每个显示屏上的2D输入所对应的响应位置坐标也都能在立体影像的显示画面上以同样的位置反映出来。例如,在所述第一范围的左上角或者第二范围的左上角显示的鼠标指针,对应在显示画面的左上角也显示有相同的鼠标指针。将获取的当前位置坐标转换为在指定范围内的响应位置坐标,能使2D输入的位置在显示画面上对应的位置反应出来,进而实现虚拟现实显示设备与外设设备相交互。Since the foregoing first range and the second range respectively represent two display screens of the VR glasses, that is, each display screen can completely display the stereoscopic image of the virtual reality picture, the response position corresponding to the 2D input on each display screen The coordinates can also be reflected in the same position on the display screen of the stereo image. For example, the mouse pointer displayed in the upper left corner of the first range or the upper left corner of the second range corresponds to the same mouse pointer displayed in the upper left corner of the display screen. Converting the acquired current position coordinates into the response position coordinates within the specified range enables the position of the 2D input to be reflected on the corresponding position on the display screen, thereby realizing the virtual reality display device to interact with the peripheral device.
在预设条件中,所述将获取的外设设备的当前位置坐标转换为在所述第二范围内的响应位置坐标的步骤包括:In the preset condition, the step of converting the current position coordinates of the acquired peripheral device into the response position coordinates in the second range includes:
步骤1026:判断所述当前位置坐标是否在所述第二范围内。Step 1026: Determine whether the current position coordinate is within the second range.
在判断步骤1026之前,首先对虚拟现实的交互范围进行划分,详细划分步骤与 步骤1021相同,将VR眼镜的左右两个显示屏的交互范围分为第一范围和第二范围。Before the step 1026 is judged, the interaction range of the virtual reality is first divided, and the detailed division steps and Step 1021 is the same, and the interaction range of the left and right display screens of the VR glasses is divided into a first range and a second range.
步骤1027:如果是,将所述当前位置坐标作为所述响应位置坐标。例如,获取的当前位置坐标为(x1,y1),且位于所述第二范围内时,确定响应位置坐标为(x1,y1),与该获取的当前位置坐标(x1,y1)相同。Step 1027: If yes, the current position coordinate is taken as the response position coordinate. For example, the acquired current position coordinate is (x1, y1), and when located within the second range, the response position coordinate is determined to be (x1, y1), which is the same as the acquired current position coordinate (x1, y1).
步骤1028:如果否,将所述第二范围的最小横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为响应位置的纵坐标。例如,当获取的所述当前位置坐标为(x1,y1),且位于所述第二范围以外时,将所述第二范围的最小横坐标Px/2作为所述响应位置的横坐标,所述当前位置的纵坐标y1作为所述响应位置的纵坐标。Step 1028: If not, the minimum abscissa of the second range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position. For example, when the acquired current position coordinate is (x1, y1) and is outside the second range, the minimum abscissa Px/2 of the second range is taken as the abscissa of the response position, The ordinate y1 of the current position is taken as the ordinate of the response position.
步骤1025:得到位于指定范围内的响应位置坐标为(Px/2,y1)。Step 1025: The coordinate of the response position within the specified range is (Px/2, y1).
在本实施例中,将所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标,并将该响应位置坐标的位于所述第二范围内,防止当前位置坐标从所述第二范围内移动到所述第一范围时,使得2D输入的响应位置坐标在显示画面上出现跳跃的现象。In this embodiment, the current position coordinate is converted to obtain a response position coordinate within a specified range, and the response position coordinate is located in the second range, preventing the current position coordinate from the second range. When moving to the first range, the response position coordinates of the 2D input cause a jump phenomenon on the display screen.
在本方案的另一个实施例中,如图8所示,在步骤102:所述采用与预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标还包括:In another embodiment of the present solution, as shown in FIG. 8, in step 102, the conversion of the current position coordinates is performed by using a conversion manner corresponding to a predetermined condition, and the coordinate of the response position within the specified range is obtained. include:
步骤201:获取所述当前位置坐标的前次位置坐标。Step 201: Acquire a previous position coordinate of the current position coordinate.
所述前次位置坐标为与所述当前位置坐标的最近的一次位置的坐标,例如,如果获取的当前位置坐标的时刻是t=1时刻,且与当前位置坐标最近一次获取位置坐标的时刻是t=0时刻,那么所述前次位置坐标即为t=0时刻外设设备上报的位置坐标。此外,所述获取前次位置坐标的方法和步骤与前述所述获取当前位置坐标的方法相同。The previous position coordinate is a coordinate of a nearest position of the current position coordinate, for example, if the time of the acquired current position coordinate is t=1 time, and the time when the position coordinate is acquired last time with the current position coordinate is At time t=0, then the previous position coordinate is the position coordinate reported by the peripheral device at time t=0. In addition, the method and the step of acquiring the previous position coordinates are the same as the foregoing method of acquiring the current position coordinates.
步骤202:根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换。Step 202: Convert the current position coordinate according to the current position coordinate and the previous position coordinate.
步骤203:得到位于指定范围内的响应位置坐标;Step 203: Obtain a coordinate of the response position within a specified range;
在一个具体的实施例中,判断所述当前位置坐标和所述前次位置坐标的位置是否在前述第一范围或第二范围内,所述第一范围和第二范围的划分与前述步骤1021相同,具体详见步骤1021。In a specific embodiment, determining whether the position of the current position coordinate and the previous position coordinate is within the foregoing first range or the second range, the division of the first range and the second range and the foregoing step 1021 For the same, see step 1021 for details.
虚拟现实显示设备获取外设设备上报的当前位置坐标和前次位置坐标,并确定这 两个坐标的位置。当所述当前位置坐标位于所述第二范围内,且所述前次位置坐标位于所述第一范围内时,表示外设设备上报的2D输入位置从所述第一范围移动到所述第二范围中,那么对所述当前位置坐标进行转换的步骤为:将所述第二范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。The virtual reality display device acquires the current position coordinates and the previous position coordinates reported by the peripheral device, and determines this The position of the two coordinates. When the current position coordinate is located in the second range, and the previous position coordinate is located in the first range, indicating that the 2D input position reported by the peripheral device moves from the first range to the first In the second range, the step of converting the current position coordinates is: taking the maximum abscissa of the second range as the abscissa of the response position, and the ordinate of the current position as the vertical position of the response position coordinate.
具体应用实施例一:如图9所示,获取外设设备的当前位置坐标为P1(x1,y1),获取的前次位置坐标为P2(x2,y2),如果所述当前位置坐标P1(x1,y1)位于所述第二范围内,前次位置坐标P2(x2,y2)位于所述第一范围内,对所述当前位置坐标P1(x1,y1)进行转换得到响应位置坐标P3(x3,y3),使得该响应位置的横坐标x3为所述二范围内的最大横坐标Px,纵坐标y3与所述当前位置坐标P1的纵坐标y1相同,得到响应位置坐标为P3(Px,y1)。Specific application embodiment 1: As shown in FIG. 9, the current position coordinate of the peripheral device is P1 (x1, y1), and the obtained previous position coordinate is P2 (x2, y2), if the current position coordinate P1 ( X1, y1) is located in the second range, the previous position coordinate P2 (x2, y2) is located in the first range, and the current position coordinate P1 (x1, y1) is converted to obtain a response position coordinate P3 ( X3, y3), such that the abscissa x3 of the response position is the maximum abscissa Px within the two ranges, the ordinate y3 is the same as the ordinate y1 of the current position coordinate P1, and the coordinate of the response position is P3 (Px, Y1).
在上述应用实施例一中,通过获取当前位置坐标和前次位置坐标,根据这两个坐标的位置判断交互的2D输入位置是否从第一范围移动到第二范围。如果是,将所述当前位置坐标进行转换,使转换后的响应位置坐标位于指定的范围内(即所述第二范围内),防止当2D输入位置从第一范围移动到所述第二范围时,在显示画面上反映的该2D输入的响应位置坐标从显示画面的最右侧跳跃到最左侧的现象,进而防止显示设备与外设交互时,2D输入的响应位置坐标在显示画面中跳跃影响用户的体验效果。In the first application example described above, by acquiring the current position coordinate and the previous position coordinate, it is determined whether the interactive 2D input position moves from the first range to the second range according to the positions of the two coordinates. If yes, converting the current position coordinates such that the converted response position coordinates are within a specified range (ie, within the second range), preventing movement of the 2D input position from the first range to the second range When the response position coordinate of the 2D input reflected on the display screen jumps from the rightmost side of the display screen to the leftmost side, thereby preventing the display device from interacting with the peripheral device, the response position coordinate of the 2D input is in the display screen. Jumping affects the user's experience.
如果当前位置坐标位于所述交互范围内的第一范围内,且所述前次位置坐标位于所述第二范围内时,将所述第一范围的最小横坐标作为所述响应位置的横坐标,所述当前位置坐标的纵坐标作为所述响应位置的纵坐标。If the current position coordinate is within the first range within the interaction range, and the previous position coordinate is within the second range, the minimum abscissa of the first range is taken as the abscissa of the response position The ordinate of the current position coordinate is taken as the ordinate of the response position.
具体应用实施例二:如图10所示,获取外设设备的当前位置坐标为P1(x1,y1),并且获取的前次位置坐标为P2(x2,y2),判断当所述当前位置坐标P1(x1,y1)位于所述第一范围内,所述前次位置坐标P2(x2,y2)位于所述第二范围内,对所述当前位置坐标P1(x1,y1)进行转换得到响应位置坐标P3(x3,y3),使得该响应位置的横坐标x3为所述第一范围内的最小横坐标0,纵坐标y3与所述当前位置坐标P1的纵坐标y1相同,得到响应位置坐标为P3(0,y1)。Specific application example 2: As shown in FIG. 10, the current position coordinate of the peripheral device is obtained as P1 (x1, y1), and the acquired previous position coordinate is P2 (x2, y2), and the current position coordinate is determined. P1(x1, y1) is located in the first range, and the previous position coordinate P2(x2, y2) is located in the second range, and the current position coordinate P1(x1, y1) is converted to obtain a response. The position coordinate P3 (x3, y3) is such that the abscissa x3 of the response position is the minimum abscissa 0 in the first range, and the ordinate y3 is the same as the ordinate y1 of the current position coordinate P1, and the coordinate of the response position is obtained. Is P3(0, y1).
在上述应用实施例二中,获取当前位置坐标和前次位置坐标,根据这两个坐标的位置判断交互的2D输入位置是否从所述第二范围移动到所述第一范围,如果是,将所述当前位置坐标进行转换,使转换后的响应位置坐标位于在指定范围内(即所述第 一范围内),防止所述2D输入位置从所述第二范围移动到所述第一范围时,所述2D输入的响应位置坐标从显示画面的最右侧跳跃到最左侧的现象。In the foregoing application embodiment 2, the current position coordinate and the previous position coordinate are obtained, and according to the positions of the two coordinates, whether the interactive 2D input position is moved from the second range to the first range, and if so, Converting the current position coordinates such that the converted response position coordinates are within a specified range (ie, the first Within a range), when the 2D input position is prevented from moving from the second range to the first range, the response position coordinate of the 2D input jumps from the rightmost side to the leftmost side of the display screen.
具体应用实施例三:当所述获取的当前位置坐标与所述前次位置坐标都在同一个范围内时,即都在所述第一范围或者都在所述第二范围内时,将所述获取的当前位置坐标作为所述响应位置坐标,再根据所述响应位置坐标响应交互事件。Specific application example 3: when the acquired current position coordinate and the previous position coordinate are both in the same range, that is, both in the first range or in the second range, The acquired current position coordinate is used as the response position coordinate, and the interaction event is responded according to the response position coordinate.
由于虚拟现实显示设备与外设设备的交互范围中确定了2D输入位置的纵坐标范围为坐标原点到最大纵坐标Py,因此,前述对获取的当前位置坐标进行转换,只对所述当前位置坐标的横坐标进行转换,纵坐标为获取的当前位置的纵坐标。如果显示设备和外设设备未设置2D输入位置的纵坐标的交互范围,则需将2D输入的响应位置的纵坐标的活动范围设置在所述交互范围内的最小纵坐标与最大纵坐标之间。Since the ordinate range of the 2D input position is determined from the coordinate origin to the maximum ordinate Py in the interaction range between the virtual reality display device and the peripheral device, the aforementioned current position coordinate is converted, and only the current position coordinate is The abscissa is converted, and the ordinate is the ordinate of the current position obtained. If the display device and the peripheral device do not set the interaction range of the ordinate of the 2D input position, the active range of the ordinate of the response position of the 2D input needs to be set between the minimum ordinate and the maximum ordinate within the interaction range. .
需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this context, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these There is any such actual relationship or order between entities or operations. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
以上所述仅是本申请的具体实施方式,使本领域技术人员能够理解或实现本申请。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本申请的精神或范围的情况下,在其它实施例中实现。因此,本申请将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。 The above description is only a specific embodiment of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the application is not limited to the embodiments shown herein, but is to be accorded the broadest scope of the principles and novel features disclosed herein.

Claims (7)

  1. 一种虚拟现实显示设备响应外设设备操作的方法,其特征在于,所述虚拟现实显示设备包括两个显示屏,每一个所述显示屏与全部交互范围的一部分相对应,所述方法包括:A method for responding to operation of a peripheral device by a virtual reality display device, wherein the virtual reality display device comprises two display screens, each of the display screens corresponding to a portion of all interaction ranges, the method comprising:
    获取外设设备的当前位置坐标;Obtain the current position coordinates of the peripheral device;
    采用与所述预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标,其中,所述指定范围为所述两个显示屏中指定显示屏所述对应的交互范围;Converting the current position coordinates by using a conversion manner corresponding to the predetermined condition to obtain a response position coordinate within a specified range, wherein the specified range is the corresponding display in the two display screens Range of interactions;
    根据所述响应位置坐标进行位置交互。Position interaction is performed according to the response position coordinates.
  2. 根据权利要求1所述的方法,其特征在于,对所述当前位置坐标进行转换的步骤包括:The method of claim 1 wherein the step of converting the current position coordinates comprises:
    获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
    判断所述当前位置坐标是否在所述第一范围内;Determining whether the current position coordinate is within the first range;
    如果是,将所述当前位置坐标作为所述响应位置坐标;If yes, the current position coordinate is taken as the response position coordinate;
    如果否,将所述第一范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。If not, the maximum abscissa of the first range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position.
  3. 根据权利要求1所述的方法,其特征在于,对所述当前位置坐标进行转换的步骤包括:The method of claim 1 wherein the step of converting the current position coordinates comprises:
    获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
    判断所述当前位置坐标是否在所述第二范围内;Determining whether the current position coordinate is within the second range;
    如果是,将所述当前位置坐标作为所述响应位置坐标;If yes, the current position coordinate is taken as the response position coordinate;
    如果否,将所述第二范围的最小横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。If not, the minimum abscissa of the second range is taken as the abscissa of the response position, and the ordinate of the current position is taken as the ordinate of the response position.
  4. 根据权利要求1所述的方法,其特征在于,所述采用与预定条件对应的转换方式,对所述当前位置坐标进行转换,得到位于指定范围内的响应位置坐标还包括: The method according to claim 1, wherein the converting the current position coordinates by using a conversion manner corresponding to the predetermined condition to obtain the response position coordinates within the specified range further comprises:
    获取所述当前位置坐标的前次位置坐标;Obtaining a previous position coordinate of the current position coordinate;
    根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换;Converting the current position coordinates according to the current position coordinates and the previous position coordinates;
    得到位于指定范围内的响应位置坐标。Get the coordinates of the response position within the specified range.
  5. 根据权利要求4所述的方法,其特征在于,根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换的步骤包括:The method according to claim 4, wherein the converting the current position coordinates according to the current position coordinates and the previous position coordinates comprises:
    获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
    当所述当前位置坐标位于所述第二范围内,且所述前次位置坐标位于所述第一范围内时,将所述第二范围的最大横坐标作为所述响应位置的横坐标,所述当前位置的纵坐标作为所述响应位置的纵坐标。When the current position coordinate is located in the second range, and the previous position coordinate is located in the first range, the maximum abscissa of the second range is taken as the abscissa of the response position, The ordinate of the current position is taken as the ordinate of the response position.
  6. 根据权利要求4所述的方法,其特征在于,根据所述当前位置坐标和所述前次位置坐标,对所述当前位置坐标进行转换的步骤包括:The method according to claim 4, wherein the converting the current position coordinates according to the current position coordinates and the previous position coordinates comprises:
    获取虚拟现实显示设备的矩形交互范围,所述交互范围的对角线的一个顶点为坐标原点(0,0),另一个顶点为(Px,Py),一条边在x轴上,其中,以原点(0,0)为一个顶点,另一个顶点为(Px/2,Py),一条边在x轴上所形成的矩形区域为第一范围,且在所述交互范围内除所述第一范围以外的区域为第二范围;Obtaining a rectangular interaction range of the virtual reality display device, wherein one vertex of the diagonal of the interaction range is a coordinate origin (0, 0), another vertex is (Px, Py), and one edge is on an x axis, wherein The origin (0,0) is a vertex, and the other vertex is (Px/2, Py). The rectangular area formed by an edge on the x-axis is the first range, and the first range is excluded in the interaction range. The area outside the range is the second range;
    当所述当前位置坐标位于所述第一范围内,且所述前次位置坐标位于所述第二范围内时,将所述第一范围的最小横坐标作为所述响应位置的横坐标,所述当前位置坐标的纵坐标作为所述响应位置的纵坐标。When the current position coordinate is located in the first range, and the previous position coordinate is located in the second range, the minimum abscissa of the first range is taken as the abscissa of the response position, The ordinate of the current position coordinate is taken as the ordinate of the response position.
  7. 根据权利要求1至6任一项所述的方法,其特征在于,在所述获取外设设备的当前位置坐标之前的步骤还包括:The method according to any one of claims 1 to 6, wherein the step of obtaining the current position coordinates of the peripheral device further comprises:
    连接所述外设设备与所述虚拟现实显示设备;Connecting the peripheral device to the virtual reality display device;
    确定所述外设设备的当前位置坐标。 Determining the current position coordinates of the peripheral device.
PCT/CN2016/076497 2015-07-22 2016-03-16 Method for response of virtual reality display device to operation of peripheral device WO2017012360A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510433732.4A CN105159522B (en) 2015-07-22 2015-07-22 A kind of method of virtual reality display device response peripheral apparatus operation
CN201510433732.4 2015-07-22

Publications (1)

Publication Number Publication Date
WO2017012360A1 true WO2017012360A1 (en) 2017-01-26

Family

ID=54800399

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/076497 WO2017012360A1 (en) 2015-07-22 2016-03-16 Method for response of virtual reality display device to operation of peripheral device

Country Status (2)

Country Link
CN (1) CN105159522B (en)
WO (1) WO2017012360A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105159522B (en) * 2015-07-22 2018-03-13 深圳多新哆技术有限责任公司 A kind of method of virtual reality display device response peripheral apparatus operation
CN105824532A (en) * 2016-03-16 2016-08-03 无锡科技职业学院 Recognizing and hash locating method of rectangular graphs
CN106060670A (en) * 2016-06-02 2016-10-26 北京光子互动科技有限公司 Multimedia processing method, device and system
CN106095238A (en) * 2016-06-08 2016-11-09 北京行云时空科技有限公司 Cursor display method based on intelligent glasses and device
US10496353B2 (en) 2016-09-29 2019-12-03 Jiang Chang Three-dimensional image formation and color correction system and method
CN106683152B (en) * 2016-11-16 2019-09-20 腾讯科技(深圳)有限公司 3D visual effect analogy method and device
CN109427100A (en) * 2017-08-29 2019-03-05 深圳市掌网科技股份有限公司 A kind of assembling fittings method and system based on virtual reality
CN107413048B (en) * 2017-09-04 2020-10-27 网易(杭州)网络有限公司 Processing method and device in VR game process
CN107957781B (en) * 2017-12-13 2021-02-09 北京小米移动软件有限公司 Information display method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101859580A (en) * 2009-04-03 2010-10-13 索尼公司 Messaging device, information processing method and program
CN104285243A (en) * 2012-05-09 2015-01-14 Nec卡西欧移动通信株式会社 3d image display device, cursor display method of same, and computer program
CN104598035A (en) * 2015-02-27 2015-05-06 北京极维客科技有限公司 Cursor display method based on 3D image display, intelligent equipment and intelligent system
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103064514A (en) * 2012-12-13 2013-04-24 航天科工仿真技术有限责任公司 Method for achieving space menu in immersive virtual reality system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101859580A (en) * 2009-04-03 2010-10-13 索尼公司 Messaging device, information processing method and program
CN104285243A (en) * 2012-05-09 2015-01-14 Nec卡西欧移动通信株式会社 3d image display device, cursor display method of same, and computer program
CN104598035A (en) * 2015-02-27 2015-05-06 北京极维客科技有限公司 Cursor display method based on 3D image display, intelligent equipment and intelligent system
CN105159522A (en) * 2015-07-22 2015-12-16 深圳多新哆技术有限责任公司 Method for response of virtual reality display device to operation of peripheral device

Also Published As

Publication number Publication date
CN105159522A (en) 2015-12-16
CN105159522B (en) 2018-03-13

Similar Documents

Publication Publication Date Title
WO2017012360A1 (en) Method for response of virtual reality display device to operation of peripheral device
US10657716B2 (en) Collaborative augmented reality system
US10095458B2 (en) Information processing apparatus, information processing method, non-transitory computer-readable storage medium, and system
JP6186415B2 (en) Stereoscopic image display method and portable terminal
US11275481B2 (en) Collaborative augmented reality system
US9766793B2 (en) Information processing device, information processing method and program
US9619105B1 (en) Systems and methods for gesture based interaction with viewpoint dependent user interfaces
KR20230048152A (en) Methods for manipulating objects in the environment
KR20210087921A (en) Haptic effect generation for space-dependent content
JP6392881B2 (en) Low latency visual response to input by pre-generation of alternative graphic representations of application elements and input processing of graphic processing units
JP2007293429A (en) Image browsing device, control method and program of computer
KR101690034B1 (en) Apparatus and method for rendering object in 3d graphic terminal
US10990240B1 (en) Artificial reality system having movable application content items in containers
US20140089859A1 (en) Equipment control device, operation reception method, and program
US9986225B2 (en) Techniques for cut-away stereo content in a stereoscopic display
KR20160014601A (en) Method and apparatus for rendering object for multiple 3d displays
JP3242079U (en) Floating image display device and floating image display system
US11195320B2 (en) Feed-forward collision avoidance for artificial reality environments
KR20220036974A (en) Methods, systems, and media for rendering immersive video content with foveated meshes
CN114138106A (en) Transitioning between states in a mixed virtual reality desktop computing environment
US11373271B1 (en) Adaptive image warping based on object and distance information
US20230147561A1 (en) Metaverse Content Modality Mapping
KR20180046793A (en) Method and system for providing 3D desktop
JP2017134803A (en) Information processing device, and information processing method
JP2019032713A (en) Information processing device, information processing method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16827051

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16827051

Country of ref document: EP

Kind code of ref document: A1