WO2018192394A1

WO2018192394A1 - Interaction method and apparatus for virtual reality scene, storage medium and electronic apparatus

Info

Publication number: WO2018192394A1
Application number: PCT/CN2018/082512
Authority: WO
Inventors: 沈超
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2017-04-20
Filing date: 2018-04-10
Publication date: 2018-10-25
Also published as: CN107145227B; CN107145227A

Abstract

An interaction method and apparatus for a virtual reality scene, a storage medium and an electronic apparatus. The method comprises: determining, from objects displayed in a virtual reality scene, initial target objects that are allowed to collide with rays, wherein the rays are displayed in the virtual reality scene (S202); detecting, from the initial target objects, a final target object that collides with the rays (S204); and operating a control selected by the rays in the final target object (S206). The solution solves the technical problem in the related art that interaction with an object in a virtual reality scene is yet not achieved.

Description

Interactive method and device for virtual reality scene, storage medium and electronic device

The present application claims priority to Chinese Patent Application No. 2017102637592, filed on Apr. 20, 2017, the entire disclosure of which is incorporated herein by reference. In the application.

Technical field

The present application relates to the field of computers, and in particular, to a method and device for interacting with a virtual reality scene, a storage medium, and an electronic device.

Background technique

Today, in order to make the user experience immersive, really feel the things in the three-dimensional space. More and more application developers are beginning to pay attention to applications in virtual reality scenarios. Among them, Virtual Reality (VR) technology is a virtual world that uses computer simulation to generate a three-dimensional space, providing users with various sensory simulation experiences. When users perform movement, the computer uses complex three-dimensional operations to enhance users. The true presence of the three-dimensional world.

Currently, interaction methods commonly used in related technologies include: mouse interaction. Among them, the mouse interaction for any program selection includes:

1) For the two-dimensional world, the displayed object has a corresponding position on the two-dimensional (2D) screen, and the interaction process with the object can be realized by clicking the position of the object on the 2D screen by the mouse.

2) For the three-dimensional world displayed by the flat panel display, first select a point A on the two-dimensional (2D) screen, and then obtain the selected point A corresponding to the three-dimensional (3D) space corresponding to the 2D screen. The position B in the 3D virtual space, through the point A and the position B, can determine the object to be interacted, so as to realize the interaction process of the three-dimensional world displayed in the flat display by mouse interaction. That is to say, the interactive interaction in the three-dimensional world displayed by the flat panel display still reflects the objects in the two-dimensional plane space. During the interaction, the mouse still interacts with the objects in the two-dimensional plane space.

However, the mouse interaction mode provided in the related art is mainly applied to interact with an object displayed in a two-dimensional plane space, and a three-dimensional object in a virtual reality VR scene does not provide a simplified interaction mode.

In response to the above problems, no effective solution has been proposed yet.

Summary of the invention

The embodiments of the present application provide a method and device for interacting with a virtual reality scenario, a storage medium, and an electronic device, so as to at least solve the technical problem that the related art cannot perform interaction with an object in a virtual reality scenario.

According to an aspect of the embodiments of the present application, an interaction method of a virtual reality scene is provided, including: determining, in an object displayed in a virtual reality scene, an initial target object that is allowed to collide with a ray, wherein the virtual reality scene is The ray is displayed; a final target object colliding with the ray is detected in the initial target object; and the control selected by the ray in the final target object is operated.

According to another aspect of the embodiments of the present application, there is also provided an interaction device for a virtual reality scene, comprising: a determining unit configured to determine, in an object displayed in the virtual reality scene, an initial target object that allows collision with the ray, Wherein the ray is displayed in the virtual reality scene; the detecting unit is configured to detect a final target object colliding with the ray in the initial target object; and the operating unit is configured to select the ray in the final target object The controls operate.

According to still another aspect of an embodiment of the present application, there is provided an electronic device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor is executed by the computer program The steps in any of the above method embodiments.

According to still another aspect of an embodiment of the present application, there is also provided a storage medium having stored therein a computer program, wherein the computer program is configured to execute the steps of any one of the method embodiments described above.

In the embodiment of the present application, after the initial target object that allows collision with the ray is determined in the object displayed in the virtual reality scene, wherein the ray is displayed in the virtual reality scene, and the ray is detected in the initial target object. The final target object in which the collision occurred, operates on the control selected by the ray in the final target object. Thereby, the final target object to be interacted in the virtual reality scene is acquired from the initial target object by the ray collision detection, so as to achieve the purpose of operating the control in the final target object in the ray selection, thereby overcoming the related technology. The problem of precise interaction of objects in a virtual reality scene. Further, the ray collision detection realizes interaction with objects in the virtual reality scene, and simplifies the interaction operation, without using a hardware device such as a mouse to perform complex interaction operations, thereby improving the interaction efficiency while ensuring the accuracy of the interaction. Effect.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

1 is a schematic diagram of a hardware environment of an interaction method of a virtual reality scenario according to an embodiment of the present application;

2 is a flowchart of an optional interaction method of a virtual reality scene according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an optional interaction method of a virtual reality scene according to an embodiment of the present application; FIG.

4 is a schematic diagram of another optional interaction method of a virtual reality scene according to an embodiment of the present application;

FIG. 5 is a schematic diagram of still another optional interaction method of a virtual reality scene according to an embodiment of the present application; FIG.

FIG. 6 is a schematic diagram of still another optional interaction method of a virtual reality scene according to an embodiment of the present application; FIG.

FIG. 7 is a schematic diagram of still another optional interaction method of a virtual reality scene according to an embodiment of the present application; FIG.

FIG. 8 is a schematic diagram of an optional virtual reality scene interaction apparatus according to an embodiment of the present application; FIG.

FIG. 9 is a structural block diagram of an interaction terminal of a virtual reality scenario according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is an embodiment of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope shall fall within the scope of the application.

It should be noted that the terms "first", "second" and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

Application According to an aspect of an embodiment of the present application, an embodiment of an interaction method of the above virtual reality scenario is provided. As an optional implementation manner, the interaction method of the virtual reality scenario may be, but is not limited to, applied to the device 102 for implementing virtual reality (VR) scenario interaction in the application environment as shown in FIG. Displaying an object to be interacted, and determining an initial target object that allows collision with the ray in the object displayed in the virtual reality scene, wherein the ray is displayed in the virtual reality scene; and the final collision with the ray is detected in the initial target object The target object; then the controls in the ray selection in the final target object are manipulated.

In this embodiment, after the initial target object that allows collision with the ray is determined in the object displayed in the virtual reality scene, wherein the ray is displayed in the virtual reality scene, and the ray occurrence is detected in the initial target object. The final target object of the collision, which operates on the controls selected by the ray in the final target object. Thereby, the final target object to be interacted in the virtual reality scene is acquired by the ray collision detection, so as to achieve the purpose of operating the control in the final target object in the ray selection, thereby overcoming the object in the virtual reality scene in the related art. The problem of precise interaction.

Optionally, in this embodiment, the foregoing apparatus for implementing virtual reality scene interaction may include, but is not limited to, at least one of the following: VR glasses, and other hardware devices for implementing virtual reality scene interaction. The above is only an example, and the embodiment does not limit this.

According to an embodiment of the present application, a method for interacting a virtual reality scenario is provided. As shown in FIG. 2, the method includes:

S202. Determine, in an object displayed in the virtual reality scene, an initial target object that is allowed to collide with the ray, where the ray is displayed in the virtual reality scene;

S204: detecting a final target object that collides with the ray in the initial target object;

S206: Operate the control selected in the ray of the final target object.

Optionally, in this embodiment, the interaction method of the virtual reality scenario may be, but is not limited to, being applied to a virtual reality interactive application using a virtual reality device. For example, the virtual reality interaction application may include but is not limited to virtual reality. Games, virtual reality video playback, virtual reality shopping, and more. The above is only an example, and is not limited in this embodiment. The virtual reality device may include, but is not limited to, VR glasses. Further, the above interaction process may be, but is not limited to, interacting with objects in a plane in a virtual reality scene, for example, as shown in FIG. 3, which is shown in the dotted line box as VR glasses (device 102 for virtual reality scene interaction). The displayed virtual reality scene content: the object A to the object E to be interacted in the two-dimensional plane, wherein the final target object colliding with the ray is the object E; further, in the embodiment, the interaction process may be It is not limited to interacting with a three-dimensional character object in a virtual reality scene. For example, as shown in FIG. 4, the virtual reality scene content displayed in the VR glasses (the device 102 of the virtual reality scene interaction) is shown in the dotted line box: The object P to be interacted, the object X, the object Y, and the object Z are displayed in the three-dimensional space, wherein the final target object colliding with the ray is the object Y. The above is only an example, and is not limited in this embodiment.

It should be noted that, in this embodiment, after the initial target object that is allowed to collide with the ray is determined in the object displayed in the virtual reality scene, wherein the ray is displayed in the virtual reality scene, and then in the initial target object. A final target object that collides with the ray is detected, and the control selected in the ray of the final target object is operated. Thereby, the final target object to be interacted in the virtual reality scene is acquired from the initial target object by the ray collision detection, so as to achieve the purpose of operating the control in the final target object in the ray selection, thereby overcoming the related technology. The problem of precise interaction of objects in a virtual reality scene. Further, the ray collision detection realizes interaction with objects in the virtual reality scene, and simplifies the interaction operation, without using a hardware device such as a mouse to perform complex interaction operations, thereby improving the interaction efficiency while ensuring the accuracy of the interaction. Effect.

Further, in the present embodiment, the above collision detection (also referred to as collision detection) generally refers to a method of determining whether two or more objects generate an intersection. It can be applied to video games and other computational physics, as well as to artificial intelligence. In addition to being used to determine if two objects have collided, it can also be used to calculate the time of impact (TOI) and to obtain the location of the object's cross collision.

Optionally, in this embodiment, determining, in the object displayed in the virtual reality scene, the initial target object that is allowed to collide with the ray comprises: determining, according to the object type of the object, a target object having a corresponding relationship with the ray type of the ray Type to determine the object of the target object type as the initial target object that is allowed to collide with the ray. Thereby, the mapping relationship between the ray type and the object type is used to determine the initial target object that is allowed to collide with the ray, so as to avoid the ray-independent object participating in the interactive judgment process in the virtual reality scene, reducing the judgment time, thereby achieving simplified interaction. Determine the effect of the step.

Optionally, in the embodiment, detecting the final target object that collides with the ray in the initial target object includes: traversing each initial target object, and detecting whether the space occupied by each initial target object in the virtual reality scene is There is a portion that coincides with the ray; an initial target object having a portion that coincides with the ray is determined as the final target object.

It should be noted that, in this embodiment, the ray may be, but is not limited to, a vector having a start point and an end point. The foregoing detecting whether the space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray may but not It is limited to: detecting whether or not the point in the vector formed by the above-mentioned rays is included in the space. That is to say, the space occupied by the virtual reality scene and each point position on the ray are respectively detected by collision, so as to accurately determine the effect of the final target object colliding with the ray. In addition, if the multi-frame picture is displayed in the virtual reality scene, in the embodiment, the collision detection may be performed for each frame to determine whether the space occupied by the virtual reality scene includes the above-mentioned rays. Points in the vector to ensure the accuracy of collision detection.

Optionally, in the embodiment, the operations performed by using the ray may include, but are not limited to, a click operation, a move operation, a selection operation, and the like. The execution event corresponding to the above operation may include, but is not limited to, at least one of the following:

1) Enter event (Enter): The ray starts to point to an object, and compares the change of the hit object list of the ray of the previous frame and the previous frame to see if there is a newly added object, triggering the event of the newly added object;

2) Leave event: The ray leaves to point to an object, and compares the change of the hit list of the ray of the previous frame and the previous frame to see if there is a newly deleted object, triggering the event of the newly deleted object;

3) Pressing the event (TouchDown): the ray pointing control, when pressing the interactive button, triggers the event of all objects in the interaction list;

4) LiftUp: The ray pointing control, when the interactive button is raised, triggers the events of all objects in the interaction list;

5) Move: The ray moves on each control in the final target object, triggering events for all objects in the interaction list.

6) Other: For some special events, such as drag events triggered by drag operations, and so on.

It should be noted that the above controls may be, but are not limited to, a series of pre-made functional controls for constructing an interface, such as buttons, check boxes, sliders, progress bars, and the like. The above is only an example, and is not limited in this embodiment.

With the embodiment provided by the present application, after the initial target object that allows the collision with the ray is determined in the object displayed in the virtual reality scene, the ray is displayed in the virtual reality scene, and then detected in the initial target object. The final target object in which the ray collides, operating on the ray-selected controls in the final target object. Thereby, the final target object to be interacted in the virtual reality scene is acquired from the initial target object by the ray collision detection, so as to achieve the purpose of operating the control in the final target object in the ray selection, thereby overcoming the related technology. The problem of precise interaction of objects in a virtual reality scene.

As an alternative, determining an initial target object that is allowed to collide with the ray in the object displayed in the virtual reality scene includes:

S1, obtaining an object type of the object;

S2, determining, in the object type, a target object type having a correspondence relationship with a ray type of the ray;

S3, determining an object of the type of the target object type as an initial target object in the object.

Alternatively, in the present embodiment, the type of the object that allows collision with the ray is set as the target object type, represented by the object collision object, and the type of the ray for collision detection is represented by a laser collision object. The above is only an example, and is not limited in this embodiment.

It should be noted that, in the embodiment, the collision mode for performing the ray collision detection may be, but not limited to, using the collision bounding box in the related art, and detecting the collision surrounding by surrounding the detected individual with the collision bounding box. Whether the box has an intersection, and in the case of an intersection, it is detected as a collision. The foregoing is only an example. In this embodiment, the manner of collision detection is not limited, and other collision detection methods may also be adopted.

Through the embodiment provided by the present application, by classifying the objects in the virtual reality scene by type, collision detection is performed on the target object type corresponding to the ray type, thereby directly skipping the object that is not the target object type. The detection reaches the number of objects that reduce the collision detection by the ray, and the effect of greatly reducing the time consumption of the collision detection is realized, thereby achieving the effect of simplifying the interactive judgment step.

As an alternative, detecting the final target object that collides with the ray in the initial target object includes:

S1, performing the following steps on each object in the initial target object, wherein the initial target object is regarded as the current target object when performing the following steps:

S11, detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray;

S12. If the space has a portion that coincides with the ray, the current target object is determined as the final target object.

Optionally, in this embodiment, the traversal determination process may be performed on the initial target object determined to be the target object type, where each initial target object is respectively used as the current target object: detecting the current target object in the virtual reality Whether the space occupied by the scene has a portion coincident with the ray; the initial target object of the portion where the ray coincides is determined as the final target object.

It should be noted that, in this embodiment, the ray may be, but is not limited to, a vector having a starting point and an ending point. In this embodiment, the detecting whether the space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray may be, but is not limited to, detecting whether the space includes a point in the vector formed by the ray. That is to say, the space occupied by the virtual reality scene and each point position on the ray are respectively detected by collision, so as to accurately determine the effect of the final target object colliding with the ray. The space occupied by the current target object in the virtual reality scene may be, but is not limited to, as shown in FIG. 3 . Taking the object E as an example, the space occupied by the object E in the virtual reality scene is a rectangular plane area; As shown in FIG. 4, taking the object Y as an example, the space occupied by the object Y in the virtual reality scene is a three-dimensional space occupied by the character character Y in the three-dimensional space.

Specifically, the following example is used. For example, taking the object E shown in FIG. 3 as an example, if it is detected that there is a cross between the rectangular plane regions corresponding to the object E, it is possible to detect that the object E has a portion overlapping with the ray, and the object can be detected. E is determined as the final target object. For example, taking the object Y shown in FIG. 4 as an example, if it is detected that the three-dimensional space occupied by the persona Y corresponding to the object Y intersects, it is possible to detect that the object Y has a portion overlapping with the ray, and the object Y can be detected. Determined as the final target object.

Through the embodiment provided by the present application, by traversing each initial target object, it is sequentially determined whether the space occupied by each initial target object in the virtual reality scene has a portion overlapping with the ray, so as to accurately detect the interaction for the interaction according to the determination result. The ultimate target object ensures the accuracy of the interaction.

As an optional solution, detecting whether the space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray includes:

S1, detecting whether the space contains a point on the ray, wherein the ray comprises: a starting point and an ending point, and the direction of the ray is directed from the starting point to the end point;

S2, if it is detected that the space includes a point on the ray, it is determined that there is a portion where the space overlaps with the ray.

Optionally, in the embodiment, the ray may be, but is not limited to, a directional vector including a starting point and an ending point. Wherein, the starting point may be, but not limited to, a position where a ray is emitted in a virtual reality scene, and an end point is a position that arrives after extending a certain distance according to a direction indicated by the ray, and collision detection is required at each position on the ray.

For example, as shown in FIG. 5, assuming that the starting point takes the position of the finger in the virtual reality scene (as indicated by Hand Position) as an example, according to the extended distance of the ray set in advance (as indicated by Max Distance), the corresponding point is obtained. The end point (as indicated by the Max Range Position) detects whether the space occupied by the object Y includes the point on the above-mentioned ray according to the direction of the finger. For example, as shown in FIG. 6 , the collision detection result indicates that the stereoscopic space occupied by the persona Y corresponding to the object Y intersects with the ray (the starting point is the Hand Position and the end point is the Max Range Position), and the intersection point is as shown in FIG. 6 . When the position is displayed, it is possible to detect that the object Y has a portion overlapping with the ray, and the object Y can be determined as the final target object.

Optionally, in this embodiment, the end point is determined by determining the end point in the virtual reality scene according to the position of the starting point in the virtual reality scene, the direction vector for indicating the direction, and the predetermined determined distance range value. s position.

For example, as shown in FIG. 7, the formula for determining the end point of the above ray is as follows:

Max Range Position=Hand Position+Hand Forward Vector*Max Distance

Wherein, the above Hand Forward Vector is used to represent a unit vector of a ray direction. That is to say, on the three-dimensional coordinates of the starting point, the three-dimensional coordinates of the extending distance in the ray direction are superimposed, thereby obtaining the three-dimensional coordinates of the end point.

Through the embodiment provided by the present application, by detecting whether the space includes a point on the ray, it is possible to detect whether the space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray, that is, in the virtual reality scene. The space occupied and the position of each point on the ray are respectively detected by collision, so as to accurately determine the effect of the final target object colliding with the ray, thereby ensuring the accuracy of the collision detection, thereby achieving the effect of improving the interaction accuracy.

As an alternative, operating the controls selected in the ray selection in the final target object includes:

S1, in the final target object, select a control at a position where the ray coincides with the final target object;

S2, operate on the control.

Optionally, in this embodiment, the operation of the control includes:

S21. When detecting that the interactive button corresponding to the virtual reality scene is pressed, determining that the start click event is detected;

S22. When detecting that the interactive button corresponding to the virtual reality scene is raised, determining that the end click event is detected;

S23, when the start click event and the end click event are detected, the control is clicked.

Optionally, in this embodiment, the objects in the virtual reality scene may include, but are not limited to, an object designed by an Unreal Mobile UI designer (referred to as a UMG object), and an object in the target object type.

It should be noted that, in this embodiment, if a UMG object collides with the ray, the UMG-related control logic needs to be called. For example, in the UE4 environment, for the UMG object, the Widget's On series function is used to trigger. The widget's event response is to achieve compatibility with the general game engine for UMG support. That is to say, the virtual reality content developer can use the general UI production method to create a user interface (UI) menu for the virtual reality scene, and the menu can be directly applied to the virtual reality scene for interaction. Further, in the present embodiment, if the UPG object is collided with the ray, but the object in the target object type, the interaction can be performed with reference to the interactive mode described in the embodiment.

Optionally, in the embodiment, the operations performed by using the ray may include, but are not limited to, a click operation, a move operation, a selection operation, and the like. The above is only an example, and is not limited in this embodiment. For example, taking a click operation as an example can be, but is not limited to, determined by the following events:

1) PressDown: The ray points to the control. When the interactive button is pressed, the events of all objects in the interactive list are triggered. For the UMG directly call the Widget already exists, the On series function triggers the existing callback mechanism, and for others, customizes the callback function of the event;

2) LiftUp: The ray pointing control, when the interactive button is raised, triggers the events of all objects in the interaction list. For the UMG directly call the Widget already exists, the On series function triggers the existing callback mechanism, and for others, customizes the callback function of the event.

That is, when it is detected that the interactive button corresponding to the virtual reality scene is pressed, it is determined that the start click event is detected; when it is detected that the interactive button corresponding to the virtual reality scene is raised, it is determined that the end click is detected Event; then confirm the click on the control when it detects the start click event and the end click event.

For example, in FIG. 5, when the selected object Y is the final target object, the position where the ray coincides with the final target object (such as the right foot of the object Y) is selected, and then the coincident position (such as the right foot of the object Y) is selected. The control performs a click operation, for example, detecting a start click event in which the interactive button is pressed and an end click event when the interactive button is raised, and then confirming that the click operation is performed on the above control. Thereby, the interactive control of the right foot of the character character Y corresponding to the object Y is realized, for example, by clicking the right foot to control the raising of the right foot to perform the kicking action. The above is only an example, and is not limited in this embodiment.

Through the embodiment provided by the present application, the control is operated by selecting a control at a position where the ray coincides with the final target object in the final target object. Thereby, the interaction between the object and the object is completed by the ray in the virtual reality scene to ensure the interaction accuracy.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present application is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present application. In the following, those skilled in the art should also understand that the embodiments described in the specification are optional embodiments, and the actions and modules involved are not necessarily required by the present application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present application.

According to another aspect of the embodiments of the present application, an interaction apparatus for implementing a virtual reality scenario of the interaction method of the virtual reality scenario described above is further provided. As shown in FIG. 8, the apparatus may include:

1) a determining unit 802, configured to determine, in an object displayed in the virtual reality scene, an initial target object that allows collision with the ray, wherein the ray is displayed in the virtual reality scene;

2) a detecting unit 804 configured to detect a final target object colliding with the ray in the initial target object;

3) An operation unit 806, configured to operate on the control selected by the ray in the final target object.

Optionally, in this embodiment, the interaction device of the virtual reality scenario may be, but is not limited to, being applied to a virtual reality interactive application using a virtual reality device. For example, the virtual reality interaction application may include, but is not limited to, virtual reality. Games, virtual reality video playback, virtual reality shopping, and more. The above is only an example, and is not limited in this embodiment. The virtual reality device may include, but is not limited to, VR glasses. Further, the above interaction process may be, but is not limited to, interacting with objects in a plane in a virtual reality scene, for example, as shown in FIG. 3, which is shown in the dotted line box as VR glasses (device 102 for virtual reality scene interaction). Displaying the virtual reality scene content: displaying the object A to the object E to be interacted in the two-dimensional plane, wherein the final target object colliding with the ray is the object E; further, in the embodiment, the interaction process may be It is not limited to interacting with a three-dimensional character object in a virtual reality scene. For example, as shown in FIG. 4, the virtual reality scene content displayed in the VR glasses (the device 102 of the virtual reality scene interaction) is shown in the dotted line box: The object P to be interacted, the object X, the object Y, and the object Z are displayed in the three-dimensional space, wherein the final target object colliding with the ray is the object Y. The above is only an example, and is not limited in this embodiment.

As an alternative, the determining unit 802 includes:

1) Get the module, set to get the object type of the object;

2) a first determining module, configured to determine, in the object type, a target object type having a corresponding relationship with a ray type of the ray;

3) The second determining module is configured to determine an object of the type of the target object type as an initial target object in the object.

As an alternative, the detecting unit 804 includes:

1) A processing module, configured to perform the following steps on each object in the initial target object, wherein the initial target object is treated as the current target object when performing the following steps:

S1, detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray;

S2, if the space has a portion that coincides with the ray, the current target object is determined as the final target object.

As an optional solution, the processing module implements the following steps to detect whether the space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray:

Optionally, in this embodiment, the processing module determines the end point by determining the end point according to the position of the starting point in the virtual reality scene, the direction vector for indicating the direction, and the predetermined determined distance range value. The location in the virtual reality scene.

Max Range Position=Hand Position+Hand Forward Vector*Max Distance

As an alternative, the operating unit 806 includes:

1) Select the module, set to control the position where the ray coincides with the final target object in the final target object;

2) The operation module is set to operate on the control.

Optionally, in this embodiment, the operation module includes:

(1) a first determining submodule configured to determine that a start click event is detected when detecting that an interactive button corresponding to the virtual reality scene is pressed;

(2) a second determining submodule configured to determine that an end click event is detected when detecting that the interactive button corresponding to the virtual reality scene is raised;

(3) The third determining sub-module is configured to perform a click operation on the control when the start click event and the end click event are detected.

It should be noted here that the above modules are the same as the examples and application scenarios implemented by the corresponding steps, but are not limited to the contents disclosed in the above embodiment 1. It should be noted that the foregoing module may be implemented in a hardware environment as shown in FIG. 1 as part of the device, and may be implemented by software or by hardware, where the hardware environment includes a network environment.

According to still another aspect of the embodiments of the present application, there is also provided an electronic device, wherein the electronic device comprises: a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the virtual reality scene described above by using a computer program Interactive method. For example, the electronic device may be an interactive terminal of a virtual reality scenario for implementing the interaction method of the virtual reality scenario. As shown in FIG. 9, the terminal includes:

1) a communication interface 902, configured to acquire a ray displayed in a virtual reality scene;

2) The processor 904 is connected to the communication interface 902, and is configured to determine, in the object displayed in the virtual reality scene, an initial target object that allows collision with the ray, wherein the ray is displayed in the virtual reality scene; A final target object that collides with the ray is detected in the target object; and is also set to operate on the ray selected control in the final target object;

3) a display 906, connected to the processor 904, configured as a real ray, an initial target object, and a final target object;

4) The memory 908 is connected to the communication interface 902, the processor 904, and the display 906, and is configured to store the initial target object, the final target object, and the ray position information.

For example, the specific examples in this embodiment may refer to the examples described in Embodiment 1 and Embodiment 2, and details are not described herein again.

A person of ordinary skill in the art may understand that all or part of the steps of the foregoing embodiments may be completed by a program to instruct terminal device related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may be Including: flash disk, read-only memory (ROM), random access memory (RAM), disk or optical disk.

Optionally, those skilled in the art can understand that the structure shown in FIG. 9 is only illustrative, and the terminal may also be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palmtop computer, and a mobile Internet device (Mobile Internet). Devices, MID), PAD and other equipment. Fig. 9 does not limit the structure of the above terminal. For example, the terminal may also include more or less components (such as a network interface, etc.) than shown in FIG. 9, or have a different configuration than that shown in FIG.

The memory 908 can be used to store software programs and modules, such as the interactive method of the virtual reality scene and the program instructions/modules corresponding to the device in the embodiment of the present invention. The processor 904 runs the software program and the module stored in the memory 908. Thereby performing various functional applications and data processing, that is, implementing the above-described interactive method of the virtual reality scene. Memory 908 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 908 can further include memory remotely located relative to processor 904, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The communication interface 902 described above is for receiving or transmitting data via a network. Specific examples of the above network may include a wired network and a wireless network. In one example, communication interface 902 includes a Network Interface Controller (NIC) that can be connected to other network devices and routers via a network cable to communicate with the Internet or a local area network. In one example, the communication interface 902 is a Radio Frequency (RF) module for communicating with the Internet wirelessly.

Specifically, the memory 908 is configured to store content such as a target object, a correspondence relationship between a ray type and a target object type, and the like.

According to still another aspect of an embodiment of the present application, a storage medium is also provided. Optionally, in this embodiment, the foregoing storage medium may be located on at least one of the plurality of network devices in the network shown in the foregoing embodiment.

Optionally, in the present embodiment, the storage medium is arranged to store a computer program for performing the following steps:

S1. Determine an initial target object that is allowed to collide with the ray in the object displayed in the virtual reality scene, where the ray is displayed in the virtual reality scene;

S2, detecting a final target object that collides with the ray in the initial target object;

S3, operates on the control selected by the ray in the final target object.

S1, obtaining an object type of the object;

S2, determining, in the object type, a target object type corresponding to the ray type of the ray;

S1, performing the following steps on each object in the initial target object, wherein the initial target object is regarded as the current target object when performing the following steps;

S2, detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping with the ray;

S3. If the space has a portion that coincides with the ray, the current target object is determined as the final target object.

S1. Determine a position of the end point in the virtual reality scene according to the position of the starting point in the virtual reality scene, the direction vector for indicating the direction, and the predetermined determined distance range value.

S2, operate on the control.

S1. When detecting that the interactive button corresponding to the virtual reality scene is pressed, determining that the start click event is detected;

S2. When detecting that the interactive button corresponding to the virtual reality scene is raised, determining that the end click event is detected;

S3, when the start click event and the end click event are detected, the control is clicked.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store computer programs, such as a disc or an optical disc.

The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

The integrated unit in the above embodiment, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in the above-described computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, or the whole or part of the technical solution, which is stored in the storage medium, including The instructions are used to cause one or more computer devices (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.

In the above-mentioned embodiments of the present application, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The above description is only an alternative embodiment of the present application, and it should be noted that those skilled in the art can make several improvements and retouchings without departing from the principles of the present application. It should also be considered as the scope of protection of this application.

Industrial applicability

Claims

A method for interacting with a virtual reality scene includes:

Determining, in an object displayed in the virtual reality scene, an initial target object that allows collision with the ray, wherein the ray is displayed in the virtual reality scene;

Detecting a final target object colliding with the ray in the initial target object;

Manipulating the control selected in the ray in the final target object.
The method of claim 1, wherein determining, in the object displayed in the virtual reality scene, an initial target object that allows collision with the ray comprises:

Get the object type of the object;

Determining, in the object type, a target object type having a corresponding relationship with a ray type of the ray;

An object of the type of the target object type is determined as the initial target object in the object.
The method of claim 1, wherein detecting a final target object colliding with the ray in the initial target object comprises:

Performing the following steps on each of the initial target objects, wherein the initial target object is considered to be the current target object when performing the following steps:

Detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping the ray;

If the space has a portion that coincides with the ray, the current target object is determined as the final target object.
The method according to claim 3, wherein detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping the ray comprises:

Detecting whether the space contains a point on the ray, wherein the ray comprises: a starting point and an ending point, and a direction of the ray is directed from the starting point to the end point;

If it is detected that the space contains a point on the ray, it is determined that the space has a portion that coincides with the ray.
The method of claim 4 wherein said endpoint is determined by the following steps:

Determining a position of the end point in the virtual reality scene according to a location of the starting point in the virtual reality scene, a direction vector indicating the direction, and a predetermined determined distance range value.
The method according to any one of claims 1 to 5, wherein operating the control selected in the ray in the final target object comprises:

Selecting, in the final target object, a control at a position where the ray coincides with the final target object;

Operate on the control.
The method of claim 6 wherein operating the control comprises:

When it is detected that the interactive button corresponding to the virtual reality scene is pressed, it is determined that the start click event is detected;

When it is detected that the interactive button corresponding to the virtual reality scene is raised, it is determined that the end click event is detected;

When the start click event and the end click event are detected, the control is clicked.
An interactive device for a virtual reality scene includes:

a determining unit configured to determine, in an object displayed in the virtual reality scene, an initial target object that is allowed to collide with the ray, wherein the ray is displayed in the virtual reality scene;

a detecting unit configured to detect, in the initial target object, a final target object that collides with the ray;

An operating unit configured to operate on a control selected by the ray in the final target object.
The apparatus of claim 8 wherein said determining unit comprises:

Obtaining a module, configured to obtain an object type of the object;

a first determining module, configured to determine, in the object type, a target object type that has a corresponding relationship with a ray type of the ray;

And a second determining module configured to determine, in the object, an object of the type of the target object as the initial target object.
The apparatus of claim 8 wherein said detecting unit comprises:

A processing module configured to perform the following steps on each of the initial target objects, wherein the initial target object is considered a current target object when performing the following steps:

Detecting whether a space occupied by the current target object in the virtual reality scene has a portion overlapping the ray;

If the space has a portion that coincides with the ray, the current target object is determined as the final target object.
The apparatus according to claim 10, wherein the processing module detects whether a space occupied by the current target object in the virtual reality scene has a portion overlapping the ray by detecting:

Detecting whether the space contains a point on the ray, wherein the ray comprises: a starting point and an ending point, and a direction of the ray is directed from the starting point to the end point;

If it is detected that the space contains a point on the ray, it is determined that the space has a portion that coincides with the ray.
The apparatus according to claim 11, wherein said processing module determines said end point by the following steps:

Determining a position of the end point in the virtual reality scene according to a location of the starting point in the virtual reality scene, a direction vector indicating the direction, and a predetermined determined distance range value.
The apparatus according to any one of claims 8 to 12, wherein the operation unit comprises:

Selecting a module, configured to select, in the final target object, a control at a position where the ray coincides with the final target object;

An operation module, configured to operate on the control.
The apparatus of claim 13 wherein said operational module comprises:

a first determining submodule configured to determine that a start click event is detected when detecting that an interactive button corresponding to the virtual reality scene is pressed;

a second determining submodule, configured to determine that an end click event is detected when detecting that the interactive button corresponding to the virtual reality scene is raised;

The third determining submodule is configured to perform a click operation on the control when the start click event and the end click event are detected.
A storage medium having stored therein a computer program, wherein the computer program is arranged to execute the method of any one of claims 1 to 7 at runtime.
An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to perform the method of any one of claims 1 to 7 by the computer program.