WO2024060959A1 - Method and apparatus for adjusting viewing picture in virtual environment, and storage medium and device - Google Patents

Abstract

Provided in the present disclosure are a method and apparatus for adjusting a viewing picture in a virtual environment, and a storage medium and a device. The method comprises: displaying a virtual environment, wherein a ray cursor and a video viewing area are presented in the virtual environment, and the ray cursor points to the direction of the video viewing area, and forms a first included angle with the video viewing area; in response to dragging control information, dragging the video viewing area on the basis of the initial position of the ray cursor and the first included angle; and on the basis of the current dragging position of the video viewing area in the virtual environment, determining a video picture, which is displayed in the video viewing area. In the present disclosure, dragging modes for three-dimensional spaces in a 2D video, a VR180 video and a VR360 video are designed, such that a user can experience the fascination of a virtual reality (VR) space and different viewing angles in the field of videos, thereby improving the immersive experience of viewing in the VR space.

Description

Viewing picture adjustment method, device, storage medium and equipment in virtual environment

This application claims priority from Chinese Patent Application No. 202211146244.1 submitted on September 20, 2022. The disclosure of the above Chinese patent application is hereby cited in its entirety as part of this application.

Technical field

Embodiments of the present disclosure relate to a method, device, storage medium and equipment for adjusting viewing images in a virtual environment.

Background technique

Currently, in 2D video, VR180 video, VR360 video and other viewing modes, the video screen is displayed in a fixed position and a fixed frame, which cannot well reflect the immersive experience of viewing in the virtual reality space. Users Poor experience.

Contents of the invention

Embodiments of the present disclosure provide a method, device, storage medium, and equipment for adjusting viewing images in a virtual environment. A drag and drop method for three-dimensional space of 2D video, VR180 video, and VR360 video is designed to allow users to experience the VR space. The charm and different viewing perspectives in the video field enhance the immersive experience of watching movies in the virtual reality space.

On the one hand, embodiments of the present disclosure provide a method for adjusting a viewing image in a virtual environment. The method includes:

Display a virtual environment, with a ray cursor and a video viewing area presented in the virtual environment, wherein the ray cursor points in the direction of the video viewing area and forms a first angle with the video viewing area;

In response to the drag control information and based on the initial position of the ray cursor and the first angle, drag the video viewing area;

Based on the current drag position of the video viewing area in the virtual environment, the video picture displayed in the video viewing area is determined.

In some embodiments, dragging the video viewing area in response to the drag control information and based on the initial position of the ray cursor and the first angle includes:

In response to the drag control information, the initial position of the ray cursor is taken as the origin of the spherical space, and the first included angle is fixed, and the video viewing area is dragged along the spherical surface of the spherical space.

In some embodiments, if the viewing mode of the virtual environment is a two-dimensional video viewing mode, the video viewing area is a virtual screen, and the virtual screen is in a display state before responding to the drag control information. ;

The dragging of the video viewing area along the spherical surface of the spherical space includes:

Drag the virtual screen along the spherical surface of the spherical space in at least one direction of the x-axis direction and the y-axis direction.

In some embodiments, the method further includes:

If the virtual screen is dragged along the spherical surface of the spherical space in the y-axis direction to the top or bottom of the y-axis direction, the virtual screen is controlled to flip 180 degrees around the center of the virtual screen.

In some embodiments, the method further includes:

If the virtual screen is dragged along the spherical surface of the spherical space to the virtual ground in the virtual environment, and a mold-crossing situation occurs between the virtual screen and the virtual ground, the virtual ground is hidden.

In some embodiments, the method further includes:

During the dragging process, control the highlighted display of the border of the virtual screen;

When the dragging is completed, the frame of the virtual screen is controlled to return to normal display.

In some embodiments, determining the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment includes:

Based on the current drag position of the virtual screen in the virtual environment, it is determined that the video picture displayed in the video viewing area is a two-dimensional video played in full screen, wherein the virtual screen is displayed at the current drag position. The video picture and the video picture displayed on the virtual screen at the drag starting position are both two-dimensional videos played in full screen.

In some embodiments, if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area is a viewing frame of a preset ratio. Before dragging the control information, the viewfinder frame is in a hidden state;

In response to the drag control information, taking the initial position of the ray cursor as the origin of the spherical space, fixing the first included angle, and dragging the video viewing area along the spherical surface of the spherical space includes:

In response to the drag control information, control the viewfinder frame to be displayed in the virtual environment;

Taking the initial position of the ray cursor as the origin of the spherical space, fixing the first included angle, and dragging the viewfinder frame along the spherical surface of the spherical space in the x-axis direction.

In some embodiments, the method further includes:

During the dragging process, control the area in the virtual environment except the viewfinder to display the mask layer;

When the dragging is completed, the viewfinder frame and the mask layer are hidden.

In some embodiments, the method further includes:

Stop dragging when the distance value of the left boundary of the viewfinder beyond the left boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The left border moves to the left border of the viewfinder frame; or

Stop dragging when the distance value of the right boundary of the viewfinder beyond the right boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The right border moves to the right border of the viewfinder frame.

In some embodiments, before responding to the reset visual field control instruction, the method further includes:

Reset visual field prompt information is displayed in the viewfinder, and the reset visual field prompt information is used to prompt the subject to input the reset visual field control instruction.

In some embodiments, determining the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment includes:

Based on the current drag position of the viewfinder frame in the virtual environment, it is determined that the video picture displayed by the viewfinder frame is the video map corresponding to the current drag position in the panoramic video, wherein the viewfinder frame is in The video picture displayed at the current dragging position is different from the video picture displayed at the dragging starting position of the viewfinder.

In some embodiments, the method further includes: during the dragging process, hiding the ray cursor and displaying the cursor focus of the ray cursor located on the video viewing area.

In some embodiments, the method further includes:

If the drag control information is drag control information generated based on the keys of the object manipulation interactive device, then in response to the drag control information, vibration prompt information is sent to the interactive device, and the vibration prompt information is used to indicate The interactive device vibrates to indicate that the drag operation is triggered.

In some embodiments, the method further includes:

If the drag control information is drag control information generated based on the object's bare hand gesture, then in response to the drag control information, voice prompt information is issued, and the voice prompt information is used to prompt that the drag operation is triggered.

On the other hand, embodiments of the present disclosure provide a device for adjusting viewing images in a virtual environment. The device includes:

A display unit is used to display a virtual environment. A ray cursor and a video viewing area are presented in the virtual environment. The ray cursor points in the direction of the video viewing area and forms a space between the ray cursor and the video viewing area. The first included angle;

A control unit, configured to respond to the drag control information and drag the video viewing area based on the initial position of the ray cursor and the first angle;

A determining unit configured to determine the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment.

On the other hand, embodiments of the present disclosure provide a computer-readable storage medium that stores a computer program, and the computer program is suitable for loading by a processor to execute the steps described in any of the above embodiments. A method for adjusting the viewing screen in a virtual environment.

On the other hand, embodiments of the present disclosure provide a virtual reality device. The virtual reality device includes a processor and a memory. A computer program is stored in the memory. The processor invokes the computer program stored in the memory. A program used to execute the viewing picture adjustment method in a virtual environment as described in any of the above embodiments.

On the other hand, embodiments of the present disclosure provide a computer program product, including a computer program. When the computer program is executed by a processor, the method for adjusting a viewing image in a virtual environment as described in any of the above embodiments is implemented.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those skilled in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

FIG1 is a schematic diagram of a flow chart of a method for adjusting a movie viewing image in a virtual environment provided by an embodiment of the present disclosure;

Figure 2 is a schematic diagram of the first application scenario of the method for adjusting the viewing picture in a virtual environment provided by an embodiment of the present disclosure;

FIG3 is a schematic diagram of a second application scenario of the method for adjusting a movie viewing image in a virtual environment provided by an embodiment of the present disclosure;

Figure 4 is a schematic diagram of the third application scenario of the method for adjusting the viewing picture in a virtual environment provided by an embodiment of the present disclosure;

Figure 5 is a schematic diagram of the fourth application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 6 is a schematic diagram of the fifth application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 7 is a schematic diagram of the sixth application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 8 is a schematic diagram of the seventh application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 9 is a schematic diagram of the eighth application scenario of the method for adjusting the viewing picture in a virtual environment provided by an embodiment of the present disclosure;

Figure 10 is a schematic diagram of the ninth application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 11 is a schematic diagram of the tenth application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

Figure 12 is a schematic diagram of an eleventh application scenario of the viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure;

FIG13 is a schematic diagram of a twelfth application scenario of the method for adjusting a movie viewing image in a virtual environment provided by an embodiment of the present disclosure;

FIG14 is a schematic diagram of the structure of a device for adjusting a viewing image in a virtual environment provided by an embodiment of the present disclosure;

Figure 15 is a first structural schematic diagram of a virtual reality device provided by an embodiment of the present disclosure; and

Figure 16 is a second structural schematic diagram of a virtual reality device provided by an embodiment of the present disclosure.

Detailed ways

The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only some of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without making creative efforts fall within the scope of protection of this disclosure.

Embodiments of the present disclosure provide a method, device, computer-readable storage medium, virtual reality device, server, and computer program product for adjusting a viewing image in a virtual environment. Specifically, the viewing picture adjustment method in the virtual environment of the embodiment of the present disclosure can be executed by a virtual reality device or a server.

The disclosed embodiments can be applied to various application scenarios such as Extended Reality (XR), Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR).

First, some nouns or terms that appear in the description of the embodiments of the present disclosure are explained as follows:

Extended Reality (XR) is a concept that includes Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR), which means that the virtual world is connected to the real world. environment, technology that enables users to interact with that environment in real time.

Virtual Reality (VR), a technology for creating and experiencing virtual worlds, calculates and generates a virtual environment, which is a kind of multi-source information (the virtual reality mentioned in this article at least includes visual perception, and can also include auditory perception, Tactile perception, motion perception, and even taste perception, smell perception, etc.), realizing the integration of virtual environment, interactive three-dimensional dynamic vision and simulation of entity behavior, immersing users in simulated virtual reality In the environment, it can be used in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair, etc.

Augmented Reality (AR) is a method in which the camera's posture parameters in the real world (or three-dimensional world, real world) are calculated in real time during the process of camera image collection. A technique for adding virtual elements to images. Virtual elements include, but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to connect the virtual world to the real world on the screen for interaction.

Mixed Reality (MR) is a simulated set that integrates computer-created sensory input (e.g., virtual objects) with sensory input from the physical set or its representation. In some MR sets, the computer-created sensory input can be adapted to the sensory input from the physical set. Changes in sensory input to the physical set. Additionally, some electronic systems used to render the MR scenery may monitor orientation and/or position relative to the physical scenery to enable virtual objects to interact with real objects (i.e., physical elements from the physical scenery or representations thereof). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

Augmented Virtuality (AV): AV scenery refers to a computer-created scenery or virtual scenery that incorporates at least one sensory input from the physical scenery to simulate the scenery. The one or more sensory inputs from the physical setting may be a representation of at least one feature of the physical setting. For example, a virtual object may take on the color of a physical element captured by one or more imaging sensors. As another example, virtual objects may exhibit characteristics consistent with actual weather conditions in the physical scene, as identified via weather-related imaging sensors and/or online weather data. In another example, an augmented reality forest can have virtual trees and structures, but the animals can have features accurately recreated from images taken of physical animals.

Virtual field of view, the area in the virtual environment that the user can perceive through the lens in the virtual reality device, uses the field of view (Field Of View, FOV) of the virtual field of view to represent the perceived area.

Virtual reality equipment, a terminal that realizes virtual reality effects, can usually be provided in the form of glasses, helmet-mounted displays (HMD), and contact lenses to achieve visual perception and other forms of perception. Of course, virtual reality equipment realizes The form is not limited to this, and can be further miniaturized or enlarged as needed.

The virtual reality devices recorded in the embodiments of the present disclosure may include but are not limited to the following: type:

Computer-based virtual reality (PCVR) devices use the PC to perform relevant calculations and data output for virtual reality functions. External computer-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

Mobile virtual reality equipment supports setting up a mobile terminal (such as a smartphone) in various ways (such as a head-mounted display with a special card slot), and through a wired or wireless connection with the mobile terminal, the mobile terminal performs virtual reality Function-related calculations and output data to mobile virtual reality devices, such as viewing virtual reality videos through mobile terminal APPs.

The all-in-one virtual reality device has a processor for performing calculations related to virtual functions, so it has independent virtual reality input and output functions. It does not need to be connected to a PC or mobile terminal, and has a high degree of freedom in use.

Each is explained in detail below. It should be noted that the description order of the following embodiments is not used to limit the priority order of the embodiments.

Each embodiment of the present disclosure provides a method for adjusting the viewing image in a virtual environment. The method can be executed by a terminal or a server, or can be executed jointly by a terminal and a server. The embodiments of the present disclosure use the method of adjusting the viewing image in a virtual environment The method is explained by taking the execution of the terminal (virtual reality device) as an example.

Please refer to Figures 1 to 13. Figure 1 is a schematic flowchart of a viewing picture adjustment method in a virtual environment provided by an embodiment of the present disclosure. Figures 2 to 13 are schematic diagrams of relevant application scenarios provided by an embodiment of the present disclosure, wherein, The blank background in Figure 2 can be a three-dimensional virtual space layer. The method includes:

Step 110: Display a virtual environment with a ray cursor and a video viewing area presented in the virtual environment. The ray cursor points in the direction of the video viewing area and forms a first cursor with the video viewing area. angle.

For example, as shown in FIG. 2 , a virtual environment 10 is displayed. A ray cursor 11 and a video viewing area 12 are presented in the virtual environment 10 . The ray cursor 11 points in the direction of the video viewing area 12 and is connected to the video viewing area 12 . forming a first included angle α. For example, in order to enrich the presentation of the virtual environment 10 , a virtual handle 13 can be presented at the starting position 111 of the ray cursor 11 , and there is a beam emitting in the direction of the video viewing area 12 directly in front of the virtual handle 13 . A first included angle α is formed between the line cursor 11, the ray cursor 11 and the video viewing area 12. The first included angle α is the included angle formed by the ray cursor 11 and the plane where the video viewing area 12 is located.

In 2D, the viewing area is the video panel (hereinafter referred to as the virtual screen) in the background; in VR180 and VR360, the viewing area is the visual focus area, which is the corresponding viewfinder when dragging subsequently.

Among them, the ray cursor 11 and the video viewing area 12 presented in the virtual environment 10 can be displayed normally or hidden. For example, if the viewing mode of the virtual environment 10 is a two-dimensional video viewing mode, the video viewing area 12 can be a virtual screen. Before the virtual screen is dragged and during the dragging process, the virtual screen can be in The display state is used to simulate that the object (the object can be a user) is in a movie viewing scene such as a cinema; the ray cursor 11 can be in the display state before the virtual screen is dragged, and the ray cursor 11 can be displayed while the virtual screen is being dragged. In a hidden state; for example, if a virtual handle 13 is also present at the starting position 111 of the ray cursor 11, the virtual handle 13 can be in a displayed state before the virtual screen is dragged. can be hidden. For example, if the viewing mode of the virtual environment 10 is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area 12 can be a viewfinder with a preset ratio (equivalent to the user's visual focus area in the virtual environment). ), before the viewfinder is dragged, the viewfinder can be hidden to simulate that the user is in a panoramic video scene, and the entire virtual environment displays panoramic video; while the viewfinder is being dragged, the viewfinder It can be in a display state; the ray cursor 11 can be in a display state before the viewfinder frame is dragged, and the ray cursor 11 can be in a hidden state while the viewfinder frame is being dragged; for example, if the starting position 111 of the ray cursor 11 is still If the virtual handle 13 is present, the virtual handle 13 can be in a displayed state before the viewfinder frame is dragged, and the virtual handle 13 can be in a hidden state while the viewfinder frame is being dragged.

Step 120: Drag the video viewing area in response to the drag control information and based on the initial position of the ray cursor and the first angle.

For example, the drag control information generated by the keys of the interactive device can be manipulated based on the object. For example, a virtual environment can be displayed on the display of a virtual reality device. The virtual reality device can be connected to an external interactive device, and the virtual environment can be driven by controlling the buttons of the interactive device. The ray cursor in the environment can be controlled to control the drag operation of the ray cursor driver on the video viewing area in response to the drag control information. For example, the interactive device may include a handle, a digital glove, a specific interactive device, etc.

For example, drag control information can be generated based on an object's bare hand gesture. The drag operation of the ray cursor driver on the video viewing area can be controlled in response to the drag control information.

In some embodiments, dragging the video viewing area in response to the drag control information and based on the initial position of the ray cursor and the first angle includes:

In response to the drag control information, the initial position of the ray cursor is taken as the origin of the spherical space, and the first included angle is fixed, and the video viewing area is dragged along the spherical surface of the spherical space.

For example, as shown in FIG. 3 , a spherical space 20 can be provided, and the spherical space 20 serves as a viewing container. When entering the viewing mode, the movie can be viewed in the viewing container of the spherical space 20 . When responding to the drag control information, taking the starting position 111 of the ray cursor 11 as the origin A of the spherical space 20 and fixing the first angle α between the ray cursor 11 and the plane where the video viewing area 12 is located, along the spherical surface The spherical surface of space 20 drags the video viewing area 12. By controlling the cursor focus 112 of the ray cursor 11 to be located in the draggable video viewing area, and along the x direction and/or the y axis direction, human-computer interaction can be performed in the spherical space to realize dragging of the viewing screen.

For example, a cubic space can also be set up as a viewing container. When entering the viewing mode, the viewing can be performed in the viewing container of the cubic space. When responding to the drag control information, the initial position of the ray cursor is taken as the center point of the cube space, and the first angle between the ray cursor and the plane where the video viewing area is located is fixed, and the video viewing area is dragged along the surface of the cube space. shadow area. The cursor focus of the control ray cursor is located in the draggable video viewing area, and along the x direction and/or y axis direction, human-computer interaction can be performed in the cubic space to realize dragging of the viewing screen.

In some embodiments, if the viewing mode of the virtual environment is a two-dimensional video viewing mode, the video viewing area is a virtual screen, and the virtual screen is in a display state before responding to the drag control information; dragging the video viewing area along the spherical surface of the spherical space includes: dragging the virtual screen along the spherical surface of the spherical space in at least one direction of the x-axis direction and the y-axis direction.

For example, if the viewing mode of the virtual environment is a two-dimensional (2D) video viewing mode, the video viewing area is a virtual screen, and before responding to the drag control information, the virtual screen is in a display state. For example, the 2D video viewing mode can refer to the virtual environment 10 shown in Figure 2 or Figure 4. The virtual environment 10 is presented with a ray cursor 11 and a video viewing area 12 (ie, a virtual screen 121), where the ray cursor 11 points to direction of the video viewing area 12 and forming a first included angle α with the video viewing area 12 . For example, in order to enrich the presentation of the virtual environment 10 , a virtual handle 13 can be presented at the starting position 111 of the ray cursor 11 , and directly in front of the virtual handle 13 there is a ray emitting in the direction of the video viewing area 12 (ie, the virtual screen 121 ). A first included angle α is formed between the cursor 11, the ray cursor 11 and the video viewing area 12 (ie, the virtual screen 121).

For example, in the 2D video viewing mode, the drag trigger condition includes that the ray cursor 11 points to the video viewing area 12 (ie, the virtual screen 121 ), and the cursor focus 112 of the ray cursor 11 is in the video viewing area 12 (ie, the virtual screen 121 ), the video viewing area 12 (i.e., the virtual screen 121) can be understood as the video hot zone range, and the object generates drag control information by long-pressing the preset button in the interactive device (such as a handle), and the virtual reality device obtains When the drag control information is received, the displacement of the ray cursor 11 in the x/y axis direction can be controlled to be greater than or equal to xdp in response to the drag control information to drag the video viewing area 12 (ie, the virtual screen 121).

For example, x in xdp is a dynamic value. The size of the rebound can be set according to the strength of the user's drag, and different values can be assigned in different scenarios. Among them, dp is a density-independent pixel, which is an abstract unit based on screen density. On a display with 160 dots per inch, 1dp=1px.

For example, the preset keys may include a Grip key, a Trigger key, an A/X key (the same function as Trigger), etc.

For example, before responding to the drag control information, in addition to the above-mentioned drag triggering conditions, an interaction avoidance condition may also be set. For example, the interaction avoidance condition includes any of the following: dragging occurs when the "settings panel" pops up; dragging occurs when the "settings panel" disappears. Among them, one of the above two is selected for interaction avoidance, such as setting the dragging to occur when the "settings panel" pops up, or setting the dragging to occur when the "settings panel" disappears.

For example, when there is a web page interaction conflict, the interaction avoidance conditions can also include: drag and drop When triggered, "video viewing area drag and drop" will be executed first, and "web page interaction" will not be executed.

For example, in the 2D video viewing mode, when responding to the drag control information, the drag object is the video viewing area 12 (ie, the virtual screen 121 ), and the dragged video viewing area 12 (ie, the virtual screen 121 ), the video picture displayed in the video viewing area 12 (ie, the virtual screen 121) is a 2D full-screen video. During the dragging process, the first angle α between the ray cursor 11 and the video viewing area 12 (ie, the virtual screen 121 ) is fixed, and the video viewing area 12 (ie, the virtual screen 121 ) is dragged by moving the ray cursor 11 .

As shown in FIG. 3 , in the 2D video viewing mode, the video viewing area 12 (ie, the virtual screen 121 ) is dragged along the spherical surface of the spherical space 20 in at least one direction of the x-axis direction and the y-axis direction. ), that is, the x-y spherical full-degree-of-freedom mobile video viewing area 12 (ie, the virtual screen 121). Specifically, the starting position 111 of the ray cursor 11 is the origin A of the spherical space 20 , the ray cursor 11 is the radius of the spherical space 20 , and the first intersection between the ray cursor 11 and the video viewing area 12 (ie, the virtual screen 121 ) is fixed. Angle α is the position of the spherical moving landing point B (x-axis coordinate and y-axis coordinate), that is, the content seen by the subject on the display screen of the virtual reality device is always the position of point B tangent to the spherical surface of the spherical space 20, The first included angle α remains unchanged during dragging. For example, the line segment AB in the figure represents the ray cursor 11 shot from the virtual handle 13 to the video viewing area 12 (ie, the virtual screen 121).

For example, during the dragging process, the RotationZ (lateral rotation) value of the video viewing area is always 0.

As shown in FIG. 5 , during dragging, the center point of the virtual screen 121 moves along the spherical surface of the spherical space 20 in at least one direction of the x-axis direction and the y-axis direction.

In some embodiments, the method further includes: if the virtual screen is dragged along the spherical surface of the spherical space in the y-axis direction to the top or bottom of the y-axis direction, controlling the virtual screen to surround the spherical surface of the spherical space. The center of the virtual screen is flipped 180 degrees.

For example, in the 2D video viewing mode, after the y-axis direction reaches the top/bottom, the virtual screen is controlled to flip 180°. For example, always ensure that in the y-axis direction, the top margin of the virtual screen >= the bottom margin of the virtual screen. When dragging to the top margin of the virtual screen = the bottom margin of the virtual screen (drag to the top/bottom), at the same time Responds to dragging and performs a 180° flip around the center point of the virtual screen.

For example, as shown in Figure 6, when dragging, the center point of the virtual screen 121 moves along the spherical space. The spherical surface of space 20 moves in the y-axis direction, and the center point of the virtual screen 121 is tangent to the spherical surface. During the dragging process, when the virtual screen 121 is dragged to the top or bottom of the y-axis direction, the virtual screen 121 is controlled. Perform a 180° flip, and if the drag operation continues, it will continue to respond to the drag's displacement changes after the flip.

In some embodiments, the method further includes: if the virtual screen is dragged along the spherical surface of the spherical space to the virtual ground in the virtual environment, and the virtual screen and the virtual ground encounter a mold-crossing situation. , then the virtual ground is hidden.

For example, as shown in FIG. 2 , in the 2D video viewing mode, when the virtual screen 121 is dragged to cross the mold with the virtual ground 14 , the virtual ground 14 disappears, and the scene becomes a scene without the virtual ground 14 . Among them, when the virtual ground 14 disappears, a smooth dragging experience can be ensured by setting disappearance processing conditions. For example, the disappearance processing condition can be that when the virtual ground 14 is penetrated by the virtual screen 121, the virtual ground 14 is controlled to gradually disappear based on the dragging speed. When the virtual screen 121 completely passes through the virtual ground 14, the virtual ground 14 is completely hidden.

In some embodiments, the method further includes:

During the dragging process, control the highlighted display of the border of the virtual screen;

When the dragging is completed, the frame of the virtual screen is controlled to return to normal display.

For example, in the 2D video viewing mode, during the dragging process, as shown in FIG. 7 , the border 1211 of the virtual screen 121 is highlighted. For example, when dragging ends, the border of the virtual screen returns to the nominal state. For example, during the dragging process, the handle connected to the virtual reality device will vibrate; when the drag ends, the handle will stop vibrating.

For example, a reset field of view instruction can be generated by long-pressing the "Home" key to reset the field of view in response to the reset field of view instruction and reset the position of the virtual screen to a default position in the field of view.

As shown in Figure 8, when the playback control Bar 15 and the setting panel 16 are displayed, if the cursor focus of the ray cursor is within the virtual screen 121 and drag is triggered outside the area shown in the setting panel 16, the virtual screen 121 remains Respond to the drag operation; when dragging, the playback control Bar 15 and the settings panel 16 can be temporarily hidden.

In some embodiments, if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area is a viewfinder of a preset proportion. In response to the drag control information Before, the viewfinder was in a hidden state; in response to dragging The control information takes the initial position of the ray cursor as the origin of the spherical space, fixes the first included angle, and drags the video viewing area along the spherical surface of the spherical space, including:

In response to the drag control information, control the viewfinder frame to be displayed in the virtual environment;

Taking the initial position of the ray cursor as the origin of the spherical space, fixing the first included angle, and dragging the viewfinder frame along the spherical surface of the spherical space in the x-axis direction.

For example, if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area is a viewing frame with a preset ratio. Before responding to the drag control information, the viewing frame is hidden. For example, the viewfinder frame with a preset ratio may be a 16:9 viewfinder frame. For example, the viewfinder frame may be an area of 1280*720.

For example, in a 180-degree or 360-degree panoramic video viewing mode, the drag trigger conditions include that the ray cursor points to the video viewing area (i.e., the viewfinder frame), and the cursor focus of the ray cursor is in the video viewing area (i.e., the viewfinder frame) Within, the video viewing area (i.e., the viewfinder) can be understood as the video hot zone range (the video hot zone range can also be understood as the visual focus area in the immersive experience), and the object is in the interactive device (such as a handle) by long pressing The preset keys generate drag control information, and when the virtual reality device obtains the drag control information, it can control the displacement of the ray cursor in the x/y axis direction to be greater than or equal to xdp in response to the drag control information to drag the video Viewing area (i.e. viewing frame).

For example, the preset keys may include a Grip key, a Trigger key, an A/X key (the same function as Trigger), etc.

For example, before responding to the drag control information, in addition to the above drag trigger conditions, interaction avoidance conditions can also be set. For example, interaction avoidance conditions include any of the following: dragging when the "Settings Panel" pops up; dragging when the "Settings Panel" pops up; dragging when the "Settings Panel" and "Immersion Bar" disappear; "Immersion Bar" is displayed Dragging occurs when the "immersion bar" disappears; dragging occurs when the "immersion bar" disappears. Among them, choose one of the above four to avoid interaction.

For example, referring to FIG. 3, in a 180-degree or 360-degree panoramic video viewing mode, the video viewing area 12 in FIG. 3 may be a viewfinder 122. When responding to the drag control information, the dragged object is the video viewing area 12 (i.e., the viewfinder 122), and the video screen displayed in the video viewing area 12 (i.e., the viewfinder 122) following the dragged video viewing area 12 (i.e., the viewfinder 122) is the video map corresponding to the current drag position in the panoramic video. During the dragging process, the fixed ray cursor 11 and the first clip of the video viewing area 12 (i.e., the viewfinder 122) are fixed. Angle α, by moving the ray cursor 11 to drag the video viewing area 12 (ie, the viewfinder 122).

As shown in Figure 3, in the 180-degree or 360-degree panoramic video viewing mode, in the horizontal direction of the x-axis, the starting position 111 of the ray cursor 11 is the origin A of the spherical space 20, and the ray cursor 11 is the spherical space. With a radius of 20, fix the first angle α between the ray cursor 11 and the video viewing area 12 (i.e., the viewing frame 122), move horizontally along the spherical surface of the spherical space 20 and drag the video viewing area 12 (i.e., the viewing frame 122).

In some embodiments, the method further includes:

During the dragging process, control the area in the virtual environment except the viewfinder to display the mask layer;

When the dragging is completed, the viewfinder frame and the mask layer are hidden.

For example, as shown in Figure 9 or Figure 10, in the 180-degree or 360-degree panoramic video viewing mode, during the dragging process, the area in the virtual environment 10 except the viewfinder 122 is controlled to display the mask layer 17, for example , the mask layer 17 can be a black mask layer, or it can be a mask layer of other colors. For example, during the dragging process, only the video map at the corresponding position can be seen within the viewfinder frame 122, and the mask layer 17 outside the viewfinder frame 122 is all displayed in black. At the end of dragging, the viewfinder frame 122 and the mask layer 17 are hidden, and during the immersive experience, the entire immersive video image of the virtual environment 10 is visible. For example, during the dragging process, the handle connected to the virtual reality device will vibrate; when the drag ends, the handle will stop vibrating.

For example, a reset field of view instruction may be generated by long-pressing the "Home" key to reset the field of view in response to the reset field of view instruction and reset the position of the viewfinder frame 122 to a default position in the field of view.

For example, as shown in Figure 11, when the playback control Bar 15 and the setting panel 16 are displayed, if the cursor focus of the ray cursor 11 is within the viewfinder 122 and a drag is triggered outside the area shown in the settings panel 16, the viewfinder will The frame 122 still responds to the drag operation; when dragging, the playback control Bar 15 and the setting panel 16 can be temporarily hidden.

In some embodiments, the method further includes:

Stop dragging when the distance value of the left boundary of the viewfinder beyond the left boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The left border moves to the left border of the viewfinder frame; or

Stop dragging when the distance value of the right boundary of the viewfinder beyond the right boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The right border moves to the right border of the viewfinder frame.

In some embodiments, before responding to the reset visual field control instruction, the method further includes:

Reset visual field prompt information is displayed in the viewfinder, and the reset visual field prompt information is used to prompt the subject to input the reset visual field control instruction.

For example, as shown in Figure 12, if the right boundary of the viewfinder 122 is dragged beyond the right boundary xdp (preset distance value) of the panoramic video, dragging cannot continue. At this time, the video picture displayed in the viewfinder 122 is not Complete, the reset field of view prompt information can be displayed in the viewfinder in the form of a toast message prompt box 1221. For example, the content of the reset field of view prompt message is "Long press the Home button on one handle to reset the field of view" or "Long press the Home button on one handle to reset the field of view" or "Long press the Home button on one handle to reset the field of view". Press the ○ key on one side of the handle to reset the field of view." The subject long presses the Home key or ○ key to trigger the reset vision control instruction through the content of the reset vision prompt information, so that the virtual reality device performs a vision reset operation in response to the reset vision control instruction, such as controlling the left side of a 180-degree panoramic video. Move the border to the left border of the viewfinder, or control the right border of the 180-degree panoramic video to move to the right border of the viewfinder.

For example, the toast message prompt box 1221 is used to display a visual field reset prompt message in the viewfinder 122. The toast message prompt box 1221 does not have any control buttons and will not gain focus and will automatically disappear after a period of time.

For example, when resetting the field of view, the video boundary bounces back to the viewfinder boundary, that is, the left boundary of the video bounces back to the left boundary of the viewfinder, or the right boundary of the video bounces back to the right boundary of the viewfinder. If the boundary of the viewfinder is not dragged beyond the boundary of the video, the toast message prompt box will not appear.

For example, the preset distance value is xdp, and x in xdp is a dynamic value. The size of the rebound can be set according to the user's drag strength, and different values can be assigned in different scenarios.

In some embodiments, the method further includes:

If the drag control information is drag control information generated based on the keys of the object manipulation interactive device, then in response to the drag control information, vibration prompt information is sent to the interactive device, and the vibration prompt information is used to indicate The interactive device vibrates to indicate that the drag operation is triggered.

For example, the interactive device takes a handle as an example. When a drag operation is triggered, a vibration prompt information is sent to the handle. The vibration prompt information is used to indicate that the handle vibrates. The handle generates an instantaneous vibration in response to the vibration prompt information to prompt the object for the drag operation. is triggered. For example, the vibration duration is x seconds, say 3 seconds.

In some embodiments, the method further includes:

If the drag control information is drag control information generated based on the object's bare hand gesture, then in response to the drag control information, voice prompt information is issued, and the voice prompt information is used to prompt that the drag operation is triggered.

For example, when a drag-and-drop operation is triggered, a voice prompt message can be issued, and the voice prompt message is used to prompt that the drag-and-drop operation is triggered.

In some embodiments, the method further includes: during the dragging process, hiding the ray cursor and displaying the cursor focus of the ray cursor located on the video viewing area.

For example, during the dragging process in 2D video viewing mode: the ray cursor 11 can be hidden and only the cursor focus 112 is displayed. The play bar 15 can also be hidden; the non-normal (standard) state can also be displayed in a full-screen video; the video play/pause state displayed on the virtual screen 121 remains unchanged. For example, during the dragging process in the 2D video viewing mode, the virtual environment is displayed as shown in Figure 7, and the video picture displayed in the video viewing area 12 (ie, the virtual screen 121) is a 2D full-screen video.

For example, during the dragging process in the 180-degree or 360-degree panoramic video viewing mode: the ray cursor 11 can be hidden, and only the cursor focus 112 is displayed. The video play/pause state displayed in the viewfinder 122 remains unchanged. For example, during the dragging process in the 180-degree or 360-degree panoramic video viewing mode, the virtual environment is displayed as shown in FIG. 9, and the video screen displayed in the video viewing area 12 (i.e., the viewfinder 122) is the video map corresponding to the dragging position.

Step 130: Determine the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment.

In some embodiments, if the viewing mode of the virtual environment is a two-dimensional video viewing mode, the video viewing area is determined based on the current drag position of the video viewing area in the virtual environment. The video screen displayed in the area includes:

Based on the current drag position of the virtual screen in the virtual environment, it is determined that the video picture displayed in the video viewing area is a two-dimensional video played in full screen, wherein the virtual screen The video picture displayed by the virtual screen at the current dragging position and the video picture displayed by the virtual screen at the dragging starting position are both two-dimensional videos played in full screen.

For example, in the 2D video viewing mode, when the subject releases the long-pressed preset button, a drag end command is generated, so that the virtual reality device responds to the drag end command and cancels the drag. At this time, the virtual screen stays at the current Drag position. As shown in Figure 13, after dragging is completed, the "UI display" of the entire full-screen mode of the virtual screen as a whole keeps the relative positions of the "full-screen bar (bar)", "full-screen video", and "setting panel" unchanged. The full-screen video is a two-dimensional video played in full screen.

Before dragging, during dragging, and after dragging, the video images displayed in the video viewing area in the 2D video viewing mode are all full-screen videos. During the dragging process, the playback or pause state of the video remains unchanged. .

For example, in the 2D video viewing mode, after the drag is completed and the virtual environment is exited, the current drag position is not recorded. The next time you enter the virtual environment, the display shows the default state. For example, the default state represents the initial state of the display system. For example, when a user wears a head-mounted virtual reality device and lies down to watch a movie, the displayed video image will be adjusted to a tilted 45° image (the video image after dragging); but the next time the user wears the virtual reality device, the displayed video image will be The video screen is a normal 90° screen (default state).

For example, the position drag information of the virtual screen may not be recorded, but the zoom information of the ray cursor may be recorded. The scaling information includes the scaling size of the ray cursor, through which the virtual screen can be zoomed in or out based on the screen center point.

In some embodiments, if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the determination is based on the current drag position of the video viewing area in the virtual environment. The video images displayed in the video viewing area include:

Based on the current drag position of the viewfinder frame in the virtual environment, it is determined that the video picture displayed by the viewfinder frame is the video map corresponding to the current drag position in the panoramic video, wherein the viewfinder frame is in The video picture displayed at the current dragging position is different from the video picture displayed at the dragging starting position of the viewfinder.

For example, in a 180-degree or 360-degree panoramic video viewing mode, when the subject releases the long-pressed preset button, a drag end command is generated, so that the virtual reality device responds to the drag end command and cancels the drag. When the viewfinder stays at the current dragging position, and the viewfinder Disappears in the way of Alpha change, and the video picture displayed in the viewfinder remains at the current dragging position for playback. The video picture displayed in the viewfinder is the video map corresponding to the current dragging position in the panoramic video, in which the viewfinder is at the current dragging position. The video screen displayed is different from the video screen displayed at the drag starting position of the viewfinder.

For example, in the VR180° immersive viewing mode, it is a 180° panorama, which is equivalent to a hemisphere. After the subject wears the virtual reality device, he or she can watch the panoramic video in a 180° range. When the video content displayed in the viewfinder is dragged out of the 180° displayable range according to the movement of the viewfinder, there will be a black mask or Alpha gradient to blend with the viewing screen. For example, if the scene is pure black Yes, the viewing screen is in color. When the video content is dragged out 180°, there will be a transition state from the color viewing screen to a pure black scene. This transition state is the Alpha change.

For example, in the 180-degree or 360-degree panoramic video viewing mode, after the drag is completed and the virtual environment is exited, the drag position will not be recorded. The next time you enter the virtual environment, the display shows the default state.

All of the above technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, which will not be described in detail here.

Embodiments of the present disclosure display a virtual environment, and a ray cursor and a video viewing area are presented in the virtual environment, where the ray cursor points in the direction of the video viewing area and forms a first angle with the video viewing area; in response to dragging Drag control information, and drag the video viewing area based on the initial position of the ray cursor and the first angle; determine the video picture displayed in the video viewing area based on the current dragging position of the video viewing area in the virtual environment. The disclosed embodiment designs a drag and drop method for three-dimensional space of 2D video, VR180 video, and VR360 video, which allows users to experience the charm of VR space and different viewing angles in the video field, and improves the viewing experience in virtual reality space. immersive experience.

In order to facilitate better implementation of the viewing image adjustment method in the virtual environment of the embodiment of the present disclosure, the embodiment of the present disclosure also provides a device for adjusting the viewing image in the virtual environment. Please refer to FIG. 14 , which is a schematic structural diagram of a viewing image adjustment device in a virtual environment provided by an embodiment of the present disclosure. Wherein, the viewing screen adjustment device 200 in the virtual environment may include:

The display unit 210 is used to display a virtual environment, wherein the virtual environment presents a ray A cursor and a video viewing area, wherein the ray cursor points in the direction of the video viewing area and forms a first angle with the video viewing area;

The control unit 220 is configured to drag the video viewing area in response to the drag control information and based on the initial position of the ray cursor and the first angle;

The determining unit 230 is configured to determine the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment.

In some embodiments, the control unit 220 is specifically used to:

In response to the drag control information, the initial position of the ray cursor is taken as the origin of the spherical space, and the first included angle is fixed, and the video viewing area is dragged along the spherical surface of the spherical space.

In some embodiments, if the viewing mode of the virtual environment is a two-dimensional video viewing mode, the video viewing area is a virtual screen, and the virtual screen is in a display state before responding to the drag control information. ;

When the control unit 220 drags the video viewing area along the spherical surface of the spherical space, it is specifically configured to: drag the video viewing area along the spherical surface of the spherical space in at least one direction of the x-axis direction and the y-axis direction. Drag the virtual screen.

In some embodiments, the control unit 220 is also configured to: if the virtual screen is dragged along the spherical surface of the spherical space in the y-axis direction to the top or bottom of the y-axis direction, control the The virtual screen is flipped 180 degrees around the center of the virtual screen.

In some embodiments, the control unit 220 is also configured to: if the virtual screen is dragged along the spherical surface of the spherical space to the virtual ground in the virtual environment, and the virtual screen and the virtual ground If a mold-breaking situation occurs, the virtual ground will be hidden.

In some embodiments, the control unit 220 is also used to:

During the dragging process, control the highlighted display of the border of the virtual screen;

When the dragging ends, the border of the virtual screen is controlled to return to normal display.

In some embodiments, the determining unit 230 is specifically used to:

Based on the current drag position of the virtual screen in the virtual environment, it is determined that the video picture displayed in the video viewing area is a two-dimensional video played in full screen, wherein the virtual screen is displayed at the current drag position. The video picture and the video picture displayed on the virtual screen at the drag starting position are both two-dimensional videos played in full screen.

In some embodiments, if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area is a viewfinder of a preset proportion. In response to the drag control information Previously, the viewfinder frame was hidden;

The control unit 220 is used for:

In response to the drag control information, control the viewfinder frame to be displayed in the virtual environment;

Taking the initial position of the ray cursor as the origin of the spherical space, fixing the first included angle, and dragging the viewfinder frame along the spherical surface of the spherical space in the x-axis direction.

In some embodiments, the control unit 220 is further configured to:

During the dragging process, control the area in the virtual environment except the viewfinder to display the mask layer;

When the dragging is completed, the viewfinder frame and the mask layer are hidden.

In some embodiments, the control unit 220 is also used to:

Stop dragging when the distance value of the left boundary of the viewfinder beyond the left boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The left border moves to the left border of the viewfinder frame; or

Stop dragging when the distance value of the right boundary of the viewfinder beyond the right boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The right border moves to the right border of the viewfinder frame.

In some embodiments, before responding to the reset visual field control instruction, the control unit 220 is also configured to:

Reset visual field prompt information is displayed in the viewfinder, and the reset visual field prompt information is used to prompt the subject to input the reset visual field control instruction.

In some embodiments, the determining unit 230 is specifically used to:

Based on the current drag position of the viewfinder frame in the virtual environment, it is determined that the video picture displayed by the viewfinder frame is the video map corresponding to the current drag position in the panoramic video, wherein the viewfinder frame is in The video picture displayed at the current dragging position is different from the video picture displayed at the dragging starting position of the viewfinder.

In some embodiments, the control unit 220 is further configured to hide the ray cursor and display the cursor focus of the ray cursor located on the video viewing area during the dragging process.

In some embodiments, the control unit 220 is further configured to:

If the drag control information is drag control information generated based on the keys of the object manipulation interactive device, then in response to the drag control information, vibration prompt information is sent to the interactive device, and the vibration prompt information is used to indicate The interactive device vibrates to indicate that the drag operation is triggered.

In some embodiments, the control unit 220 is also configured to: if the drag control information is drag control information generated based on the object's bare hand gesture, when responding to the drag control information, issue a voice prompt Information, the voice prompt information is used to prompt that the drag operation is triggered.

Each unit in the above-mentioned viewing image adjustment device 200 in the virtual environment can be implemented in whole or in part by software, hardware, and combinations thereof. Each of the above-mentioned units may be embedded in or independent of the processor in the virtual reality device in the form of hardware, or may be stored in the memory of the virtual reality device in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned units.

The viewing image adjustment device 200 in the virtual environment can be integrated in a terminal or server that has a storage device and a processor and has computing capabilities, or the viewing image adjustment device 200 in the virtual environment is the terminal or server.

In some embodiments, the present disclosure also provides a virtual reality device, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, it implements the steps in the above method embodiments.

As shown in Figure 15, Figure 15 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present disclosure. The virtual reality device 300 can usually be provided in the form of glasses, a helmet-mounted display (HMD), or a contact lens. It is used to realize visual perception and other forms of perception. Of course, the form of virtual reality equipment is not limited to this, and can be further miniaturized or enlarged as needed. The virtual reality device 300 may include but is not limited to the following components:

Detection module 301: Use various sensors to detect the user's operation commands and act on the virtual environment, such as continuously updating the image displayed on the display screen following the user's line of sight, to achieve user interaction with the virtual and scene, for example, continuously updating the real content based on the detected rotation direction of the user's head.

Feedback module 302: receives data from sensors and provides real-time feedback to the user; wherein, the feedback module 302 may be used to display a graphical user interface, such as displaying a virtual environment on the graphical user interface. For example, the feedback module 302 may include a display screen or the like.

Sensor 303: On the one hand, it accepts operation commands from the user and applies them to the virtual environment; on the other hand, it provides the results of the operation to the user in the form of various feedbacks.

Control module 304: Controls sensors and various input/output devices, including obtaining user data (such as actions, voice) and output sensing data, such as images, vibrations, temperature and sound, etc., to the user, virtual environment and real world Have an effect.

Modeling module 305: Constructs a three-dimensional model of the virtual environment, which can also include various feedback mechanisms such as sound and touch in the three-dimensional model.

In the embodiment of the present disclosure, a virtual environment can be constructed through the modeling module 305, and the virtual environment can be displayed through the feedback module 302. A ray cursor and a video viewing area are presented in the virtual environment, wherein the ray The cursor points in the direction of the video viewing area and forms a first angle with the video viewing area; then the control module 304 responds to the drag control information and based on the initial position of the ray cursor and the At the first included angle, drag the video viewing area; then the control module 304 determines the video picture displayed in the video viewing area based on the current dragging position of the video viewing area in the virtual environment.

In some embodiments, as shown in Figure 16, which is another structural schematic diagram of a virtual reality device provided by an embodiment of the present disclosure, the virtual reality device 300 also includes a processor 310 with one or more processing cores. Or the memory 320 of more than one computer-readable storage medium and the computer program stored on the memory 320 and executable on the processor. Among them, the processor 310 is electrically connected to the memory 320. Those skilled in the art can understand that the structure of the virtual reality device shown in the figures does not constitute a limitation on the virtual reality device, and may include more or fewer components than shown in the figures, or combine certain components, or arrange different components. .

The processor 310 is the control center of the virtual reality device 300. It uses various interfaces and lines to connect various parts of the entire virtual reality device 300, by running or loading software programs and/or modules stored in the memory 320, and by calling the software programs and/or modules stored in the memory 320. The data in 320 performs various functions of the virtual reality device 300 and processes the data, thereby performing virtual reality processing. The actual device 300 performs overall monitoring.

In the embodiment of the present disclosure, the processor 310 in the virtual reality device 300 will follow the following steps to load instructions corresponding to the processes of one or more application programs into the memory 320, and the processor 310 will run the instructions stored in application in memory 320 to implement various functions:

Display a virtual environment, with a ray cursor and a video viewing area presented in the virtual environment, wherein the ray cursor points in the direction of the video viewing area and forms a first angle with the video viewing area; In response to the drag control information, and based on the initial position of the ray cursor and the first angle, drag the video viewing area; based on the current dragging position of the video viewing area in the virtual environment position to determine the video picture displayed in the video viewing area.

For the specific implementation of each of the above operations, please refer to the previous embodiments and will not be described again here.

In some embodiments, processor 310 may include detection module 301, control module 304, and modeling module 305.

In some embodiments, as shown in FIG16 , the virtual reality device 300 further includes: a radio frequency circuit 306, an audio circuit 307, and a power supply 308. The processor 310 is electrically connected to the memory 320, the feedback module 302, the sensor 303, the radio frequency circuit 306, the audio circuit 307, and the power supply 308, respectively. Those skilled in the art will appreciate that the structure of the virtual reality device shown in FIG15 or FIG16 does not constitute a limitation on the virtual reality device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

The radio frequency circuit 306 can be used to send and receive radio frequency signals to establish wireless communication with network equipment or other virtual reality equipment through wireless communication, and to send and receive signals with network equipment or other virtual reality equipment.

The audio circuit 307 can be used to provide an audio interface between the user and the virtual reality device through speakers and microphones. The audio circuit 307 can transmit the electrical signal converted from the received audio data to the speaker, which converts it into a sound signal and outputs it; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received and converted by the audio circuit 307 The audio data is processed by the audio data output processor 301 and then sent to, for example, another virtual reality device via the radio frequency circuit 306, or the audio data is output to the memory for further processing. Audio circuit 307 may also include an earplug jack to provide peripheral headphones with Communication with virtual reality devices.

The power supply 308 is used to power various components of the virtual reality device 300 .

Although not shown in FIG. 15 or FIG. 16 , the virtual reality device 300 may further include a camera, a wireless fidelity module, a Bluetooth module, an input module, etc., which will not be described in detail here.

In some embodiments, the present disclosure also provides a computer-readable storage medium for storing a computer program. The computer-readable storage medium can be applied to a virtual reality device or server, and the computer program causes the virtual reality device or server to execute the corresponding process in the viewing picture adjustment method in a virtual environment in the embodiment of the present disclosure. For simplicity, in This will not be described again.

In some embodiments, the present disclosure also provides a computer program product including a computer program stored in a computer-readable storage medium. The processor of the virtual reality device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the virtual reality device executes the corresponding process in the viewing picture adjustment method in the virtual environment in the embodiment of the present disclosure, For the sake of brevity, no further details will be given here.

The present disclosure also provides a computer program, the computer program includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the virtual reality device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the virtual reality device executes the corresponding process in the viewing picture adjustment method in the virtual environment in the embodiment of the present disclosure, For the sake of brevity, no further details will be given here.

It should be understood that the processor in the embodiment of the present disclosure may be an integrated circuit chip with signal processing capabilities. During the implementation process, each step of the above method embodiment can be completed through an integrated logic circuit of hardware in the processor or instructions in the form of software. The above-mentioned processor can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other available processors. Programmed logic devices, discrete gate or transistor logic devices, discrete hardware components. Each disclosed method, step and logical block diagram in the embodiment of the present disclosure can be implemented or executed. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as hardware translation. The execution of the code processor is completed, or the execution is completed using a combination of hardware and software modules in the decoding processor. The software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

It can be understood that the memory in the embodiments of the present disclosure may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Among them, non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically removable memory. Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. Volatile memory may be Random Access Memory (RAM), which is used as an external cache. By way of illustration, but not limitation, many forms of RAM are available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (Direct Rambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered to be beyond the scope of this disclosure.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure can be embodied in essence or part of the technical solution in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions to enable a virtual reality device ( It may be a personal computer or a server) that executes all or part of the steps of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure. should be covered by the protection scope of this disclosure. Therefore, the protection scope of the present disclosure should be determined by the protection scope of the claims.

Claims (19)

1. A method for adjusting movie viewing images in a virtual environment, including:

   Display a virtual environment, with a ray cursor and a video viewing area presented in the virtual environment, wherein the ray cursor points in the direction of the video viewing area and forms a first angle with the video viewing area;

   In response to the drag control information and based on the initial position of the ray cursor and the first angle, drag the video viewing area;

   Based on the current drag position of the video viewing area in the virtual environment, the video picture displayed in the video viewing area is determined.
2. The method for adjusting viewing images in a virtual environment as claimed in claim 1, wherein the video is dragged in response to the drag control information and based on the initial position of the ray cursor and the first angle. Movie viewing area, including:

   In response to the drag control information, the initial position of the ray cursor is used as the origin of the spherical space, and the first included angle is fixed, and the video viewing area is dragged along the spherical surface of the spherical space.
3. The viewing picture adjustment method in a virtual environment as claimed in claim 2, wherein if the viewing mode of the virtual environment is a two-dimensional video viewing mode, the video viewing area is a virtual screen, and in response to Before dragging control information, the virtual screen is in a display state;

   The dragging of the video viewing area along the spherical surface of the spherical space includes:

   Drag the virtual screen along the spherical surface of the spherical space in at least one direction of the x-axis direction and the y-axis direction.
4. The method for adjusting movie viewing images in a virtual environment as claimed in claim 3, further comprising:

   If the virtual screen is dragged along the spherical surface of the spherical space in the y-axis direction to the top or bottom of the y-axis direction, the virtual screen is controlled to flip 180 degrees around the center of the virtual screen.
5. The method for adjusting the viewing picture in a virtual environment as claimed in claim 3 or 4, further comprising:

   If the virtual screen is dragged along the spherical surface of the spherical space into the virtual environment The virtual ground is hidden, and the virtual screen and the virtual ground are in a mold-crossing situation, the virtual ground is hidden.
6. The method for adjusting the viewing picture in the virtual environment according to any one of claims 3 to 5, further comprising:

   During the dragging process, control the highlighted display of the border of the virtual screen;

   When the dragging is completed, the frame of the virtual screen is controlled to return to normal display.
7. The method for adjusting the viewing picture in a virtual environment according to any one of claims 3 to 6, wherein the determination of the video viewing area is based on the current drag position of the video viewing area in the virtual environment. The video images displayed in the shadow area include:

   Based on the current drag position of the virtual screen in the virtual environment, it is determined that the video picture displayed in the video viewing area is a two-dimensional video played in full screen, wherein the virtual screen is displayed at the current drag position. The video picture and the video picture displayed on the virtual screen at the drag starting position are both two-dimensional videos played in full screen.
8. The method for adjusting viewing images in a virtual environment as claimed in claim 2, wherein if the viewing mode of the virtual environment is a 180-degree or 360-degree panoramic video viewing mode, the video viewing area is a pre-set viewing area. Assume a proportional viewfinder frame, and before responding to the drag control information, the viewfinder frame is in a hidden state;

   In response to the drag control information, the initial position of the ray cursor is used as the origin of the spherical space, and the first included angle is fixed, and the video viewing area is dragged along the spherical surface of the spherical space, include:

   In response to the drag control information, control the viewfinder frame to be displayed in the virtual environment;

   Taking the initial position of the ray cursor as the origin of the spherical space, fixing the first included angle, and dragging the viewfinder frame along the spherical surface of the spherical space in the x-axis direction.
9. The method for adjusting movie viewing images in a virtual environment as claimed in claim 8, further comprising:

   During the dragging process, control the area in the virtual environment except the viewfinder to display the mask layer;

   When the dragging is completed, the viewfinder frame and the mask layer are hidden.
10. The method for adjusting the viewing picture in a virtual environment as claimed in claim 8 or 9, further comprising:

    Stop dragging when the distance value of the left boundary of the viewfinder beyond the left boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The left border moves to the left border of the viewfinder frame; or

    Stop dragging when the distance value of the right boundary of the viewfinder beyond the right boundary of the 180-degree panoramic video reaches a preset distance value, and in response to the reset field of view control instruction, control the 180-degree panoramic video The right border moves to the right border of the viewfinder frame.
11. The method for adjusting the viewing image in the virtual environment as claimed in claim 10, wherein before the response to the reset field of view control instruction, the method for adjusting the viewing image in the virtual environment further includes:

    Reset visual field prompt information is displayed in the viewfinder, and the reset visual field prompt information is used to prompt the subject to input the reset visual field control instruction.
12. The method for adjusting the viewing picture in a virtual environment according to any one of claims 8 to 11, wherein the determination of the video viewing area based on the current drag position of the video viewing area in the virtual environment is The video images displayed in the shadow area include:

    Based on the current drag position of the viewfinder frame in the virtual environment, it is determined that the video picture displayed by the viewfinder frame is the video map corresponding to the current drag position in the panoramic video, wherein the viewfinder frame is in The video picture displayed at the current dragging position is different from the video picture displayed at the dragging starting position of the viewfinder.
13. The method for adjusting the viewing picture in the virtual environment according to any one of claims 1 to 12, further comprising:

    During the dragging process, the ray cursor is hidden, and the cursor focus of the ray cursor located on the video viewing area is displayed.
14. The method for adjusting the viewing picture in the virtual environment according to any one of claims 1-13, further comprising:

    If the drag control information is drag control information generated based on the keys of the object manipulation interactive device, then in response to the drag control information, vibration prompt information is sent to the interactive device, and the vibration prompt information is Instructing the interactive device to vibrate to prompt that the drag operation is triggered.
15. The method for adjusting the viewing picture in the virtual environment according to any one of claims 1-14, further comprising:

    If the drag control information is drag control information generated based on the bare-hand gesture of the object, then in response to the drag control information, voice prompt information is issued, and the voice prompt information is used to prompt that the drag operation is trigger.
16. A device for adjusting movie viewing images in a virtual environment, including:

    A display unit is used to display a virtual environment. A ray cursor and a video viewing area are presented in the virtual environment. The ray cursor points in the direction of the video viewing area and forms a space between the ray cursor and the video viewing area. The first included angle;

    A control unit configured to drag the video viewing area in response to the drag control information and based on the initial position of the ray cursor and the first angle;

    A determining unit configured to determine the video picture displayed in the video viewing area based on the current drag position of the video viewing area in the virtual environment.
17. A computer-readable storage medium stores a computer program, wherein the computer program is suitable for loading by a processor to execute the method for adjusting a viewing picture in a virtual environment as claimed in any one of claims 1-15.
18. A virtual reality device, including a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute any one of claims 1-15 by calling the computer program stored in the memory. The method for adjusting the viewing screen in the virtual environment described in the item.
19. A computer program product includes a computer program, wherein when the computer program is executed by a processor, the method for adjusting a viewing image in a virtual environment according to any one of claims 1 to 15 is implemented.