WO2020029556A1

WO2020029556A1 - Plane adaptation method and device, and computer readable storage medium

Info

Publication number: WO2020029556A1
Application number: PCT/CN2019/073080
Authority: WO
Inventors: 刘昂; 陈怡�
Original assignee: 北京微播视界科技有限公司
Priority date: 2018-08-09
Filing date: 2019-01-25
Publication date: 2020-02-13
Also published as: CN110827412A

Abstract

A plane adaptation method, a plane adaptation device, a plane adaptation hardware device, and a computer readable storage medium. The plane adaptation method comprises: determining the direction of a virtual object in a target plane in a real scene (S1); and adjusting, according to the direction, a placement posture of the virtual object, and displaying the virtual object on a terminal screen, the displayed virtual object adapting to the target plane (S2). By means of said method, firstly a direction of a virtual object in a target plane in a real scene is determined, then a placement gesture of the virtual object is adjusted according to the direction, and the virtual object is displayed on a terminal screen, and the displayed virtual object adapts to the target plane, it is possible to avoid the situation in which a virtual object is suspended in a plane or is in an incorrect posture in a plane during movement, improving the display effect of a terminal.

Description

Method, device and computer-readable storage medium for adaptive plane

cross reference

The present disclosure refers to a Chinese patent application with the application number 201810900637.4, entitled "Method, Apparatus, and Computer-Readable Storage Medium for Adaptive Plane", filed on August 9, 2018, which is incorporated herein by reference in its entirety.

Technical field

The present disclosure relates to the field of information technology, and in particular, to a method, an apparatus, and a computer-readable storage medium for an adaptive plane.

Background technique

Augmented Reality (AR) is a technology that calculates the position and angle of the camera image in real time and adds the corresponding images, videos, and virtual objects. The goal of this technology is to put the virtual world on the screen. Real world and interact.

The implementation method of augmented reality technology is to put a virtual object in a real scene, that is, a real environment and a virtual object are superimposed on the same screen or space in real time. After superimposing, the virtual object will move according to a predetermined motion trajectory, or control the virtual object to perform a predetermined action through controls.

At present, in existing augmented reality scenes, virtual objects are usually placed on a plane in a real scene, such as on a desktop or a wall. The placed virtual objects can be controlled to move between multiple planes. However, when moving, the plane angle is different due to different planes, such as moving from the desktop to the wall. In the prior art, the virtual object is either suspended or kept on the desktop (vertical to the desktop).

For example, as shown in Figure 1, the virtual cylindrical object was originally placed on a horizontal plane, and then moved from the horizontal plane to another vertical plane, but after moving out of the horizontal plane, the virtual cylindrical object is still Keeping the previous posture and the size has not changed, it can be seen from the figure that the virtual cylindrical object is not correctly placed on the vertical plane, which affects the display effect.

Summary of the invention

The technical problem solved by the present disclosure is to provide an adaptive plane method to at least partially solve the technical problem of how to improve the display effect of a virtual object on a terminal. In addition, an adaptive plane device, an adaptive plane hardware device, a computer-readable storage medium, and an adaptive plane terminal are also provided.

To achieve the above objective, according to one aspect of the present disclosure, the following technical solutions are provided:

An adaptive plane method includes:

Determine the direction of the target plane of the virtual object in the real scene;

Adjusting the placement posture of the virtual object according to the direction; and

The virtual object is displayed on a terminal screen, and the displayed virtual object is adapted to the target plane.

Further, the step of adjusting the placement posture of the virtual object according to the direction includes:

Determining a z-axis of the virtual object in a real scene;

Adjust the placement posture of the virtual object so that the z-axis is perpendicular to the target plane, and display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane.

Further, the method further includes:

Controlling the virtual object to move on the initial plane;

If it is determined that the position of the virtual object exceeds the initial plane, triggering the operation of determining the direction of the target plane of the virtual object in the real scene is triggered.

Further, the method further includes:

Identifying multiple planes included in the real scene;

A plane is selected from the identified planes as the target plane.

Further, the step of selecting a plane from the identified planes as the target plane includes:

Displaying the identified plane on the terminal screen, and making the identified plane selectable;

The selected plane is used as the target plane.

Further, the method further includes:

Determining a target display position of the virtual object on a terminal screen;

Determining a target position according to the target display position and the target plane;

The step of adjusting the placement posture of the virtual object according to the direction further includes:

Controlling the virtual object to move to the target position, and adjusting the placement posture of the virtual object according to the direction.

Further, the step of determining a target position according to the target display position and the target plane includes:

Obtaining a line passing through a point at which the target display position is located;

An intersection of the line and the target plane is used as the target position.

Further, the line is perpendicular to a plane on which the terminal screen is located.

Further, the step of determining a target display position of the virtual object on a terminal screen includes:

Detecting a trigger response generated on the terminal screen, and using the generation position of the trigger response as the target display position; or

The target display position to receive the input.

Determine the target plane and target position of the virtual object in the real scene;

Controlling the virtual object to move to the target position, and positioning the virtual object on a surface of the target plane.

Further, the step of determining a target plane of the virtual object in the real scene includes:

Identifying multiple planes included in the real scene;

A plane is selected from the identified planes as the target plane.

The selected plane is used as the target plane.

Further, the step of determining a target position of a virtual object in a real scene includes:

Determining the target position according to the target display position and the target plane;

Further, the step of determining the target position according to the target display position and the target plane includes:

Detecting a first trigger response generated on the terminal screen, and using the generation position of the first trigger response as the target display position; or

The target display position to receive the input.

To achieve the above object, according to another aspect of the present disclosure, the following technical solutions are also provided:

An adaptive plane device includes:

A plane direction determining module, configured to determine a direction of a target plane of a virtual object in a real scene;

An attitude adjustment module is configured to adjust the placement posture of the virtual object according to the direction, and display the virtual object on a terminal screen, and the displayed virtual object is adapted to the target plane.

Further, the attitude adjustment module is specifically configured to:

Determine the z-axis of the virtual object in a real scene; adjust the placement posture of the virtual object so that the z-axis is perpendicular to the target plane, and display the virtual object on the terminal screen, and display The virtual object that comes out is adapted to the target plane.

Further, the device further includes:

A control movement module, configured to control the virtual object to move on an initial plane;

A position determination module is configured to, if it is determined that the position of the virtual object exceeds the initial plane, trigger an operation of determining a direction of a target plane of the virtual object in a real scene.

Further, the device further includes:

A plane identification module is configured to identify a plurality of planes included in the real scene; and select one plane from the identified planes as the target plane.

Further, the plane identification module is specifically configured to:

Displaying the identified plane on the terminal screen and making the identified plane in a selectable state; using the selected plane as the target plane.

Further, the device further includes:

A target position determining module, configured to determine a target display position of the virtual object on a terminal screen; determine a target position according to the target display position and the target plane;

Accordingly, the attitude adjustment module is specifically configured to:

Controlling the virtual object to move to the target position, adjusting the placement posture of the virtual object according to the direction, and displaying the virtual object on a terminal screen, and the displayed virtual object adapts to the Target plane.

Further, the target position determination module is specifically configured to:

Acquiring a line passing through a point at which the target display position is located; and taking an intersection point of the line and the target plane as the target position.

The target display position to receive the input.

An adaptive plane hardware device includes:

Memory for storing non-transitory computer-readable instructions; and

A processor, configured to run the computer-readable instructions, so that the processor, when executed, implements the steps described in any one of the foregoing technical solutions of the adaptive plane.

A computer-readable storage medium is configured to store non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are executed by a computer, cause the computer to execute any one of the foregoing adaptive plane method technical solutions Described steps.

An adaptive plane terminal includes any of the foregoing adaptive plane devices.

Embodiments of the present disclosure provide an adaptive plane method, an adaptive plane device, an adaptive plane hardware device, a computer-readable storage medium, and an adaptive plane terminal. The adaptive plane method includes determining a direction of a target plane of a virtual object in a real scene; adjusting a placement posture of the virtual object according to the direction, and displaying the virtual object on a terminal screen, and displaying the virtual object. The virtual object is adapted to the target plane. The embodiment of the present disclosure first determines the direction of a target plane of a virtual object in a real scene, and then adjusts the posture of the virtual object according to the direction, and displays the virtual object on a terminal screen, and the displayed all The virtual object is adapted to the target plane, which can avoid the situation where the virtual object is suspended in the plane or the posture of the plane is incorrect when moving, and improve the display effect of the terminal.

The above description is only an overview of the technical solutions of the present disclosure. In order to better understand the technical means of the present disclosure, it can be implemented in accordance with the contents of the description, and to make the above and other objects, features, and advantages of the present disclosure more obvious and understandable. The preferred embodiments are described below and described in detail with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a posture for controlling a virtual object to reach a target plane according to the prior art; FIG.

2a is a schematic flowchart of a method for adaptive plane according to an embodiment of the present disclosure;

2b is a schematic diagram of controlling a placement posture of a virtual object to a target plane in a method of adaptive plane according to an embodiment of the present disclosure;

2c is a schematic flowchart of a method for adaptive plane according to another embodiment of the present disclosure;

2d is a schematic flowchart of a method for adaptive plane according to another embodiment of the present disclosure;

FIG. 2e is a schematic diagram of a plane selection state in the method for adaptive plane according to the embodiment shown in FIG. 2a;

2f is a schematic diagram of a selected plane state in the method for adaptive plane according to the embodiment shown in FIG. 2a;

3a is a schematic structural diagram of an adaptive plane device according to an embodiment of the present disclosure;

3b is a schematic structural diagram of an adaptive plane device according to another embodiment of the present disclosure;

4 is a schematic structural diagram of a hardware device of an adaptive plane according to an embodiment of the present disclosure;

5 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of an adaptive plane terminal according to an embodiment of the present disclosure.

detailed description

The embodiments of the present disclosure are described below through specific specific examples. Those skilled in the art can easily understand other advantages and effects of the present disclosure from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, but not all the embodiments. The present disclosure can also be implemented or applied through different specific implementations, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in the present disclosure, all other embodiments obtained by a person having ordinary skill in the art without making creative efforts fall within the protection scope of the present disclosure.

It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that aspects described herein may be embodied in a wide variety of forms and that any specific structure and / or function described herein is merely illustrative. Based on the present disclosure, those skilled in the art should understand that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, any number of the aspects set forth herein may be used to implement a device and / or a practice method. In addition, the apparatus and / or the method may be implemented using other structures and / or functionality than one or more of the aspects set forth herein.

It should also be noted that the illustrations provided in the following embodiments only illustrate the basic idea of the present disclosure in a schematic manner, and only the components related to the present disclosure are shown in the drawings instead of the number, shape and For size drawing, the type, quantity, and proportion of each component can be changed at will in actual implementation, and the component layout type may be more complicated.

In addition, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects may be practiced without these specific details.

In order to solve the technical problem of how to improve the user experience effect, an embodiment of the present disclosure provides an adaptive plane method. As shown in FIG. 2a, the adaptive plane method mainly includes the following steps S1 to S2. among them:

Step S1: Determine the direction of the target plane of the virtual object in the real scene.

The execution subject of this embodiment may be an adaptive plane device provided by an embodiment of the present disclosure, or an adaptive plane hardware device provided by an embodiment of the present disclosure, or an adaptive plane terminal provided by an embodiment of the present disclosure.

Among them, the virtual object may be a three-dimensional model of the real object in the scene.

The target plane is a plane to which a virtual object is to be moved in a real scene, and the plane is a surface of an entity located in the real scene, and may be, for example, but not limited to, a desktop or a wall.

The direction of the target plane can be determined according to the coordinate axis of any direction in the three-dimensional space where the virtual object is located. For example, if the x-axis of the three-dimensional coordinates is used as a reference, the orientation of the target plane can be determined by calculating the angle between the target plane and the x-axis. For example, if the angle is 0, it is determined that the target plane is parallel to the x-axis. If the included angle is an angle greater than 0 and less than 90 degrees, it is determined that the target plane is inclined by a preset angle with respect to the x axis, and if the included angle is 90 degrees, it is determined that the target plane is perpendicular to the x axis.

Step S2: Adjust the posture of the virtual object according to the direction, display the virtual object on the terminal screen, and the displayed virtual object is adapted to the target plane.

The terminal may be, but is not limited to, a mobile terminal (for example, an iPhone, a smart phone, a tablet computer, etc.), or a fixed terminal (for example, a desktop computer). Specifically, the virtual object can be controlled to rotate and / or zoom, and the virtual object can be displayed on the terminal screen, and the displayed virtual object can be adapted to the target plane. Take Figure 1 as an example. According to Figure 1, it can be seen that the virtual cylindrical object was originally placed vertically on a horizontal plane, and then moved to the target plane. As shown in Figure 1, the target plane is placed vertically, so the The virtual cylindrical object can be placed vertically on the vertical plane after being rotated by 90 degrees. The placement position of the virtual cylindrical object finally obtained is shown in FIG. 2b.

In this embodiment, by adopting the above technical solution, by determining the direction of the target plane of the virtual object in the real scene, and then adjusting the orientation of the virtual object according to the direction, and displaying the virtual object on the terminal screen, the displayed virtual object adapts The target plane can avoid the situation where the virtual object is suspended in the plane or the posture is incorrect when the virtual object is moved, and improve the display effect of the terminal.

In an optional embodiment, as shown in FIG. 2c, step S2 may include:

S21: Determine the z-axis of the virtual object in the real scene.

S22: Adjust the posture of the virtual object so that the z-axis is perpendicular to the target plane, and display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane.

As shown in FIG. 1 as an example, it can be seen from FIG. 1 that the initial position of the virtual cylindrical object is that the corresponding z-axis is perpendicular to the horizontal plane, and then it is moved to the target plane, as shown in FIG. 1. The target plane is placed vertically, the direction of the corresponding plane has changed, and its corresponding z-axis is no longer perpendicular to the target plane. Therefore, the virtual cylindrical object's z-axis needs to be perpendicular to the target plane. It is placed vertically on the target plane, and the placement position of the virtual cylindrical object finally obtained is shown in FIG. 2b.

In an optional embodiment, as shown in FIG. 2d, the method in the embodiment of the present disclosure further includes:

S13: Control the virtual object to move on the initial plane.

The initial plane can be selected by the user and is the plane on which the virtual object is initially placed.

Specifically, the virtual screen can be controlled to move on the initial plane by controlling the terminal screen or the terminal. For example, you can use mobile controls to control the movement of virtual objects, such as virtual manipulation buttons to achieve the movement of virtual objects; you can also use your fingers to slide on the terminal screen to control the movement of virtual objects; you can also control the movement of virtual objects by directly moving the terminal, At this time, the virtual object is always located in the center of the terminal screen, and the mobile terminal is equivalent to a mobile virtual model.

In the process of moving a virtual object, you can move the virtual object on the plane without calculating a new position. The movement here can be on the plane in proportion to the above-mentioned movement control, finger movement, or terminal movement; it can also be directly Calculate the new position and move the virtual object to the new position.

S14: If it is determined that the position of the virtual object exceeds the initial plane, trigger an operation to determine the direction of the target plane of the virtual object in the real scene.

Specifically, the edge contour position of the initial plane is recorded in advance, and then it is determined whether the position of the virtual object completely exceeds the initial plane. Specifically, it can be implemented by using the recognition method of the extended plane edge contour in the prior art, for example, using feature points or using texture to identify. Once it is determined that the position of the virtual object exceeds the initial plane, the direction of the target plane is determined.

This embodiment adopts the above technical solution, and determines whether the position of the virtual object exceeds the initial plane. If the position of the virtual object exceeds the initial plane, the operation of determining the direction of the target plane of the virtual object in the real scene is triggered, and then the virtual object is adjusted according to the direction. Placing a posture and displaying the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane, can avoid the virtual object floating on the plane or the posture of the plane is incorrect when moving, and improve the display effect of the terminal.

In an optional embodiment, the method in this embodiment may further include a step of determining a target plane:

S15: Identify the planes contained in the real scene.

Among them, a real scene may include one or more planes. Corresponding algorithms are needed to identify the planes contained in the real scene. This step can be implemented using existing technologies, for example, real-time positioning and map construction (simultaneous localization and mapping) (SLAM) algorithms, which are not repeated here.

S16: Select a plane from the identified planes as the target plane.

Further, this step can be implemented in the following two ways:

In the first method, a plane is automatically selected as the target plane, that is, a plane is automatically selected as the target plane from the identified planes.

In the second method, the user selects the target plane, that is, the identified plane is displayed on the terminal screen, and the identified plane is selected; the selected plane is used as the target plane. That is, the user can select the plane by clicking or double-clicking or other preset actions, and use the plane selected by the user as the target plane.

Exemplarily, as shown in FIG. 2e, planes 1 to 3 in the recognized real scene are sequentially displayed on the terminal screen. If the user wants to display the virtual object on the plane 1, they only need to order on the terminal screen. Click or double-click on plane 1 to complete the selection operation. When plane 1 is selected, it is displayed on the terminal screen according to its placement position in the display scene, as shown in FIG. 2f. The process of determining the initial plane is similar to that of the target plane, and is not repeated here.

In an optional embodiment, the method in the embodiment of the present disclosure further includes:

S17: determine the target display position of the virtual object on the terminal screen;

The terminal may be, but is not limited to, a mobile terminal (for example, an iPhone, a smart phone, a tablet computer, etc.), or a fixed terminal (for example, a desktop computer).

The target display position is the display position of the virtual object on the terminal screen.

S18: Determine the target position according to the target display position and the target plane;

Accordingly, step S2 specifically includes:

Control the virtual object to move to the target position, adjust the placement posture of the virtual object according to the direction, and display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane.

Further, in step S17, the target display position can be obtained in the following two ways: the first method: the trigger response generated on the screen of the terminal is detected, and the generation position of the trigger response is used as the target display position.

The trigger response is a response generated by a trigger operation acting on the terminal screen, and may be, but is not limited to, a click response, a double-click response, or a detected preset gesture action generated for the terminal screen.

The location where the trigger response is generated is a point on the corresponding plane of the terminal screen, which can be specifically determined by a sensor arranged on the terminal screen.

Specifically, if the user wants to change the display position of the virtual object on the terminal screen, the user needs to perform operations on the terminal screen, for example, by clicking, or double-clicking, or making a preset gesture on the terminal screen to determine the virtual object A display position. After the terminal screen receives the above operation, a trigger response is generated. The generation position of the trigger response is the display position where the user wants to move the virtual object, and the display position is not the target position of the virtual object in the real scene. The trigger response determines the target position of the virtual object in the real scene, so that the display position of the virtual object on the terminal screen can be accurately located.

The second way is to receive the input target display position.

Specifically, the user can input the target display position through the terminal. Since the user's trigger operation on the terminal screen is often a trigger area, it is difficult to locate to a point, and the target position can be accurately located to the point. Compared with the trigger operation of the user on the terminal screen, the embodiment can more accurately locate the position of the virtual object and further improve the display effect of the terminal.

Further, step S18 may include:

Get the line passing through the point where the target display position is;

Use the intersection of the line and the target plane as the target position.

The line may be a straight line, a ray, or a line segment.

Further, the line is perpendicular to the plane where the terminal screen is located.

Those skilled in the art should understand that, on the basis of the foregoing embodiments, obvious modifications (for example, combining the listed modes) or equivalent replacements can also be performed.

In the foregoing, although the steps in the method embodiment of the adaptive plane are described in the above order, those skilled in the art should understand that the steps in the embodiments of the present disclosure are not necessarily performed in the above order, and they may also be reversed, Parallel, cross, and other sequential executions, and on the basis of the above steps, those skilled in the art can also add other steps. These obvious variations or equivalent replacements should also be included in the scope of protection of the present disclosure. No longer.

The following is a device embodiment of the present disclosure. The device embodiment of the present disclosure can be used to perform the steps implemented by the method embodiments of the present disclosure. For convenience of explanation, only parts related to the embodiments of the present disclosure are shown. Specific technical details are not disclosed. Reference is made to the method embodiments of the present disclosure.

In order to solve the technical problem of how to improve the user experience effect, an embodiment of the present disclosure provides an adaptive plane device. The apparatus may perform the steps in the foregoing embodiment of the adaptive plane method. As shown in FIG. 3a, the device mainly includes: a plane direction determination module 21 and an attitude adjustment module 22; wherein the plane direction determination module 21 is used to determine the direction of a target plane of a virtual object in a real scene; The posture of the virtual object is adjusted according to the direction, and the virtual object is displayed on the terminal screen, and the displayed virtual object is adapted to the target plane.

Specifically, the attitude adjustment module 22 may control the rotation and / or scaling of the virtual object, and display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane. Take Figure 1 as an example. According to Figure 1, it can be seen that the virtual cylindrical object was originally placed vertically on a horizontal plane, and then moved to the target plane. As shown in Figure 1, the target plane is placed vertically, so the The virtual cylindrical object can be placed vertically on the vertical plane after being rotated by 90 degrees. The placement position of the virtual cylindrical object finally obtained is shown in FIG. 2b.

In this embodiment, by adopting the above technical solution, the plane direction determination module 21 determines the direction of the target plane of the virtual object in the real scene, and then uses the attitude adjustment module 22 to adjust the posture of the virtual object according to the direction, and displays the virtual object on the terminal screen. The virtual object is displayed on the screen, and the displayed virtual object is adapted to the target plane, which can prevent the virtual object from floating on the plane or the posture of the plane is incorrect when moving, and improve the display effect of the terminal.

In an optional embodiment, based on FIG. 3a, the attitude adjustment module 22 is specifically configured to:

Determine the z-axis of the virtual object in the real scene; adjust the placement of the virtual object so that the z-axis is perpendicular to the target plane.

In an optional embodiment, as shown in FIG. 3b, the device further includes: a control movement module 23 and a position determination module 24; wherein the control movement module 23 is used to control the movement of the virtual object on the initial plane; the position determination module 24 is used If it is determined that the position of the virtual object exceeds the initial plane, an operation for determining the direction of the target plane of the virtual object in the real scene is triggered.

Specifically, the control movement module 23 can control the movement of the virtual object on the initial plane by controlling the terminal screen or the terminal. For example, you can use mobile controls to control the movement of virtual objects, such as virtual manipulation buttons to achieve the movement of virtual objects; you can also use your fingers to slide on the terminal screen to control the movement of virtual objects; you can also control the movement of virtual objects by directly moving the terminal, At this time, the virtual object is always located in the center of the terminal screen, and the mobile terminal is equivalent to a mobile virtual model.

Specifically, the position determination module 24 may record the edge contour position of the initial plane in advance, and then determine whether the position of the virtual object completely exceeds the initial plane. Specifically, it can be implemented by using the recognition method of the extended plane edge contour in the prior art, for example, using feature points or using texture to identify. Once it is determined that the position of the virtual object exceeds the initial plane, the direction of the target plane is determined.

In an optional embodiment, the device further includes: a plane identification module; the plane identification module is used to identify a plane included in the real scene; and a plane is selected from the identified planes as a target plane.

Among them, a real scene may include one or more planes. Corresponding algorithms are required to identify the planes contained in the real scene. This step can be implemented using existing technologies, for example, real-time positioning and map construction (simultaneous localization and mapping) (SLAM) algorithms, which are not repeated here.

Further, the plane identification module can be implemented in the following two ways:

Exemplarily, as shown in FIG. 2e, the plane recognition module sequentially displays the plane 1-plane 3 in the recognized real scene on the terminal screen. If the user wants to display the virtual object on the plane 1, it only needs to be displayed on the terminal. Click or double-click plane 1 on the screen to complete the selected operation. When plane 1 is selected, it is displayed on the terminal screen according to its placement position in the display scene, as shown in FIG. 2f.

The process of determining the initial plane is similar to that of the target plane, and is not repeated here.

In an optional embodiment, the device further includes: a target position determination module for determining a target display position of the virtual object on the terminal screen; determining the target position according to the target display position and the target plane; correspondingly The posture adjustment module 22 is specifically configured to control the virtual object to move to the target position, adjust the placement posture of the virtual object according to the direction, and display the virtual object on the terminal screen, and the displayed virtual object adapts Target plane.

The attitude adjustment module 22 is specifically configured to control the virtual object to move to the target position, adjust the placement posture of the virtual object according to the direction, display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane.

Further, the target position determination module is specifically configured to detect a trigger response generated on the screen of the terminal, and use the generation position of the trigger response as a target display position.

The trigger response is a response generated by a trigger operation acting on the terminal screen, and may be, but is not limited to, a click response, a double-click response, or a preset gesture gesture detected for the terminal screen.

Alternatively, the target position determination module is specifically configured to receive an input target display position.

Further, the target position determination module is specifically configured to: obtain a line passing through a point at which the target display position is located; and use the intersection of the line and the target plane as the target position.

For detailed descriptions of the working principle and technical effects of the device embodiment of the adaptive plane, reference may be made to related descriptions in the foregoing embodiment of the method of the adaptive plane, and details are not described herein again.

FIG. 4 is a hardware block diagram illustrating a hardware device of an adaptive plane according to an embodiment of the present disclosure. As shown in FIG. 4, an adaptive plane hardware device 30 according to an embodiment of the present disclosure includes a memory 31 and a processor 32.

The memory 31 is configured to store non-transitory computer-readable instructions. Specifically, the memory 31 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, and the like.

The processor 32 may be a central processing unit (CPU) or other form of processing unit having data processing capabilities and / or instruction execution capabilities, and may control other components in the hardware device 30 of the adaptive plane to perform desired functions. In an embodiment of the present disclosure, the processor 32 is configured to run the computer-readable instructions stored in the memory 31, so that the hardware device 30 of the adaptive plane executes the aforementioned adaptive plane of the embodiments of the present disclosure. All or part of the steps of a method.

Those skilled in the art should understand that in order to solve the technical problem of how to obtain a good user experience effect, this embodiment may also include well-known structures such as a communication bus and an interface. These well-known structures should also be included in the protection scope of the present disclosure. within.

For detailed descriptions of this embodiment, reference may be made to corresponding descriptions in the foregoing embodiments, and details are not described herein again.

FIG. 5 is a schematic diagram illustrating a computer-readable storage medium according to an embodiment of the present disclosure. As shown in FIG. 5, a computer-readable storage medium 40 according to an embodiment of the present disclosure stores non-transitory computer-readable instructions 41 thereon. When the non-transitory computer-readable instruction 41 is executed by a processor, all or part of the steps of the method for adaptive plane of the foregoing embodiments of the present disclosure are performed.

The computer-readable storage medium 40 includes, but is not limited to, optical storage media (for example, CD-ROM and DVD), magneto-optical storage media (for example, MO), magnetic storage media (for example, magnetic tape or mobile hard disk), Non-volatile memory rewritable media (for example: memory card) and media with built-in ROM (for example: ROM box).

FIG. 6 is a schematic diagram illustrating a hardware structure of a terminal according to an embodiment of the present disclosure. As shown in FIG. 5, the adaptive plane terminal 50 includes the foregoing embodiment of the adaptive plane device.

The terminal may be implemented in various forms, and the terminal in the present disclosure may include, but is not limited to, such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP ( Portable multimedia players), navigation devices, on-board terminals, on-board display terminals, on-board electronic rear-view mirrors, and other mobile terminals, and fixed terminals such as digital TVs, desktop computers, and the like.

As an equivalent alternative, the terminal may further include other components. As shown in FIG. 5, the adaptive plane terminal 50 may include a power supply unit 51, a wireless communication unit 52, an A / V (audio / video) input unit 53, a user input unit 54, a sensing unit 55, an interface unit 56, The controller 57, the output unit 58 and the memory 59 and so on. FIG. 5 illustrates a terminal having various components, but it should be understood that it is not required to implement all the illustrated components, and more or fewer components may be implemented instead.

Among them, the wireless communication unit 52 allows radio communication between the terminal 50 and a wireless communication system or network. The A / V input unit 53 is used to receive audio or video signals. The user input unit 54 may generate key input data according to a command input by the user to control various operations of the terminal. The sensing unit 55 detects the current state of the terminal 50, the position of the terminal 50, the presence or absence of a user's touch input to the terminal 50, the orientation of the terminal 50, the acceleration or deceleration movement and direction of the terminal 50, and the like, and generates a signal for controlling the terminal. 50 commands or signals for operation. The interface unit 56 functions as an interface through which at least one external device can be connected to the terminal 50. The output unit 58 is configured to provide an output signal in a visual, audio, and / or tactile manner. The memory 59 may store software programs and the like for processing and control operations performed by the controller 55, or may temporarily store data that has been output or is to be output. The memory 59 may include at least one type of storage medium. Moreover, the terminal 50 may cooperate with a network storage device that performs a storage function of the memory 59 through a network connection. The controller 57 generally controls the overall operation of the terminal. In addition, the controller 57 may include a multimedia module for reproducing or playing back multimedia data. The controller 57 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as characters or images. The power supply unit 51 receives external power or internal power under the control of the controller 57 and provides appropriate power required to operate each element and component.

Various embodiments of the adaptive plane approach proposed by the present disclosure may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementation, various embodiments of the adaptive plane method proposed by the present disclosure can be implemented by using application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, electronic unit designed to perform the functions described herein, and in some cases, Various embodiments of the adaptive plane method proposed by the present disclosure may be implemented in the controller 57. For software implementation, various embodiments of the adaptive plane method proposed by the present disclosure may be implemented with separate software modules that allow performing at least one function or operation. The software codes may be implemented by a software application (or program) written in any suitable programming language, and the software codes may be stored in the memory 59 and executed by the controller 57.

The basic principles of the present disclosure have been described above in conjunction with specific embodiments, but it should be noted that the advantages, advantages, effects, etc. mentioned in this disclosure are merely examples and not limitations, and these advantages, advantages, effects, etc. cannot be considered as Required for various embodiments of the present disclosure. In addition, the specific details of the above disclosure are only for the purpose of example and easy to understand, and are not limiting, and the above details do not limit the present disclosure to the implementation of the above specific details.

The block diagrams of the devices, devices, equipment, and systems referred to in this disclosure are merely illustrative and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be recognized by those skilled in the art, these devices, devices, equipment, systems can be connected, arranged, and configured in any manner. Words such as "including," "including," "having," and the like are open words that refer to "including, but not limited to," and can be used interchangeably with them. As used herein, the terms "or" and "and" refer to the terms "and / or" and are used interchangeably therewith unless the context clearly indicates otherwise. The term "such as" as used herein refers to the phrase "such as, but not limited to," and is used interchangeably with it.

In addition, as used herein, an "or" used in an enumeration of items beginning with "at least one" indicates a separate enumeration such that, for example, an "at least one of A, B, or C" enumeration means A or B or C, or AB or AC or BC, or ABC (ie A and B and C). Furthermore, the word "exemplary" does not mean that the described example is preferred or better than other examples.

It should also be noted that in the system and method of the present disclosure, each component or each step can be disassembled and / or recombined. These decompositions and / or recombinations should be regarded as equivalent solutions of the present disclosure.

Various changes, substitutions, and alterations to the techniques described herein can be made without departing from the techniques taught by the appended claims. Further, the scope of the claims of the present disclosure is not limited to the specific aspects of the processes, machines, manufacturing, composition of events, means, methods, and actions described above. The composition, means, methods, or actions of processes, machines, manufacturing, and events that currently exist or are to be developed later may be utilized that perform substantially the same functions or achieve substantially the same results as the corresponding aspects described herein. Accordingly, the appended claims include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or actions.

The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Accordingly, the disclosure is not intended to be limited to the aspects shown herein, but to the broadest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been given for the purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

An adaptive plane method includes:

Determine the direction of the target plane of the virtual object in the real scene;

Adjusting the placement posture of the virtual object according to the direction; and

The virtual object is displayed on a terminal screen, and the displayed virtual object is adapted to the target plane.
The method according to claim 1, wherein the step of adjusting the posture of the virtual object according to the direction comprises:

Determining a z-axis of the virtual object in a real scene;

Adjust the placement posture of the virtual object so that the z-axis is perpendicular to the target plane, and display the virtual object on the terminal screen, and the displayed virtual object adapts to the target plane.
The method of claim 1, wherein the method further comprises:

Controlling the virtual object to move on the initial plane;

In response to determining that the position of the virtual object exceeds the initial plane, triggering the operation of determining a direction of a target plane of the virtual object in a real scene is triggered.
The method of claim 1, wherein the method further comprises:

Identifying multiple planes included in the real scene;

A plane is selected from the identified planes as the target plane.
The method according to claim 4, wherein the step of selecting a plane from the identified planes as the target plane comprises:

Displaying the identified plane on the terminal screen, and making the identified plane selectable;

The selected plane is used as the target plane.
The method of claim 1, wherein the method further comprises:

Determining a target display position of the virtual object on a terminal screen;

Determining a target position according to the target display position and the target plane;

The step of adjusting the placement posture of the virtual object according to the direction further includes: controlling the virtual object to move to the target position, and adjusting the placement posture of the virtual object according to the direction.
The method according to claim 6, wherein the step of determining a target position based on the target display position and the target plane comprises:

Obtaining a line passing through a point at which the target display position is located;

An intersection of the line and the target plane is used as the target position.
The method according to claim 7, wherein the line is perpendicular to a plane on which the terminal screen is located.
The method according to claim 6, wherein the step of determining a target display position of the virtual object on a terminal screen comprises:

Detecting a trigger response generated on the terminal screen, and using the generation position of the trigger response as the target display position; or

The target display position to receive the input.
An adaptive plane device includes:

A plane direction determining module, configured to determine a direction of a target plane of a virtual object in a real scene;

An attitude adjustment module is configured to adjust the placement posture of the virtual object according to the direction, and display the virtual object on a terminal screen, and the displayed virtual object is adapted to the target plane.
An adaptive plane hardware device includes:

Memory for storing non-transitory computer-readable instructions; and

A processor, configured to run the computer-readable instructions, so that the processor, when executed, implements the method of the adaptive plane according to any one of claims 1-9.
A computer-readable storage medium for storing non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are executed by a computer, cause the computer to execute any one of claims 1-9 Adaptive plane method.