WO2016141594A1

WO2016141594A1 - Virtual object operation method and device

Info

Publication number: WO2016141594A1
Application number: PCT/CN2015/074121
Authority: WO
Inventors: 彭玉卓
Original assignee: 华为技术有限公司
Priority date: 2015-03-12
Filing date: 2015-03-12
Publication date: 2016-09-15
Also published as: CN106462264B; CN106462264A

Abstract

A virtual object operation method and device, which relate to the technical field of computers. The method is applied to an electronic device comprising a screen and a touch surface, and the touch surface is disposed on an outer surface of the electronic device excluding the screen. The method comprises: acquiring an operation triggered on a touch surface (101); mapping the touch surface to a virtual object to obtain a mapping surface, the virtual object being a three-dimensional object displayed in the screen, and the mapping surface being corresponding to at least one surface that is not displayed in the screen in the virtual object (102); mapping the operation as the operation triggered on the mapping surface (103); and changing the display state of the virtual object according to the operation (104). The problem is solved that the operation efficiency is low because a surface, which is not displayed in a screen, of a three-dimensional object is controlled by means of the screen and the control requires multiple operations; accordingly the effect of improving the operation efficiency is achieved.

Description

Virtual object operation method and device

Technical field

The present invention relates to the field of computer technologies, and in particular, to a virtual object operating method and apparatus.

Background technique

A virtual object is a three-dimensional object displayed in an electronic device, and may be a three-dimensional cube, a car, a character, or the like. The user can control the virtual object by performing related operations on the screen.

For example, the virtual object is a three-dimensional character and the front side of the character is displayed on the screen. If the user needs to perform a hit on the back of the character, the character needs to be rotated first to display the back of the character on the screen and then hit the back. That is, the user needs to perform two operations of rotating and striking according to the preset rule to achieve a hitting operation on a surface of the virtual object that is not displayed on the screen. Specifically, the preset rule of the rotating operation is from left to right. The sliding operation, the preset rule of the hitting operation is a click operation, and the user needs to perform two operations of sliding and clicking to implement the hitting on the back of the character.

Since the virtual object is a three-dimensional object, and the screen can only display one surface in the three-dimensional object, it is usually required to perform multiple operations to control the surface of the three-dimensional object that is not displayed on the screen through the screen, and the operation efficiency is low.

Summary of the invention

In order to solve the problem that a surface that is not displayed on the screen in the three-dimensional object is controlled by the screen, a plurality of operations are usually required to be completed, and the operation efficiency is low, the embodiment of the present invention provides a virtual object operation method and apparatus. The technical solution is as follows:

In a first aspect, a virtual object operating method is provided for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, Methods include:

Obtaining an operation triggered on one of the touch surfaces;

Mapping the touch surface onto the virtual object to obtain a mapping surface, the virtual object being a three-dimensional object displayed in the screen, the mapping surface corresponding to the virtual object not being displayed in the screen At least one surface;

Mapping the operation to an operation triggered on the mapping surface;

The display state of the virtual object is changed according to the operation.

In a first possible implementation manner of the first aspect, the mapping the touch surface to a virtual object to obtain a mapping surface includes:

Place the virtual object in a stereo model, the stereo model being a model corresponding to an outer surface geometric model of the electronic device;

At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.

According to the first aspect or the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, the changing the display state of the virtual object according to the operation includes:

Obtaining the contact on the touch surface and the movement track of the contact on the touch surface;

Mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point;

Mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory;

Controlling, according to the mapping point, a display state of the virtual object changes with the mapping trajectory.

According to a second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the proportional relationship between the area of the touch surface and the area of the mapping surface, The contact is shot onto the mapping surface to obtain a mapping point, including:

Obtaining contact coordinates of the contact on the touch surface;

Mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates;

A point corresponding to the coordinates of the map point is determined as the map point.

According to the second possible implementation of the first aspect, or the third possible implementation of the first aspect, in a fourth possible implementation manner of the first aspect, the controlling the virtual according to the mapping point The display pose of the object changes with the mapping trajectory, including:

When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;

Determining a rotation direction and an angle of the mapping trajectory when the mapping trajectory is used to indicate a rotation operation And controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.

According to a second possible implementation of the first aspect or a third possible implementation of the first aspect or a fourth possible implementation of the first aspect, in a fifth possible implementation of the first aspect The operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.

According to the first aspect or the first possible implementation manner of the first aspect, in the sixth possible implementation manner of the first aspect, the changing the display state of the virtual object according to the operation includes:

Searching, in a preset correspondence, a display instruction corresponding to the operation, where the display instruction is used to indicate performing at least one of a zoom operation, a panning operation, and a rotating operation on the virtual object;

The display state of the virtual object is changed according to the display instruction acting on the mapping surface.

In a second aspect, a virtual object operating device is provided for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, The device includes:

An operation obtaining module, configured to acquire an operation triggered on one of the touch surfaces;

a surface mapping module, configured to map the touch surface to the virtual object, to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object not in the virtual object At least one surface displayed in the screen;

An operation mapping module, configured to map the operation acquired by the operation obtaining module to an operation triggered on the mapping surface obtained by the surface mapping module;

And a state changing module, configured to change a display state of the virtual object according to the operation of the operation mapping module mapping.

In a first possible implementation manner of the second aspect, the operation mapping module is specifically configured to:

According to the second aspect or the first possible implementation manner of the second aspect, in a second possible implementation manner of the second aspect, the state changing module is specifically configured to:

According to a second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the state changing module is specifically configured to:

Obtaining contact coordinates of the contact on the touch surface;

According to the second possible implementation manner of the second aspect, or the third possible implementation manner of the second aspect, in the fourth possible implementation manner of the second aspect, the state changing module is specifically configured to:

When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.

According to the second possible implementation of the second aspect or the third possible implementation of the second aspect or the fourth possible implementation of the second aspect, in a fifth possible implementation manner of the second aspect The operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.

According to the second aspect or the first possible implementation manner of the second aspect, in a sixth possible implementation manner of the second aspect, the state changing module is further configured to:

In a third aspect, a virtual object operating device is provided for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, The device includes: a bus, and a processor, a memory, a transmitter, and a receiver connected to the bus Device. Wherein the memory is for storing a plurality of instructions, the instructions being configured to be executed by the processor;

The receiver is configured to acquire an operation triggered on one of the touch surfaces;

The processor is configured to map the touch surface to a virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object At least one surface displayed in the screen;

The processor, configured to map the operation received by the receiver to an operation triggered on the mapping surface;

The processor is configured to change a display state of the virtual object according to the operation.

In a first possible implementation manner of the third aspect, the processor is specifically configured to:

According to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the processor is specifically configured to:

According to a second possible implementation manner of the third aspect, in a third possible implementation manner of the third aspect, the processor is specifically configured to:

Obtaining contact coordinates of the contact on the touch surface;

According to the second possible implementation manner of the third aspect, or the third possible implementation manner of the third aspect, in a fourth possible implementation manner of the third aspect, the processor is specifically configured to:

In a fifth possible implementation manner of the third aspect, or a third possible implementation manner of the third aspect, or a fourth possible implementation manner of the third aspect, in a fifth possible implementation manner of the third aspect The operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.

According to the third aspect or the first possible implementation manner of the third aspect, in a sixth possible implementation manner of the third aspect, the processor is specifically configured to:

The beneficial effects of the technical solutions provided by the embodiments of the present invention are:

By acquiring an operation triggered on a touch surface, the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to the virtual object to obtain a mapping surface, and the virtual object is displayed on the screen a three-dimensional object, the mapping surface corresponding to at least one surface of the virtual object not displayed on the screen; mapping the operation to an operation triggered on the mapping surface; changing the display state of the virtual object according to the operation, according to characteristics of the electronic device being a three-dimensional object Performing operations on the off-screen touch surface to directly map the operation to the corresponding surface of the virtual object, and solving the control of the surface not displayed on the screen in the three-dimensional object through the screen, usually requires multiple operations to complete, operation The problem of low efficiency has achieved the effect of improving operational efficiency.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

1 is a flowchart of a method for operating a virtual object according to an embodiment of the present invention;

2A is a flowchart of still another method for operating a virtual object according to an embodiment of the present invention;

2B is a schematic diagram of an electronic device and a stereo model according to an embodiment of the present invention;

2C is a schematic diagram of a first variation of a virtual object according to an embodiment of the present invention;

2D is a schematic diagram of a second variation of a virtual object according to an embodiment of the present invention;

2E is a schematic diagram of a usage scenario of operating a virtual object according to an embodiment of the present invention;

3 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention.

detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

FIG. 1 is a flowchart of a method for operating a virtual object according to an embodiment of the present invention. The virtual object operation method is applied to an electronic device including a screen and a touch surface. The touch surface is disposed on an outer surface of the electronic device other than the screen, and may include:

Step 101: Acquire an operation triggered on a touch surface.

Step 102: Map the touch surface to the virtual object to obtain a mapping surface. The virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen.

In step 103, the operation is mapped to an operation triggered on the mapping surface.

Step 104, changing the display state of the virtual object according to the operation.

In summary, the virtual object operation method provided by the embodiment of the present invention, by acquiring an operation triggered on a touch surface, the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen. The surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency. For example, the virtual object is a three-dimensional character and the front side of the character is displayed on the screen. If the user needs to hit the back of the character, only the electronic device corresponds to the outer surface of the back of the character (for example, electronic A tapping operation (such as a click operation) is performed on the opposite side of the device screen, that is, only one click operation is performed to achieve a hit on the back of the character.

Referring to FIG. 2A, a flowchart of still another method for operating a virtual object according to an embodiment of the present invention is shown. The virtual object operation method is applied to an electronic device including a screen and a touch surface. The touch surface is disposed on an outer surface of the electronic device other than the screen, and may include:

Step 201: Acquire an operation triggered on a touch surface.

The touch surface is disposed on an outer surface of the electronic device other than the screen. For example, the touch surface may be disposed on the back surface of the electronic device, or may be disposed on the side of the electronic device, or may be disposed on the front surface of the electronic device except the screen.

Optionally, when the electronic device has a casing, the touch surface is also disposed on the outer surface of the outer casing, and the touch surface of the outer casing overlaps with the touch surface of the electronic device, so that the electronic device can acquire the touch at the outer casing. Control the action triggered on the surface.

In this embodiment, the touch surface of the electronic device and the touch surface of the outer casing may be implemented in the same manner or differently, which is not limited in this embodiment. The following describes several implementations of the touch surface:

The first implementation may include: providing a printed circuit board in a lower layer of the outer surface of the electronic device other than the screen, the distribution area of the printed circuit board being the area of the touch surface. The printed circuit board detects whether the user touches the touch surface by detecting whether the capacitance value of the touch surface changes.

The second implementation manner may include: disposing a sensor on an outer surface of the electronic device other than the screen, and the distribution area of the sensor is an area of the touch surface. Among them, the sensor can be a distance sensor or the like.

According to the touch surface implemented above, the electronic device can acquire an operation performed by the user on a touch surface, and the operation can be a click operation, a double-click operation, a pan operation, a rotation operation, a zoom operation, and the like.

Step 202: The virtual object is placed in a stereo model, and the stereo model is a model corresponding to the geometric model of the outer surface of the electronic device, and the surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object is displayed on the screen. The three-dimensional object, the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen.

Since the user triggers the operation on the touch surface in order to change the display state of the virtual object, the electronic device also needs to map the operation to the operation triggered on the virtual object. In a possible reality In the current mode, the electronic device may first map the touch surface to the virtual object, obtain a mapping surface, and then map the operation to the mapping surface.

Wherein, the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen. For example, when the virtual object is a three-dimensional character and the front side of the three-dimensional character is displayed on the screen, the mapping surface may correspond to the back side, the side surface, and the like of the three-dimensional character.

When the mapping surface is obtained, if the virtual object is a surface-consistent three-dimensional object, that is, each touch surface of the electronic device uniquely corresponds to one surface of the virtual object, and the virtual object may directly correspond to the touch surface. The surface is determined to be the mapped surface. For example, the electronic device and the virtual object are both rectangular parallelepipes. If the touch surface is the right side surface of the electronic device, the right side surface of the virtual object can be directly determined as the mapping surface. Optionally, each touch surface may also correspond to at least two surfaces of the virtual object, and the at least two surfaces may be determined as the mapping surface. For example, the electronic device and the virtual object are both rectangular parallelepipes. If the touch surface is the right side surface and the lower side surface of the electronic device, the right side surface and the lower side surface of the virtual object may be directly determined as the mapping surface.

If the virtual object is an irregular three-dimensional object, that is, the touch surface of the electronic device does not correspond to the surface of the virtual object, the virtual object needs to be placed in the stereo model, and the surface corresponding to the touch surface in the stereo model is determined as Map the surface.

Wherein, the three-dimensional model is a model corresponding to the geometric model of the outer surface of the electronic device. For example, when the electronic device is a rectangular parallelepiped, the three-dimensional model is also a rectangular parallelepiped; when the electronic device is a cylinder, the three-dimensional model is also a cylinder.

Among them, the stereo model is used to fix virtual objects. In this embodiment, the stereo model can accommodate the virtual object. For example, when the stereo model is a rectangular parallelepiped, the length, width, and height of the stereo model need to be greater than or equal to the length, width, and height of the virtual object, respectively. Alternatively, the size of the solid model may also be smaller than the size of the virtual object.

Since the stereo model corresponds to the geometric model of the outer surface of the electronic device, each touch surface of the electronic device uniquely corresponds to one surface of the stereo model, and the surface corresponding to the touch surface in the stereo model can be directly determined as The mapping surface, without the need to map to a virtual object, achieves the effect of simplifying the mapping process for operations. For example, both the electronic device and the stereo model are cuboids. Assuming that the touch surface is the right side surface of the electronic device, the right side surface of the stereo model can be directly determined as the mapping surface.

Please refer to the schematic diagram of the electronic device and the stereo model shown in FIG. 2B, wherein the virtual object is a three-dimensional table, the electronic device and the stereo model are both rectangular parallelepipeds, and the virtual object is located in the stereo model. Assuming that the touch surface is the right side surface A of the electronic device, the mapping surface is the right side surface A' of the three-dimensional model.

Optionally, each touch surface may also correspond to at least two surfaces of the stereo model, and the at least two surfaces may be determined as the mapping surface. For example, both the electronic device and the stereo model are cuboids. Assuming that the touch surface is the right side surface and the lower side surface of the electronic device, the right side surface and the lower side surface of the three-dimensional model can be directly determined as the mapping surface.

In step 203, the operation is mapped to an operation triggered on the mapping surface.

For example, when the operation is a panning operation triggered on the touch surface, the operation may be mapped to a panning operation triggered on the mapping surface; when the operation is a rotation operation triggered on the touch surface, the operation may be mapped The rotation operation that is triggered on the mapped surface.

Since the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen, the operation can be directly applied to at least one surface of the virtual object that is not displayed on the screen, without first operating the virtual object to At least one surface displayed on the screen is displayed on the screen, and then an operation is applied to the surface of the display, which saves operation. For example, the virtual object is a three-dimensional character and the front side of the character is displayed on the screen. If the user needs to hit the back of the character, only the outer surface of the electronic device corresponding to the back of the character (for example, the opposite side of the screen of the electronic device) is needed. Perform a hit operation (such as a click operation), that is, you only need to perform a single click to achieve a hit on the back of the character without first rotating the back of the character to the screen for display, and then hitting the screen. (eg click action).

Step 204, changing the display state of the virtual object according to the operation.

This embodiment provides two implementation manners for changing the display state of a virtual object according to an operation. The following two implementation manners are respectively described:

In the first implementation manner, changing the display state of the virtual object according to the operation includes:

1) acquiring a contact operated on the touch surface and a movement track of the contact on the touch surface;

2) mapping the contact to the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point;

3) mapping the motion trajectory to the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface, to obtain a mapping trajectory;

4) Control the display state of the virtual object according to the mapping point to change with the mapping trajectory.

In this embodiment, the electronic device can map the contact to the mapping surface to obtain a mapping point; then map the motion trajectory to the mapping surface to obtain a mapping trajectory, and control the virtual object to change with the mapping trajectory, so that the display state of the virtual object can be The user experience is improved as the user-triggered operation changes. The contact is the point of contact with the touch surface when the user triggers the operation.

Wherein, when the mapping point is obtained, if the mapping point is the default point on the mapping surface, the default point can be directly read; if the mapping point is not the default point on the mapping surface, the area of the touch surface can be obtained at this time. The proportional relationship between the regions of the mapping surface, and the mapping points are obtained according to the proportional relationship.

Specifically, according to the proportional relationship between the area of the touch surface and the area of the mapping surface, the contact is shot onto the mapping surface to obtain a mapping point, including:

1) acquiring the contact coordinates of the contact on the touch surface;

2) mapping the contact coordinates onto the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface, and obtaining the coordinates of the mapping point;

3) Determine the point corresponding to the coordinates of the map point as the map point.

For example, the area of the touch surface is a rectangular area of 5 cm in length and 10 cm in width, and the area of the mapping surface is a rectangular area of 2.5 cm in length and 5 cm in width, assuming that the contact coordinates are (2.5, 5), Then the calculated map point coordinates are (1.25, 2.5).

Referring to the first variation of the virtual object shown in Fig. 2C, point a is a contact on the right side surface of the electronic device, and point a' is a mapping point on the right side surface of the stereo model.

When mapping the motion track of the contact to the mapping track, each point in the motion track can be mapped onto the mapping surface according to the mapping manner of the above contact points, and the mapping points of each point are obtained, and all the mapping points are obtained. Combine to get the mapping trajectory.

In this embodiment, the display posture of the virtual object is controlled according to the mapping point to change according to the mapping trajectory, including:

1) when the mapping trajectory is used to indicate the panning operation, determining the moving direction and distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;

2) When the mapping trajectory is used to indicate the rotation operation, determine the rotation direction and angle of the mapping trajectory, control the virtual object to follow the mapping point, and rotate the angle according to the rotation direction.

First, when the mapping trajectory is used to indicate the panning operation, please refer to FIG. 2C, where the operation is a panning operation triggered on the right side surface of the electronic device, the contact is a, and the motion trajectory indication starts from the contact a. Move the first distance. A mapping point a' and a mapping trajectory are obtained based on the contact a and the motion trajectory, which indicates that the second distance is moved downward by the mapping point a'. The left diagram of FIG. 2C shows the correspondence between the contact a and the motion trajectory, the mapping point a', and the mapping trajectory, and the display state of the virtual object before moving according to the mapping trajectory, in the right diagram of FIG. 2C. The display state after the virtual object moves according to the mapping trajectory is shown.

Second, when the mapping track is used to indicate the rotation operation, please refer to the second variation diagram of the virtual object shown in FIG. 2D, wherein the operation is a rotation operation triggered on the rear surface of the electronic device. The trajectory indication is rotated counterclockwise by a predetermined angle by contact a (located on the back of the electronic device, not shown in Figure 2D). The mapping point a' and the mapping trajectory are obtained based on the contact a and the motion trajectory, which indicates that the predetermined angle is rotated counterclockwise by the mapping point a', please refer to the dotted arrow in the right diagram of Fig. 2D. The left diagram of FIG. 2D shows the display state of the virtual object before moving according to the mapping trajectory, and the right diagram of FIG. 2D shows the display state of the virtual object after moving according to the mapping trajectory.

In this embodiment, the operated contacts may be at least one. For example, when the user triggers an operation on the touch surface by a finger, the contact of the operation is one; when the user triggers the operation on the touch surface through multiple fingers or through other parts of the hand, the operated contact is At least two. In the following, the virtual object operation method is introduced by the user operating the virtual object through the tiger's mouth part. At this time, the contact on the touch surface is two, and the two contacts rotate in opposite directions at any time. .

Please refer to the schematic diagram of the operation scenario of the operation virtual object shown in FIG. 2E. When the electronic device is located at the tiger's mouth position of the hand, the contact between the tiger mouth and the touch surface includes the contact A and the contact B, since the touch surface is an electronic device. The lower surface, therefore, the mapping surface is the lower surface of the three-dimensional model. At this time, the electronic device can determine the mapping point a corresponding to the contact A and the mapping point b corresponding to the contact B on the lower surface of the three-dimensional model.

When the user rotates the hand counterclockwise, the contact A and the contact B simultaneously move in the counterclockwise direction and the rotation directions of the contact A and the contact B are opposite. Suppose that at a certain moment, the moving direction of the mapping point a and the mapping point b is as shown in Fig. 2E.

In the second implementation manner, changing the display state of the virtual object according to the operation includes:

1) searching, in a preset correspondence, a display instruction corresponding to the operation, where the display instruction is used to instruct at least one of a zoom operation, a panning operation, and a rotation operation on the virtual object;

2) Changing the display state of the virtual object according to the display instruction acting on the mapping surface.

The correspondence relationship is used to store the relationship between the operation and the display instruction. For example, two opposite sliding operations simultaneously acting on the touch surface correspond to the zooming operation, while two opposite sliding operations acting on the touch surface correspond to the zooming operation, the click operation corresponds to the panning operation, and the double clicking operation corresponds to the zooming operation. The rotation operation or the like does not limit the correspondence in this embodiment. In this embodiment, the scaling of the scaling operation may be fixed or related to the operation. In one possible implementation, the sliding distance of the operation is positively correlated with the scaling. For example, the sliding distance of 1 cm in the opposite sliding operation corresponds to a magnification ratio of 200%; the sliding distance of 1 cm in the relative sliding operation corresponds to a reduction ratio of 50% or the like.

The direction and distance of movement of the panning operation can be fixed or related to the operation. In one kind In the energy implementation, the operation duration of the operation is positively related to the distance. For example, when the operation time of the click operation is 1 second, it corresponds to a distance of 2 cm; when the operation time of the click operation is 2 seconds, it corresponds to a distance of 5 cm. The type of operation is related to the direction of movement. For example, when the operation type is a click operation, the movement direction is to the left; when the operation type is a double-click operation, the movement direction is to the right.

Similarly, the direction and angle of rotation of the rotary operation can be fixed or related to operation. In one possible implementation, the operational duration of the operation is positively correlated with the angle. For example, when the operation time of the click operation is 1 second, it corresponds to 30°; when the operation time of the click operation is 2 seconds, it corresponds to 60°. Alternatively, the type of operation is related to the direction of movement. For example, when the operation type is a click operation, the rotation direction is counterclockwise; when the operation type is a double-click operation, the rotation direction is clockwise.

After determining the display instruction, the electronic device can change the display state of the virtual object according to the display instruction acting on the mapping surface. Specifically, the electronic device may set a default point on the mapping surface, control the virtual object to follow the default point, and move a certain distance according to the moving direction; or control the virtual object to follow the mapping point and rotate an angle according to the rotation direction. The specific translation and rotation process is described in detail above, and will not be described here.

Optionally, when at least two virtual objects are displayed on the screen, the two virtual objects may be operated as a whole, or a virtual object may be selected for operation. The operation method is as described above, and is not described herein. .

In summary, the virtual object operation method provided by the embodiment of the present invention, by acquiring an operation triggered on a touch surface, the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen. The surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.

In addition, by placing the virtual object in the stereo model, the stereo model is a model corresponding to the outer surface geometric model of the electronic device; at least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object may be When the surface of the three-dimensional object is irregular, the virtual object can be placed in a stereo model corresponding to the geometric model of the outer surface of the electronic device. Since the touch surface corresponds to a mapping surface, operations performed on the touch surface can be mapped. For the operations performed on the mapped surface, It does not need to be mapped to a virtual object, and the effect of simplifying the mapping process to the operation is achieved.

Please refer to FIG. 3 , which is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention. The virtual object operating device is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed on the electronic device. On the outer surface other than the screen, it may include:

The operation obtaining module 301 is configured to acquire an operation triggered on a touch surface;

The surface mapping module 302 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;

The operation mapping module 303 is configured to map the operation acquired by the operation obtaining module 301 to an operation triggered on the mapping surface obtained by the surface mapping module 302.

The state change module 304 is configured to change the display state of the virtual object according to the operation mapped by the operation mapping module 303.

In summary, the virtual object operating device provided by the embodiment of the present invention obtains an operation triggered on a touch surface, and the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen. The surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.

Referring to FIG. 3, an embodiment of the present invention further provides a virtual object operating device, which is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed outside the screen of the electronic device. On the surface, it can include:

An operation mapping module 303, configured to map the operation acquired by the operation obtaining module 301 to be on the surface The operation triggered on the mapping surface obtained by the mapping module 302;

Optionally, the operation mapping module 303 is specifically configured to:

The virtual object is placed in a stereo model, which is a model corresponding to the geometric model of the outer surface of the electronic device;

At least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface.

Optionally, the state change module 304 is specifically configured to:

Acquiring the contact on the touch surface and the movement track of the contact on the touch surface;

According to the proportional relationship between the area of the touch surface and the area of the mapping surface, the motion trajectory is mapped onto the mapping surface to obtain a mapping trajectory;

The display state of the virtual object is controlled to vary with the mapping trajectory according to the mapping point.

Optionally, the state change module 304 is specifically configured to:

Obtaining the contact coordinates of the contact on the touch surface;

According to the proportional relationship between the area of the touch surface and the area of the mapping surface, the contact coordinates are mapped onto the mapping surface to obtain the mapping point coordinates;

The point corresponding to the coordinates of the map point is determined as a map point.

Optionally, the state change module 304 is specifically configured to:

When the mapping trajectory is used to indicate the rotation operation, the rotation direction and angle of the mapping trajectory are determined, and the virtual object is controlled to follow the mapping point, and the angle is rotated according to the rotation direction.

Optionally, there are two contacts operating on the touch surface, and the two contacts rotate in opposite directions at any time.

Optionally, the state change module 304 is further configured to:

The display state of the virtual object is changed according to a display instruction acting on the mapping surface.

In summary, the virtual object operating device provided by the embodiment of the present invention is obtained by acquiring a touch The surface-triggered operation, the touch surface is disposed on an outer surface of the electronic device other than the screen; the touch surface is mapped onto the virtual object to obtain a mapping surface, and the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to At least one surface not displayed on the screen in the virtual object; mapping the operation to an operation triggered on the mapping surface; changing the display state of the virtual object according to the operation, according to the characteristics of the electronic device being a three-dimensional object, touching on the screen Performing operations on the control surface, thereby directly mapping the operation to the corresponding surface of the virtual object, solves the problem of controlling the surface not displayed on the screen in the three-dimensional object through the screen, usually requires multiple operations to complete, and the operation efficiency is low, reaching The effect of improving operational efficiency.

In addition, by placing the virtual object in the stereo model, the stereo model is a model corresponding to the outer surface geometric model of the electronic device; at least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object may be When the surface of the three-dimensional object is irregular, the virtual object can be placed in a stereo model corresponding to the geometric model of the outer surface of the electronic device. Since the touch surface corresponds to a mapping surface, operations performed on the touch surface can be mapped. The effect of simplifying the mapping process to operations is achieved for operations performed on the mapped surface without mapping to virtual objects.

Please refer to FIG. 4 , which is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention. The virtual object operating device is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed on the electronic device. In addition to the external surface of the screen, the apparatus includes a bus 401, and a processor 402, a memory 403, a transmitter 404, and a receiver 405 connected to the bus 401. Wherein, the memory 403 is configured to store a plurality of instructions, the instructions being configured to be executed by the processor 402;

a receiver 405, configured to acquire an operation triggered on a touch surface;

The processor 402 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;

The processor 402 is configured to map the operation received by the receiver 405 to an operation triggered on the mapping surface;

The processor 402 is configured to change a display state of the virtual object according to the operation.

In summary, the virtual object operating device provided by the embodiment of the present invention obtains an operation triggered on a touch surface, and the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; mapping the operation to Mapping the operation triggered on the surface; changing the display state of the virtual object according to the operation, according to the characteristics of the electronic device being a three-dimensional object, performing an operation on the off-screen touch surface, thereby directly mapping the operation to the corresponding surface of the virtual object, The invention solves the problem that the surface not displayed on the screen in the three-dimensional object is controlled by the screen, usually requires multiple operations to complete, and the operation efficiency is low, and the effect of improving the operation efficiency is achieved.

Referring to FIG. 4, an embodiment of the present invention further provides a virtual object operating device, which is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed outside the screen of the electronic device. In the surface, the apparatus includes a bus 401, and a processor 402, a memory 403, a transmitter 404, and a receiver 405 connected to the bus 401. Wherein, the memory 403 is configured to store a plurality of instructions, the instructions being configured to be executed by the processor 402;

Optionally, the processor 402 is specifically configured to:

Obtaining the contact coordinates of the contact on the touch surface;

Optionally, the processor 402 is specifically configured to:

It should be noted that the virtual object operating device provided by the above embodiment performs virtual object operations. In the actual application, the above-mentioned function allocation can be completed by different functional modules according to requirements, that is, the internal structure of the virtual object operating device is divided into different functional modules to complete All or part of the functions described above. In addition, the virtual object operating device and the virtual object operating method embodiment are provided in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit may be only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

The functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present invention may contribute to the prior art or part of the technical solution. Illustrated in the form of a software product stored in a storage medium, comprising instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the embodiments of the present invention All or part of the steps of the method. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

A virtual object operation method, which is applied to an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, the method comprising :

Obtaining an operation triggered on one of the touch surfaces;

Mapping the touch surface onto the virtual object to obtain a mapping surface, the virtual object being a three-dimensional object displayed in the screen, the mapping surface corresponding to the virtual object not being displayed in the screen At least one surface;

Mapping the operation to an operation triggered on the mapping surface;

The display state of the virtual object is changed according to the operation.
The method according to claim 1, wherein the mapping the touch surface to the virtual object to obtain a mapping surface comprises:

Place the virtual object in a stereo model, the stereo model being a model corresponding to an outer surface geometric model of the electronic device;

At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
The method according to claim 1 or 2, wherein the changing the display state of the virtual object according to the operation comprises:

Obtaining the contact on the touch surface and the movement track of the contact on the touch surface;

Mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point;

Mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory;

Controlling, according to the mapping point, a display state of the virtual object changes with the mapping trajectory.
The method according to claim 3, wherein the contact is incident on the mapping surface according to a proportional relationship between a region of the touch surface and a region of the mapping surface, Get mapped points, including:

Obtaining contact coordinates of the contact on the touch surface;

Mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates;

A point corresponding to the coordinates of the map point is determined as the map point.
The method according to claim 3 or 4, wherein the controlling the display posture of the virtual object according to the mapping point to change according to the mapping trajectory comprises:

When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;

When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.
The method according to any one of claims 3 to 5, wherein the operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.
The method according to claim 1 or 2, wherein the changing the display state of the virtual object according to the operation comprises:

Searching, in a preset correspondence, a display instruction corresponding to the operation, where the display instruction is used to indicate performing at least one of a zoom operation, a panning operation, and a rotating operation on the virtual object;

The display state of the virtual object is changed according to the display instruction acting on the mapping surface.
A virtual object operating device, which is applied to an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, the device comprising :

An operation obtaining module, configured to acquire an operation triggered on one of the touch surfaces;

a surface mapping module, configured to map the touch surface to the virtual object, to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object not in the virtual object At least one surface displayed in the screen;

An operation mapping module, configured to map the operation acquired by the operation obtaining module to an operation triggered on the mapping surface obtained by the surface mapping module;

And a state changing module, configured to change a display state of the virtual object according to the operation of the operation mapping module mapping.
The device according to claim 8, wherein the operation mapping module is specifically configured to:

Place the virtual object in a stereo model, the stereo model being a model corresponding to an outer surface geometric model of the electronic device;

At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
The device according to claim 8 or 9, wherein the state change module is specifically configured to:

Obtaining the contact on the touch surface and the movement track of the contact on the touch surface;

Mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point;

Mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory;

Controlling, according to the mapping point, a display state of the virtual object changes with the mapping trajectory.
The device according to claim 10, wherein the state change module is specifically configured to:

Obtaining contact coordinates of the contact on the touch surface;

Mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates;

A point corresponding to the coordinates of the map point is determined as the map point.
The device according to claim 10 or 11, wherein the state change module is specifically configured to:

When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;

When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.
The apparatus according to any one of claims 10 to 12, wherein said two contacts on said touch surface are operated, and said two contacts are rotated in opposite directions at any time.
The device according to claim 9 or 10, wherein the state change module is further configured to:

Searching, in a preset correspondence, a display instruction corresponding to the operation, where the display instruction is used to indicate performing at least one of a zoom operation, a panning operation, and a rotating operation on the virtual object;

The display state of the virtual object is changed according to the display instruction acting on the mapping surface.
A virtual object operating device, which is applied to an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, the device comprising : a bus, and a processor, memory, transmitter, and receiver connected to the bus. Wherein the memory is for storing a plurality of instructions, the instructions being configured to be executed by the processor;

The receiver is configured to acquire an operation triggered on one of the touch surfaces;

The processor is configured to map the touch surface to a virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object At least one surface displayed in the screen;

The processor, configured to map the operation received by the receiver to an operation triggered on the mapping surface;

The processor is configured to change a display state of the virtual object according to the operation.
The device according to claim 15, wherein the processor is specifically configured to:

Placing the virtual object in a stereo model, the stereo model being external to the electronic device The model corresponding to the surface geometry model;

At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
The device according to claim 15 or 16, wherein the processor is specifically configured to:

Obtaining the contact on the touch surface and the movement track of the contact on the touch surface;

Mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point;

Mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory;

Controlling, according to the mapping point, a display state of the virtual object changes with the mapping trajectory.
The device according to claim 17, wherein the processor is specifically configured to:

Obtaining contact coordinates of the contact on the touch surface;

Mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates;

A point corresponding to the coordinates of the map point is determined as the map point.
The device according to claim 17 or 18, wherein the processor is specifically configured to:

When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;

When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.
The device according to any one of claims 17 to 19, wherein said two contacts on said touch surface are operated, and said two contacts are rotated in opposite directions at any time.
The device according to claim 15 or 16, wherein the processor is specifically configured to:

Searching, in a preset correspondence, a display instruction corresponding to the operation, where the display instruction is used to indicate performing at least one of a zoom operation, a panning operation, and a rotating operation on the virtual object;

The display state of the virtual object is changed according to the display instruction acting on the mapping surface.