WO2016141594A1 - Procédé et dispositif d'opération d'objet virtuel - Google Patents

Procédé et dispositif d'opération d'objet virtuel Download PDF

Info

Publication number
WO2016141594A1
WO2016141594A1 PCT/CN2015/074121 CN2015074121W WO2016141594A1 WO 2016141594 A1 WO2016141594 A1 WO 2016141594A1 CN 2015074121 W CN2015074121 W CN 2015074121W WO 2016141594 A1 WO2016141594 A1 WO 2016141594A1
Authority
WO
WIPO (PCT)
Prior art keywords
mapping
virtual object
touch surface
touch
screen
Prior art date
Application number
PCT/CN2015/074121
Other languages
English (en)
Chinese (zh)
Inventor
彭玉卓
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2015/074121 priority Critical patent/WO2016141594A1/fr
Priority to CN201580023366.3A priority patent/CN106462264B/zh
Publication of WO2016141594A1 publication Critical patent/WO2016141594A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a virtual object operating method and apparatus.
  • a virtual object is a three-dimensional object displayed in an electronic device, and may be a three-dimensional cube, a car, a character, or the like.
  • the user can control the virtual object by performing related operations on the screen.
  • the virtual object is a three-dimensional character and the front side of the character is displayed on the screen.
  • the character needs to be rotated first to display the back of the character on the screen and then hit the back. That is, the user needs to perform two operations of rotating and striking according to the preset rule to achieve a hitting operation on a surface of the virtual object that is not displayed on the screen.
  • the preset rule of the rotating operation is from left to right.
  • the sliding operation, the preset rule of the hitting operation is a click operation, and the user needs to perform two operations of sliding and clicking to implement the hitting on the back of the character.
  • the virtual object is a three-dimensional object
  • the screen can only display one surface in the three-dimensional object, it is usually required to perform multiple operations to control the surface of the three-dimensional object that is not displayed on the screen through the screen, and the operation efficiency is low.
  • the embodiment of the present invention provides a virtual object operation method and apparatus.
  • the technical solution is as follows:
  • a virtual object operating method for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen, Methods include:
  • mapping the touch surface onto the virtual object to obtain a mapping surface, the virtual object being a three-dimensional object displayed in the screen, the mapping surface corresponding to the virtual object not being displayed in the screen At least one surface;
  • the display state of the virtual object is changed according to the operation.
  • mapping the touch surface to a virtual object to obtain a mapping surface includes:
  • the stereo model being a model corresponding to an outer surface geometric model of the electronic device
  • At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
  • the changing the display state of the virtual object according to the operation includes:
  • mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory
  • the proportional relationship between the area of the touch surface and the area of the mapping surface, The contact is shot onto the mapping surface to obtain a mapping point including:
  • mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates
  • a point corresponding to the coordinates of the map point is determined as the map point.
  • the controlling the virtual according to the mapping point changes with the mapping trajectory, including:
  • mapping trajectory When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • the operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.
  • the changing the display state of the virtual object according to the operation includes:
  • the display state of the virtual object is changed according to the display instruction acting on the mapping surface.
  • a virtual object operating device for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen,
  • the device includes:
  • An operation obtaining module configured to acquire an operation triggered on one of the touch surfaces
  • a surface mapping module configured to map the touch surface to the virtual object, to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object not in the virtual object At least one surface displayed in the screen;
  • An operation mapping module configured to map the operation acquired by the operation obtaining module to an operation triggered on the mapping surface obtained by the surface mapping module;
  • a state changing module configured to change a display state of the virtual object according to the operation of the operation mapping module mapping.
  • the operation mapping module is specifically configured to:
  • the stereo model being a model corresponding to an outer surface geometric model of the electronic device
  • At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
  • the state changing module is specifically configured to:
  • mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory
  • the state changing module is specifically configured to:
  • mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates
  • a point corresponding to the coordinates of the map point is determined as the map point.
  • the state changing module is specifically configured to:
  • mapping trajectory When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • mapping trajectory When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.
  • the operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.
  • the state changing module is further configured to:
  • the display state of the virtual object is changed according to the display instruction acting on the mapping surface.
  • a virtual object operating device for use in an electronic device including a screen and a touch surface, the touch surface being disposed on an outer surface of the electronic device other than the screen,
  • the device includes: a bus, and a processor, a memory, a transmitter, and a receiver connected to the bus Device.
  • the memory is for storing a plurality of instructions, the instructions being configured to be executed by the processor;
  • the receiver is configured to acquire an operation triggered on one of the touch surfaces
  • the processor is configured to map the touch surface to a virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed in the screen, and the mapping surface corresponds to the virtual object At least one surface displayed in the screen;
  • the processor configured to map the operation received by the receiver to an operation triggered on the mapping surface
  • the processor is configured to change a display state of the virtual object according to the operation.
  • the processor is specifically configured to:
  • the stereo model being a model corresponding to an outer surface geometric model of the electronic device
  • At least one surface of the three-dimensional model corresponding to the touch surface is determined as the mapping surface.
  • the processor is specifically configured to:
  • mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • mapping the motion trajectory to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping trajectory
  • the processor is specifically configured to:
  • mapping the contact coordinates onto the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain mapping point coordinates
  • a point corresponding to the coordinates of the map point is determined as the map point.
  • the processor is specifically configured to:
  • mapping trajectory When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • mapping trajectory When the mapping trajectory is used to indicate a rotation operation, determining a rotation direction and an angle of the mapping trajectory, controlling the virtual object to follow the mapping point, and rotating the angle according to the rotation direction.
  • the operation has two contacts on the touch surface, and the two of the contacts rotate in opposite directions at any time.
  • the processor is specifically configured to:
  • the display state of the virtual object is changed according to the display instruction acting on the mapping surface.
  • the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to the virtual object to obtain a mapping surface, and the virtual object is displayed on the screen a three-dimensional object, the mapping surface corresponding to at least one surface of the virtual object not displayed on the screen; mapping the operation to an operation triggered on the mapping surface; changing the display state of the virtual object according to the operation, according to characteristics of the electronic device being a three-dimensional object Performing operations on the off-screen touch surface to directly map the operation to the corresponding surface of the virtual object, and solving the control of the surface not displayed on the screen in the three-dimensional object through the screen, usually requires multiple operations to complete, operation The problem of low efficiency has achieved the effect of improving operational efficiency.
  • FIG. 1 is a flowchart of a method for operating a virtual object according to an embodiment of the present invention
  • FIG. 2A is a flowchart of still another method for operating a virtual object according to an embodiment of the present invention.
  • 2B is a schematic diagram of an electronic device and a stereo model according to an embodiment of the present invention.
  • 2C is a schematic diagram of a first variation of a virtual object according to an embodiment of the present invention.
  • 2D is a schematic diagram of a second variation of a virtual object according to an embodiment of the present invention.
  • 2E is a schematic diagram of a usage scenario of operating a virtual object according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for operating a virtual object according to an embodiment of the present invention.
  • the virtual object operation method is applied to an electronic device including a screen and a touch surface.
  • the touch surface is disposed on an outer surface of the electronic device other than the screen, and may include:
  • Step 101 Acquire an operation triggered on a touch surface.
  • Step 102 Map the touch surface to the virtual object to obtain a mapping surface.
  • the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen.
  • step 103 the operation is mapped to an operation triggered on the mapping surface.
  • Step 104 changing the display state of the virtual object according to the operation.
  • the virtual object operation method by acquiring an operation triggered on a touch surface, the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen.
  • the surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.
  • the virtual object is a three-dimensional character and the front side of the character is displayed on the screen. If the user needs to hit the back of the character, only the electronic device corresponds to the outer surface of the back of the character (for example, electronic A tapping operation (such as a click operation) is performed on the opposite side of the device screen, that is, only one click operation is performed to achieve a hit on the back of the character.
  • FIG. 2A a flowchart of still another method for operating a virtual object according to an embodiment of the present invention is shown.
  • the virtual object operation method is applied to an electronic device including a screen and a touch surface.
  • the touch surface is disposed on an outer surface of the electronic device other than the screen, and may include:
  • Step 201 Acquire an operation triggered on a touch surface.
  • the touch surface is disposed on an outer surface of the electronic device other than the screen.
  • the touch surface may be disposed on the back surface of the electronic device, or may be disposed on the side of the electronic device, or may be disposed on the front surface of the electronic device except the screen.
  • the touch surface is also disposed on the outer surface of the outer casing, and the touch surface of the outer casing overlaps with the touch surface of the electronic device, so that the electronic device can acquire the touch at the outer casing. Control the action triggered on the surface.
  • the touch surface of the electronic device and the touch surface of the outer casing may be implemented in the same manner or differently, which is not limited in this embodiment.
  • the first implementation may include: providing a printed circuit board in a lower layer of the outer surface of the electronic device other than the screen, the distribution area of the printed circuit board being the area of the touch surface.
  • the printed circuit board detects whether the user touches the touch surface by detecting whether the capacitance value of the touch surface changes.
  • the second implementation manner may include: disposing a sensor on an outer surface of the electronic device other than the screen, and the distribution area of the sensor is an area of the touch surface.
  • the sensor can be a distance sensor or the like.
  • the electronic device can acquire an operation performed by the user on a touch surface, and the operation can be a click operation, a double-click operation, a pan operation, a rotation operation, a zoom operation, and the like.
  • Step 202 The virtual object is placed in a stereo model, and the stereo model is a model corresponding to the geometric model of the outer surface of the electronic device, and the surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object is displayed on the screen.
  • the three-dimensional object, the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen.
  • the electronic device Since the user triggers the operation on the touch surface in order to change the display state of the virtual object, the electronic device also needs to map the operation to the operation triggered on the virtual object. In a possible reality In the current mode, the electronic device may first map the touch surface to the virtual object, obtain a mapping surface, and then map the operation to the mapping surface.
  • the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen.
  • the mapping surface may correspond to the back side, the side surface, and the like of the three-dimensional character.
  • each touch surface of the electronic device uniquely corresponds to one surface of the virtual object, and the virtual object may directly correspond to the touch surface.
  • the surface is determined to be the mapped surface.
  • the electronic device and the virtual object are both rectangular parallelepipes.
  • the touch surface is the right side surface of the electronic device, the right side surface of the virtual object can be directly determined as the mapping surface.
  • each touch surface may also correspond to at least two surfaces of the virtual object, and the at least two surfaces may be determined as the mapping surface.
  • the electronic device and the virtual object are both rectangular parallelepipes. If the touch surface is the right side surface and the lower side surface of the electronic device, the right side surface and the lower side surface of the virtual object may be directly determined as the mapping surface.
  • the virtual object is an irregular three-dimensional object, that is, the touch surface of the electronic device does not correspond to the surface of the virtual object, the virtual object needs to be placed in the stereo model, and the surface corresponding to the touch surface in the stereo model is determined as Map the surface.
  • the three-dimensional model is a model corresponding to the geometric model of the outer surface of the electronic device.
  • the three-dimensional model is also a rectangular parallelepiped; when the electronic device is a cylinder, the three-dimensional model is also a cylinder.
  • the stereo model is used to fix virtual objects.
  • the stereo model can accommodate the virtual object.
  • the length, width, and height of the stereo model need to be greater than or equal to the length, width, and height of the virtual object, respectively.
  • the size of the solid model may also be smaller than the size of the virtual object.
  • each touch surface of the electronic device uniquely corresponds to one surface of the stereo model, and the surface corresponding to the touch surface in the stereo model can be directly determined as The mapping surface, without the need to map to a virtual object, achieves the effect of simplifying the mapping process for operations.
  • both the electronic device and the stereo model are cuboids. Assuming that the touch surface is the right side surface of the electronic device, the right side surface of the stereo model can be directly determined as the mapping surface.
  • the virtual object is a three-dimensional table
  • the electronic device and the stereo model are both rectangular parallelepipeds
  • the virtual object is located in the stereo model.
  • the touch surface is the right side surface A of the electronic device
  • the mapping surface is the right side surface A' of the three-dimensional model.
  • each touch surface may also correspond to at least two surfaces of the stereo model, and the at least two surfaces may be determined as the mapping surface.
  • both the electronic device and the stereo model are cuboids. Assuming that the touch surface is the right side surface and the lower side surface of the electronic device, the right side surface and the lower side surface of the three-dimensional model can be directly determined as the mapping surface.
  • step 203 the operation is mapped to an operation triggered on the mapping surface.
  • the operation when the operation is a panning operation triggered on the touch surface, the operation may be mapped to a panning operation triggered on the mapping surface; when the operation is a rotation operation triggered on the touch surface, the operation may be mapped The rotation operation that is triggered on the mapped surface.
  • the operation can be directly applied to at least one surface of the virtual object that is not displayed on the screen, without first operating the virtual object to At least one surface displayed on the screen is displayed on the screen, and then an operation is applied to the surface of the display, which saves operation.
  • the virtual object is a three-dimensional character and the front side of the character is displayed on the screen. If the user needs to hit the back of the character, only the outer surface of the electronic device corresponding to the back of the character (for example, the opposite side of the screen of the electronic device) is needed. Perform a hit operation (such as a click operation), that is, you only need to perform a single click to achieve a hit on the back of the character without first rotating the back of the character to the screen for display, and then hitting the screen. (eg click action).
  • a hit operation such as a click operation
  • Step 204 changing the display state of the virtual object according to the operation.
  • This embodiment provides two implementation manners for changing the display state of a virtual object according to an operation. The following two implementation manners are respectively described:
  • changing the display state of the virtual object according to the operation includes:
  • mapping the contact to the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • mapping the motion trajectory to the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface, to obtain a mapping trajectory
  • the electronic device can map the contact to the mapping surface to obtain a mapping point; then map the motion trajectory to the mapping surface to obtain a mapping trajectory, and control the virtual object to change with the mapping trajectory, so that the display state of the virtual object can be
  • the user experience is improved as the user-triggered operation changes.
  • the contact is the point of contact with the touch surface when the user triggers the operation.
  • mapping point when the mapping point is obtained, if the mapping point is the default point on the mapping surface, the default point can be directly read; if the mapping point is not the default point on the mapping surface, the area of the touch surface can be obtained at this time.
  • the proportional relationship between the regions of the mapping surface, and the mapping points are obtained according to the proportional relationship.
  • mapping point including:
  • mapping the contact coordinates onto the mapping surface according to the proportional relationship between the area of the touch surface and the area of the mapping surface, and obtaining the coordinates of the mapping point;
  • the area of the touch surface is a rectangular area of 5 cm in length and 10 cm in width
  • the area of the mapping surface is a rectangular area of 2.5 cm in length and 5 cm in width, assuming that the contact coordinates are (2.5, 5), Then the calculated map point coordinates are (1.25, 2.5).
  • point a is a contact on the right side surface of the electronic device
  • point a' is a mapping point on the right side surface of the stereo model.
  • each point in the motion track can be mapped onto the mapping surface according to the mapping manner of the above contact points, and the mapping points of each point are obtained, and all the mapping points are obtained. Combine to get the mapping trajectory.
  • the display posture of the virtual object is controlled according to the mapping point to change according to the mapping trajectory, including:
  • mapping trajectory when the mapping trajectory is used to indicate the panning operation, determining the moving direction and distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • mapping trajectory When the mapping trajectory is used to indicate the rotation operation, determine the rotation direction and angle of the mapping trajectory, control the virtual object to follow the mapping point, and rotate the angle according to the rotation direction.
  • mapping trajectory is used to indicate the panning operation
  • the operation is a panning operation triggered on the right side surface of the electronic device
  • the contact is a
  • the motion trajectory indication starts from the contact a.
  • Move the first distance A mapping point a' and a mapping trajectory are obtained based on the contact a and the motion trajectory, which indicates that the second distance is moved downward by the mapping point a'.
  • the left diagram of FIG. 2C shows the correspondence between the contact a and the motion trajectory, the mapping point a', and the mapping trajectory, and the display state of the virtual object before moving according to the mapping trajectory, in the right diagram of FIG. 2C.
  • the display state after the virtual object moves according to the mapping trajectory is shown.
  • mapping track when used to indicate the rotation operation, please refer to the second variation diagram of the virtual object shown in FIG. 2D, wherein the operation is a rotation operation triggered on the rear surface of the electronic device.
  • the trajectory indication is rotated counterclockwise by a predetermined angle by contact a (located on the back of the electronic device, not shown in Figure 2D).
  • the mapping point a' and the mapping trajectory are obtained based on the contact a and the motion trajectory, which indicates that the predetermined angle is rotated counterclockwise by the mapping point a', please refer to the dotted arrow in the right diagram of Fig. 2D.
  • the left diagram of FIG. 2D shows the display state of the virtual object before moving according to the mapping trajectory
  • the right diagram of FIG. 2D shows the display state of the virtual object after moving according to the mapping trajectory.
  • the operated contacts may be at least one.
  • the contact of the operation is one; when the user triggers the operation on the touch surface through multiple fingers or through other parts of the hand, the operated contact is At least two.
  • the virtual object operation method is introduced by the user operating the virtual object through the tiger's mouth part. At this time, the contact on the touch surface is two, and the two contacts rotate in opposite directions at any time. .
  • the electronic device When the electronic device is located at the tiger's mouth position of the hand, the contact between the tiger mouth and the touch surface includes the contact A and the contact B, since the touch surface is an electronic device. The lower surface, therefore, the mapping surface is the lower surface of the three-dimensional model. At this time, the electronic device can determine the mapping point a corresponding to the contact A and the mapping point b corresponding to the contact B on the lower surface of the three-dimensional model.
  • the contact A and the contact B simultaneously move in the counterclockwise direction and the rotation directions of the contact A and the contact B are opposite.
  • the moving direction of the mapping point a and the mapping point b is as shown in Fig. 2E.
  • changing the display state of the virtual object according to the operation includes:
  • the correspondence relationship is used to store the relationship between the operation and the display instruction.
  • two opposite sliding operations simultaneously acting on the touch surface correspond to the zooming operation
  • the click operation corresponds to the panning operation
  • the double clicking operation corresponds to the zooming operation.
  • the rotation operation or the like does not limit the correspondence in this embodiment.
  • the scaling of the scaling operation may be fixed or related to the operation.
  • the sliding distance of the operation is positively correlated with the scaling. For example, the sliding distance of 1 cm in the opposite sliding operation corresponds to a magnification ratio of 200%; the sliding distance of 1 cm in the relative sliding operation corresponds to a reduction ratio of 50% or the like.
  • the direction and distance of movement of the panning operation can be fixed or related to the operation.
  • the operation duration of the operation is positively related to the distance. For example, when the operation time of the click operation is 1 second, it corresponds to a distance of 2 cm; when the operation time of the click operation is 2 seconds, it corresponds to a distance of 5 cm.
  • the type of operation is related to the direction of movement. For example, when the operation type is a click operation, the movement direction is to the left; when the operation type is a double-click operation, the movement direction is to the right.
  • the direction and angle of rotation of the rotary operation can be fixed or related to operation.
  • the operational duration of the operation is positively correlated with the angle. For example, when the operation time of the click operation is 1 second, it corresponds to 30°; when the operation time of the click operation is 2 seconds, it corresponds to 60°.
  • the type of operation is related to the direction of movement. For example, when the operation type is a click operation, the rotation direction is counterclockwise; when the operation type is a double-click operation, the rotation direction is clockwise.
  • the electronic device can change the display state of the virtual object according to the display instruction acting on the mapping surface. Specifically, the electronic device may set a default point on the mapping surface, control the virtual object to follow the default point, and move a certain distance according to the moving direction; or control the virtual object to follow the mapping point and rotate an angle according to the rotation direction.
  • the specific translation and rotation process is described in detail above, and will not be described here.
  • the two virtual objects when at least two virtual objects are displayed on the screen, the two virtual objects may be operated as a whole, or a virtual object may be selected for operation.
  • the operation method is as described above, and is not described herein. .
  • the virtual object operation method by acquiring an operation triggered on a touch surface, the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen.
  • the surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.
  • the stereo model is a model corresponding to the outer surface geometric model of the electronic device; at least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object may be
  • the virtual object can be placed in a stereo model corresponding to the geometric model of the outer surface of the electronic device. Since the touch surface corresponds to a mapping surface, operations performed on the touch surface can be mapped. For the operations performed on the mapped surface, It does not need to be mapped to a virtual object, and the effect of simplifying the mapping process to the operation is achieved.
  • FIG. 3 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention.
  • the virtual object operating device is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed on the electronic device.
  • the touch surface is disposed on the electronic device.
  • the operation obtaining module 301 is configured to acquire an operation triggered on a touch surface
  • the surface mapping module 302 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;
  • the operation mapping module 303 is configured to map the operation acquired by the operation obtaining module 301 to an operation triggered on the mapping surface obtained by the surface mapping module 302.
  • the state change module 304 is configured to change the display state of the virtual object according to the operation mapped by the operation mapping module 303.
  • the virtual object operating device obtains an operation triggered on a touch surface, and the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen.
  • the surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.
  • an embodiment of the present invention further provides a virtual object operating device, which is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed outside the screen of the electronic device.
  • a virtual object operating device which is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed outside the screen of the electronic device.
  • the touch surface On the surface, it can include:
  • the operation obtaining module 301 is configured to acquire an operation triggered on a touch surface
  • the surface mapping module 302 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;
  • An operation mapping module 303 configured to map the operation acquired by the operation obtaining module 301 to be on the surface The operation triggered on the mapping surface obtained by the mapping module 302;
  • the state change module 304 is configured to change the display state of the virtual object according to the operation mapped by the operation mapping module 303.
  • the operation mapping module 303 is specifically configured to:
  • the virtual object is placed in a stereo model, which is a model corresponding to the geometric model of the outer surface of the electronic device;
  • At least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface.
  • the state change module 304 is specifically configured to:
  • mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • the motion trajectory is mapped onto the mapping surface to obtain a mapping trajectory
  • the display state of the virtual object is controlled to vary with the mapping trajectory according to the mapping point.
  • the state change module 304 is specifically configured to:
  • the contact coordinates are mapped onto the mapping surface to obtain the mapping point coordinates;
  • the point corresponding to the coordinates of the map point is determined as a map point.
  • the state change module 304 is specifically configured to:
  • mapping trajectory When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • mapping trajectory When the mapping trajectory is used to indicate the rotation operation, the rotation direction and angle of the mapping trajectory are determined, and the virtual object is controlled to follow the mapping point, and the angle is rotated according to the rotation direction.
  • the state change module 304 is further configured to:
  • the display state of the virtual object is changed according to a display instruction acting on the mapping surface.
  • the virtual object operating device is obtained by acquiring a touch The surface-triggered operation, the touch surface is disposed on an outer surface of the electronic device other than the screen; the touch surface is mapped onto the virtual object to obtain a mapping surface, and the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to At least one surface not displayed on the screen in the virtual object; mapping the operation to an operation triggered on the mapping surface; changing the display state of the virtual object according to the operation, according to the characteristics of the electronic device being a three-dimensional object, touching on the screen Performing operations on the control surface, thereby directly mapping the operation to the corresponding surface of the virtual object, solves the problem of controlling the surface not displayed on the screen in the three-dimensional object through the screen, usually requires multiple operations to complete, and the operation efficiency is low, reaching The effect of improving operational efficiency.
  • the stereo model is a model corresponding to the outer surface geometric model of the electronic device; at least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object may be
  • the virtual object can be placed in a stereo model corresponding to the geometric model of the outer surface of the electronic device. Since the touch surface corresponds to a mapping surface, operations performed on the touch surface can be mapped. The effect of simplifying the mapping process to operations is achieved for operations performed on the mapped surface without mapping to virtual objects.
  • FIG. 4 is a schematic structural diagram of a virtual object operating device according to an embodiment of the present invention.
  • the virtual object operating device is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed on the electronic device.
  • the apparatus includes a bus 401, and a processor 402, a memory 403, a transmitter 404, and a receiver 405 connected to the bus 401.
  • the memory 403 is configured to store a plurality of instructions, the instructions being configured to be executed by the processor 402;
  • a receiver 405, configured to acquire an operation triggered on a touch surface
  • the processor 402 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;
  • the processor 402 is configured to map the operation received by the receiver 405 to an operation triggered on the mapping surface;
  • the processor 402 is configured to change a display state of the virtual object according to the operation.
  • the virtual object operating device obtains an operation triggered on a touch surface, and the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; mapping the operation to Mapping the operation triggered on the surface; changing the display state of the virtual object according to the operation, according to the characteristics of the electronic device being a three-dimensional object, performing an operation on the off-screen touch surface, thereby directly mapping the operation to the corresponding surface of the virtual object,
  • the invention solves the problem that the surface not displayed on the screen in the three-dimensional object is controlled by the screen, usually requires multiple operations to complete, and the operation efficiency is low, and the effect of improving the operation efficiency is achieved.
  • an embodiment of the present invention further provides a virtual object operating device, which is applied to an electronic device including a screen and a touch surface, and the touch surface is disposed outside the screen of the electronic device.
  • the apparatus includes a bus 401, and a processor 402, a memory 403, a transmitter 404, and a receiver 405 connected to the bus 401.
  • the memory 403 is configured to store a plurality of instructions, the instructions being configured to be executed by the processor 402;
  • a receiver 405, configured to acquire an operation triggered on a touch surface
  • the processor 402 is configured to map the touch surface to the virtual object to obtain a mapping surface, where the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen;
  • the processor 402 is configured to map the operation received by the receiver 405 to an operation triggered on the mapping surface;
  • the processor 402 is configured to change a display state of the virtual object according to the operation.
  • the processor 402 is specifically configured to:
  • the virtual object is placed in a stereo model, which is a model corresponding to the geometric model of the outer surface of the electronic device;
  • At least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface.
  • the processor 402 is specifically configured to:
  • mapping the contact to the mapping surface according to a proportional relationship between the area of the touch surface and the area of the mapping surface to obtain a mapping point
  • the motion trajectory is mapped onto the mapping surface to obtain a mapping trajectory
  • the display state of the virtual object is controlled to vary with the mapping trajectory according to the mapping point.
  • the processor 402 is specifically configured to:
  • the contact coordinates are mapped onto the mapping surface to obtain the mapping point coordinates;
  • the point corresponding to the coordinates of the map point is determined as a map point.
  • the processor 402 is specifically configured to:
  • mapping trajectory When the mapping trajectory is used to indicate a panning operation, determining a moving direction and a distance indicated by the mapping trajectory, controlling the virtual object to follow the mapping point, and moving the distance according to the moving direction;
  • mapping trajectory When the mapping trajectory is used to indicate the rotation operation, the rotation direction and angle of the mapping trajectory are determined, and the virtual object is controlled to follow the mapping point, and the angle is rotated according to the rotation direction.
  • the processor 402 is specifically configured to:
  • the display state of the virtual object is changed according to a display instruction acting on the mapping surface.
  • the virtual object operating device obtains an operation triggered on a touch surface, and the touch surface is disposed on an outer surface of the electronic device other than the screen; mapping the touch surface to On the virtual object, a mapping surface is obtained, the virtual object is a three-dimensional object displayed on the screen, and the mapping surface corresponds to at least one surface of the virtual object that is not displayed on the screen; the operation is mapped to an operation triggered on the mapping surface; Changing the display state of the virtual object can perform operations on the off-screen touch surface according to the characteristics of the electronic device being a three-dimensional object, thereby directly mapping the operation to the corresponding surface of the virtual object, thereby solving the problem of controlling the three-dimensional object through the screen.
  • the surface displayed on the screen usually requires multiple operations to complete, and the problem of low operational efficiency achieves an effect of improving operational efficiency.
  • the stereo model is a model corresponding to the outer surface geometric model of the electronic device; at least one surface corresponding to the touch surface in the stereo model is determined as a mapping surface, and the virtual object may be
  • the virtual object can be placed in a stereo model corresponding to the geometric model of the outer surface of the electronic device. Since the touch surface corresponds to a mapping surface, operations performed on the touch surface can be mapped. The effect of simplifying the mapping process to operations is achieved for operations performed on the mapped surface without mapping to virtual objects.
  • the virtual object operating device provided by the above embodiment performs virtual object operations.
  • the above-mentioned function allocation can be completed by different functional modules according to requirements, that is, the internal structure of the virtual object operating device is divided into different functional modules to complete All or part of the functions described above.
  • the virtual object operating device and the virtual object operating method embodiment are provided in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit may be only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present invention may contribute to the prior art or part of the technical solution. Illustrated in the form of a software product stored in a storage medium, comprising instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the embodiments of the present invention All or part of the steps of the method.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Abstract

L'invention concerne un procédé et un dispositif d'opération d'objet virtuel qui se rapportent au domaine technique des ordinateurs. Le procédé s'applique à un dispositif électronique comportant un écran et une surface tactile, la surface tactile étant disposée sur une surface externe du dispositif électronique excluant l'écran. Le procédé consiste : à acquérir une opération déclenchée sur une surface tactile (101) ; à faire correspondre la surface tactile à un objet virtuel pour obtenir une surface de mise en correspondance, l'objet virtuel étant un objet tridimensionnel affiché sur l'écran, et la surface de mise en correspondance correspondant à au moins une surface qui n'est pas affichée sur l'écran sur l'objet virtuel (102) ; à mettre en correspondance l'opération en tant qu'opération déclenchée sur la surface de mise en correspondance (103) ; à changer l'état d'affichage de l'objet virtuel selon l'opération (104). L'invention permet de résoudre le problème selon lequel l'efficacité d'opération est faible en raison du fait qu'une surface, qui n'est pas affichée sur un écran, d'un objet tridimensionnel est commandée au moyen de l'écran et que la commande nécessite de multiples opérations ; par conséquent, l'effet d'amélioration de l'efficacité d'opération est obtenu.
PCT/CN2015/074121 2015-03-12 2015-03-12 Procédé et dispositif d'opération d'objet virtuel WO2016141594A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2015/074121 WO2016141594A1 (fr) 2015-03-12 2015-03-12 Procédé et dispositif d'opération d'objet virtuel
CN201580023366.3A CN106462264B (zh) 2015-03-12 2015-03-12 虚拟对象操作方法及装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/074121 WO2016141594A1 (fr) 2015-03-12 2015-03-12 Procédé et dispositif d'opération d'objet virtuel

Publications (1)

Publication Number Publication Date
WO2016141594A1 true WO2016141594A1 (fr) 2016-09-15

Family

ID=56878752

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/074121 WO2016141594A1 (fr) 2015-03-12 2015-03-12 Procédé et dispositif d'opération d'objet virtuel

Country Status (2)

Country Link
CN (1) CN106462264B (fr)
WO (1) WO2016141594A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1260533A (zh) * 1998-12-22 2000-07-19 将盟股份有限公司 视窗应用程序使用的电脑输入系统及其指标输入装置
US8229510B2 (en) * 2009-04-29 2012-07-24 Unique Instruments Co. Ltd Device having 2D and 3D image display functions for mobile phone
CN102645986A (zh) * 2012-03-03 2012-08-22 吕岳敏 一种具有三维对象的手持电子装置
CN104007915A (zh) * 2013-02-27 2014-08-27 共青城赛龙通信技术有限责任公司 一种电子装置的三维触摸式操作结构及操作方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002229991A (ja) * 2001-01-31 2002-08-16 Fujitsu Ltd サーバ，ユーザ端末，情報提供サービスシステムおよび情報提供サービス方法
US8384683B2 (en) * 2010-04-23 2013-02-26 Tong Luo Method for user input from the back panel of a handheld computerized device
CN103092381B (zh) * 2011-10-28 2016-03-23 宏碁股份有限公司 具有多个触控界面的电子装置以及操控三维图像的方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1260533A (zh) * 1998-12-22 2000-07-19 将盟股份有限公司 视窗应用程序使用的电脑输入系统及其指标输入装置
US8229510B2 (en) * 2009-04-29 2012-07-24 Unique Instruments Co. Ltd Device having 2D and 3D image display functions for mobile phone
CN102645986A (zh) * 2012-03-03 2012-08-22 吕岳敏 一种具有三维对象的手持电子装置
CN104007915A (zh) * 2013-02-27 2014-08-27 共青城赛龙通信技术有限责任公司 一种电子装置的三维触摸式操作结构及操作方法

Also Published As

Publication number Publication date
CN106462264B (zh) 2019-07-12
CN106462264A (zh) 2017-02-22

Similar Documents

Publication Publication Date Title
CN110581947B (zh) 在虚拟现实内拍照
JP6046729B2 (ja) 全方向ジェスチャー入力
US10684673B2 (en) Apparatus and control method based on motion
JP7382994B2 (ja) 仮想現実システム内の仮想コントローラの位置および向きの追跡
US20150186004A1 (en) Multimode gesture processing
TW201220159A (en) Apparatus and method for user input for controlling displayed information
EP2558924B1 (fr) Appareil, procédé et programme d'entrée d'utilisateur à l'aide d'une caméra
CN103890703A (zh) 输入控制设备、输入控制方法以及输入控制程序
KR20120126508A (ko) 포인터를 사용하지 않는 가상 터치 장치에서의 터치 인식 방법
WO2014116166A1 (fr) Saisie évolutive à partir d'un objet suivi
US20190087020A1 (en) Three-dimensional input device
US20150241968A1 (en) Method for Processing Information and Electronic Device
JP6569794B1 (ja) 情報処理装置及びプログラム
US20130249807A1 (en) Method and apparatus for three-dimensional image rotation on a touch screen
CN110276794A (zh) 信息处理方法、信息处理装置、终端设备及服务器
CN106569716A (zh) 单手操控方法及操控系统
US20170017389A1 (en) Method and apparatus for smart device manipulation utilizing sides of device
WO2016141594A1 (fr) Procédé et dispositif d'opération d'objet virtuel
JP2017215842A (ja) 電子機器
US9082223B2 (en) Smooth manipulation of three-dimensional objects
JP2019096182A (ja) 電子装置、表示方法、およびプログラム
JP2020062376A (ja) 情報処理装置及びプログラム
TW201913298A (zh) 可顯示實體輸入裝置即時影像之虛擬實境系統及其控制方法
CN112328154B (zh) 设备控制方法、装置及电子设备
CN112402967B (zh) 游戏控制方法、装置、终端设备及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15884277

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15884277

Country of ref document: EP

Kind code of ref document: A1