CN111467791A - Target object control method, device and system - Google Patents

Target object control method, device and system Download PDF

Info

Publication number
CN111467791A
CN111467791A CN202010287575.1A CN202010287575A CN111467791A CN 111467791 A CN111467791 A CN 111467791A CN 202010287575 A CN202010287575 A CN 202010287575A CN 111467791 A CN111467791 A CN 111467791A
Authority
CN
China
Prior art keywords
touch screen
event
virtual key
target object
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010287575.1A
Other languages
Chinese (zh)
Other versions
CN111467791B (en
Inventor
卢涛
范志刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Wanxiang Electronics Technology Co Ltd
Original Assignee
Xian Wanxiang Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Wanxiang Electronics Technology Co Ltd filed Critical Xian Wanxiang Electronics Technology Co Ltd
Priority to CN202010287575.1A priority Critical patent/CN111467791B/en
Publication of CN111467791A publication Critical patent/CN111467791A/en
Application granted granted Critical
Publication of CN111467791B publication Critical patent/CN111467791B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55—Controlling game characters or game objects based on the game progress

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a target object control method, device and system. Wherein, the method comprises the following steps: sending the virtual key information of the virtual key to a terminal, wherein the virtual key is used for controlling a target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event. The cloud game system based on the end game solves the technical problem that the game of the cloud end game cannot be controlled through the touch screen of the hand game.

Description

Target object control method, device and system
Technical Field
The application relates to the field of computers, in particular to a method, a device and a system for controlling a target object.
Background
Cloud gaming (Cloud gaming), also known as game on demand (gaming), is an online gaming technology based on Cloud computing technology. Cloud gaming technology enables a high-quality game to be run by a terminal thin client (thin client) with relatively limited graphics processing and data computing capabilities. In a cloud game scene, a game is not in a player game terminal but runs in a cloud server, a user can control VM (virtual machine)/PM (physical machine) on the cloud server through the game terminal, the cloud server renders the game scene into a video and audio stream, the video and audio stream is transmitted to the player game terminal through a network and displayed to the user through a display screen, visual lossy/lossless transmission of computer images such as texts, graphs and diagrams in a standard network and a reverse control function of the user on the VM/PM are achieved, and extremely-sophisticated experience which is completely the same as that of a remote user using a computer locally is provided for the remote user. The player game terminal does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring player input instructions and sending the instructions to the cloud server. The structural schematic diagram of the cloud game system is shown in fig. 1.
Existing game control methods include keyboard and mouse control, gamepad control, touch screen control, and the like. The cloud games can be divided into two categories of hand games and end games, wherein the hand games are mostly controlled by a touch screen (a small amount of game handles are also controlled), namely the games are controlled by the touch screen of a mobile phone, and control events of the touch screen of the game terminal are injected into a mobile phone operating system of VM/PM and then into the cloud games. The game terminal is usually controlled by using a keyboard mouse or a gamepad connected to the game terminal, and the control event of the keyboard mouse or the gamepad of the terminal is transmitted to the cloud and then injected into a desktop operating system of the VM/PM and further into the cloud game.
How to control the game of the cloud end game through the touch screen of the hand game is a problem to be solved.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a target object control method, a target object control device and a target object control system, and aims to at least solve the technical problem that a cloud game system based on end games cannot control a game of a cloud end game through a touch screen of a hand game.
According to an aspect of an embodiment of the present application, there is provided a method of controlling a target object, including: sending the virtual key information of the virtual key to a terminal, wherein the virtual key is used for controlling a target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event.
Optionally, the virtual key information includes: the method comprises the steps of displaying icons of virtual keys on a touch screen of the terminal, and displaying positions of the icons of the virtual keys on the touch screen of the terminal.
Optionally, the first touch screen event is generated by at least one of: generating a first touch screen event according to an operation action of clicking a single virtual key on the touch screen or an operation action of clicking a region corresponding to the single virtual key; and generating a first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
Optionally, the controlling the target object to perform a function corresponding to the first touch screen event includes: synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of the server; searching a first key operation event corresponding to a second touch screen event from first preset control information, wherein the first preset control information stores virtual key information, a control area corresponding to a virtual key and a first key operation event corresponding to clicking of a single virtual key; the control target object executes a function corresponding to the first key operation event.
Optionally, the controlling the target object to execute a function corresponding to the first touch screen event further includes: synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of the server; searching a second key operation event corresponding to a second touch screen event from second preset control information, wherein the second preset control information stores second key operation events corresponding to continuous clicking of a plurality of virtual keys; and controlling the target object to execute the function corresponding to the second key operation event.
Optionally, synchronizing the first touch screen event to a second touch screen event corresponding to the touch screen of the server includes: and simulating and executing the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
Optionally, the icon of the virtual key is displayed on the touch screen of the terminal in a form of at least one of: displaying on a touch screen of the terminal according to different transparencies; hidden on the touch screen of the terminal.
According to another aspect of the embodiments of the present application, there is provided another method for controlling a target object, including: acquiring virtual key information of a virtual key sent by a server, wherein the virtual key is used for controlling a target object; generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event.
Optionally, the virtual key information includes: the method comprises the steps of displaying icons of virtual keys on a touch screen of the terminal, and displaying positions of the icons of the virtual keys on the touch screen of the terminal.
Optionally, after obtaining the virtual key information of the virtual key sent by the server, the method further includes: displaying the icon of the virtual key on a touch screen of the terminal according to at least one of the following forms: displaying on a touch screen of the terminal according to different transparencies; hidden on the display screen of the terminal.
Optionally, the first touch screen event is generated according to an operation action on the virtual key detected on the touch screen of the terminal, and includes at least one of the following: generating a first touch screen event according to an operation action of clicking a single virtual key on the touch screen or an operation action of clicking a region corresponding to the single virtual key; and generating a first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
Optionally, the controlling the target object to perform a function corresponding to the first touch screen event includes: the control target object executes a function corresponding to a first key operation event, wherein the first key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; the server searches a first key operation event corresponding to the second touch screen event from first preset control information, wherein the first preset control information stores virtual key information, a control area corresponding to a virtual key and a first key operation event corresponding to clicking of a single virtual key.
Optionally, the controlling the target object to execute a function corresponding to the first touch screen event further includes: controlling the target object to execute a function corresponding to a second key operation event, wherein the second key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; and the server searches a second key operation event corresponding to the second touch screen event from second preset control information, wherein the second key operation event corresponding to continuous clicking of the plurality of virtual keys is stored in the second preset control information.
Optionally, the second touch screen event is generated by: and the server simulates and executes the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
According to another aspect of the embodiments of the present application, there is also provided a control apparatus of a target object, including: the sending module is used for sending the virtual key information of the virtual keys to the terminal, and the virtual keys are used for controlling the target object; the terminal comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a first touch screen event from the terminal, and the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; and the first control module is used for controlling the target object to execute the function corresponding to the first touch screen event.
According to another aspect of the embodiments of the present application, there is provided another control apparatus for a target object, including: the second acquisition module is used for acquiring virtual key information of a virtual key sent by the server, and the virtual key is used for controlling the target object; the generating module is used for generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal; and the second control module is used for controlling the target object to execute the function corresponding to the first touch screen event.
According to another aspect of the embodiments of the present application, there is also provided a control system of a target object, including: the server is used for sending the virtual key information of the virtual keys to the terminal, and the virtual keys are used for controlling the target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; controlling the target object to execute a function corresponding to the first touch screen event; the terminal is in communication connection with the server and used for acquiring virtual key information of the virtual key sent by the server; and generating a first touch screen event and sending the first touch screen event to a server.
According to still another aspect of the embodiments of the present application, there is also provided a storage medium including a stored program, wherein the control method of controlling a device on which the storage medium is located to execute the above target object is controlled when the program runs.
According to still another aspect of the embodiments of the present application, there is also provided a processor for executing a program stored in a memory, wherein the program executes the above control method of a target object when running.
In the embodiment of the application, the virtual key information of the virtual key is sent to the terminal, and the virtual key is used for controlling the target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; the mode of controlling the target object to execute the function corresponding to the first touch screen event comprises the steps of firstly generating a touch screen event according to the operation action of a game user, then sending the touch screen event to VM/PM of a cloud server, firstly synchronizing the touch screen event triggered by a remote game terminal into the touch screen event generated by the local VM/PM by the VM/PM, then converting the touch screen event into a gamepad key event which can be analyzed by an operating system and a game, and finally injecting the gamepad key event into the operating system and the game on the local VM/PM to realize the control of the game based on the cloud game system, thereby realizing the technical effect that the touch screen of the game terminal is used as a game handle for a game user to control the game when displaying the game picture, and then solved the cloud recreation system based on the end game, can't realize through the touch-sensitive screen of hand trip to the recreation of high in the clouds end game control technical problem.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic structural diagram of a cloud game system according to an embodiment of the present application;
FIG. 2 is a flow chart of a method of controlling a target object according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a cloud game system according to an embodiment of the present application;
FIG. 4 is a block diagram of a virtual handle driving module of a game terminal according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a screen of a game terminal according to an embodiment of the present application, which is compatible with a display screen and a gamepad during a game;
fig. 6 is a flowchart of another control method of a target object according to an embodiment of the present application;
fig. 7 is a block diagram of a control apparatus of a target object according to an embodiment of the present application;
fig. 8 is a block diagram of a control apparatus of another target object according to an embodiment of the present application;
fig. 9 is a block diagram of a control system of a target object according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an embodiment of the present application, there is provided an embodiment of a method for controlling a target object, it should be noted that the steps shown in the flowchart of the drawings may be executed in a computer system such as a set of computer executable instructions, and that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in an order different from that here.
Fig. 2 is a flowchart of a method for controlling a target object according to an embodiment of the present application, and as shown in fig. 2, the method includes the following steps:
step S202, virtual key information of the virtual keys is sent to the terminal, and the virtual keys are used for controlling the target object.
According to an optional embodiment of the present application, the virtual key information includes: the method comprises the steps of displaying icons of virtual keys on a touch screen of the terminal, and displaying positions of the icons of the virtual keys on the touch screen of the terminal.
Fig. 3 is a schematic structural diagram of a cloud game system according to an embodiment of the present application, and as shown in fig. 3, the cloud game system includes a cloud server and a game terminal, where a plurality of VMs/PMs run in the cloud server, a virtual handle driving module and a touch screen driving module 2 are disposed in the VMs/PMs, and a touch screen driving module 1 is disposed in the game terminal.
The game terminal can be an intelligent terminal device provided with a display screen, such as an intelligent mobile phone, a tablet personal computer, a notebook computer and the like, and the display screen has a touch function. For convenience, the screens mentioned hereinafter are all display screens having a touch function.
The game terminal can be simulated as a gamepad, and the screen of the game terminal displays key icons of the gamepad. In this way, the screen of the game terminal can acquire the operation action of the game player while displaying the game screen. The gamer realizes gamepad-based control of the game by touching the screen of the game terminal.
A virtual handle driving module of the VM/PM sends key display information of a game handle to the game terminal; the game terminal displays each key icon on the screen after receiving the key display information.
In this step, since the key layouts of the various game pads may be different, the virtual pad driver module on the VM/PM may send the matched key display information of the game pad to the game terminal, where the key display information includes the shape and color of each key icon and the display position of each key image; and after receiving the key display information of the gamepad, the game terminal displays each key icon on the screen according to the key display information.
It should be noted that the virtual handle driving module is preset with game handle control information. The game paddle control information comprises key display information of the game paddle, control areas of all keys and handle key events corresponding to all the keys.
Step S204, a first touch screen event from the terminal is obtained, and the first touch screen event is generated according to the operation action of the virtual key detected on the touch screen of the terminal.
The game terminal generates a touch screen event 1 according to an operation action executed by a game user on a game handle, and sends the generated touch screen event 1 to a VM/PM on the cloud server.
In this step, when each key icon is displayed on the screen of the game terminal, the game user can perform an operation action for controlling the game on the screen; after the touch screen driving module 1 of the game terminal acquires the operation action, generating a touch screen event 1 corresponding to the operation action; the game terminal transmits the generated touch screen event 1 to the touch screen driving module 2 on the VM/PM.
In step S206, the control target object performs a function corresponding to the first touch screen event.
Through the steps, the touch screen event is generated according to the operation action of the game user, the touch screen event is sent to the VM/PM of the cloud server, the VM/PM synchronizes the touch screen event triggered by the remote game terminal to the touch screen event generated by the local VM/PM, the touch screen event is converted into the game handle key event which can be analyzed by the operating system and the game, and finally the game handle key event is injected into the local VM/PM operating system and the game, so that the control of the game based on the cloud game system is realized, and the technical effect that the touch screen of the game terminal is used as the game handle for the game user to control the game while displaying the game picture is realized.
According to an alternative embodiment of the present application, the first touch screen event in step S204 is generated by at least one of: generating a first touch screen event according to an operation action of clicking a single virtual key on the touch screen or an operation action of clicking a region corresponding to the single virtual key; and generating a first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
In an alternative embodiment of the present application, a user may click a single virtual key on a touch screen to generate a first touch screen event, or may generate the first touch screen event through a gesture event, where the gesture event is to trigger a certain function event through a specific gesture operation. For example, drawing S on a cell phone screen may trigger a screen capture event. Gesture events may also be set in the game for controlling actions or functions in the game.
Specifically, a combination of multiple keys may be set as a gesture event, and the gesture event triggers a gamepad event corresponding to the multiple combined keys.
According to an alternative embodiment of the present application, step S206 may be implemented by: synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of the server; searching a first key operation event corresponding to a second touch screen event from first preset control information, wherein the first preset control information stores virtual key information, a control area corresponding to a virtual key and a first key operation event corresponding to clicking of a single virtual key; the control target object executes a function corresponding to the first key operation event.
According to an optional embodiment of the application, a touch screen driving module 2 of the VM/PM receives a touch screen event 1 from the game terminal, and synchronizes the touch screen event 1 to a touch screen event 2 of the local device; and sending the synchronized touch screen event 2 to the virtual handle driving module.
In this step, the touch screen driving module 2 synchronizes the touch screen event 1 generated by the remote device (game terminal) to the touch screen event 2 generated on the touch screen of the local device (cloud server), and sends the touch screen event 2 to the virtual handle driving module.
It should be noted that synchronizing the touch screen event 1 to the touch screen event 2 is equivalent to "moving" the game user to the touch screen connected to the cloud server to perform the operation action performed on the screen of the game terminal, and finally generating the touch screen event 2.
For example, a game user clicks a button a on a screen of a game terminal, and the game terminal sends a touch screen event 1 generated by an operation action of clicking the button a once to a touch screen driver 2; the touch screen driver 2 also simulates and executes an operation action of clicking the key A once on the touch screen connected with the cloud server according to the received touch screen event 1, and generates a touch screen event 2 corresponding to the clicking the key A once.
A virtual handle driving module in the VM/PM determines a game handle key event corresponding to the touch screen event 2 according to preset game handle control information; the gamepad key events are injected into the game program.
In this step, after receiving the touch screen event 2 sent by the touch screen driving module 2, the virtual handle driving module in the VM/PM may determine, according to preset gamepad control information, a gamepad key event corresponding to the touch screen event 2, and inject the gamepad key event into the operating system of the VM/PM and further into the game program.
The game program can realize the function corresponding to the game handle key event in the game after receiving the game handle key event.
It should be noted that the joystick control information includes key display information of the joystick, a control area of each key, and a joystick key event corresponding to each key.
For example, the control area of the button a is the lower left area of the touch screen, and the game handle button event corresponding to one click of the button a is "jump"; then, when the touch screen event occurs in the lower left area of the touch screen and the operation action corresponding to the touch screen event is a click once, the gamepad key event corresponding to the touch screen event is a "jump", and after the gamepad key event is injected into the game program, the character in the game may perform the "jump" action.
According to an alternative embodiment of the present application, step S206 can also be implemented by the following method: synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of the server; searching a second key operation event corresponding to a second touch screen event from second preset control information, wherein the second preset control information stores second key operation events corresponding to continuous clicking of a plurality of virtual keys; and controlling the target object to execute the function corresponding to the second key operation event.
In order to realize that the game player controls the game through the gesture event, a setting sub-module may be added to the virtual handle driving module, as shown in fig. 4: the corresponding relation between the gesture event and the game handle event can be preset in a setting submodule in a virtual handle driving module of the game terminal.
The specific treatment process is as follows: firstly, a touch screen driving module 2 synchronizes a received gesture event 1 generated by a remote gesture operation into a local gesture event 2, and sends the gesture event 2 to a virtual handle driving module; then, the virtual handle driving module determines a game handle key event corresponding to the gesture event 2 according to a preset corresponding relation in the setting submodule; and finally, injecting the game handle key event corresponding to the gesture event 2 into the operating system of the VM/PM by the virtual handle driving module, and further injecting the game handle key event into a game program.
It should be noted that the games mentioned in the present invention are all games supporting joystick control.
In an optional implementation of the present application, synchronizing the first touch screen event to a second touch screen event corresponding to a touch screen of the server includes: and simulating and executing the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
Synchronizing the touch screen event 1 into a touch screen event 2, which is equivalent to "moving" the operation action executed by the game user on the screen of the game terminal to the touch screen connected with the cloud server for execution, and finally generating the touch screen event 2.
In the invention, the conversion of the touch screen event into the gamepad key event is completed by the cloud server, and the game terminal only needs to send the touch screen event to the cloud server, so that the cloud server can be compatible no matter whether the operating system of the game terminal is iOS or android. Therefore, the research and development cost can be saved, and the research and development period can be shortened.
In some optional embodiments of the present application, the icon of the virtual key is displayed on the touch screen of the terminal in a form of at least one of: displaying on a touch screen of the terminal according to different transparencies; hidden on the touch screen of the terminal.
Fig. 5 is a schematic diagram of a game terminal screen and a gamepad in a game process according to an embodiment of the application, in fig. 5, a rectangle with a thick black frame is a smartphone screen, a game picture is displayed on the smartphone screen, and meanwhile, control keys of the gamepad are displayed on the smartphone screen. In order to reduce the influence on the display effect of the game picture as much as possible, the display mode of the control keys of the game pad can be set to be semi-transparent or hidden and not displayed.
When the display mode of the control key on the display screen is set to be hidden and not displayed, although the control key of the gamepad is not displayed on the screen, when the finger of the game user contacts the control area corresponding to the control key on the screen, the touch screen driving module 1 of the game terminal can acquire the operation action of the game user and generate a corresponding touch screen event.
Fig. 6 is a flowchart of another control method of a target object according to an embodiment of the present application, as shown in fig. 6, the method including:
step S602, obtaining virtual key information of a virtual key sent by the server, where the virtual key is used to control the target object.
According to an optional embodiment of the present application, the virtual key information includes: the method comprises the steps of displaying icons of virtual keys on a touch screen of the terminal, and displaying positions of the icons of the virtual keys on the touch screen of the terminal.
Step S604, generating a first touch screen event according to the operation action on the virtual key detected on the touch screen of the terminal.
In step S606, the control target object executes a function corresponding to the first touch screen event.
According to an alternative embodiment of the present application, after step S602 is executed, the icons of the virtual keys are displayed on the touch screen of the terminal in the form of at least one of the following: displaying on a touch screen of the terminal according to different transparencies; hidden on the display screen of the terminal.
According to an alternative embodiment of the present application, step S604 may be implemented by: generating a first touch screen event according to an operation action of clicking a single virtual key on the touch screen or an operation action of clicking a region corresponding to the single virtual key; and generating a first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
In some optional embodiments of the present application, step S606 may be implemented by: the control target object executes a function corresponding to a first key operation event, wherein the first key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; the server searches a first key operation event corresponding to the second touch screen event from first preset control information, wherein the first preset control information stores virtual key information, a control area corresponding to a virtual key and a first key operation event corresponding to clicking of a single virtual key.
In some optional embodiments of the present application, step S606 may also be implemented by: controlling the target object to execute a function corresponding to a second key operation event, wherein the second key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; and the server searches a second key operation event corresponding to the second touch screen event from second preset control information, wherein the second key operation event corresponding to continuous clicking of the plurality of virtual keys is stored in the second preset control information.
According to an alternative embodiment of the present application, the second touch screen event is generated by: and the server simulates and executes the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
It should be noted that, reference may be made to the description related to the embodiment shown in fig. 2 for a preferred implementation of the embodiment shown in fig. 6, and details are not described here again.
Fig. 7 is a block diagram of a control apparatus of a target object according to an embodiment of the present application, and as shown in fig. 7, the apparatus includes:
a sending module 70, configured to send virtual key information of a virtual key to the terminal, where the virtual key is used to control the target object.
The first obtaining module 72 is configured to obtain a first touch screen event from the terminal, where the first touch screen event is generated according to an operation action on a virtual key detected on a touch screen of the terminal.
A first control module 74 for controlling the target object to perform a function corresponding to the first touch screen event.
It should be noted that, reference may be made to the description related to the embodiment shown in fig. 2 for a preferred implementation of the embodiment shown in fig. 7, and details are not described here again.
Fig. 8 is a block diagram of another control apparatus of a target object according to an embodiment of the present application, and as shown in fig. 8, the apparatus includes:
a second obtaining module 80, configured to obtain virtual key information of a virtual key sent by the server, where the virtual key is used to control the target object.
The generating module 82 is configured to generate a first touch screen event according to the operation action on the virtual key detected on the touch screen of the terminal.
A second control module 84 for controlling the target object to perform a function corresponding to the first touch screen event.
It should be noted that, reference may be made to the description related to the embodiment shown in fig. 2 for a preferred implementation of the embodiment shown in fig. 8, and details are not repeated here.
Fig. 9 is a block diagram of a control system of a target object according to an embodiment of the present application, and as shown in fig. 9, the system includes: a server 90 and a terminal 92, wherein,
a server 90 configured to send virtual key information of a virtual key to the terminal 92, where the virtual key is used to control a target object; acquiring a first touch screen event from the terminal 92, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal 92; the control target object performs a function corresponding to the first touch screen event.
According to an alternative embodiment of the present application, the server 90 includes, but is not limited to, a cloud server, and a plurality of VMs/PMs are running in the cloud server.
A terminal 92, which is in communication connection with the server 90 and is used for acquiring the virtual key information of the virtual key sent by the server 90; a first touch screen event is generated and sent to the server 90.
The terminal 92 in the invention can be an intelligent terminal device equipped with a display screen, such as a smart phone, a tablet computer, a notebook computer, etc., and the display screen has a touch function.
It should be noted that, reference may be made to the description related to the embodiments shown in fig. 2 and fig. 6 for a preferred implementation of the embodiment shown in fig. 9, and details are not repeated here.
The embodiment of the application also provides a storage medium, which comprises a stored program, wherein when the program runs, the device on which the storage medium is positioned is controlled to execute the control method of the target object.
The storage medium stores a program for executing the following functions: sending the virtual key information of the virtual key to a terminal, wherein the virtual key is used for controlling a target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event. Or
Acquiring virtual key information of a virtual key sent by a server, wherein the virtual key is used for controlling a target object; generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event.
The embodiment of the application also provides a processor, wherein the processor is used for running the program stored in the memory, and the program is used for executing the control method of the target object when running.
The processor is used for running a program for executing the following functions: sending the virtual key information of the virtual key to a terminal, wherein the virtual key is used for controlling a target object; acquiring a first touch screen event from a terminal, wherein the first touch screen event is generated according to an operation action of a virtual key detected on a touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event. Or
Acquiring virtual key information of a virtual key sent by a server, wherein the virtual key is used for controlling a target object; generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal; the control target object performs a function corresponding to the first touch screen event.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a read-Only Memory (ROM), a random access Memory (RWDXDZM, RWDZndom WXDZccess Memory), a removable hard disk, a magnetic or optical disk, and various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims (19)

1. A method of controlling a target object, comprising:
sending virtual key information of a virtual key to a terminal, wherein the virtual key is used for controlling a target object;
acquiring a first touch screen event from the terminal, wherein the first touch screen event is generated according to the operation action of the virtual key detected on the touch screen of the terminal;
and controlling the target object to execute a function corresponding to the first touch screen event.
2. The method of claim 1, wherein the virtual key information comprises: the shape of the icon of the virtual key, the color of the icon of the virtual key and the display position of the icon of the virtual key on the touch screen of the terminal.
3. The method of claim 1, wherein the first touch screen event is generated by at least one of:
generating the first touch screen event according to the operation action of clicking a single virtual key on the touch screen or the operation action of clicking a region corresponding to the single virtual key;
and generating the first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
4. The method of claim 3, wherein controlling the target object to perform a function corresponding to the first touch screen event comprises:
synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of a server;
searching a first key operation event corresponding to the second touch screen event from first preset control information, wherein the first preset control information stores the virtual key information, a control area corresponding to the virtual key and the first key operation event corresponding to clicking a single virtual key;
and controlling the target object to execute a function corresponding to the first key operation event.
5. The method of claim 3, wherein controlling the target object to perform a function corresponding to the first touch screen event further comprises:
synchronizing the first touch screen event into a second touch screen event corresponding to a touch screen of a server;
searching a second key operation event corresponding to the second touch screen event from second preset control information, wherein the second key operation event corresponding to continuous clicking of a plurality of virtual keys is stored in the second preset control information;
and controlling the target object to execute a function corresponding to the second key operation event.
6. The method of claim 4 or 5, wherein synchronizing the first touch screen event to a second touch screen event corresponding to a touch screen of a server comprises:
and simulating and executing the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
7. The method according to claim 2, wherein the icons of the virtual keys are displayed on the touch screen of the terminal in the form of at least one of:
displaying on a touch screen of the terminal according to different transparencies;
hidden on the touch screen of the terminal.
8. A method of controlling a target object, comprising:
acquiring virtual key information of a virtual key sent by a server, wherein the virtual key is used for controlling a target object;
generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal;
and controlling the target object to execute a function corresponding to the first touch screen event.
9. The method of claim 8, wherein the virtual key information comprises: the shape of the icon of the virtual key, the color of the icon of the virtual key and the display position of the icon of the virtual key on the touch screen of the terminal.
10. The method of claim 9, wherein after obtaining the virtual key information of the virtual key sent by the server, the method further comprises:
displaying the icon of the virtual key on a touch screen of the terminal according to at least one of the following forms:
displaying on a touch screen of the terminal according to different transparencies;
hidden on a display screen of the terminal.
11. The method according to claim 8, wherein generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal comprises at least one of the following steps:
generating the first touch screen event according to the operation action of clicking a single virtual key on the touch screen or the operation action of clicking a region corresponding to the single virtual key;
and generating the first touch screen event according to the operation actions of continuously clicking the virtual keys on the touch screen or the operation actions of continuously clicking the areas corresponding to the virtual keys.
12. The method of claim 11, wherein controlling the target object to perform a function corresponding to the first touch screen event comprises:
controlling the target object to execute a function corresponding to a first key operation event, wherein the first key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; the server searches the first key operation event corresponding to the second touch screen event from first preset control information, wherein the first preset control information stores the virtual key information, the control area corresponding to the virtual key and the first key operation event corresponding to clicking a single virtual key.
13. The method of claim 11, wherein controlling the target object to perform a function corresponding to the first touch screen event further comprises:
controlling the target object to execute a function corresponding to a second key operation event, wherein the second key operation event is determined by: the server synchronizes the first touch screen event into a second touch screen event corresponding to a touch screen of the server; and the server searches the second key operation event corresponding to the second touch screen event from second preset control information, wherein the second key operation event corresponding to continuous clicking of a plurality of virtual keys is stored in the second preset control information.
14. The method of claim 12 or 13, wherein the second touch screen event is generated by:
and the server simulates and executes the operation action corresponding to the first touch screen event on the touch screen of the server to generate a second touch screen event.
15. A control apparatus of a target object, characterized by comprising:
the sending module is used for sending the virtual key information of the virtual key to the terminal, and the virtual key is used for controlling the target object;
the first acquisition module is used for acquiring a first touch screen event from the terminal, wherein the first touch screen event is generated according to the operation action of the virtual key detected on the touch screen of the terminal;
and the first control module is used for controlling the target object to execute a function corresponding to the first touch screen event.
16. A control apparatus of a target object, characterized by comprising:
the second acquisition module is used for acquiring virtual key information of a virtual key sent by the server, wherein the virtual key is used for controlling a target object;
the generating module is used for generating a first touch screen event according to the operation action of the virtual key detected on the touch screen of the terminal;
and the second control module is used for controlling the target object to execute the function corresponding to the first touch screen event.
17. A control system for a target object, comprising: a server and a terminal, wherein,
the server is used for sending the virtual key information of the virtual key to the terminal, and the virtual key is used for controlling the target object; acquiring a first touch screen event from the terminal, wherein the first touch screen event is generated according to the operation action of the virtual key detected on the touch screen of the terminal; controlling the target object to execute a function corresponding to the first touch screen event;
the terminal is in communication connection with the server and is used for acquiring the virtual key information of the virtual key sent by the server; and generating the first touch screen event and sending the first touch screen event to the server.
18. A storage medium characterized by comprising a stored program, wherein a device in which the storage medium is located is controlled to execute the control method of the target object according to any one of claims 1 to 14 when the program runs.
19. A processor for executing a program stored in a memory, wherein the program executes to perform the method of controlling a target object according to any one of claims 1 to 14.
CN202010287575.1A 2020-04-13 2020-04-13 Target object control method, device and system Active CN111467791B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010287575.1A CN111467791B (en) 2020-04-13 2020-04-13 Target object control method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010287575.1A CN111467791B (en) 2020-04-13 2020-04-13 Target object control method, device and system

Publications (2)

Publication Number Publication Date
CN111467791A true CN111467791A (en) 2020-07-31
CN111467791B CN111467791B (en) 2024-04-12

Family

ID=71752405

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010287575.1A Active CN111467791B (en) 2020-04-13 2020-04-13 Target object control method, device and system

Country Status (1)

Country Link
CN (1) CN111467791B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930328A (en) * 2020-08-10 2020-11-13 西安万像电子科技有限公司 Application data display method, device and system
CN112494929A (en) * 2020-12-04 2021-03-16 四三九九网络股份有限公司 Implementation method of game controller serving cloud game scenes
CN112891936A (en) * 2021-02-10 2021-06-04 广州虎牙科技有限公司 Virtual object rendering method and device, mobile terminal and storage medium
CN114090085A (en) * 2021-11-18 2022-02-25 腾讯科技（深圳）有限公司 Object control method and related device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440099A (en) * 2013-08-14 2013-12-11 深圳市同洲电子股份有限公司 Multi-screen interactive method, terminal and system
CN103480153A (en) * 2013-09-04 2014-01-01 张家港保税区润桐电子技术研发有限公司 Method for simulating computer gamepad with smartphone
US20150182856A1 (en) * 2013-12-31 2015-07-02 Microsoft Corporation Touch screen game controller
CN104941181A (en) * 2015-06-18 2015-09-30 深圳市新众玩网络科技有限公司 Method and device for achieving real-time game interaction between different intelligent terminals
KR101580210B1 (en) * 2015-01-08 2016-01-04 라인플러스 주식회사 Game method and system for providing smart control for touch type
CN105872664A (en) * 2016-03-31 2016-08-17 李强 Touch screen game operating-controlling method, device and system
CN107844243A (en) * 2017-11-09 2018-03-27 新华三云计算技术有限公司 Cloud tabletop touch implementation method and device
JP2019013297A (en) * 2017-07-04 2019-01-31 株式会社コロプラ Game program, recording medium, method, and information processing device
CN110548281A (en) * 2019-08-19 2019-12-10 广州点云科技有限公司 virtual key pressing method based on cloud game terminal

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440099A (en) * 2013-08-14 2013-12-11 深圳市同洲电子股份有限公司 Multi-screen interactive method, terminal and system
CN103480153A (en) * 2013-09-04 2014-01-01 张家港保税区润桐电子技术研发有限公司 Method for simulating computer gamepad with smartphone
US20150182856A1 (en) * 2013-12-31 2015-07-02 Microsoft Corporation Touch screen game controller
KR101580210B1 (en) * 2015-01-08 2016-01-04 라인플러스 주식회사 Game method and system for providing smart control for touch type
CN104941181A (en) * 2015-06-18 2015-09-30 深圳市新众玩网络科技有限公司 Method and device for achieving real-time game interaction between different intelligent terminals
CN105872664A (en) * 2016-03-31 2016-08-17 李强 Touch screen game operating-controlling method, device and system
JP2019013297A (en) * 2017-07-04 2019-01-31 株式会社コロプラ Game program, recording medium, method, and information processing device
CN107844243A (en) * 2017-11-09 2018-03-27 新华三云计算技术有限公司 Cloud tabletop touch implementation method and device
CN110548281A (en) * 2019-08-19 2019-12-10 广州点云科技有限公司 virtual key pressing method based on cloud game terminal

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111930328A (en) * 2020-08-10 2020-11-13 西安万像电子科技有限公司 Application data display method, device and system
CN111930328B (en) * 2020-08-10 2024-03-15 西安万像电子科技有限公司 Application data display method, device and system
CN112494929A (en) * 2020-12-04 2021-03-16 四三九九网络股份有限公司 Implementation method of game controller serving cloud game scenes
CN112494929B (en) * 2020-12-04 2023-05-16 四三九九网络股份有限公司 Implementation method of game controller serving cloud game scene
CN112891936A (en) * 2021-02-10 2021-06-04 广州虎牙科技有限公司 Virtual object rendering method and device, mobile terminal and storage medium
CN114090085A (en) * 2021-11-18 2022-02-25 腾讯科技（深圳）有限公司 Object control method and related device
CN114090085B (en) * 2021-11-18 2023-06-30 腾讯科技（深圳）有限公司 Object control method and related device

Also Published As

Publication number Publication date
CN111467791B (en) 2024-04-12

Similar Documents

Publication Publication Date Title
CN111467790B (en) Target object control method, device and system
CN111467791B (en) Target object control method, device and system
CN112351302B (en) Live broadcast interaction method and device based on cloud game and storage medium
CN110559651A (en) Control method and device of cloud game, computer storage medium and electronic equipment
WO2022063022A1 (en) Video preview method and apparatus and electronic device
CN107168616B (en) Game interaction interface display method and device, electronic equipment and storage medium
US9437158B2 (en) Electronic device for controlling multi-display and display control method thereof
CN112363658B (en) Interaction method and device for video call
CN113559520B (en) Interaction control method and device in game, electronic equipment and readable storage medium
CN113350779A (en) Game virtual character action control method and device, storage medium and electronic equipment
CN111643890A (en) Card game interaction method and device, electronic equipment and storage medium
CN111760272A (en) Game information display method and device, computer storage medium and electronic equipment
WO2024016924A1 (en) Video processing method and apparatus, and electronic device and storage medium
CN107626105B (en) Game picture display method and device, storage medium and electronic equipment
CN111672132A (en) Game control method, game control device, server, and storage medium
CN113101633B (en) Cloud game simulation operation method and device and electronic equipment
CN113318429B (en) Control method and device for exiting game, processor and electronic device
US20150352442A1 (en) Game having a Plurality of Engines
CN113318430B (en) Method and device for adjusting posture of virtual character, processor and electronic device
CN114504808A (en) Information processing method, information processing apparatus, storage medium, processor, and electronic apparatus
CN113986377A (en) Wallpaper interaction method and device and electronic equipment
CN113230649A (en) Display control method and device
CN112755510A (en) Mobile terminal cloud game control method, system and computer readable storage medium
CN117101117B (en) Touch control method and related equipment
CN114504814A (en) Information processing method, information processing apparatus, storage medium, processor, and electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant