CN112000258B

CN112000258B - Operation control method and device, intelligent terminal and storage medium

Info

Publication number: CN112000258B
Application number: CN201910448667.0A
Authority: CN
Inventors: 杨学营
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-05-27
Filing date: 2019-05-27
Publication date: 2024-07-26
Anticipated expiration: 2039-05-27
Also published as: CN112000258A

Abstract

The embodiment of the invention discloses an operation control method, an operation control device, an intelligent terminal and a storage medium, wherein the method comprises the following steps: in the process of running a target application, determining a target control file according to an application identifier of the target application, wherein the target control file records operation parameters for controlling the target application, and the operation parameters are obtained by the intelligent terminal according to an operation instruction sent by the external equipment and recorded in the target control file; reading operation parameters for controlling the target application from the target control file; and determining an application control instruction corresponding to the operation parameter according to a conversion rule, and controlling the target application according to the application control instruction, so that the operation instruction of the external equipment can be mapped into the intelligent terminal with higher precision, and the control precision of the intelligent terminal can be improved.

Description

Operation control method and device, intelligent terminal and storage medium

Technical Field

The present invention relates to the field of computer technologies, and in particular, to an operation control method, an operation control device, an intelligent terminal, and a storage medium.

Background

Along with the continuous development of computer terminal technology, application types are gradually enriched so as to meet the daily life entertainment demands of users. The current user mainly controls the application through the application keys displayed in the terminal screen, for example, a certain movement operation key in the terminal screen is slid, and movement of characters in the application is realized.

However, when the external device is used for controlling the terminal, if the operation of the external device cannot be mapped into the operation of the terminal screen with higher precision, the operation mapped to the terminal screen may be different from the operation data indicated by the operation of the external device, and the operation precision of the user will be directly affected. Therefore, how to improve the mapping of the operation instruction of the external device to the operation of the terminal screen with higher precision is a current research hotspot.

Disclosure of Invention

The embodiment of the invention provides an operation control method, an operation control device, an intelligent terminal and a storage medium, which can map an operation instruction of external equipment into the intelligent terminal with higher precision, thereby improving the control precision of the intelligent terminal.

In one aspect, an embodiment of the present invention provides an operation control method, where the method is applied to an intelligent terminal, the intelligent terminal is connected to an external device, and the method includes:

In the process of running a target application, determining a target control file according to an application identifier of the target application, wherein the target control file records operation parameters for controlling the target application, and the operation parameters are obtained by the intelligent terminal according to an operation instruction sent by the external equipment and recorded in the target control file;

reading operation parameters for controlling the target application from the target control file;

And determining an application control instruction corresponding to the operation parameter according to a conversion rule, and controlling the target application according to the application control instruction.

In another aspect, an embodiment of the present invention provides an operation control device, where the device is applied to an intelligent terminal, and the intelligent terminal is connected to an external device, and the device includes:

The determining unit is used for determining a target control file according to an application identifier of the target application in the process of running the target application, wherein the target control file records operation parameters for controlling the target application, and the operation parameters are obtained by the intelligent terminal according to an operation instruction sent by the external equipment and recorded in the target control file;

The reading unit is used for reading operation parameters for controlling the target application from the target control file;

The determining unit is further used for determining an application control instruction corresponding to the operation parameter according to a conversion rule;

And the control unit is used for controlling the target application according to the application control instruction.

In still another aspect, an embodiment of the present invention provides an intelligent terminal, including a processor, an input device, an output device, and a memory, where the processor, the input device, the output device, and the memory are connected to each other, where the memory is configured to store a computer program supporting the terminal to execute the above method, where the computer program includes program instructions, and where the processor is configured to invoke the program instructions to perform the following steps:

In yet another aspect, an embodiment of the present invention provides a computer-readable storage medium having stored therein computer program instructions for executing the operation control method according to the first aspect when the computer program instructions are executed by a processor.

In the embodiment of the invention, in the process of running the target application, the intelligent terminal can firstly determine and record the target control file of the control parameters corresponding to the control instruction sent by the user through the external equipment according to the application identifier of the target application, and read the operation parameters from the target control file after acquiring the reading authority of the control file. After determining an application control instruction corresponding to the operation parameter based on the conversion rule, the application control instruction can be sent to the target application, so that the target application can control the target application based on the received application control instruction, the purpose that a user controls the intelligent terminal through the external device is achieved, and because the operation parameter corresponding to the operation instruction sent by the user through the external device is stored in the control file at the bottom layer, the operation parameter read through the control file at the bottom layer is an original parameter which is not processed by the system, the accuracy of the read operation parameter is higher, the accuracy of the application control instruction obtained by converting the operation parameter based on the conversion rule can be improved, the control accuracy of the intelligent terminal can be improved based on the application control instruction with higher accuracy, and therefore the operation experience of the user can be improved simultaneously.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1a is a schematic block diagram of a control system provided by an embodiment of the present invention;

FIG. 1b is a schematic block diagram of data interaction between an intelligent terminal and a handle according to another embodiment of the present invention;

FIG. 2 is a schematic flow chart of an operation control method provided by an embodiment of the present invention;

FIG. 3a is a schematic flow chart of an intelligent terminal reading operation parameters from the target manipulation file according to an embodiment of the present invention;

FIG. 3b is a schematic flow chart of the intelligent terminal converting the operation parameters according to the embodiment of the present invention;

Fig. 3c is a schematic flow chart of the intelligent terminal according to the embodiment of the present invention for controlling the target application according to the application control instruction;

FIG. 4 is a schematic flow chart of an operation control method according to another embodiment of the present invention;

FIG. 5a is a user interface diagram of a housekeeper application provided by an embodiment of the present invention;

FIG. 5b is a user interface diagram of an accessibility interface for a housekeeper application provided by an embodiment of the present invention;

FIG. 5c is a diagram of a user interface for outputting a connection prompt provided by an embodiment of the present invention;

FIG. 5d is a diagram of a user interface for outputting connection prompt information of an external device according to an embodiment of the present invention;

FIG. 5e is a user interface diagram of outputting an unconnected flag when connection to an external device is not detected according to an embodiment of the present invention;

FIG. 5f is a diagram of a user interface for outputting a connected flag when detecting that an external device is connected according to an embodiment of the present invention;

FIG. 5g is a user interface diagram of an output auxiliary tool selection list provided by an embodiment of the present invention;

FIG. 6 is a diagram of a user interface for running a target application through an external device according to an embodiment of the present invention;

fig. 7 is a schematic block diagram of an operation control apparatus provided by an embodiment of the present invention;

fig. 8 is a schematic block diagram of an intelligent terminal provided in an embodiment of the present invention.

Detailed Description

In order to improve the control accuracy of the external device on the application when the external device is used for controlling the intelligent terminal, the embodiment of the invention provides an operation control method which is mainly used for interaction of operation data when the intelligent terminal is connected with the external device, and the method can be applied to a control system shown in fig. 1a, and particularly can be applied to the intelligent terminal of the control system. In one embodiment, the control system includes an intelligent terminal 11 and at least one external device 12, where each external device of the intelligent terminal 11 and the at least one external device 12 is connected, and the intelligent terminal 11 and the external device 12 may be connected by wired connection or wireless connection, for example, the external device 12 may be connected wirelessly by bluetooth or the intelligent terminal 11.

In the embodiment of the present invention, the intelligent terminal 11 is, for example, a mobile phone terminal, a laptop computer terminal, or a tablet computer, and the external device 12 may be, for example, an external handle, or other devices capable of simulating handle operation, for example, an interface capable of operating a simulated handle operation in a terminal such as a mobile phone is taken as an external device, in an embodiment, the intelligent terminal 11 is a mobile phone, the external device is a handle 121 in the at least one external device for a detailed description, and when the intelligent terminal or the external device is other terminal devices, reference may be made to the embodiment of the present invention.

After determining that the intelligent terminal 11 and the handle 121 establish a communication connection, in an embodiment, see a data interaction diagram between the intelligent terminal 11 and the handle 121 as shown in fig. 1b, as shown in the drawing, the handle 121 may send a manipulation instruction (or an operation instruction) to the intelligent terminal 11, where in order to store the manipulation instruction, the intelligent terminal 11 may extract an operation parameter corresponding to the manipulation instruction, and store the operation parameter in a manipulation file in a designated storage location, where the manipulation file may be, for example, a file with a terminal bottom directory being/dev/input/devices.

In an embodiment, when the intelligent terminal 11 runs the target application, the target control file may be determined according to an application identifier of the target application, where any application in the intelligent terminal 11 corresponds to an application identifier, where the application identifier is used to distinguish an application corresponding to the application identifier from other applications, and any application identifier corresponding to the application may be an icon corresponding to the application, or a unique identifier corresponding to the application, or the like. Therefore, a target manipulation file generated during the process of running the target application may be determined based on the application identifier of the target application, where the target manipulation file is used to record an operation parameter corresponding to an operation instruction sent by the handle 121 to the intelligent terminal 11 during the process of controlling the target application by the handle 121.

After the intelligent terminal 11 determines the target manipulation file, the intelligent terminal 11 may detect whether the read right of the manipulation file (i.e. the manipulation file read right) is obtained, and when determining that the intelligent terminal 11 obtains the manipulation file read right, read the operation parameter generated in the process of controlling the target application by the handle 121 from the target manipulation file, so that the operation parameter may be converted into an application control instruction for a screen in the intelligent terminal 11 according to a conversion rule, and control the target application program according to the application control instruction.

In one embodiment, the manipulation file is used to store parameters corresponding to the operation instruction sent by the handle 121 to the intelligent terminal 11, where the manipulation file is an underlying file based on a kernel of a target operating system (such as a Linux system). The operation parameters corresponding to the operation instructions of the handle 121 for different applications may be stored in the same operation file, or may be stored in different operation files, or the operation parameters corresponding to the operation instructions of different handles for the same application may be stored in the same operation file, or may be stored in different operation files.

The read authority of the control file may be, for example, a Shell authority, where the Shell authority is a set of mobile phone operating system based on Linux, and the Shell authority is located at an outermost layer of the operating system and is used for managing interaction between the handle 121 and the intelligent terminal 11, and specifically, the Shell authority is used for explaining, to the operating system, an operation parameter corresponding to an operation instruction sent by the handle 121 to the intelligent terminal 11. The Shell is also used for providing authority of the intelligent terminal for reading operation parameters from the control file, and the operation parameters are used for indicating operation instructions sent to the intelligent terminal by the handle.

After the intelligent terminal 11 reads the operation parameter for controlling the target application from the target manipulation file, in order to translate the operation instruction sent by the handle 121 to the intelligent terminal 11 into an instruction of the intelligent terminal 11, it may be determined that the operation parameter corresponds to an application control instruction of the intelligent terminal 11 according to a conversion rule, so that the control of the target application may be implemented according to the application control instruction, and in an embodiment, the target application may be one or more of a social application, a game application, or an office application, for example.

The intelligent terminal reads the operation parameters for controlling the running target application from the target control file, and converts the operation parameters into application control instructions aiming at the intelligent terminal based on a preset conversion rule, so that the conversion of the operation instructions input by the handle is realized. When the intelligent terminal receives the operation parameters corresponding to the operation instructions sent by the handle, the operation parameters are stored in the target operation file, and the operation file is based on the file of the bottom layer of the operation system, so that the intelligent terminal can acquire Shell permission for reading the operation file by activating the lifting right, and the intelligent terminal can directly read the operation parameters corresponding to the original operation instructions input by the handle from the operation file after acquiring the Shell permission. When the intelligent terminal converts the operation parameters, the operation parameters which are directly obtained can be converted based on a preset conversion rule, so that the conversion accuracy of the operation instructions sent by the mobile phone can be improved, the control accuracy of the external device to the intelligent terminal can be improved, and further, the user experience of a user when the user controls the application through the external device is improved.

Referring to fig. 2, a schematic flow chart of an operation control method according to an embodiment of the present invention is provided, and the method may be applied to a control system as shown in fig. 1a, and in particular may be applied to an intelligent terminal in the control system, where the method may include:

S201, in the process of running the target application, determining a target control file according to the application identifier of the target application.

In one embodiment, the target control file records an operation parameter for controlling the target application, where the operation parameter is obtained by the intelligent terminal according to an operation instruction sent by the external device and recorded in the target control file. When a user controls a target application (such as a game application) operated by the intelligent terminal through the external equipment, the intelligent terminal can receive a control instruction sent by the external equipment and store the control instruction in a target control file corresponding to the target application. In one embodiment, the intelligent terminal may determine the target manipulation file according to the application identifier of the currently running target application, for example, when the application identifier is the application identifier corresponding to the game application a, the corresponding target manipulation file may be the manipulation file 8, for example. If the intelligent terminal stores the received operation instruction of the operation handle to the application in the same operation file, the target operation file corresponding to the target application determined based on the application identifier of the target application is a sub-file of the operation file.

In one embodiment, the manipulation file includes a file with file directory of/dev/input/devices in the kernel of the intelligent terminal system, and the operation parameters of the intelligent terminal stored in the target manipulation file may be as shown in table 1:

TABLE 1

/dev/input/event8：EU_ABS	ABS_X	0000008d
			/dev/input/event8：EU_ABS	ABS_Y	0000007d
/dev/input/event8：EU_SYN	SYN_REPORT	00000000
			/dev/input/event8：EU_ABS	ABS_X	000000b2
/dev/input/event8：EU_SYN	SYN_REPORT	00000000
			/dev/input/event8：EU_ABS	ABS_X	000000d3
/dev/input/event8：EU_ABS	ABS_Y	00000071
			/dev/input/event8：EU_SYN	SYN_REPORT	00000000
/dev/input/event8：EU_ABS	ABS_X	000000ec
			/dev/input/event8：EU_ABS	ABS_Y	00000062
/dev/input/event8：EU_SYN	SYN_REPORT	00000000
			/dev/input/event8：EU_ABS	ABS_X	000000fa
/dev/input/event8：EU_ABS	ABS_Y	00000063

When the intelligent terminal stores the control instruction sent by the external device, the operation parameter corresponding to the operation instruction can be determined first, so that the operation parameter can be stored in the control file. In an embodiment, the operation parameter includes a type identifier for indicating a type of the manipulation instruction, and a manipulation increment corresponding to the manipulation instruction, for example, the operation parameter may be abs_x, where ABS may indicate that the manipulation instruction type is a rocker type, and a value (such as 0000008 d) of X is a manipulation increment corresponding to a user-input rocker operation, where the manipulation increment includes a difference between a current position of the rocker and a previous position of the rocker after the user inputs the rocker operation. In one embodiment, when the external device is a handle, the joystick may be a circular member at the lower portion of the handle 121 as in fig. 1a, and the user may issue an operation instruction of the joystick type by shaking the circular member.

In one embodiment, when the intelligent terminal stores the operation parameters, the data stored in the operation file may be determined according to the parameter types of the operation parameters, where the parameter types include a coordinate parameter type or a key parameter type, different parameter types are used to indicate different operation instructions, for example, the operation instructions indicated by the coordinate parameter types include a rocker instruction, a slide instruction, and the like, the operation instructions indicated by the key parameter types may be, for example, a press instruction or a click instruction, when the parameter types of the operation parameters are coordinate types, the operation parameters corresponding to the operation parameters stored in the operation file are the coordinate values, and when the parameter types of the operation parameters are key parameter types, the operation parameters corresponding to the operation parameters stored in the operation file are unique identification codes corresponding to the operation keys.

After the intelligent terminal stores the operation parameters corresponding to the operation instruction of the user to the external device in the operation file, when the intelligent terminal runs the target application, the target operation file can be determined from the operation file according to the application identifier of the target application, and step S202 is executed.

S202, reading operation parameters for controlling the target application from the target control file.

In one embodiment, see a schematic flow chart of the intelligent terminal reading an operation parameter from the target manipulation file as shown in fig. 3a, specifically, when the intelligent terminal reads the operation parameter from the target manipulation file, it needs to detect whether the intelligent terminal obtains a reading authority (i.e. a manipulation file reading authority) of the manipulation file, and if it is determined that the intelligent terminal has the manipulation file reading authority, the step of reading the operation parameter for controlling the target application from the target manipulation file is performed; and if the control file reading permission is determined not to be available, outputting a notification message, wherein the notification message is used for indicating to conduct an authorization step of the control file reading permission so as to guide a user to connect the intelligent terminal to any server and grant the control file reading permission through the server. For example, when the smart terminal is a mobile phone, if the mobile phone detects that the mobile phone does not have the control file reading authority when the mobile phone reads the operation parameters from the target control file, the user is prompted to connect the mobile phone to the computer through the universal serial bus (Universal Serial Bus, USB), and after the user starts the USB debug mode, the user grants the mobile phone the reading authority of the control file through the computer. It should be noted that, after the intelligent terminal history has detected that the intelligent terminal has the authority to read the control file, the step of reading the operation parameter from the target control file may be directly performed, and the authority detection is not required every time the operation parameter is read from the control file.

After the intelligent terminal determines that the control file reading authority is obtained, the intelligent terminal can read the target control file under the/dev/input/devices directory, and obtain the operation parameters recorded in the target control file and used for controlling the target application, where the obtained operation parameters can be shown in the table 1. Furthermore, in order to obtain the operation parameter with higher precision, the terminal can further filter the read operation parameter. When the intelligent terminal filters the operation parameters, the operation parameters are filtered useless parameters, for example, the useless parameters can be parameters with a value of 0, such as the operation parameters with a type of SYN in the table 1, so as to ensure that the operation parameters processed by the intelligent terminal are all parameters with corresponding values in the subsequent conversion process of the operation parameters, thereby improving the conversion efficiency of the intelligent terminal to the operation parameters.

S203, determining an application control instruction corresponding to the operation parameter according to a conversion rule, and controlling the target application according to the control instruction.

In one embodiment, since the operation parameter stored in the control file corresponds to the operation instruction input by the external device, the intelligent terminal cannot be directly controlled according to the operation parameter, an application control instruction for directly controlling the intelligent terminal needs to be determined according to the operation parameter, and if the target application is running in the touch terminal, the determined application control instruction may be, for example, a screen touch instruction, and the screen touch instruction may be, for example, a click instruction, a press instruction, a slide instruction, or the like for a screen; if the target application runs in the non-touch terminal, the application control instruction may be, for example, a click instruction, a press instruction, a slide instruction, or the like for a key in the non-touch terminal. The touch terminal refers to a terminal comprising a touch screen, such as a smart phone and the like; the non-touch terminal refers to a terminal such as a computer, etc. where the screen is not a touch screen. In the embodiment of the invention, the intelligent terminal is mainly taken as a touch terminal for example for detailed description, and when the intelligent terminal is a non-touch terminal, the embodiment of the invention can be seen.

In one embodiment, reference may be specifically made to a schematic flow chart of a conversion of the operation parameter by an intelligent terminal as shown in fig. 3b, where the intelligent terminal needs to determine a conversion rule for converting the operation parameter when converting the operation parameter, where the intelligent terminal may determine a corresponding conversion rule based on a parameter type of the operation parameter, so that the operation parameter may be converted into an application control instruction based on the conversion rule.

After the intelligent terminal determines the conversion rule for converting the operation parameters, the conversion rule can be sent to a conversion rule mapper, so that the conversion rule mapper can convert the read operation parameters according to the determined indication of the conversion rule, and a screen control instruction capable of operating the intelligent terminal is obtained. In one embodiment, if the parameter types corresponding to the operation parameters determined according to the operation parameters include at least two types, there may be at least two types of conversion rule correspondence determined correspondingly, and after the at least two types of conversion rules are sent to the conversion rule mapper, the conversion rule mapper may perform conversion based on the at least two types of conversion rules and the conversion rules corresponding to the read conversion parameters, so as to obtain an application control instruction corresponding to the operation parameters to the intelligent terminal.

Further, after determining the application control instruction, the intelligent terminal may control the target application according to the application control instruction, specifically, the intelligent terminal may first inject the application control instruction into the target application to control the target application, where the intelligent terminal injects the application control instruction into the target application refers to sending the application control instruction to the target application through a specific instruction injection port, so that the application control instruction may be executed by the target application to control the target application. In one embodiment, see a schematic flow chart of controlling the target application by an intelligent terminal according to the application control instruction shown in fig. 3c, where the target application may be, for example, a game application, and when the target application is controlled according to the application control instruction, the target application needs to be run in a specified running environment, and injection (sending) of the application control instruction is performed when it is determined that the target application runs in the specified running environment. Specifically, a window (window) for injecting an application control instruction when the target application is running in a specified running environment may be acquired first, so that the application control instruction may be sent to the target application through the window to determine that the target application can receive the application control instruction. The specified operation environment may be, for example, an operation environment in a sandbox, that is, a dual-open operation environment, where a target application running under the sandbox has a window for injecting an application control instruction.

Referring to fig. 4, a schematic flowchart of an operation control method according to another embodiment of the present invention is provided, and the method may also be applied to the intelligent terminal in the operating system, as shown in fig. 4, and the method may include:

s401, in the process of running the target application, determining a target control file according to the application identifier of the target application.

In an embodiment, the intelligent terminal may use a direct start mode when running the target application, or may use a method of indirectly starting the target application through other applications, such as a management application. Therefore, before the intelligent terminal runs the target application, the management application is started, and in the process of running the management application, the intelligent terminal detects the connection state with the external equipment, wherein the connection state comprises a normal state and an abnormal state; if the intelligent terminal determines that the connection state with the external equipment is a normal state, monitoring a starting instruction of the target application on a user interface, and running the target application when the starting state of the target application is detected; if the intelligent terminal determines that the connection state between the intelligent terminal and the external device is an abnormal state, outputting connection reminding information, wherein the connection reminding information is used for reminding that the intelligent terminal is not connected with the external device currently.

In one embodiment, the management application may be, for example, a game manager application, and the running interface of the game manager on the mobile phone may be as shown in fig. 5a, where the game manager interface includes a function key area 51, an application management area 52, and a search area 53, where the function key area 51 includes a gift box key 510, a tool key 511, a back key 512, a game key 513, and a live key 514, and clicking the gift box key 510 may jump to a prize interface for capturing each game, so that a game prize, such as a login prize that is retrievable for logging in a game, may be captured through the prize interface; clicking on the tool interface 511 will jump to an auxiliary tool interface as shown in fig. 5b, which comprises an acceleration key, as shown in the figure a one-touch acceleration key. The user can realize the release of the memory occupied by the intelligent terminal by clicking the acceleration key, in addition, the auxiliary tool interface further comprises an external device connection key, the user can establish connection with the external device by clicking the external device connection key, after the intelligent terminal detects the clicking instruction of the user on the external device connection key, the connection prompt interface shown in fig. 5c can be output, the user can select a connection mode between the external device and the connection prompt interface based on the connection prompt interface, the output connection mode comprises a wired connection mode, a Bluetooth connection mode and the like, the connection mode is output, and meanwhile, the connection method corresponding to the connection mode is output together, for example, the connection method of the Bluetooth connection mode is to open the Bluetooth connection function of the external device, and the pairing with the intelligent terminal is completed. Clicking the game button 513 can output a game download interface through which game searching and downloading can be performed, clicking the live button 514 can jump to a live interface where a user can view historical live content or part of live fragments of other users, and the user can also live on the live interface or issue part of live fragments.

In the process of running the management application by the intelligent terminal, if the external device is detected to be not connected, the external device connection prompt information shown in fig. 5d can be output, and the prompt information is used for reminding the user that the external device is not connected, and also providing a purchase connection key and a connection tutorial viewing key of the external device. When the intelligent terminal detects a click command for purchasing a key of the external equipment, displaying a recommendation list of the external equipment on an interface; when a click command for viewing the connection course is received, the connection method of the external device outputting different signals, the problems possibly encountered, the corresponding solutions and the like are output. Therefore, the intelligent terminal and the external devices with different models can be connected through the management application, and the intelligent terminal and the external devices with different models can not be connected only with the external devices with specific models.

In an embodiment, when the external device is not connected to the intelligent terminal, an unconnected flag may be output in the main interface shown in fig. 5a, where the output unconnected flag may be output simultaneously with or different from the connection prompt information shown in fig. 5d, and the user interface after the unconnected flag is not output simultaneously with the connection prompt information may be shown in fig. 5 e. If the intelligent terminal detects that the external device is connected, a mark of successful connection can be output, and a user interface after the mark of successful connection is output can be shown as a figure 5 f.

In one embodiment, the application management area 52 includes application icons corresponding to some applications in the smart terminal, such as application icons corresponding to game application a, game application B, and WeChat. The user may jump from the currently running management application to the corresponding target application directly by clicking the application icon included in the application management area 52, and when the intelligent terminal ends to run the target application or receives an exit operation for the target application, the intelligent terminal will switch back from the target application to the management application again. For example, when the intelligent terminal receives a click command on an icon of the game A, the intelligent terminal can directly jump into the game A from the management application, and when receiving an operation of exiting the game A, the intelligent terminal switches back to the management application from the game A. In addition, the application management area 52 further includes an add icon, and the user may add an icon of the downloaded application in the intelligent terminal to the application management area 52 by clicking the add icon, so as to facilitate the starting of the target application from the management application; or the icons of the non-downloaded applications to be added can be selected through the application search window in the interface after the search key is clicked, so that the icons of the non-downloaded applications can be loaded into the application management area 52, and meanwhile, the non-downloaded applications can be downloaded to the intelligent terminal.

In one embodiment, the search area 53 may perform an application search or a function search, etc., and after the user clicks on each function key of the function key area 51, when a return to the main interface is required, the return key 512 in the function key area 51 may be clicked, so that the main interface may be switched back from each function interface as shown in fig. 5 a. In addition, the operation interface further includes a tool entry key, which may be a plus key located above the search area 53 as shown in fig. 5a, and when the intelligent terminal receives a click command on the plus key, an auxiliary tool selection list may be output, and the interface after outputting the auxiliary tool selection list may be as shown in fig. 5g, and when the intelligent terminal receives a selection command on an icon key or a corresponding function definition introduction key in the selection list, the intelligent terminal may perform function jump. And when the intelligent terminal receives the selection operation of the more buttons, the current interface is jumped to an auxiliary tool interface shown in fig. 5 b.

The user interface of the management application displays application identifiers of a plurality of managed applications, as shown in fig. 5a, before the intelligent terminal starts a target application, the intelligent terminal may detect whether the management application manages the target application, in one embodiment, whether the management application manages the target application may be determined by searching for an application icon corresponding to the target application in an application management area as shown in fig. 5a, and determining that the management application manages the target application when the application icon corresponding to the target application is found in the application management area; and if the application icon corresponding to the target application is not found in the application management area, determining that the associated application does not associate the target application.

If the intelligent terminal does not manage the target application, specifically, when receiving an adding instruction of the application identifier of the target application, a user can send an adding instruction of the application identifier by clicking an adding icon in the application management area, and after the intelligent terminal receives the adding instruction, the application currently installed by the intelligent terminal can be searched, and the application identifier of each searched application is displayed. And the user determines whether the currently installed application comprises the target application, if so, the intelligent terminal adds the selected application identifier of the target application to the display area of the management application and runs the target application when receiving the selection operation of the application identifier of the target application. The user may add the icon of the target application to the application management area by clicking the application identifier (i.e., the application icon) of the target application, and if the user determines that the currently installed application does not include the target application, the user needs to download the target application first, and then add the icon of the target application to the application management area.

When the intelligent terminal determines that the intelligent terminal is connected to the external device and runs the target application (such as a game a), an operating device such as a rocker, a key and the like in the external device can be virtually displayed in the running target application, as shown in fig. 6, the left rocker of the operating device can be displayed at a position 601 in fig. 6, the right rocker can be displayed at a position 602 in fig. 6, and the key a can be displayed at a position 603 and the like.

S402, reading operation parameters for controlling the target application from the target control file.

In the embodiment of the present invention, the specific implementation of step S402 may refer to the real-time manner of step S202 in the above embodiment, which is not described herein.

S403, determining the parameter type corresponding to the operation parameter.

S404, a conversion rule is selected according to the parameter type corresponding to the operation parameter, and an application control instruction corresponding to the operation parameter is determined according to the selected conversion rule.

In step S403 to step S404, the parameter types include a coordinate parameter type or a key parameter type, when the intelligent terminal determines an application control instruction corresponding to an operation parameter according to a conversion rule, if the parameter type corresponding to the operation parameter is determined to be the coordinate parameter type, a coordinate mapping rule is selected as the conversion rule, and after the intelligent terminal selects the coordinate mapping rule as the conversion rule, the coordinate mapping rule may be sent to a conversion rule mapper, so that the conversion rule mapper may obtain a displacement coordinate on a screen of the intelligent terminal according to the coordinate mapping rule and convert the displacement coordinate according to the operation parameter, so that an application control instruction for performing screen displacement control may be generated according to the displacement coordinate.

In one embodiment, as shown in table 1, the operation parameter with the parameter type being the coordinate parameter type may be 0000008d, for example, the coordinate mapping rule may determine the relative distance of movement of the rocker (i.e., the relative displacement of the rocker) according to the operation parameter, and may further map the relative displacement of the rocker to the terminal screen, determine the displacement coordinates on the terminal screen, and generate an application control command for performing screen displacement control based on the determined displacement coordinates, where the application control command for performing screen displacement control may be a sliding command for a certain moving key in the screen, for example.

If the parameter type corresponding to the operation parameter is determined to be a key parameter type, the intelligent terminal selects a key mapping rule as a conversion rule, so that the key mapping rule can be sent to a conversion rule mapper, the conversion rule mapper can obtain a key operation instruction for a target coordinate position in an intelligent terminal screen according to the key conversion rule and the operation parameter, and the key operation instruction is used as an application control instruction for the target coordinate position in the intelligent terminal screen. In one embodiment, the operation parameters recorded by the key operation type include a unique identification (identity, ID) corresponding to a key of the external device sending an operation instruction, a conversion rule predefined according to the key conversion rule, and the key ID can determine a target coordinate position of the key of the external device corresponding to the key of the terminal screen, so that the operation instruction of the external device can be converted into an application control instruction of the key corresponding to the target coordinate position in the screen of the intelligent terminal.

In one embodiment, the key mapping rule defines that the key ID of the external device corresponds to the key position in the external device in advance, and since the key positions of the applications in the terminal screen are different when different applications are run, the key mapping rule corresponding to the application can be selected as the conversion rule for the different running applications, so that the position of the key ID corresponding to the key of the application on the terminal screen is determined. For example, a key ID of the external device predefined by the key mapping rule corresponds to a key position in the external device, which may be:

<item

CenterX＝“0.744”

CenterY＝“0.872”

ControlHelper＝“10201”

GameStickAction＝“10105”

R＝“40”/>

Wherein the above definition predefines a key with an ID of 10105, based on which the key with an ID of 10105 corresponds to a position on the handle of (CenterX = "0.744", centerY = "0.872"), and the key with an ID of 10105 corresponds to a target coordinate position of the target application in the terminal screen can be determined based on a mapping relation of the handle position of (CenterX = "0.744", centerY = "0.872") in the key mapping rule to the key position of the target application in the terminal screen, so that a pressing instruction of the key at the target coordinate position can be used as an application control instruction for the target coordinate position in the terminal screen.

In one embodiment, if the determined coordinate parameter type corresponding to the operation parameter includes two or more types, a mapping rule corresponding to any coordinate parameter type is used as a conversion rule, and the conversion rule is sent to a conversion rule mapper. For example, if the determined parameter types corresponding to the operation parameters include a coordinate parameter type and a key parameter type, both the coordinate mapping rule and the key mapping rule are sent to the rule mapper to realize conversion of the operation parameters.

In the embodiment of the invention, the intelligent terminal can determine the target control file according to the application identifier of the target application in the process of running the target application through the manager application, so that the operating parameter for controlling the target application can be read from the target control file, and the corresponding conversion rule is selected by determining the parameter type corresponding to the operating parameter, so that the control instruction based on the external device can be converted into the application control instruction aiming at the terminal screen. Meanwhile, as the control file for storing the operation parameters is positioned at the bottom layer of the terminal, when the operation parameters are read through the target authority, the parameters which are not processed by the system are not processed, so that the accuracy of the application control instruction obtained based on the translation of the operation parameters is higher, and the operation experience of a user is improved.

Based on the description of the above embodiments of the operation control method, the embodiments of the present invention further provide an operation control device, which may be a computer program (including program code) running in the intelligent terminal in the above operation control system. The operation control device may perform the operation control method as described in fig. 2 and 4, referring to fig. 7, the operation control device includes: a determination unit 701, a reading unit 702, and a control unit 703.

A determining unit 701, configured to determine, during running a target application, a target control file according to an application identifier of the target application, where the target control file records an operation parameter for controlling the target application, where the operation parameter is obtained by the intelligent terminal according to an operation instruction sent by the external device and recorded in the target control file;

a reading unit 702, configured to read, from the target manipulation file, an operation parameter for controlling the target application;

the determining unit 701 is further configured to determine an application control instruction corresponding to the operation parameter according to a conversion rule;

A control unit 703, configured to control the target application according to the application control instruction.

In one embodiment, when determining the application control instruction corresponding to the operation parameter according to the conversion rule, the determining unit 701 specifically performs:

Determining a parameter type corresponding to the operation parameter, wherein the parameter type comprises a coordinate parameter type or a key parameter type;

And selecting a conversion rule according to the parameter type corresponding to the operation parameter, and determining an application control instruction corresponding to the operation parameter according to the selected conversion rule.

if the parameter type corresponding to the operation parameter is determined to be the coordinate parameter type, selecting a coordinate mapping rule as a conversion rule;

and according to the coordinate mapping rule, converting according to the operation parameter to obtain a displacement coordinate on the screen of the intelligent terminal, and generating an application control instruction for screen displacement control according to the displacement coordinate.

if the parameter type corresponding to the operation parameter is determined to be a key parameter type, a key mapping rule is selected as a conversion rule;

And according to the key conversion rule, obtaining a key operation instruction for the target coordinate position in the intelligent terminal screen according to the operation parameter conversion, and taking the key operation instruction as an application control instruction for the target coordinate position in the intelligent terminal screen.

In one embodiment, the apparatus further comprises: a judging unit 704 and an output unit 705.

A judging unit 704, configured to judge whether a control file reading authority is obtained, where the control file reading authority includes an authority to read a control file from the intelligent terminal kernel;

The reading unit 702 is configured to execute a step of reading an operation parameter for controlling the target application from the target manipulation file if the judging unit 704 determines that the manipulation file reading authority is obtained;

And an output unit 705, configured to output a notification message if the judging unit 704 determines that the control file reading authority is not acquired, where the notification message is used to instruct to perform the step of authorizing the control file reading authority.

In one embodiment, the apparatus further comprises: a detection unit 706 and a monitoring unit 707.

A detecting unit 706, configured to detect a connection state between the intelligent terminal and the external device during an operation process of the management application, where the connection state includes a normal state and an abnormal state;

a monitoring unit 707, configured to monitor, on a user interface, a start instruction for the target application if it is determined that the connection state between the intelligent terminal and the external device is a normal state, so as to operate the target application;

the output unit 705 is further configured to output connection reminding information if it is determined that the connection state between the intelligent terminal and the external device is an abnormal state, where the connection reminding information is used to prompt that the intelligent terminal is not currently connected to the external device.

In one embodiment, the user interface displays application identifiers of a plurality of applications managed by the management application, and the apparatus further includes: a search unit 708, an addition unit 709, and an operation unit 710.

The detecting unit 706 is further configured to detect whether the management application manages the target application;

A searching unit 708, configured to search, if the detecting unit 706 does not manage the target application, for an application currently installed in the intelligent terminal and display application identifiers of the searched applications when receiving an addition instruction for an application identifier of the target application;

An adding unit 709, configured to, if a selection operation of an application identifier corresponding to a target application in the displayed application identifiers is received, add the selected application identifier of the target application to a display area of the management application;

And the operation unit 710 is configured to operate the target application when receiving a selection operation of the application identifier of the target application.

In the embodiment of the present invention, in the process of running the target application, the determining unit 701 may determine, according to the application identifier of the target application, a target control file in which a control parameter corresponding to a control instruction sent by a user through an external device is recorded, and after the determining unit 704 determines that a read permission for the control file is obtained, the reading unit 702 reads the operation parameter from the target control file. Further, the determining unit 701 may determine, based on the conversion rule, an application control instruction corresponding to the operation parameter, where the control unit 703 may send the application control instruction to the target application, so that the target application completes control of the target application based on the received application control instruction, to achieve a goal that the user controls the intelligent terminal through the external device, and since the operation parameter corresponding to the operation instruction sent by the user through the external device is stored in the control file of the bottom layer, the operation parameter read through the bottom layer control file is an original parameter that is not processed by the system, and therefore, the accuracy of the read operation parameter is higher, so that the accuracy of the application control instruction obtained by converting the operation parameter based on the conversion rule may also be improved, and the target application is controlled based on the application control instruction with higher accuracy, thereby improving the operation experience of the user.

Referring to fig. 8, which is a schematic block diagram of a structure of an intelligent terminal according to an embodiment of the present invention, the intelligent terminal according to the embodiment of the present invention shown in fig. 8 may include: one or more processors 801; one or more input devices 802, one or more output devices 803, and a memory 804. The processor 801, the input device 802, the output device 803, and the memory 804 are connected through a bus 805. The memory 802 is used for storing a computer program comprising program instructions, and the processor 801 is used for executing the program instructions stored in the memory 802.

The memory 804 may include volatile memory (RAM), such as random-access memory (RAM); the memory 804 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a solid state disk (SSD-STATE DRIVE), etc.; the memory 804 may also include a combination of the above types of memory.

The processor 801 may be a central processing unit (central processing unit, CPU). The processor 801 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (programmable logic device, PLD), or the like. The PLD may be a field-programmable gate array (FPGA) of field-programmable GATE ARRAY, generic array logic (GENERIC ARRAY logic, GAL), or the like. The processor 801 may also be a combination of the above.

In an embodiment of the present invention, the memory 804 is configured to store a computer program, where the computer program includes program instructions, and the processor 801 is configured to execute the program instructions stored in the memory 804, to implement the steps of the corresponding methods shown in fig. 2 and fig. 4.

In one embodiment, the processor 801 is configured to call the program instructions for executing:

In one embodiment, the processor 801, when determining the application control instruction corresponding to the operation parameter according to the conversion rule, is further configured to call the program instruction for executing:

In one embodiment, the processor 801 is further configured to invoke the program instructions for performing:

judging whether a control file reading authority is acquired or not, wherein the control file reading authority comprises the authority for reading the control file from the intelligent terminal kernel;

If the control file reading authority is determined to be acquired, executing a step of reading operation parameters for controlling the target application from the target control file;

And if the control file reading permission is not obtained, outputting a notification message, wherein the notification message is used for indicating the authorization step of the control file reading permission.

Detecting a connection state between the intelligent terminal and the external equipment in the running process of the management application, wherein the connection state comprises a normal state and an abnormal state;

if the connection state between the intelligent terminal and the external equipment is determined to be a normal state, monitoring a starting instruction of the target application on a user interface so as to conveniently run the target application;

if the connection state between the intelligent terminal and the external device is determined to be an abnormal state, outputting connection reminding information, wherein the connection reminding information is used for reminding that the intelligent terminal is not connected with the external device currently.

In one embodiment, application identifiers of a plurality of applications managed by the management application are displayed on the user interface, and the processor 801 is further configured to invoke the program instructions for executing:

Detecting whether the management application manages the target application;

If not, searching the application currently installed by the intelligent terminal and displaying the application identification of each searched application when receiving an adding instruction of the application identification of the target application;

if a selection operation of an application identifier corresponding to a target application in the displayed application identifiers is received, adding the selected application identifier of the target application into a display area of the management application;

And when receiving a selection operation of the application identification of the target application, running the target application.

Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored on a computer readable storage medium, which when executed may comprise the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random-access Memory (Random Access Memory, RAM), or the like.

The foregoing disclosure is merely illustrative of some embodiments of the present invention and it is not to be construed as limiting the scope of the invention, as a person of ordinary skill in the art will appreciate that all or part of the above-described embodiments may be practiced with equivalent variations which fall within the scope of the invention as defined in the appended claims.

Claims

1. An operation control method is characterized in that the method is applied to an intelligent terminal, the intelligent terminal is connected with external equipment, and the method comprises the following steps:

In the process of running a target application, determining a target control file according to an application identifier of the target application, wherein the target control file is generated in the process of running the target application, the target control file records operation parameters for controlling the target application, the operation parameters are obtained by the intelligent terminal according to an operation instruction sent by the external equipment and recorded in the target control file, and the target control file is a bottom file based on a target operating system kernel;

Reading operation parameters for controlling the target application from the target operation file based on the operation file reading authority; and determining an application control instruction corresponding to the operation parameter according to a conversion rule, and controlling the target application according to the application control instruction, wherein the control file reading permission is used for explaining the operation parameter corresponding to the operation instruction sent by the external device, and the control file reading permission comprises Shell permission.

2. The method according to claim 1, wherein determining the application control instruction corresponding to the operation parameter according to the conversion rule includes:

3. The method according to claim 2, wherein determining the application control instruction corresponding to the operation parameter according to the conversion rule includes:

4. The method according to claim 2, wherein determining the application control instruction corresponding to the operation parameter according to the conversion rule includes:

5. The method according to claim 1, wherein the method further comprises:

6. The method according to claim 1, wherein the method further comprises:

7. The method of claim 6, wherein application identifications of a plurality of applications managed by the management application are displayed on the user interface, the method further comprising:

Detecting whether the management application manages the target application;

8. An operation control device, characterized in that, the device is applied to intelligent terminal, intelligent terminal links to each other with external equipment, the device includes:

The system comprises a determining unit, a target control file and a control unit, wherein the determining unit is used for determining a target control file according to an application identifier of a target application in the process of running the target application, the target control file is generated in the process of running the target application, the target control file records operation parameters for controlling the target application, the operation parameters are obtained by the intelligent terminal according to an operation instruction sent by the external equipment and recorded in the target control file, and the target control file is a bottom file based on a target operating system kernel;

The reading unit is used for reading operation parameters for controlling the target application from the target operation file based on operation file reading permission, wherein the operation file reading permission is used for explaining the operation parameters corresponding to the operation instructions sent by the external equipment, and the operation file reading permission comprises Shell permission;

and the control unit is used for controlling the target application according to the control instruction.

9. An intelligent terminal comprising a processor, an input device, an output device, and a memory, the processor, the input device, the output device, and the memory being interconnected, wherein the memory is configured to store a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method of any of claims 1-7.

10. A computer-readable storage medium, in which computer program instructions are stored, which, when being executed by a processor, are adapted to carry out the operation control method according to any one of claims 1-7.