WO2015149704A1

WO2015149704A1 - Multi-input operation control method and apparatus

Info

Publication number: WO2015149704A1
Application number: PCT/CN2015/075708
Authority: WO
Inventors: 田康
Original assignee: 中国移动通信集团公司
Priority date: 2014-04-02
Filing date: 2015-04-01
Publication date: 2015-10-08
Also published as: CN104980560B; CN104980560A

Abstract

Provided in the present invention are a multi-input operation control method and apparatus, which solve the problem that a plurality of existing devices applied to multi-screen interaction cannot be cooperatively controlled. The method of the present invention comprises: upon the establishment of initial connection with a plurality of sending ends, constructing and registering virtual drives corresponding to the input types of the sending ends; upon the establishment of communication connection with the plurality of sending ends, receiving input instructions sent respectively by the plurality of sending ends and transmitting the input instructions to the virtual drive corresponding to each sending end, and the virtual drive converting the input instruction of each sending end into a respective control instruction; and performing operation control on a plurality of objects in the same application respectively according to the control instructions. In the multi-input operation control method of the present invention, a plurality of terminal devices can cooperatively work as a multi-input source for the purpose of control of input receiving devices, thus there is a wide application prospect.

Description

Multi-input operation control method and device

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 201410131856.2, filed on Jan. 2, 2014, in

Technical field

The present invention relates to the field of communications technologies, and in particular, to a multi-input operation control method and apparatus.

Background technique

With the development and popularization of various intelligent terminals and high-speed wireless networks, multi-screen interaction and data sharing technologies and standards between devices based on network transmission are gradually being developed and widely used, such as digital living networks. Alliance DLNA / Universal Plug and Play UPNP, MIRACAST and other specifications, there are also recently launched Google Chrome technology solutions.

Along with the development and implementation of these multi-screen interactive technology solutions, interactive solutions for controlling other terminal devices with device input have also been naturally proposed, such as constructing a smart phone application instead of a conventional remote control, and controlling a large-screen TV through a set-top box. However, due to the difference in hardware systems, it is not possible to flexibly implement various input source coordinated control work.

Summary of the invention

An object of the present invention is to provide a multi-input operation control method and apparatus for solving the problem that the multi-screen interaction technology cannot flexibly implement coordinated control of various input sources.

In order to achieve the above object, the present invention provides a multi-input operation control method, including:

After establishing an initial connection with a plurality of transmitting ends, constructing and registering a virtual drive corresponding to the input type of the transmitting end;

After establishing a communication connection with a plurality of the transmitting ends, receiving an input instruction respectively sent by the plurality of sending ends, and transmitting the input instructions to each of the transmitting ends, wherein the virtual driving drives the input of each transmitting end The instruction is converted into a corresponding control instruction;

Performing operation control on a plurality of objects in the same application according to the control instruction.

The multi-input operation control method described above, the step of establishing an initial connection with a plurality of transmitting ends includes:

Obtaining first input information sent by multiple sending ends according to a broadcast search instruction, where The first input information includes: an address and an input type of the sending end;

Determining, according to the first input information, a transmitting end that is compatible with a receiving end input type among the plurality of transmitting ends;

Obtaining second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;

According to the second input information, in the transmitting end that is compatible with the input type of the receiving end, the application that selects the receiving end needs to establish a connection to establish a connection connection.

The step of constructing and registering a virtual driver corresponding to the input type of the sender includes:

When the input types of the multiple sending ends are the same, constructing and registering a virtual drive for the multiple sending ends, or constructing a virtual driving for the multiple sending ends;

When the input types of the plurality of transmitting ends are different, one virtual drive is separately configured and registered for the plurality of transmitting ends.

The step of establishing a communication connection with a plurality of the sending ends includes:

Obtaining first information that is sent by the multiple sending ends, including an input type;

According to the first information, if the current state of the virtual drive corresponding to the input type is an idle state, a communication connection is established with a plurality of the transmitting ends.

The step of converting the input instruction of each sender to a corresponding control instruction by the virtual driver includes:

When the input types of the plurality of transmitting ends are the same, the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or the virtual driving corresponding to the plurality of transmitting ends The input instruction of the transmitting end is converted into a corresponding control instruction; or

When the input types of the plurality of transmitting ends are different, the virtual driving corresponding to each of the transmitting ends respectively converts the input commands of each transmitting end into corresponding control commands.

Wherein, when the input types of the plurality of transmitting ends are the same, the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or a virtual driving corresponding to the multiple transmitting ends The steps of converting the input instruction of the transmitting end into the corresponding control instruction include:

When a sender corresponds to a virtual driver, the virtual driver corresponding to each sender will be lost. The input instruction is converted into a corresponding control instruction;

When the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input commands of each transmitting end into corresponding control commands according to the sequence of receiving the plurality of sending end input commands.

The step of performing operation control on multiple objects in the same application according to the control instruction includes:

Receiving, in sequence, a control instruction converted by the virtual drive according to the input instruction;

The plurality of objects in the same application are respectively subjected to operation control according to the control instruction.

The embodiment of the invention further provides a multi-input operation control device, comprising:

a constructing module, configured to construct and register a virtual driver corresponding to an input type of the sending end after establishing an initial connection with multiple sending ends;

a control management module, configured to: after establishing a communication connection with the plurality of the sending ends, receive an input instruction sent by each of the sending ends, and transmit the input instruction to each of the sending ends, and the virtual driving will be performed by the virtual driving The input instructions of the sending end convert the corresponding control instructions;

The response module is configured to perform operation control on the plurality of objects in the same application according to the control instruction.

The foregoing multi-input operation control device establishes an initial connection with the plurality of sending ends by using a first connection module, where the first connection module includes:

a first acquiring unit, configured to acquire first input information that is sent by the multiple sending ends according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;

a selecting unit, configured to select, according to the first input information, a sending end that is compatible with a receiving end input type among the plurality of sending ends;

a second acquiring unit, configured to acquire second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;

The first connecting unit is configured to: according to the second input information, in a transmitting end that is compatible with the input type of the receiving end, the plurality of sending ends that select the receiving end application to establish a connection establish an initial connection.

Wherein, in the above multi-input operation control device, the constructing module includes:

a first constructing unit, configured to: when the input types of the multiple sending ends are the same The sender separately constructs and registers a virtual driver, or constructs a virtual driver for the multiple senders;

The second constructing unit constructs and registers a virtual drive for each of the plurality of transmitting ends when the input types of the plurality of transmitting ends are different.

The multi-input operation control device is configured to establish a communication connection with the plurality of sending ends by using a second connection module, where the second connection module includes:

a third acquiring unit, configured to acquire first information that is sent by the multiple sending ends, including an input type;

And a second connecting unit, configured to establish, according to the first information, a communication connection with multiple sending ends if a current state of the virtual driving corresponding to the input type is idle.

The control management module includes:

a first converting unit, configured to convert, when the input types of the plurality of sending ends are the same, the input commands of each transmitting end into corresponding control commands or by the plurality of The virtual driver corresponding to the end converts the input instruction of the transmitting end into a corresponding control instruction;

The second converting unit is configured to convert, when the input types of the plurality of transmitting ends are different, the input commands of each transmitting end into corresponding control commands by the virtual drives respectively corresponding to each of the transmitting ends.

The first conversion unit includes:

The first conversion subunit is configured to: when a transmitting end corresponds to a virtual driving, the virtual driving corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction;

a second conversion subunit, when the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input instructions of each transmitting end according to a sequence of receiving the input commands of the plurality of sending ends Control instruction.

The response module includes:

a receiving unit, configured to sequentially receive a control instruction converted by the virtual driving according to the input instruction;

And a response unit, configured to sequentially respond to the control instructions sequentially received by the receiving unit.

Embodiments of the present invention have the following beneficial effects:

The multi-input operation control method of the embodiment of the present invention, the receiving end application constructs and registers a plurality of virtual Driving; after receiving a plurality of sending end instructions, assigning each of the sending end instructions to a virtual driving corresponding to the sending end instruction type according to the sending end instruction type; the virtual driving will be used by each transmitting end The input instruction is converted into a corresponding control instruction, and finally, the plurality of objects in the same application are respectively operated and controlled according to the control instruction, thereby realizing the function of cooperatively controlling the application between the multiple input sources, which has great application prospects. .

DRAWINGS

1 is a flowchart of a method according to an embodiment of the present invention;

2 is a connection diagram of a connection between a transmitting end and a receiving end according to an embodiment of the present invention;

3 is a schematic structural diagram of a scenario 1 according to an embodiment of the present invention;

4 is a schematic structural diagram of a scenario 2 according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a scenario 3 according to an embodiment of the present invention;

Figure 6 is a specific flowchart of an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a transmitting end and a receiving end according to an embodiment of the present invention;

FIG. 8 is a structural block diagram of an apparatus according to an embodiment of the present invention.

detailed description

In order to make the technical problems, technical solutions and advantages of the present invention more clear, the following detailed description will be made in conjunction with the specific embodiments and the accompanying drawings.

The embodiment of the invention solves the problem that the multi-input interaction technology cannot implement the coordinated control of the various input sources. The embodiment of the invention provides a multi-input operation control method, as shown in FIG. 1 , wherein the multi-input Operation control methods include:

Step 10: After establishing an initial connection with multiple senders, construct and register a virtual driver corresponding to the input type of the sender;

Step 20: After establishing a connection with a plurality of the sending ends, receive an input instruction sent by each of the sending ends, and transmit the input instruction to each virtual terminal, where each virtual terminal drives each transmitting end Converting the input command into a corresponding control command;

Step 30: Perform operation control on multiple objects in the same application according to the control instruction.

The multi-input operation control method of the embodiment of the present invention can flexibly implement multiple input sources to jointly control the same application. With the development and popularization of multi-screen interaction technologies and applications, the embodiments of the present invention have a wide range of application scenarios.

In the multiple input operation control method of the embodiment of the present invention, the step of establishing an initial connection with multiple sending ends includes:

Obtaining, by the multiple sending ends, the first input information that is sent by the sending end according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;

According to the second input information, in the transmitting end that is compatible with the input type of the receiving end, the application that selects the receiving end needs to establish a connection to establish a connection connection. The specific instructions are as follows:

As shown in Figure 2, the receiving end establishes an initial connection process with multiple sending ends, which is divided into three phases:

(1) Discovery phase: the receiving end broadcasts the search sender, and the sender broadcasts the first input information including the address and the input type, that is, the capability information of the sender, to the network periodically or after receiving the search command from the receiver;

(2) a selection phase: the receiving end selects, according to the first input information, a transmitting end that is compatible with the input type of the receiving end among the plurality of transmitting ends, and further acquires a transmitting end that is compatible with the input type of the receiving end, including the transmitting end The second input information of the input type and the input value range is detailed capability information of the transmitting end, wherein the detailed capability is generated by a capability defining unit in the transmitting end;

(3) Connection phase: When the receiving end needs to connect to a certain transmitting end, the receiving end initiates a connection request to the transmitting end compatible with the receiving end, and the transmitting end responds to the connection request to establish an initial connection.

In a specific embodiment of the present invention, after the initialization connection is completed, the receiving end establishes a long-term communication connection by using a time keeping message.

In the embodiment of the present invention, after establishing an initial connection with a plurality of transmitting ends, it is necessary to construct and register a virtual driving corresponding to the input type of the transmitting end. The main function of the virtual driver is to convert the input command sent by the sender into an instruction that the receiver application can respond to, and drive the application to complete the relevant action. For example, after the virtual mouse driver receives the input instruction including the x/y relative coordinate value and the button type sent by the transmitting end, the input command is converted into a mouse movement and a key operation control instruction, and is transmitted to the application and drives the application to complete the related action. Similarly, the game controller virtual driver can convert the direction and game buttons into corresponding control commands, transmit to the application and drive the application to complete. Related actions. Therefore, each virtual driver is responsible for a control capability. After the negotiation between the sender and the receiver device is completed, the receiver can construct a virtual driver with corresponding capabilities.

In the multiple input operation control method of the embodiment of the present invention, the step of constructing and registering a virtual drive corresponding to the input type of the transmitting end includes:

In a specific embodiment of the present invention, the virtual driver corresponding to the input type of the sender is constructed and registered according to the application, and the purpose of cooperative control of the same application by multiple senders is achieved.

In the multiple input operation control method of the embodiment of the present invention, the step of establishing a communication connection with a plurality of the sending ends includes:

According to the first information, if the current state of the virtual driver corresponding to the input type is idle, a communication connection is established with a plurality of the transmitting ends.

In a specific embodiment of the present invention, when the current state of the virtual drive is an idle state, a communication connection is established with multiple of the sending ends to avoid conflict with the current access.

In the multi-input operation control method of the embodiment of the present invention, the step of the virtual drive converting the input instruction of each transmitting end into a corresponding control instruction comprises:

Further, when one transmitting end corresponds to one virtual driving, the virtual driving corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction; when the plurality of transmitting ends correspond to one virtual driving, the virtual driving is received according to the multiple The sequence of the input commands of the sending end sequentially converts the input commands of each transmitting end into corresponding control commands; sequentially receives the control commands converted by the virtual driving according to the input instructions; and sequentially according to the control commands For the same application Multiple objects are individually controlled for operation. Specific examples are as follows.

scene one

As shown in FIG. 3, the left mobile phone terminal will play the game to the right end smart device, and the two terminals simultaneously operate the game, such as racing, ball and other competitive games. The operation is based on the type of game, which may be a button, or may be based on the somatosensory control of the sensor such as acceleration, gravity, etc. in the mobile phone.

At this time, the input type of the sender is the same. It is assumed that the two mobile terminals are the mobile terminal a and the mobile terminal b respectively, and the game application constructs and registers the virtual driver corresponding to the mobile terminal a and the mobile terminal b, respectively, assuming virtual drive A and Virtual drive B; after the two mobile phone terminals establish a communication connection with the right smart device, the virtual drive A and the virtual drive B respectively convert the input command into a corresponding control command, wherein the control command includes the control source (A or B) The control commands are read sequentially by the game application, and different game objects can be separately controlled based on the control source and the instruction type. For example, two animation sprites A, and B can be made to respond to the beating from virtual driver A and virtual driver B, respectively. The instruction is beating.

Scene two

As shown in Figure 4, the left laptop, keyboard and mobile terminal provide different types of input control for the right smart device: the main control notebook provides content and mouse input, the independent keyboard provides text input, and the mobile terminal provides somatosensory input. .

At this time, the input type of the sender is not the same, the application constructs and registers the virtual driver corresponding to the left laptop, keyboard and mobile terminal respectively, assuming virtual drive A, virtual drive B and virtual drive C, when the laptop on the left side After the keyboard and the mobile terminal establish a communication connection with the smart device on the right side, the left notebook computer, the keyboard and the mobile phone terminal respectively transmit the input command to the corresponding virtual drive, and the virtual drive converts the input command into a control command. At this point, the application responds to different instruction types and binds mouse events to OnMouseEvent(); binds touch events to OnTouchEvent(), etc., to complete collaborative control.

Scene three

As shown in Figure 5, two (or more) working laptops operate a unified interface, and each computer terminal can perform input operations without conflicts. One can perform keyboard input and the other can perform mouse control.

At this point, the sender input type is the same, the application constructs and registers a virtual drive, the two on the left After the laptop establishes a communication connection with the smart device on the right side, all input commands are transmitted to the virtual control unit indiscriminately, and then converted into control commands, which are transmitted to the application in the order in which they arrive.

The multi-input operation control method of the embodiment of the invention achieves the purpose of cooperatively controlling applications by multiple senders, has great application prospects, and improves user experience.

The implementation process of the embodiment of the present invention is specifically described below.

In a specific embodiment of the present invention, as shown in FIG. 6, the receiving end further includes one or more instruction receiving units associated with the virtual drive. As shown in FIG. 7 , after the receiving end establishes an initial connection with multiple sending ends, the constructing module constructs and registers a virtual driving corresponding to the input type of the transmitting end to the control management module in the receiving end; the control management module acquires the multiple sending The first information sent by the terminal includes an input type; the control management module determines whether the instruction receiving unit is idle according to the first information, and further determines whether the virtual driver associated with the idle instruction receiving unit is compatible when the instruction receiving unit is idle; When compatible, establish a communication connection with the transmitting end; update the receiving state of the instruction receiving unit, and start the keep-alive process; the control management unit receives the input commands respectively sent by the plurality of transmitting ends, and transmits the input instructions to the corresponding instruction receiving unit; Receiving, by the receiving unit, format conversion of the input instruction to the corresponding virtual driver; the virtual driving converting the input instruction of each transmitting end to a corresponding control instruction; the response module is more than the same application according to the control instruction The objects are separately controlled for operation, thus achieving multiple losses. The purpose of the source control of the receiving end system.

The embodiment of the invention further provides a multi-input operation control device, as shown in FIG. 8, comprising:

In the multi-input operation control device of the embodiment of the present invention, an initial connection is established with the multiple sending ends by using the first connection module, where the first connection module includes:

a first acquiring unit, configured to acquire a first sending, respectively, that is sent by multiple sending ends according to a broadcast search command Inputting information, where the first input information includes: an address of the sending end and an input type;

In the multiple input operation control device of the embodiment of the present invention, the constructing module includes:

a first constructing unit, configured to construct and register a virtual drive for the plurality of sending ends respectively, or construct a virtual driving for the multiple sending ends when the input types of the multiple sending ends are the same;

In the multi-input operation control device of the embodiment of the present invention, the connection is established with the multiple sending ends by using the second connection module, where the second connection module includes:

In the multi-input operation control device of the embodiment of the present invention, the transmitting module includes:

The second conversion unit is configured to convert the input instructions of each of the sending ends into corresponding control commands by the virtual drivers respectively corresponding to the respective transmitting ends when the input types of the plurality of transmitting ends are different.

In the multiple input operation control device of the embodiment of the present invention, the first conversion unit includes:

The first conversion subunit is configured to use one virtual drive when one sender corresponds to one virtual driver The virtual drive should convert the input command into a corresponding control command;

In the multiple input operation control device of the embodiment of the present invention, the response module includes:

In a specific embodiment of the present invention, as shown in FIG. 7, the transmitting end and the receiving end in the figure may correspond to a specific terminal device, or may be embedded in a system as a functional module. When the two ends are in the same LAN environment, when the multi-screen interaction condition is met, the connection discovery protocol is first established, an effective network connection is established, and then the input control data information between the devices is transmitted through the data transmission protocol.

The sender includes:

1) input the acquisition unit, interact with the input device or application of the sender, collect the input information, and generate relevant input instructions according to a certain data structure;

2) The instruction sending unit sends the instruction data generated after the acquisition to the receiving end in real time;

3) Capability definition unit, which is used to define the capabilities of the sender. The capability description should at least include the input type and input value range. For example, the type is a standard keyboard, the data corresponds to the scan code Scan Code; the type is mouse, the value should at least contain x/y coordinates and precision; or it can be specific input for the application, such as the left and right of the racing game, acceleration and deceleration, need Through the acceleration of the mobile terminal and the input of the horizontal sensing value, such customized input is directly associated with the application type and customized by the application.

The receiving end includes:

1) Control management unit, its functions include: a) First, control access, when it is found that the sender is connected, it needs to judge whether it is idle when receiving status, whether it is compatible with the input type of the sender, and whether it conflicts with the current access. Whether it is selected by the application layer, etc., and finally decides to establish a connection with the sender; b) secondly, manages the current access state, such as whether the sender keeps the connection, whether the relevant control unit is in the normal state; c) finally, receives the sender After the transmitted instruction, the control management unit distributes the instruction to the specific virtual control unit for processing by accessing the status.

2) A virtual control unit, the receiving end includes one to a plurality of virtual control units, each virtual control unit responds to an input command distributed by the control management unit, and converts the input command into a specific control command, and finally delivers to the application. Each virtual control unit comprises: an instruction receiving unit, a virtual driving and an instruction response unit, wherein the instruction receiving unit checks the received instruction, and then performs format conversion to provide data input for the “virtual drive”; The driver acts as a data bridge between the input command and the upper application, and adapts the control input layer in the specific operation platform; the command response unit exists in a specific application, and each application needs to associate with a specific input type if it can respond to an input type. The virtual driver is registered with the control management unit. Therefore, when the application receives the input control transmitted by the sender, the corresponding application logic processing can be completed by the command response unit.

In the multi-input operation control method and device of the embodiment of the invention, a plurality of terminal devices can work together to control the input receiving device as a multi-input source, thereby improving the user experience and having broad application prospects.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are included in the spirit and scope of the present invention, should be included in the present invention. Within the scope of protection.

Claims

A multi-input operation control method, comprising:

After establishing an initial connection with a plurality of transmitting ends, constructing and registering a virtual drive corresponding to the input type of the transmitting end;

After establishing a communication connection with a plurality of the transmitting ends, receiving an input instruction respectively sent by the plurality of sending ends, and transmitting the input instructions to each of the transmitting ends, wherein the virtual driving drives the input of each transmitting end The instruction is converted into a corresponding control instruction;

Performing operation control on a plurality of objects in the same application according to the control instruction.
The multi-input operation control method according to claim 1, wherein the step of establishing an initial connection with the plurality of transmitting ends comprises:

Obtaining, by the multiple sending ends, the first input information that is sent by the sending end according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;

Determining, according to the first input information, a transmitting end that is compatible with a receiving end input type among the plurality of transmitting ends;

Obtaining second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;

According to the second input information, in the transmitting end that is compatible with the input type of the receiving end, the application that selects the receiving end needs to establish a connection to establish a connection connection.
The multi-input operation control method according to claim 1, wherein the step of constructing and registering a virtual drive corresponding to an input type of the transmitting end comprises:

When the input types of the multiple sending ends are the same, constructing and registering a virtual drive for the multiple sending ends, or constructing a virtual driving for the multiple sending ends;

When the input types of the plurality of transmitting ends are different, one virtual drive is separately configured and registered for the plurality of transmitting ends.
The multi-input operation control method according to claim 3, wherein the step of establishing a communication connection with the plurality of the transmitting ends comprises:

Obtaining first information that is sent by the multiple sending ends, including an input type;

According to the first information, if the current state of the virtual driver corresponding to the input type is empty In the idle state, a communication connection is established with a plurality of the transmitting ends.
The multi-input operation control method according to claim 3, wherein the step of the virtual drive converting the input instruction of each transmitting end into a corresponding control instruction comprises:

When the input types of the plurality of transmitting ends are the same, the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or the virtual driving corresponding to the plurality of transmitting ends The input instruction of the transmitting end is converted into a corresponding control instruction; or

When the input types of the plurality of transmitting ends are different, the virtual driving corresponding to each of the transmitting ends respectively converts the input commands of each transmitting end into corresponding control commands.
The multi-input operation control method according to claim 5, wherein when the input types of the plurality of transmitting ends are the same, the virtual driving corresponding to each transmitting end respectively converts the input commands of each transmitting end into corresponding And the step of converting the input instruction of the sending end into the corresponding control instruction by the virtual driving corresponding to the plurality of transmitting ends comprises:

When a transmitting end corresponds to a virtual driving, the virtual driver corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction;

When the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input commands of each transmitting end into corresponding control commands according to the sequence of receiving the plurality of sending end input commands.
The multi-input operation control method according to claim 5 or 6, wherein the step of separately performing operation control on a plurality of objects in the same application according to the control instruction comprises:

Receiving, in sequence, a control instruction converted by the virtual drive according to the input instruction;

The plurality of objects in the same application are respectively subjected to operation control according to the control instruction.
A multi-input operation control device, comprising:

a constructing module, configured to construct and register a virtual driver corresponding to an input type of the sending end after establishing an initial connection with multiple sending ends;

a control management module, configured to: after establishing a communication connection with the plurality of the sending ends, receive an input instruction sent by each of the sending ends, and transmit the input instruction to each of the sending ends, and the virtual driving will be performed by the virtual driving The input instructions of the sending end convert the corresponding control instructions;

The response module is configured to perform operation control on the plurality of objects in the same application according to the control instruction.
The multi-input operation control device according to claim 8, wherein the first connection module establishes an initial connection with the plurality of sending ends, the first connection module comprising:

a first acquiring unit, configured to acquire first input information that is sent by the multiple sending ends according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;

a selecting unit, configured to select, according to the first input information, a sending end that is compatible with a receiving end input type among the plurality of sending ends;

a second acquiring unit, configured to acquire second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;

The first connecting unit is configured to: according to the second input information, in a transmitting end that is compatible with the input type of the receiving end, the plurality of sending ends that select the receiving end application to establish a connection establish an initial connection.
The multi-input operation control device according to claim 8, wherein the constructing module comprises:

a first constructing unit, configured to construct and register a virtual drive for the plurality of sending ends respectively, or construct a virtual driving for the multiple sending ends when the input types of the multiple sending ends are the same;

The second constructing unit constructs and registers a virtual drive for each of the plurality of transmitting ends when the input types of the plurality of transmitting ends are different.
The multi-input operation control device according to claim 10, wherein a communication connection is established with the plurality of transmitting ends by using a second connection module, the second connection module comprising:

a third acquiring unit, configured to acquire first information that is sent by the multiple sending ends, including an input type;

And a second connecting unit, configured to establish, according to the first information, a communication connection with multiple sending ends if a current state of the virtual driving corresponding to the input type is idle.
The multi-input operation control device according to claim 10, wherein the control management module comprises:

a first converting unit, configured to convert, when the input types of the plurality of sending ends are the same, the input commands of each transmitting end into corresponding control commands or by the plurality of The virtual driver corresponding to the end converts the input command of the sender into a corresponding Control instruction;

The second converting unit is configured to convert, when the input types of the plurality of transmitting ends are different, the input commands of each transmitting end into corresponding control commands by the virtual drives respectively corresponding to each of the transmitting ends.
The multi-input operation control device according to claim 12, wherein the first conversion unit comprises:

The first conversion subunit is configured to: when a transmitting end corresponds to a virtual driving, the virtual driving corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction;

a second conversion subunit, when the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input instructions of each transmitting end according to a sequence of receiving the input commands of the plurality of sending ends Control instruction.
The multi-input operation control device according to claim 12 or 13, wherein the response module comprises:

a receiving unit, configured to sequentially receive a control instruction converted by the virtual driving according to the input instruction;

And a response unit, configured to sequentially respond to the control instructions sequentially received by the receiving unit.