WO2015149704A1 - 多输入操作控制方法及装置 - Google Patents

多输入操作控制方法及装置 Download PDF

Info

Publication number
WO2015149704A1
WO2015149704A1 PCT/CN2015/075708 CN2015075708W WO2015149704A1 WO 2015149704 A1 WO2015149704 A1 WO 2015149704A1 CN 2015075708 W CN2015075708 W CN 2015075708W WO 2015149704 A1 WO2015149704 A1 WO 2015149704A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
transmitting
instruction
sending
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/075708
Other languages
English (en)
French (fr)
Inventor
田康
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Corp filed Critical China Mobile Communications Corp
Publication of WO2015149704A1 publication Critical patent/WO2015149704A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0382—Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a multi-input operation control method and apparatus.
  • An object of the present invention is to provide a multi-input operation control method and apparatus for solving the problem that the multi-screen interaction technology cannot flexibly implement coordinated control of various input sources.
  • the present invention provides a multi-input operation control method, including:
  • the step of establishing an initial connection with a plurality of transmitting ends includes:
  • the first input information includes: an address and an input type of the sending end;
  • Second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;
  • the application that selects the receiving end needs to establish a connection to establish a connection connection.
  • the step of constructing and registering a virtual driver corresponding to the input type of the sender includes:
  • one virtual drive is separately configured and registered for the plurality of transmitting ends.
  • the step of establishing a communication connection with a plurality of the sending ends includes:
  • the first information if the current state of the virtual drive corresponding to the input type is an idle state, a communication connection is established with a plurality of the transmitting ends.
  • the step of converting the input instruction of each sender to a corresponding control instruction by the virtual driver includes:
  • the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or the virtual driving corresponding to the plurality of transmitting ends
  • the input instruction of the transmitting end is converted into a corresponding control instruction
  • the virtual driving corresponding to each of the transmitting ends respectively converts the input commands of each transmitting end into corresponding control commands.
  • the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or a virtual driving corresponding to the multiple transmitting ends
  • the steps of converting the input instruction of the transmitting end into the corresponding control instruction include:
  • the virtual driving sequentially converts the input commands of each transmitting end into corresponding control commands according to the sequence of receiving the plurality of sending end input commands.
  • the step of performing operation control on multiple objects in the same application according to the control instruction includes:
  • the plurality of objects in the same application are respectively subjected to operation control according to the control instruction.
  • the embodiment of the invention further provides a multi-input operation control device, comprising:
  • the response module is configured to perform operation control on the plurality of objects in the same application according to the control instruction.
  • the foregoing multi-input operation control device establishes an initial connection with the plurality of sending ends by using a first connection module, where the first connection module includes:
  • a first acquiring unit configured to acquire first input information that is sent by the multiple sending ends according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;
  • a selecting unit configured to select, according to the first input information, a sending end that is compatible with a receiving end input type among the plurality of sending ends;
  • a second acquiring unit configured to acquire second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;
  • the first connecting unit is configured to: according to the second input information, in a transmitting end that is compatible with the input type of the receiving end, the plurality of sending ends that select the receiving end application to establish a connection establish an initial connection.
  • the constructing module includes:
  • a first constructing unit configured to: when the input types of the multiple sending ends are the same
  • the sender separately constructs and registers a virtual driver, or constructs a virtual driver for the multiple senders;
  • the second constructing unit constructs and registers a virtual drive for each of the plurality of transmitting ends when the input types of the plurality of transmitting ends are different.
  • the multi-input operation control device is configured to establish a communication connection with the plurality of sending ends by using a second connection module, where the second connection module includes:
  • a third acquiring unit configured to acquire first information that is sent by the multiple sending ends, including an input type
  • the control management module includes:
  • a first converting unit configured to convert, when the input types of the plurality of sending ends are the same, the input commands of each transmitting end into corresponding control commands or by the plurality of The virtual driver corresponding to the end converts the input instruction of the transmitting end into a corresponding control instruction;
  • the second converting unit is configured to convert, when the input types of the plurality of transmitting ends are different, the input commands of each transmitting end into corresponding control commands by the virtual drives respectively corresponding to each of the transmitting ends.
  • the first conversion unit includes:
  • the first conversion subunit is configured to: when a transmitting end corresponds to a virtual driving, the virtual driving corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction;
  • a second conversion subunit when the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input instructions of each transmitting end according to a sequence of receiving the input commands of the plurality of sending ends Control instruction.
  • the response module includes:
  • a receiving unit configured to sequentially receive a control instruction converted by the virtual driving according to the input instruction
  • a response unit configured to sequentially respond to the control instructions sequentially received by the receiving unit.
  • FIG. 2 is a connection diagram of a connection between a transmitting end and a receiving end according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a scenario 1 according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a scenario 2 according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a scenario 3 according to an embodiment of the present invention.
  • FIG. 6 is a specific flowchart of an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a transmitting end and a receiving end according to an embodiment of the present invention.
  • FIG. 8 is a structural block diagram of an apparatus according to an embodiment of the present invention.
  • Step 10 After establishing an initial connection with multiple senders, construct and register a virtual driver corresponding to the input type of the sender;
  • Step 20 After establishing a connection with a plurality of the sending ends, receive an input instruction sent by each of the sending ends, and transmit the input instruction to each virtual terminal, where each virtual terminal drives each transmitting end Converting the input command into a corresponding control command;
  • Step 30 Perform operation control on multiple objects in the same application according to the control instruction.
  • the multi-input operation control method of the embodiment of the present invention can flexibly implement multiple input sources to jointly control the same application.
  • the embodiments of the present invention have a wide range of application scenarios.
  • the step of establishing an initial connection with multiple sending ends includes:
  • the first input information that is sent by the sending end according to the broadcast search instruction, where the first input information includes: an address and an input type of the sending end;
  • Second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;
  • the application that selects the receiving end needs to establish a connection to establish a connection connection.
  • the specific instructions are as follows:
  • the receiving end establishes an initial connection process with multiple sending ends, which is divided into three phases:
  • (1) Discovery phase the receiving end broadcasts the search sender, and the sender broadcasts the first input information including the address and the input type, that is, the capability information of the sender, to the network periodically or after receiving the search command from the receiver;
  • the receiving end selects, according to the first input information, a transmitting end that is compatible with the input type of the receiving end among the plurality of transmitting ends, and further acquires a transmitting end that is compatible with the input type of the receiving end, including the transmitting end
  • the second input information of the input type and the input value range is detailed capability information of the transmitting end, wherein the detailed capability is generated by a capability defining unit in the transmitting end;
  • connection phase When the receiving end needs to connect to a certain transmitting end, the receiving end initiates a connection request to the transmitting end compatible with the receiving end, and the transmitting end responds to the connection request to establish an initial connection.
  • the receiving end after the initialization connection is completed, the receiving end establishes a long-term communication connection by using a time keeping message.
  • the main function of the virtual driver is to convert the input command sent by the sender into an instruction that the receiver application can respond to, and drive the application to complete the relevant action.
  • the virtual mouse driver receives the input instruction including the x/y relative coordinate value and the button type sent by the transmitting end
  • the input command is converted into a mouse movement and a key operation control instruction, and is transmitted to the application and drives the application to complete the related action.
  • the game controller virtual driver can convert the direction and game buttons into corresponding control commands, transmit to the application and drive the application to complete.
  • each virtual driver is responsible for a control capability. After the negotiation between the sender and the receiver device is completed, the receiver can construct a virtual driver with corresponding capabilities.
  • the step of constructing and registering a virtual drive corresponding to the input type of the transmitting end includes:
  • one virtual drive is separately configured and registered for the plurality of transmitting ends.
  • the virtual driver corresponding to the input type of the sender is constructed and registered according to the application, and the purpose of cooperative control of the same application by multiple senders is achieved.
  • the step of establishing a communication connection with a plurality of the sending ends includes:
  • the first information if the current state of the virtual driver corresponding to the input type is idle, a communication connection is established with a plurality of the transmitting ends.
  • a communication connection is established with multiple of the sending ends to avoid conflict with the current access.
  • the step of the virtual drive converting the input instruction of each transmitting end into a corresponding control instruction comprises:
  • the virtual driving corresponding to each transmitting end respectively converts the input instruction of each transmitting end into a corresponding control instruction or the virtual driving corresponding to the plurality of transmitting ends
  • the input instruction of the transmitting end is converted into a corresponding control instruction
  • the virtual driving corresponding to each of the transmitting ends respectively converts the input commands of each transmitting end into corresponding control commands.
  • the virtual driving corresponding to each transmitting end respectively converts the input instruction into a corresponding control instruction; when the plurality of transmitting ends correspond to one virtual driving, the virtual driving is received according to the multiple
  • the sequence of the input commands of the sending end sequentially converts the input commands of each transmitting end into corresponding control commands; sequentially receives the control commands converted by the virtual driving according to the input instructions; and sequentially according to the control commands
  • Multiple objects are individually controlled for operation. Specific examples are as follows.
  • the left mobile phone terminal will play the game to the right end smart device, and the two terminals simultaneously operate the game, such as racing, ball and other competitive games.
  • the operation is based on the type of game, which may be a button, or may be based on the somatosensory control of the sensor such as acceleration, gravity, etc. in the mobile phone.
  • the input type of the sender is the same. It is assumed that the two mobile terminals are the mobile terminal a and the mobile terminal b respectively, and the game application constructs and registers the virtual driver corresponding to the mobile terminal a and the mobile terminal b, respectively, assuming virtual drive A and Virtual drive B; after the two mobile phone terminals establish a communication connection with the right smart device, the virtual drive A and the virtual drive B respectively convert the input command into a corresponding control command, wherein the control command includes the control source (A or B)
  • the control commands are read sequentially by the game application, and different game objects can be separately controlled based on the control source and the instruction type. For example, two animation sprites A, and B can be made to respond to the beating from virtual driver A and virtual driver B, respectively.
  • the instruction is beating.
  • the left laptop, keyboard and mobile terminal provide different types of input control for the right smart device: the main control notebook provides content and mouse input, the independent keyboard provides text input, and the mobile terminal provides somatosensory input. .
  • the application constructs and registers the virtual driver corresponding to the left laptop, keyboard and mobile terminal respectively, assuming virtual drive A, virtual drive B and virtual drive C, when the laptop on the left side
  • the left notebook computer, the keyboard and the mobile phone terminal respectively transmit the input command to the corresponding virtual drive
  • the virtual drive converts the input command into a control command.
  • the application responds to different instruction types and binds mouse events to OnMouseEvent(); binds touch events to OnTouchEvent(), etc., to complete collaborative control.
  • two (or more) working laptops operate a unified interface, and each computer terminal can perform input operations without conflicts.
  • One can perform keyboard input and the other can perform mouse control.
  • the sender input type is the same, the application constructs and registers a virtual drive, the two on the left After the laptop establishes a communication connection with the smart device on the right side, all input commands are transmitted to the virtual control unit indiscriminately, and then converted into control commands, which are transmitted to the application in the order in which they arrive.
  • the multi-input operation control method of the embodiment of the invention achieves the purpose of cooperatively controlling applications by multiple senders, has great application prospects, and improves user experience.
  • the receiving end further includes one or more instruction receiving units associated with the virtual drive.
  • the constructing module constructs and registers a virtual driving corresponding to the input type of the transmitting end to the control management module in the receiving end; the control management module acquires the multiple sending
  • the first information sent by the terminal includes an input type; the control management module determines whether the instruction receiving unit is idle according to the first information, and further determines whether the virtual driver associated with the idle instruction receiving unit is compatible when the instruction receiving unit is idle; When compatible, establish a communication connection with the transmitting end; update the receiving state of the instruction receiving unit, and start the keep-alive process; the control management unit receives the input commands respectively sent by the plurality of transmitting ends, and transmits the input instructions to the corresponding instruction receiving unit; Receiving, by the receiving unit, format conversion of the input instruction to the corresponding virtual driver; the virtual driving converting the input instruction of each transmitting
  • the embodiment of the invention further provides a multi-input operation control device, as shown in FIG. 8, comprising:
  • a constructing module configured to construct and register a virtual driver corresponding to an input type of the sending end after establishing an initial connection with multiple sending ends
  • control management module configured to: after establishing a communication connection with the plurality of the sending ends, receive an input instruction sent by each of the sending ends, and transmit the input instruction to each of the sending ends, and the virtual driving will be performed by the virtual driving
  • the input instructions of the sending end convert the corresponding control instructions
  • the response module is configured to perform operation control on the plurality of objects in the same application according to the control instruction.
  • an initial connection is established with the multiple sending ends by using the first connection module, where the first connection module includes:
  • a first acquiring unit configured to acquire a first sending, respectively, that is sent by multiple sending ends according to a broadcast search command Inputting information, where the first input information includes: an address of the sending end and an input type;
  • a selecting unit configured to select, according to the first input information, a sending end that is compatible with a receiving end input type among the plurality of sending ends;
  • a second acquiring unit configured to acquire second input information that is sent by the sending end that is compatible with the input type of the receiving end, where the second input information includes: an input type of the sending end and an input value range;
  • the first connecting unit is configured to: according to the second input information, in a transmitting end that is compatible with the input type of the receiving end, the plurality of sending ends that select the receiving end application to establish a connection establish an initial connection.
  • the constructing module includes:
  • a first constructing unit configured to construct and register a virtual drive for the plurality of sending ends respectively, or construct a virtual driving for the multiple sending ends when the input types of the multiple sending ends are the same;
  • the second constructing unit constructs and registers a virtual drive for each of the plurality of transmitting ends when the input types of the plurality of transmitting ends are different.
  • the connection is established with the multiple sending ends by using the second connection module, where the second connection module includes:
  • a third acquiring unit configured to acquire first information that is sent by the multiple sending ends, including an input type
  • a second connecting unit configured to establish, according to the first information, a communication connection with multiple sending ends if a current state of the virtual driving corresponding to the input type is idle.
  • the transmitting module includes:
  • a first converting unit configured to convert, when the input types of the plurality of sending ends are the same, the input commands of each transmitting end into corresponding control commands or by the plurality of The virtual driver corresponding to the end converts the input instruction of the transmitting end into a corresponding control instruction;
  • the second conversion unit is configured to convert the input instructions of each of the sending ends into corresponding control commands by the virtual drivers respectively corresponding to the respective transmitting ends when the input types of the plurality of transmitting ends are different.
  • the first conversion unit includes:
  • the first conversion subunit is configured to use one virtual drive when one sender corresponds to one virtual driver
  • the virtual drive should convert the input command into a corresponding control command
  • a second conversion subunit when the plurality of transmitting ends correspond to one virtual driving, the virtual driving sequentially converts the input instructions of each transmitting end according to a sequence of receiving the input commands of the plurality of sending ends Control instruction.
  • the response module includes:
  • a receiving unit configured to sequentially receive a control instruction converted by the virtual driving according to the input instruction
  • a response unit configured to sequentially respond to the control instructions sequentially received by the receiving unit.
  • the transmitting end and the receiving end in the figure may correspond to a specific terminal device, or may be embedded in a system as a functional module.
  • the connection discovery protocol is first established, an effective network connection is established, and then the input control data information between the devices is transmitted through the data transmission protocol.
  • the sender includes:
  • the instruction sending unit sends the instruction data generated after the acquisition to the receiving end in real time
  • Capability definition unit which is used to define the capabilities of the sender.
  • the capability description should at least include the input type and input value range.
  • the type is a standard keyboard, the data corresponds to the scan code Scan Code; the type is mouse, the value should at least contain x/y coordinates and precision; or it can be specific input for the application, such as the left and right of the racing game, acceleration and deceleration, need Through the acceleration of the mobile terminal and the input of the horizontal sensing value, such customized input is directly associated with the application type and customized by the application.
  • the receiving end includes:
  • Control management unit its functions include: a) First, control access, when it is found that the sender is connected, it needs to judge whether it is idle when receiving status, whether it is compatible with the input type of the sender, and whether it conflicts with the current access. Whether it is selected by the application layer, etc., and finally decides to establish a connection with the sender; b) secondly, manages the current access state, such as whether the sender keeps the connection, whether the relevant control unit is in the normal state; c) finally, receives the sender After the transmitted instruction, the control management unit distributes the instruction to the specific virtual control unit for processing by accessing the status.
  • a virtual control unit the receiving end includes one to a plurality of virtual control units, each virtual control unit responds to an input command distributed by the control management unit, and converts the input command into a specific control command, and finally delivers to the application.
  • Each virtual control unit comprises: an instruction receiving unit, a virtual driving and an instruction response unit, wherein the instruction receiving unit checks the received instruction, and then performs format conversion to provide data input for the “virtual drive”;
  • the driver acts as a data bridge between the input command and the upper application, and adapts the control input layer in the specific operation platform; the command response unit exists in a specific application, and each application needs to associate with a specific input type if it can respond to an input type.
  • the virtual driver is registered with the control management unit. Therefore, when the application receives the input control transmitted by the sender, the corresponding application logic processing can be completed by the command response unit.
  • a plurality of terminal devices can work together to control the input receiving device as a multi-input source, thereby improving the user experience and having broad application prospects.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明提供一种多输入操作控制方法及装置，解决现有应用于多屏互动中的多设备不能协同控制的问题。本发明的方法包括：与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令；根据所述控制指令对同一应用中的多个对象分别进行操作控制。本发明的多输入操作控制方法中，多个终端设备可以协同工作，作为多输入源对输入接收设备进行控制，具有广阔的应用前景。

Description

多输入操作控制方法及装置
相关申请的交叉引用
本申请主张在2014年4月2日在中国提交的中国专利申请号No.201410131856.2的优先权，其全部内容通过引用包含于此。
技术领域
本发明涉及通信技术领域，特别是涉及一种多输入操作控制方法及装置。
背景技术
随着各种智能终端和高速无线网络的发展和普及，基于网络传输的设备之间的多屏互动与数据共享技术和标准也正逐渐被开发，并得到了广泛的应用，如有数字生活网络联盟DLNA/通用即插即用UPNP，MIRACAST等规范，也有最近Google推出的Chromecast技术方案。
伴随着这些多屏互动技术方案的发展和实现，以设备输入去控制其他终端设备的互动方案也被自然提出，如构造智能手机应用替代传统遥控器，通过机顶盒控制大屏电视。然而，由于硬件系统的差异，不能够灵活的实现各种输入源协同控制工作。
发明内容
本发明的目的在于提供一种多输入操作控制方法及装置，用以解决多屏互动技术中不能够灵活的实现各种输入源协同控制的问题。
为了实现上述目的，本发明提供了一种多输入操作控制方法，包括：
与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令；
根据所述控制指令对同一应用中的多个对象分别进行操作控制。
其中，上述的多输入操作控制方法，所述与多个发送端建立初始化连接的步骤包括：
获取多个发送端根据广播搜寻指令分别发送的第一输入信息，其中，所 述第一输入信息包括：所述发送端的地址及输入类型；
根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。
其中，构造并注册与所述发送端的输入类型相对应的虚拟驱动的步骤包括：
在所述多个发送端的输入类型相同时，为所述多个发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
其中，与多个所述发送端建立通信连接的步骤包括：
获取所述多个发送端分别发送的包括输入类型的第一信息；
根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空闲状态，则与多个所述发送端建立通信连接。
其中，所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令的步骤包括：
在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令；或者
在所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
其中，在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令的步骤包括：
一个发送端对应一个虚拟驱动时，每个发送端对应的虚拟驱动分别将输 入指令转换成相应的控制指令；
多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令。
其中，所述根据所述控制指令对同一应用中的多个对象分别进行操作控制的步骤包括：
顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；
依次根据所述控制指令对同一应用中的多个对象分别进行操作控制。
本发明实施例还提供了一种多输入操作控制装置，包括：
构造模块，用于与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
控制管理模块，用于与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换相应的控制指令；
响应模块，用于根据所述控制指令对同一应用中的多个对象分别进行操作控制。
其中，上述的多输入操作控制装置，具体通过第一连接模块与所述多个发送端建立初始化连接，所述第一连接模块包括：
第一获取单元，用于获取多个发送端根据广播搜寻指令分别发送的第一输入信息，其中，所述第一输入信息包括：所述发送端的地址及输入类型；
选择单元，用于根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
第二获取单元，用于获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
第一连接单元，用于根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。
其中，上述的多输入操作控制装置，所述构造模块包括：
第一构造单元，用于在所述多个发送端的输入类型相同时，为所述多个 发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
第二构造单元，在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
其中，上述多输入操作控制装置，具体通过第二连接模块与所述多个发送端建立通信连接，所述第二连接模块包括：
第三获取单元，用于获取所述多个发送端分别发送的包括输入类型的第一信息；
第二连接单元，用于根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空闲，则与多个所述发送端建立通信连接。
其中，所述控制管理模块包括：
第一转换单元，用于在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令；
第二转换单元，用于在所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
其中，所述第一转换单元包括：
第一转换子单元，用于一个发送端对应一个虚拟驱动时，每个发送端对应的虚拟驱动分别将输入指令转换成相应的控制指令；
第二转换子单元，用于多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令。
其中，所述响应模块包括：
接收单元，用于顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；
响应单元，用于依次响应所述接收单元顺序接收的控制指令。
本发明实施例具有以下有益效果：
本发明实施例的多输入操作控制方法，接收端应用构造并注册多个虚拟 驱动；当接收到多个发送端指令后，根据发送端指令类型将所述每个发送端指令分配给与所述发送端指令类型相对应的虚拟驱动；所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令，最后根据所述控制指令对同一应用中的多个对象分别进行操作控制，实现了多个输入源之间可以协同控制应用的功能，具有很大的应用前景。
附图说明
图1为本发明实施例的方法流程图；
图2为本发明实施例中发送端与接收端的连接交互图；
图3为本发明实施例中场景一的结构示意图；
图4为本发明实施例中场景二的结构示意图；
图5为本发明实施例中场景三的结构示意图；
图6为本发明实施例的具体流程图；
图7为本发明实施例中发送端与接收端的结构示意图；
图8为本发明实施例装置的结构框图。
具体实施方式
为使本发明要解决的技术问题、技术方案和优点更加清楚，下面将结合具体实施例及附图进行详细描述。
本发明实施例解决多屏互动技术中不能够灵活的实现各种输入源协同控制的问题，本发明实施例提供了一种多输入操作控制方法，如图1所示，其中，所述多输入操作控制方法包括：
步骤10：与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
步骤20：与多个所述发送端建立连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令；
步骤30：根据所述控制指令对同一应用中的多个对象分别进行操作控制。
本发明实施例的多输入操作控制方法，能够灵活的实现多个输入源协同控制同一应用，随着多屏互动技术和应用的发展与普及，本发明实施例具有广泛的应用场景。
本发明实施例的多输入操作控制方法中，所述与多个发送端建立初始化连接的步骤包括：
获取多个发送端根据广播搜寻指令分别发送的第一输入信息，其中，所述第一输入信息包括：所述发送端的地址及输入类型；
根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。具体说明如下：
如图2所示，接收端与多个发送端建立初始化连接过程，分为三个阶段：
(1)发现阶段：接收端广播搜寻发送端，发送端定期或者收到接收端搜寻指令后，向网内广播包括自身地址以及输入类型的第一输入信息，即发送端能力信息；
(2)选择阶段：接收端根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端，并进一步获取与接收端输入类型兼容的发送端的包括发送端的输入类型及输入数值范围的第二输入信息即发送端的详细能力信息，其中，所述详细能力通过发送端中的能力定义单元产生；
(3)连接阶段：当接收端需要连接某个发送端时，接收端向与接收端兼容的发送端发起连接请求，发送端响应连接请求，建立初始化连接。
在本发明的具体实施例中，完成初始化连接后，接收端通过定时保活消息建立长期通信连接。
本发明实施例中，与多个发送端建立初始化连接后，需要构造并注册与所述发送端的输入类型相对应的虚拟驱动。虚拟驱动的主要功能是将发送端发送的输入指令转化为接收端应用可以响应的指令，并驱动应用完成相关动作。如虚拟鼠标驱动，接收到发送端发送的包括x/y相对坐标值以及按键类型的输入指令后，将所述输入指令转换为鼠标移动以及按键操作控制指令，传输给应用并驱动应用完成相关动作；同理，游戏手柄类虚拟驱动，可以将方向与游戏按键等指令转化为相应的控制指令，传输给应用并驱动应用完成 相关动作。所以每种虚拟驱动负责一种控制能力，当发送端与接收端设备进行连接的能力协商完成后，接收端可以构建具备相应能力的虚拟驱动。
本发明实施例的多输入操作控制方法中，构造并注册与所述发送端的输入类型相对应的虚拟驱动的步骤包括：
在所述多个发送端的输入类型相同时，为所述多个发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
在本发明的具体实施例中，根据应用构造并注册与发送端输入类型对应的虚拟驱动，实现多个发送端对同一应用协同控制的目的。
本发明实施例的多输入操作控制方法中，与多个所述发送端建立通信连接的步骤包括：
获取所述多个发送端分别发送的包括输入类型的第一信息；
根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空闲，则与多个所述发送端建立通信连接。
本发明具体实施例中，当虚拟驱动的当前状态为空闲状态时与多个所述发送端建立通信连接，避免与当前的接入产生冲突。
本发明实施例的多输入操作控制方法，所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令的步骤包括：
在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令；或者
所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
进一步地，当一个发送端对应一个虚拟驱动时，每个发送端对应的虚拟驱动分别将输入指令转换成相应的控制指令；多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令；顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；依次根据所述控制指令对同一应用中的 多个对象分别进行操作控制。具体举例说明如下。
场景一
如图3所示，左侧手机终端将游戏同屏至右端智能设备，两个终端同时操作游戏，如赛车、球类等竞争类游戏。操作基于游戏的种类，可能是按键，也可能是基于手机中的加速、重力等传感器的体感控制。
此时，发送端的输入类型相同，假定两个手机终端分别为手机终端a和手机终端b，游戏应用构造并注册与手机终端a和手机终端b相对应的虚拟驱动，假定分别为虚拟驱动A和虚拟驱动B；两个手机终端与右侧智能设备建立通信连接后，虚拟驱动A和虚拟驱动B分别将输入指令转换成相应的控制指令，其中，所示控制指令中包括控制来源(A或者B)；控制指令被游戏应用按顺序读取，可以基于控制来源及指令类型分别控制不同的游戏对象，如可以让两个动画精灵A，和B，分别响应来自虚拟驱动A和虚拟驱动B的跳动指令进行跳动。
场景二
如图4所示，左侧的笔记本电脑、键盘和手机终端同时为右侧智能设备提供不同类型的输入控制：主控笔记本提供内容和鼠标输入，独立键盘提供文字输入，而手机终端提供体感输入。
此时，发送端输入类型不相同，应用构造并注册分别与左侧笔记本电脑、键盘以及手机终端对应的虚拟驱动，假定为虚拟驱动A、虚拟驱动B以及虚拟驱动C，当左侧的笔记本电脑、键盘和手机终端与右侧的智能设备建立通信连接后，左侧笔记本电脑、键盘以及手机终端分别将输入指令传送给相应的虚拟驱动，并由虚拟驱动将所述输入指令转换为控制指令。此时应用响应不同指令类型，并绑定鼠标事件至OnMouseEvent()；绑定触摸事件至OnTouchEvent()等，从而完成协同控制。
场景三
如图5所示，两台(或者多台)工作笔记本电脑操作统一界面，每个电脑终端都可以进行输入操作，并不会产生冲突，可以一个进行键盘输入，另外一个进行鼠标控制。
此时，发送端输入类型相同，应用构造并注册一个虚拟驱动，左侧的两 台笔记本电脑与右侧是智能设备建立通信连接后，所有输入指令被无区别的传输至虚拟控制单元，然后被转换成控制指令，按照指令到达的先后顺序传输至应用。
本发明实施例的多输入操作控制方法，实现多个发送端协同控制应用的目的，具有很大的应用前景，同时提高了用户体验。
下面具体说明本发明实施例的实现过程。
在本发明的具体实施例中，如图6所示，接收端还包括与虚拟驱动关联的一个或者多个指令接收单元。如图7所示，接收端与多个发送端建立初始化连接后，构造模块构造并向接收端中的控制管理模块注册与发送端输入类型对应的虚拟驱动；控制管理模块获取所述多个发送端分别发送的包括输入类型的第一信息；控制管理模块根据所述第一信息判断指令接收单元是否空闲，当指令接收单元空闲时，进一步判断与空闲的指令接收单元关联的虚拟驱动是否兼容；当兼容时与发送端建立通信连接；更新指令接收单元的接收状态，并启动保活过程；控制管理单元接收多个所述发送端分别发送的输入指令，并传送给相应的指令接收单元；指令接收单元对所述输入指令进行格式转换后传送给相应的虚拟驱动；所述虚拟驱动将每个发送端的所述输入指令转换相应的控制指令；响应模块根据所述控制指令对同一应用中的多个对象分别进行操作控制，从而实现了多个输入源对接收端系统控制的目的。
本发明实施例还提供了一种多输入操作控制装置，如图8所示，包括：
构造模块，用于与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
控制管理模块，用于与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换相应的控制指令；
响应模块，用于根据所述控制指令对同一应用中的多个对象分别进行操作控制。
本发明实施例的多输入操作控制装置中，具体通过第一连接模块与所述多个发送端建立初始化连接，所述第一连接模块包括：
第一获取单元，用于获取多个发送端根据广播搜寻指令分别发送的第一 输入信息，其中，所述第一输入信息包括：所述发送端的地址及输入类型；
选择单元，用于根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
第二获取单元，用于获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
第一连接单元，用于根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。
本发明实施例的多输入操作控制装置中，所述构造模块包括：
第一构造单元，用于在所述多个发送端的输入类型相同时，为所述多个发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
第二构造单元，在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
本发明实施例的多输入操作控制装置中，具体通过第二连接模块与所述多个发送端建立连接，所述第二连接模块包括：
第三获取单元，用于获取所述多个发送端分别发送的包括输入类型的第一信息；
第二连接单元，用于根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空闲，则与多个所述发送端建立通信连接。
本发明实施例的多输入操作控制装置中，所述传送模块包括：
第一转换单元，用于在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令；
第二转换单元，用于所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
本发明实施例的多输入操作控制装置中，所述第一转换单元包括：
第一转换子单元，用于一个发送端对应一个虚拟驱动时，每个发送端对 应的虚拟驱动分别将输入指令转换成相应的控制指令；
第二转换子单元，用于多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令。
本发明实施例的多输入操作控制装置中，所述响应模块包括：
接收单元，用于顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；
响应单元，用于依次响应所述接收单元顺序接收的控制指令。
在本发明的具体实施例中，如图7所示，图中的发送端和接收端可以对应一个具体的终端设备，也可以作为一个功能模块嵌入到一个系统当中。两端处于同一局域网环境当中，满足多屏互动条件时，首先通过连接发现协议，建立有效的网络连接，然后通过数据传输协议进行设备间的输入控制数据信息的传输。
其中，发送端包括：
1)输入采集单元，与发送端输入设备或者应用交互，采集输入信息，并按照一定数据结构，生成相关输入指令；
2)指令发送单元，将采集后生成的指令数据实时发送给接收端；
3)能力定义单元，用来定义发送端的能力，能力描述至少应该包括输入类型和输入数值范围。如，类型为标准键盘，数据对应为扫描码Scan Code；类型为鼠标，数值至少应该包含x/y坐标和精度；也可以是针对应用的特定输入，如赛车游戏需要的左右，加减速，需要通过手机终端的加速和水平传感值的输入，这类定制输入直接与应用类型关联，由应用进行定制。
接收端包括：
1)控制管理单元，其功能包括：a)首先，控制接入，当发现发送端接入时，需要判断接收状态时否为空闲，是否兼容发送端输入类型，是否与当前的接入有冲突，是否被应用层选择等，从而最终决定与发送端建立连接；b)其次，管理当前接入状态，如发送端是否保持连接，相关控制单元是否在正常状态；c)最后，接收到发送端传送的指令后，控制管理单元通过接入状态，将指令分发给具体虚拟控制单元进行处理。
2)虚拟控制单元，接收端包含一个至多个虚拟控制单元，每个虚拟控制单元响应控制管理单元分发过来的输入指令，并将输入指令转化为具体控制指令，最终传递给应用。每个虚拟控制单元，包含：指令接收单元，虚拟驱动和指令响应单元三个子部分，其中，指令接收单元将接收到的指令进行检查，然后进行格式转换，为“虚拟驱动”提供数据输入；虚拟驱动充当输入指令与上层应用之间的数据桥梁，适配具体的操作平台中控制输入层；指令响应单元存在于具体的应用当中，每个应用如果可以响应某种输入类型，则需要关联具体的虚拟驱动，并向控制管理单元注册，因此，当应用收到发送端传送的输入控制时，可以通过指令响应单元完成相应的应用逻辑处理。
本发明实施例的多输入操作控制方法及装置，多个终端设备可以协同工作，作为多输入源对输入接收设备进行控制，提高了用户体验，具有广阔的应用前景。
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (14)

  1. 一种多输入操作控制方法，其特征在于，包括：
    与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
    与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令；
    根据所述控制指令对同一应用中的多个对象分别进行操作控制。
  2. 根据权利要求1所述的多输入操作控制方法，其特征在于，所述与多个发送端建立初始化连接的步骤包括：
    获取多个发送端根据广播搜寻指令分别发送的第一输入信息，其中，所述第一输入信息包括：所述发送端的地址及输入类型；
    根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
    获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
    根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。
  3. 根据权利要求1所述的多输入操作控制方法，其特征在于，所述构造并注册与所述发送端的输入类型相对应的虚拟驱动的步骤包括：
    在所述多个发送端的输入类型相同时，为所述多个发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
    在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
  4. 根据权利要求3所述的多输入操作控制方法，其特征在于，与多个所述发送端建立通信连接的步骤包括：
    获取所述多个发送端分别发送的包括输入类型的第一信息；
    根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空 闲状态，则与多个所述发送端建立通信连接。
  5. 根据权利要求3所述的多输入操作控制方法，其特征在于，所述虚拟驱动将每个发送端的所述输入指令转换成相应的控制指令的步骤包括：
    在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令；或者
    在所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
  6. 根据权利要求5所述的多输入操作控制方法，其特征在于，在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的控制指令的步骤包括：
    一个发送端对应一个虚拟驱动时，每个发送端对应的虚拟驱动分别将输入指令转换成相应的控制指令；
    多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令。
  7. 根据权利要求5或6所述的多输入操作控制方法，其特征在于，所述根据所述控制指令对同一应用中的多个对象分别进行操作控制的步骤包括：
    顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；
    依次根据所述控制指令对同一应用中的多个对象分别进行操作控制。
  8. 一种多输入操作控制装置，其特征在于，包括：
    构造模块，用于与多个发送端建立初始化连接后，构造并注册与所述发送端的输入类型相对应的虚拟驱动；
    控制管理模块，用于与多个所述发送端建立通信连接后，接收多个所述发送端分别发送的输入指令，并传送给每个发送端对应的虚拟驱动，由所述虚拟驱动将每个发送端的所述输入指令转换相应的控制指令；
    响应模块，用于根据所述控制指令对同一应用中的多个对象分别进行操作控制。
  9. 根据权利要求8所述的多输入操作控制装置，其特征在于，具体通过第一连接模块与所述多个发送端建立初始化连接，所述第一连接模块包括：
    第一获取单元，用于获取多个发送端根据广播搜寻指令分别发送的第一输入信息，其中，所述第一输入信息包括：所述发送端的地址及输入类型；
    选择单元，用于根据所述第一输入信息，在所述多个发送端中选择与接收端输入类型兼容的发送端；
    第二获取单元，用于获取与接收端输入类型兼容的发送端分别发送的第二输入信息，其中，所述第二输入信息包括：所述发送端的输入类型及输入数值范围；
    第一连接单元，用于根据所述第二输入信息，在与接收端输入类型兼容的发送端中，选择接收端的应用需要建立连接的多个发送端建立初始化连接。
  10. 根据权利要求8所述的多输入操作控制装置，其特征在于，所述构造模块包括：
    第一构造单元，用于在所述多个发送端的输入类型相同时，为所述多个发送端分别构造并注册一个虚拟驱动，或者为所述多个发送端构造一个虚拟驱动；
    第二构造单元，在所述多个发送端的输入类型不同时，为所述多个发送端分别构造并注册一个虚拟驱动。
  11. 根据权利要求10所述的多输入操作控制装置，其特征在于，具体通过第二连接模块与所述多个发送端建立通信连接，所述第二连接模块包括：
    第三获取单元，用于获取所述多个发送端分别发送的包括输入类型的第一信息；
    第二连接单元，用于根据所述第一信息，若与所述输入类型对应的虚拟驱动的当前状态为空闲，则与多个所述发送端建立通信连接。
  12. 根据权利要求10所述的多输入操作控制装置，其特征在于，所述控制管理模块包括：
    第一转换单元，用于在所述多个发送端的输入类型相同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令或者由所述多个发送端对应的虚拟驱动将该发送端的输入指令转换成相应的 控制指令；
    第二转换单元，用于在所述多个发送端的输入类型不同时，由每个发送端分别对应的虚拟驱动分别将每个发送端的输入指令转换成相应的控制指令。
  13. 根据权利要求12所述的多输入操作控制装置，其特征在于，所述第一转换单元包括：
    第一转换子单元，用于一个发送端对应一个虚拟驱动时，每个发送端对应的虚拟驱动分别将输入指令转换成相应的控制指令；
    第二转换子单元，用于多个发送端对应一个虚拟驱动时，所述虚拟驱动根据接收的多个所述发送端输入指令的先后顺序，依次将每个发送端的所述输入指令转换相应的控制指令。
  14. 根据权利要求12或13所述的多输入操作控制装置，其特征在于，所述响应模块包括：
    接收单元，用于顺序接收所述虚拟驱动根据所述输入指令转换成的控制指令；
    响应单元，用于依次响应所述接收单元顺序接收的控制指令。
PCT/CN2015/075708 2014-04-02 2015-04-01 多输入操作控制方法及装置 Ceased WO2015149704A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410131856.2A CN104980560B (zh) 2014-04-02 2014-04-02 一种多输入操作控制方法及装置
CN201410131856.2 2014-04-02

Publications (1)

Publication Number Publication Date
WO2015149704A1 true WO2015149704A1 (zh) 2015-10-08

Family

ID=54239406

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/075708 Ceased WO2015149704A1 (zh) 2014-04-02 2015-04-01 多输入操作控制方法及装置

Country Status (2)

Country Link
CN (1) CN104980560B (zh)
WO (1) WO2015149704A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113827953B (zh) * 2021-09-28 2024-03-22 完美世界(北京)软件科技发展有限公司 游戏控制系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707894A (zh) * 2012-05-22 2012-10-03 Tcl集团股份有限公司 一种应用于多屏互动的输入方法及装置
CN103024588A (zh) * 2012-11-15 2013-04-03 长春指南针科技有限公司 一种多屏互动系统及方法
CN103248952A (zh) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 一种智能终端与智能电视机多屏互动方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103513810A (zh) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 一种用移动终端模拟鼠标控制适配器的方法及系统
CN103517026A (zh) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 多屏适配器、多屏适配器的遥控方法及系统
CN103019967A (zh) * 2012-12-21 2013-04-03 鸿富锦精密工业（深圳）有限公司 电子装置控制系统及控制方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707894A (zh) * 2012-05-22 2012-10-03 Tcl集团股份有限公司 一种应用于多屏互动的输入方法及装置
CN103024588A (zh) * 2012-11-15 2013-04-03 长春指南针科技有限公司 一种多屏互动系统及方法
CN103248952A (zh) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 一种智能终端与智能电视机多屏互动方法

Also Published As

Publication number Publication date
CN104980560A (zh) 2015-10-14
CN104980560B (zh) 2018-02-23

Similar Documents

Publication Publication Date Title
CN110012328B (zh) 一种与智能电视交互的方法及装置
WO2012093848A2 (en) Apparatus and method for remotely controlling peripheral devices in mobile communication terminal
US20130189925A1 (en) Pairing Wireless Device Using Multiple Modalities
US20140215358A1 (en) Screen sharing system and central apparatus
CN102932695A (zh) 一种遥控方法、智能终端及智能遥控系统
US10591999B2 (en) Hand gesture recognition method, device, system, and computer storage medium
WO2017097088A1 (zh) 多屏投影控制方法、系统、终端设备及计算机存储介质
WO2017165105A1 (en) Universal internet of things (iot) smart translator
CN106896920B (zh) 虚拟现实系统、虚拟现实设备、虚拟现实控制装置及方法
CN103856374A (zh) 一种数据传输方法、终端及家庭互联系统
CN107071551A (zh) 应用于智能电视系统中的多屏互动屏幕响应方法
US20180250596A1 (en) Interworking between scenario-based content of main device and external device
CN105491135A (zh) 建立数据连接的方法及装置
CN108320148A (zh) 一种资源转移方法及相关设备
CN103686287A (zh) 一种实现智能电视触摸屏的方法和系统
CN103024457A (zh) 一种服务器端触屏控制方法及装置
CN111447208A (zh) 信息共享方法及电子设备
WO2025011179A1 (zh) 数据传输方法、装置、介质及设备
CN108494895B (zh) 交互智能平板、网域冲突控制方法、装置及介质
CN105578240A (zh) 电视终端交互方法和系统
CN106570045B (zh) 一种数据操作控制方法及其系统、用户终端
KR20110018694A (ko) 호스트 장치 및 슬레이브 장치 제어 방법
WO2015062400A1 (zh) 视频通道分配管理方法和相关设备及通信系统
JP5294416B2 (ja) リモコン制御システムおよびリモコン制御方法
WO2015149704A1 (zh) 多输入操作控制方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15774407

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase
122 Ep: pct application non-entry in european phase

Ref document number: 15774407

Country of ref document: EP

Kind code of ref document: A1