WO2017107429A1 - Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium - Google Patents

Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium Download PDF

Info

Publication number
WO2017107429A1
WO2017107429A1 PCT/CN2016/088138 CN2016088138W WO2017107429A1 WO 2017107429 A1 WO2017107429 A1 WO 2017107429A1 CN 2016088138 W CN2016088138 W CN 2016088138W WO 2017107429 A1 WO2017107429 A1 WO 2017107429A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
event
event data
application
operating system
Prior art date
Application number
PCT/CN2016/088138
Other languages
French (fr)
Chinese (zh)
Inventor
赵科
张丙林
陈聪
Original Assignee
百度在线网络技术（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术（北京）有限公司 filed Critical 百度在线网络技术（北京）有限公司
Publication of WO2017107429A1 publication Critical patent/WO2017107429A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/448—Execution paradigms, e.g. implementations of programming paradigms

Definitions

  • the present invention relates to communication technologies, and in particular, to an operation processing method, apparatus, device, and non-volatile computer storage medium for an interconnection application.
  • terminal devices integrate more and more functions, so that more and more corresponding applications (Applications, APPs) are included in the system function list of the terminal devices.
  • An application installed on some terminal devices which is referred to as an interconnection application in the present invention, needs to be installed by using a corresponding cooperation application on another terminal device connected thereto, otherwise there is no use value, especially for some vehicle interconnections. application.
  • the operation event data of the other terminal device connected to the terminal device connected by the user in the interconnection application can only be transmitted to another terminal device through an event simulation interface, such as an Instrumentation interface of the Android system.
  • the matching application corresponding to the connected application cannot be delivered to another application other than the cooperative application on another terminal device, for example, an input method application, etc., and therefore, another terminal connected to the terminal device connected thereto cannot be operated through the interconnected application.
  • Other applications on the device other than the matching application corresponding to the interconnected application are examples of the device connected to the terminal device connected by the user in the interconnection application.
  • aspects of the present invention provide an operation processing method, apparatus, device, and non-volatile computer storage medium for an interconnection application, which are configured to implement a cooperation corresponding to the interconnection application on another terminal device connected thereto through an interconnection application operation.
  • the application and other applications than the corresponding application corresponding to the interconnected application are configured to implement a cooperation corresponding to the interconnection application on another terminal device connected thereto through an interconnection application operation.
  • An aspect of the present invention provides an operation processing method for an interconnection application, including:
  • the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
  • the event simulation interface includes an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
  • the aspect as described above, and any possible implementation manner, further provide an implementation manner, where the acquiring user operates with the first terminal device by using an interconnected application on the first terminal device Operation event data of the connected second terminal device, including:
  • the communication connection comprising at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
  • the operational event data comprising an operational event and coordinate data of the operational event.
  • the operational event comprising at least one of the following events:
  • the sending the operation event data to an input module of the operating system including:
  • the operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides an operation processing apparatus for an interconnection application, including:
  • An acquiring unit configured to acquire operation event data of a user operating the second terminal device by using the first terminal device
  • a normal sending unit configured to send, by using an event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
  • An abnormal sending unit configured to send the operation event data to an input module of the operating system, if the abnormality indication returned by the event distribution module is received, so that the input module performs input processing according to the operation event data .
  • the event simulation interface includes an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
  • any possible implementation manner further provide an implementation manner, where the acquiring unit is specifically configured to
  • the communication connection comprising at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
  • the operational event data comprising an operational event and coordinate data of the operational event.
  • the operational event comprising at least one of the following events:
  • the operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • an apparatus comprising:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, When executed by the one or more processors:
  • the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
  • a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
  • the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
  • the embodiment of the present invention is configured by acquiring a user through the first terminal.
  • the standby interconnection application operates the operation event data of the second terminal device connected to the first terminal device, and then sends the operation event data to the event distribution module of the operating system of the second terminal device through the event simulation interface.
  • the event distribution module performs input processing according to the operation event data, and if the abnormality indication returned by the event distribution module is received, the operation event data can be sent to the input module of the operating system, And causing the input module to perform an input process according to the operation event data, because the user can directly send the user through the interconnection application operation on the first terminal device to the input module of the operating system of the second terminal device connected to the first terminal device.
  • the operation event data of the second terminal device connected to the first terminal device so that the operation event data triggered by the user in the interconnection application and the operation event data of another terminal device connected to the terminal device thereof can be transmitted to another terminal device except the Work with other apps than the app, for example, typing Applications, other applications enabling another terminal apparatus via the Internet where the application operating its terminal connected with the application in addition to the corresponding network application.
  • the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application.
  • Complex input-related processing can effectively reduce the processing load of interconnected applications.
  • the input module of the operating system since different operating systems deal with the operation event data in different manners, the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the reliability and efficiency of input processing.
  • the technical solution provided by the present invention can greatly improve the user experience.
  • FIG. 1 is a schematic flowchart of an operation processing method of an interconnection application according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an operation processing apparatus of an interconnection application according to another embodiment of the present invention.
  • the user terminal device involved in the embodiments of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer). , PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart Can watch, smart bracelet, etc.).
  • the vehicle-mounted terminal device involved in the embodiment of the present invention may also be referred to as a vehicle, and refers to an abbreviation of an in-vehicle infotainment product installed in a car.
  • the car machine must be capable of realizing people and vehicles, vehicles and the outside world ( Information communication between car and car).
  • FIG. 1 is a schematic flowchart of an operation processing method of an interconnection application according to an embodiment of the present invention, as shown in FIG. 1 .
  • An event distribution module of the operating system is configured to acquire an operation event in an application through an event simulation interface, perform related processing required for inputting the operation event, for example, coordinate conversion processing, and then distribute the processing result. Give the app that is currently running. If the application is not the currently running application, the event dispatch module returns an exception indication to the application to indicate an abnormal condition and the processing fails.
  • An input module of the operating system for obtaining operational events in the operating system, Contains touch events, physical button events, etc., and distributes them to the corresponding application.
  • the input module can also perform related processing required for inputting the acquired operation event, for example, coordinate conversion processing and the like.
  • the executor of the application of the second terminal device that is, the application corresponding to the interconnection application, or the application located at the second terminal device (ie, the cooperation corresponding to the interconnection application)
  • the functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the event distribution module sends the operation event data to cause the event distribution module to perform an input process according to the operation event data, and if an abnormality indication returned by the event distribution module is received, enabling input to the operating system Sending, by the module, the operation event data, so that the input module performs an input process according to the operation event data, because the user can directly send the user through the input module of the operating system of the second terminal device connected to the first terminal device.
  • the interconnection application on a terminal device operates the operation event data of the second terminal device connected to the first terminal device, so that the operation triggered by the user in the interconnection application can be operated event data of another terminal device connected to the terminal device Passed to another terminal device in addition to the match
  • Other applications other than, for example, application of the input method, enabling its operation by the application of the interconnection where The
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
  • the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection.
  • a Bluetooth connection a Universal Serial Bus (USB) connection
  • a Wireless Fidelity (WI-FI) connection a Wireless Fidelity connection.
  • One of the connections is not specifically limited in this embodiment.
  • the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
  • the user may obtain an operation by using an interconnected application on the first terminal device based on a communication connection with the interconnected application. Operation event data of the second terminal device.
  • the so-called operation event data of the second terminal device connected to the first terminal device by the user on the first terminal device means that the user is in the first end.
  • the operation behaviors performed in the interconnection application on the end device for example, clicking, double-clicking, dragging, etc., mapping data to the operation events on the display device of the second terminal device may include, but are not limited to, operation events and The coordinate data of the operation event.
  • the interconnection application on the first terminal device may project the display of the second terminal device on the display device of the first terminal device by using the cooperation application corresponding to the interconnection application on the second terminal device.
  • the interface output by the device can be operated by the user on the interface projected in the interconnection application, for example, a touch operation or a physical button operation, so that the second terminal device connected to the first terminal device connected thereto can be realized. All the applications on the network, that is, the cooperation application corresponding to the interconnection application and other applications other than the cooperation application corresponding to the interconnection application.
  • the interconnection application on the first terminal device may also be used as an operation terminal, for example, a mouse or a remote controller, by using a matching application corresponding to the interconnection application on the second terminal device, and the user may By operating in an interconnected application, for example, a touch operation or a physical key operation, etc., it is possible to implement all applications on the second terminal device connected to the first terminal device, that is, the corresponding cooperation of the interconnection application.
  • the application and other applications than the corresponding application corresponding to the interconnected application may be used as an operation terminal, for example, a mouse or a remote controller, by using a matching application corresponding to the interconnection application on the second terminal device, and the user may By operating in an interconnected application, for example, a touch operation or a physical key operation, etc., it is possible to implement all applications on the second terminal device connected to the first terminal device, that is, the corresponding cooperation of the interconnection application.
  • the application and other applications than the corresponding application corresponding to the interconnected application may be used as an operation
  • the operation behavior of the user in the interconnected application on the first terminal device may be specifically
  • the coordinate data is mapped to coordinate data of an operation event on the display device of the second terminal device.
  • the current terminal devices are all touch-type terminal devices, and the display device has a touch input function in addition to the display function. Any operational behavior on the display device of the terminal device needs to be broken down into a collection of several operational events, the operating system The relevant data of these operational events can be processed accordingly.
  • the operation event includes at least one of the following events:
  • the so-called Down event is triggered only once in one operation, and is triggered when the finger just touches the display device of the terminal device.
  • the so-called Up event is triggered only once in one operation, and is triggered when the finger leaves the display device of the terminal device.
  • the so-called Move event will trigger 0, 1 or more Move events during an operation. If the finger has been moving on the display device of the terminal device, the Move event will be triggered all the time, and both are in the Down event. After the event with the Up.
  • the event simulation interface may be an Instrumentation interface;
  • the operating system of the second terminal device is an IOS operating system.
  • the event simulation interface may be a UITouch class interface or a UIEvent class interface, which is not specifically limited in this embodiment.
  • the operation event data may be sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
  • the operation event data of the second terminal device connected to the first terminal device is operated by the user through the interconnection application on the first terminal device, and then the event is simulated to the second terminal device through the event simulation interface.
  • the event distribution module of the operating system sends the operation event data to cause the event distribution module to perform an input process according to the operation event data, and if the abnormality indication returned by the event distribution module is received, enabling the operation
  • the input module of the system sends the operation event data, so that the input module performs an input process according to the operation event data, because it can directly send to an input module of an operating system of the second terminal device connected to the first terminal device.
  • the operation operation data of the second terminal device connected to the first terminal device is operated by the user on the first terminal device, so that the operation triggered by the user in the interconnection application is an operation event of another terminal device connected to the terminal device Data that can be passed to another terminal device Other than the application with the application, e.g., application input, enabling the other applications on another terminal apparatus via the Internet where the application operating its terminal connected with the application in addition to the corresponding network application.
  • the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application.
  • Complex input-related processing can effectively reduce the processing load of interconnected applications.
  • the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the loss The reliability and efficiency of the processing.
  • FIG. 2 is a schematic structural diagram of an operation processing apparatus of an interconnection application according to another embodiment of the present invention, as shown in FIG. 2 .
  • the operation processing device of the interconnection application of the present embodiment may include an acquisition unit 21, a normal transmission unit 22, and an abnormality transmission unit 23.
  • the obtaining unit 21 is configured to acquire operation event data of the second terminal device operated by the user by using the first terminal device
  • the normal sending unit 22 is configured to distribute the event to the operating system of the second terminal device by using the event simulation interface.
  • the module sends the operation event data, so that the event distribution module performs an input process according to the operation event data;
  • the abnormality sending unit 23 is configured to: if receiving the abnormality indication returned by the event distribution module, to the operation
  • the input module of the system transmits the operation event data to cause the input module to perform an input process according to the operation event data.
  • the operation processing device of the interconnection application of the embodiment may be an application corresponding to the application of the second terminal device, that is, the corresponding application, or may be an application located at the second terminal device (ie, the interconnection application)
  • the plug-in in the corresponding application) or the functional unit such as the Software Development Kit (SDK)
  • SDK Software Development Kit
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
  • the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection.
  • a Bluetooth connection a Universal Serial Bus (USB) connection
  • a Wireless Fidelity (WI-FI) connection a Wireless Fidelity connection.
  • One of the connections is not specifically limited in this embodiment.
  • the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
  • the acquiring unit 21 may be specifically configured to acquire, by using the communication connection with the interconnected application, the user by using the first terminal device.
  • the interconnection application operates the operation event data of the second terminal device.
  • the so-called operation event data of the second terminal device connected to the first terminal device by the user on the first terminal device is performed by the user in the interconnection application on the first terminal device.
  • the operational behavior for example, clicking, double-clicking, dragging, etc., mapping data to the operational events on the display device of the second terminal device may include, but is not limited to, operational events and coordinate data of the operational events.
  • the operation behavior of the user in the interconnected application on the first terminal device may be specifically
  • the coordinate data is mapped to coordinate data of an operation event on the display device of the second terminal device.
  • the current terminal devices are all touch-type terminal devices, and the display device has a touch input function in addition to the display function. Any operational behavior on the display device of the terminal device needs to be decomposed into a set of several operational events, and the operating system can process the relevant data of these operational events accordingly.
  • the operation event includes at least one of the following events:
  • the so-called Down event is triggered only once in one operation, and is triggered when the finger just touches the display device of the terminal device.
  • the so-called Up event is triggered only once in one operation, and is triggered when the finger leaves the display device of the terminal device.
  • the so-called Move event will trigger 0, 1 or more Move events in the course of an operation. If the finger has been moving on the display device of the terminal device, it will The Move event is fired all the time, and is after the Down event and before the Up event.
  • the event simulation interface may be an Instrumentation interface;
  • the operating system of the second terminal device is an IOS operating system.
  • the event simulation interface may be a UITouch class interface or a UIEvent class interface, which is not specifically limited in this embodiment.
  • the abnormal sending unit 23 may be specifically configured to send the operation event data to an input module of the operating system based on a Socket connection with an input module of the operating system.
  • the operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application operation on the first terminal device is obtained by the acquiring unit, and then the normal sending unit passes the event simulation interface to the office.
  • the event distribution module of the operating system of the second terminal device sends the operation event data, so that the event distribution module performs input processing according to the operation event data, and receives the difference returned by the event distribution module.
  • the abnormal sending unit can send the operation event data to an input module of the operating system, so that the input module performs an input process according to the operation event data, since the device can be directly connected to the first terminal device
  • the input module of the operating system of the second terminal device sends the operation event data of the second terminal device that the user connects with the first terminal device through the interconnection application on the first terminal device, so that the operation triggered by the user in the connected application is
  • the operation event data of another terminal device connected to the terminal device can be transmitted to another terminal device other than the cooperation application, for example, an input method application, etc., thereby realizing operation through the interconnection application and the terminal device thereof
  • the other terminal device connected to the application other than the matching application corresponding to the interconnection application since the device can be directly connected to the first terminal device.
  • the input module of the operating system of the second terminal device sends the operation event data of the second terminal device that the user connects with the first terminal device through the interconnection application on the first terminal device, so that the operation triggered by the user in the
  • the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application.
  • Complex input-related processing can effectively reduce the processing load of interconnected applications.
  • the input module of the operating system since different operating systems deal with the operation event data in different manners, the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the reliability and efficiency of input processing.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative, for example, the division of the elements is merely a logical functional division, There may be additional divisions in actual implementation, for example multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
  • the software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an audio processing engine, or a network device, etc.) or a processor to perform various embodiments of the present invention. Part of the steps of the method.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Abstract

An operation processing method, apparatus and device for an interconnection application, and a non-volatile computer storage medium. Operation event data generated when a user operates a second terminal device connected to a first terminal device by means of an interconnection application on the first terminal device can be directly sent to an input module of an operating system of the second terminal device connected to the first terminal device, so that an operation triggered by the user in the interconnection application and operation event data of another terminal device connected to the terminal device where the interconnection application is located can be transmitted to applications, such as an input method application, other than the matched application on another terminal device, and applications, other than the matched application corresponding to the interconnection application, on another terminal device connected to the terminal device where the interconnection application is located are operated by means of the interconnection application.

Description

互联应用的操作处理方法、装置、设备及非易失性计算机存储介质Operation processing method, device, device and non-volatile computer storage medium for interconnected applications
本申请要求了申请日为2015年12月25日，申请号为201510994264.8发明名称为“互联应用的操作处理方法及装置”的中国专利申请的优先权。The present application claims priority to Chinese Patent Application No. 201510994264.8, entitled "Operation Processing Method and Apparatus for Interconnected Applications", filed on December 25, 2015.
技术领域Technical field
本发明涉及通信技术，尤其涉及一种互联应用的操作处理方法、装置、设备及非易失性计算机存储介质。The present invention relates to communication technologies, and in particular, to an operation processing method, apparatus, device, and non-volatile computer storage medium for an interconnection application.
背景技术Background technique
随着通信技术的发展，终端设备集成了越来越多的功能，从而使得终端设备的系统功能列表中包含了越来越多相应的应用(Application，APP)。有些终端设备上所安装的应用，本发明中称为互联应用，需要通过与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用，否则没有任何使用价值，特别是对于一些车机互联应用。With the development of communication technologies, terminal devices integrate more and more functions, so that more and more corresponding applications (Applications, APPs) are included in the system function list of the terminal devices. An application installed on some terminal devices, which is referred to as an interconnection application in the present invention, needs to be installed by using a corresponding cooperation application on another terminal device connected thereto, otherwise there is no use value, especially for some vehicle interconnections. application.
然而，由于用户在互联应用中所触发的操作与其所在终端设备连接的另一个终端设备的操作事件数据，只能通过事件模拟接口，例如安卓系统的Instrumentation接口等，传递到另一个终端设备上该互联应用所对应的配合应用，而无法传递到另一个终端设备上除了该配合应用之外的其他应用，例如，输入法应用等，因此，无法通过互联应用操作与其所在终端设备连接的另一个终端设备上除了该互联应用所对应的配合应用之外的其他应用。 However, since the operation event data of the other terminal device connected to the terminal device connected by the user in the interconnection application can only be transmitted to another terminal device through an event simulation interface, such as an Instrumentation interface of the Android system. The matching application corresponding to the connected application cannot be delivered to another application other than the cooperative application on another terminal device, for example, an input method application, etc., and therefore, another terminal connected to the terminal device connected thereto cannot be operated through the interconnected application. Other applications on the device other than the matching application corresponding to the interconnected application.
发明内容Summary of the invention
本发明的多个方面提供一种互联应用的操作处理方法、装置、设备及非易失性计算机存储介质，用以实现通过互联应用操作与其连接的另一个终端设备上该互联应用所对应的配合应用和除了该互联应用所对应的配合应用之外的其他应用。Aspects of the present invention provide an operation processing method, apparatus, device, and non-volatile computer storage medium for an interconnection application, which are configured to implement a cooperation corresponding to the interconnection application on another terminal device connected thereto through an interconnection application operation. The application and other applications than the corresponding application corresponding to the interconnected application.
本发明的一方面，提供一种互联应用的操作处理方法，包括：An aspect of the present invention provides an operation processing method for an interconnection application, including:
获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述事件模拟接口包括Instrumentation接口或UITouch类接口或UIEvent类接口。The aspect and any possible implementation manners described above further provide an implementation manner, where the event simulation interface includes an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述获取用户通过第一终端设备上的互联应用操作与所述第一终端设备 连接的第二终端设备的操作事件数据，包括：The aspect as described above, and any possible implementation manner, further provide an implementation manner, where the acquiring user operates with the first terminal device by using an interconnected application on the first terminal device Operation event data of the connected second terminal device, including:
基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。Acquiring operation event data of the second terminal device by the user through an interconnection application on the first terminal device based on a communication connection with the interconnection application.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述通信连接包括蓝牙连接、USB连接和WI-FI连接中的至少一项。In an aspect as described above and any possible implementation, an implementation is further provided, the communication connection comprising at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述操作事件数据包括操作事件和所述操作事件的坐标数据。In an aspect as described above and any possible implementation, an implementation is further provided, the operational event data comprising an operational event and coordinate data of the operational event.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述操作事件包括下列事件中的至少一项：An aspect as described above and any possible implementation, further providing an implementation, the operational event comprising at least one of the following events:
Down事件；Down event;
Up事件；以及Up event; and
Move事件。Move event.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述向所述操作系统的输入模块发送所述操作事件数据，包括：The aspect as described above, and any possible implementation manner, further provide an implementation manner, the sending the operation event data to an input module of the operating system, including:
基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。The operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，An aspect of the above, and any possible implementation, further providing an implementation manner,
所述第一终端设备为车载终端设备； The first terminal device is an in-vehicle terminal device;
所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
本发明的另一方面，提供一种互联应用的操作处理装置，包括：Another aspect of the present invention provides an operation processing apparatus for an interconnection application, including:
获取单元，用于获取用户通过第一终端设备操作第二终端设备的操作事件数据；An acquiring unit, configured to acquire operation event data of a user operating the second terminal device by using the first terminal device;
正常发送单元，用于通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；a normal sending unit, configured to send, by using an event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
异常发送单元，用于若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。An abnormal sending unit, configured to send the operation event data to an input module of the operating system, if the abnormality indication returned by the event distribution module is received, so that the input module performs input processing according to the operation event data .
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述事件模拟接口包括Instrumentation接口或UITouch类接口或UIEvent类接口。The aspect and any possible implementation manners described above further provide an implementation manner, where the event simulation interface includes an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述获取单元，具体用于The aspect as described above and any possible implementation manner further provide an implementation manner, where the acquiring unit is specifically configured to
基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。Acquiring operation event data of the second terminal device by the user through an interconnection application on the first terminal device based on a communication connection with the interconnection application.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述通信连接包括蓝牙连接、USB连接和WI-FI连接中的至少一项。 In an aspect as described above and any possible implementation, an implementation is further provided, the communication connection comprising at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述操作事件数据包括操作事件和所述操作事件的坐标数据。In an aspect as described above and any possible implementation, an implementation is further provided, the operational event data comprising an operational event and coordinate data of the operational event.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述操作事件包括下列事件中的至少一项：An aspect as described above and any possible implementation, further providing an implementation, the operational event comprising at least one of the following events:
Down事件；Down event;
Up事件；以及Up event; and
Move事件。Move event.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，所述异常发送单元，具体用于The above-mentioned aspect and any possible implementation manner further provide an implementation manner, where the abnormal sending unit is specifically configured to
基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。The operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
如上所述的方面和任一可能的实现方式，进一步提供一种实现方式，An aspect of the above, and any possible implementation, further providing an implementation manner,
所述第一终端设备为车载终端设备；The first terminal device is an in-vehicle terminal device;
所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
本发明的另一方面，提供一种设备，包括：In another aspect of the invention, an apparatus is provided, comprising:
一个或者多个处理器；One or more processors;
存储器；Memory
一个或者多个程序，所述一个或者多个程序存储在所述存储器中， 当被所述一个或者多个处理器执行时：One or more programs, the one or more programs being stored in the memory, When executed by the one or more processors:
获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
本发明的另一方面，提供一种非易失性计算机存储介质，所述非易失性计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备：In another aspect of the present invention, a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
由所述技术方案可知，本发明实施例通过获取用户通过第一终端设 备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，进而通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理，若接收到所述事件分发模块返回的异常指示，使得能够向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理，由于能够直接向与第一终端设备连接的第二终端设备的操作系统的输入模块发送用户通过第一终端设备上的互联应用操作与第一终端设备连接的第二终端设备的操作事件数据，使得用户在互联应用中所触发的操作与其所在终端设备连接的另一个终端设备的操作事件数据，能够传递到另一个终端设备上除了该配合应用之外的其他应用，例如，输入法应用等，从而实现了通过互联应用操作与其所在终端设备连接的另一个终端设备上除了该互联应用所对应的配合应用之外的其他应用。According to the technical solution, the embodiment of the present invention is configured by acquiring a user through the first terminal. The standby interconnection application operates the operation event data of the second terminal device connected to the first terminal device, and then sends the operation event data to the event distribution module of the operating system of the second terminal device through the event simulation interface. So that the event distribution module performs input processing according to the operation event data, and if the abnormality indication returned by the event distribution module is received, the operation event data can be sent to the input module of the operating system, And causing the input module to perform an input process according to the operation event data, because the user can directly send the user through the interconnection application operation on the first terminal device to the input module of the operating system of the second terminal device connected to the first terminal device The operation event data of the second terminal device connected to the first terminal device, so that the operation event data triggered by the user in the interconnection application and the operation event data of another terminal device connected to the terminal device thereof can be transmitted to another terminal device except the Work with other apps than the app, for example, typing Applications, other applications enabling another terminal apparatus via the Internet where the application operating its terminal connected with the application in addition to the corresponding network application.
另外，采用本发明所提供的技术方案，由于利用了操作系统的输入模块对外所开放的特殊接口，直接将操作事件数据发送给操作系统的输入模块进行输入处理，无需互联应用对操作事件数据进行复杂的输入相关处理，能够有效降低互联应用的处理负担。In addition, according to the technical solution provided by the present invention, since the special interface opened by the input module of the operating system is utilized, the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application. Complex input-related processing can effectively reduce the processing load of interconnected applications.
另外，采用本发明所提供的技术方案，由于不同操作系统对与操作事件数据的处理方式不同，因此，由操作系统的输入模块亲自对操作事件数据进行复杂的输入相关处理，无需进行适配处理，能够有效提高输入处理的可靠性和效率。 In addition, according to the technical solution provided by the present invention, since different operating systems deal with the operation event data in different manners, the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the reliability and efficiency of input processing.
另外，采用本发明所提供的技术方案，能够极大提升用户体验。In addition, the technical solution provided by the present invention can greatly improve the user experience.
附图说明DRAWINGS
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are the present invention. For some embodiments, other drawings may be obtained from those of ordinary skill in the art in light of the inventive workability.
图1为本发明一实施例提供的互联应用的操作处理方法的流程示意图；FIG. 1 is a schematic flowchart of an operation processing method of an interconnection application according to an embodiment of the present invention;
图2为本发明另一实施例提供的互联应用的操作处理装置的结构示意图。FIG. 2 is a schematic structural diagram of an operation processing apparatus of an interconnection application according to another embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的全部其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
需要说明的是，本发明实施例中所涉及的用户终端设备可以包括但不限于手机、个人数字助理(Personal Digital Assistant，PDA)、无线手持设备、平板电脑(Tablet Computer)、个人电脑(Personal Computer，PC)、MP3播放器、MP4播放器、可穿戴设备(例如，智能眼镜、智 能手表、智能手环等)等。本发明实施例中所涉及的车载终端设备，还可以称为车机，指的是安装在汽车里面的车载信息娱乐产品的简称，车机在功能上要能够实现人与车，车与外界(车与车)的信息通信。It should be noted that the user terminal device involved in the embodiments of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer). , PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart Can watch, smart bracelet, etc.). The vehicle-mounted terminal device involved in the embodiment of the present invention may also be referred to as a vehicle, and refers to an abbreviation of an in-vehicle infotainment product installed in a car. The car machine must be capable of realizing people and vehicles, vehicles and the outside world ( Information communication between car and car).
另外，本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。In addition, the term "and/or" herein is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B exist at the same time. There are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.
图1为本发明一实施例提供的互联应用的操作处理方法的流程示意图，如图1所示。FIG. 1 is a schematic flowchart of an operation processing method of an interconnection application according to an embodiment of the present invention, as shown in FIG. 1 .
101、获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据。101. Acquire operation event data of the second terminal device that is connected to the first terminal device by the user through the interconnection application on the first terminal device.
102、通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理。102. Send, by using an event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs input processing according to the operation event data.
所谓的操作系统的事件分发模块，用于通过事件模拟接口，获取某个应用中的操作事件，对该操作事件进行输入所需要的相关处理，例如，坐标转换处理等，并再将处理结果分发给当前正在运行的该应用。如果该应用不是当前正在运行的应用，那么，事件分发模块则向该应用返回异常指示，以指示异常情况，处理失败。An event distribution module of the operating system is configured to acquire an operation event in an application through an event simulation interface, perform related processing required for inputting the operation event, for example, coordinate conversion processing, and then distribute the processing result. Give the app that is currently running. If the application is not the currently running application, the event dispatch module returns an exception indication to the application to indicate an abnormal condition and the processing fails.
103、若接收到所述事件分发模块返回的异常提示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。103. If receiving an exception prompt returned by the event distribution module, send the operation event data to an input module of the operating system, so that the input module performs an input process according to the operation event data.
所谓的操作系统的输入模块，用于获取操作系统中的操作事件，包 含触控事件、物理按键事件等，并分发给相应的应用。该输入模块，还可以对所获取的操作事件进行输入所需要的相关处理，例如，坐标转换处理等。An input module of the operating system for obtaining operational events in the operating system, Contains touch events, physical button events, etc., and distributes them to the corresponding application. The input module can also perform related processing required for inputting the acquired operation event, for example, coordinate conversion processing and the like.
需要说明的是，101～102的执行主体可以为位于第二终端设备的应用即互联应用所对应的配合应用，或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit，SDK)等功能单元，本实施例对此不进行特别限定。It should be noted that the executor of the application of the second terminal device, that is, the application corresponding to the interconnection application, or the application located at the second terminal device (ie, the cooperation corresponding to the interconnection application) The functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
可以理解的是，所述应用可以是安装在第二终端设备上的本地程序(nativeApp)，或者还可以是第二终端设备上的浏览器的一个网页程序(webApp)，本实施例对此不进行特别限定。It can be understood that the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
这样，通过获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，进而通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理，若接收到所述事件分发模块返回的异常指示，使得能够向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理，由于能够直接向与第一终端设备连接的第二终端设备的操作系统的输入模块发送用户通过第一终端设备上的互联应用操作与第一终端设备连接的第二终端设备的操作事件数据，使得用户在互联应用中所触发的操作与其所在终端设备连接的另一个终端设备的操作事件数据，能够传递到另一个终端设备上除了该配合应用之外的其他应用，例如，输入法应用等，从而实现了通过互联应用操作与其所在 终端设备连接的另一个终端设备上除了该互联应用所对应的配合应用之外的其他应用。In this way, by acquiring the operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device, and further, through the event simulation interface, to the operating system of the second terminal device. The event distribution module sends the operation event data to cause the event distribution module to perform an input process according to the operation event data, and if an abnormality indication returned by the event distribution module is received, enabling input to the operating system Sending, by the module, the operation event data, so that the input module performs an input process according to the operation event data, because the user can directly send the user through the input module of the operating system of the second terminal device connected to the first terminal device The interconnection application on a terminal device operates the operation event data of the second terminal device connected to the first terminal device, so that the operation triggered by the user in the interconnection application can be operated event data of another terminal device connected to the terminal device Passed to another terminal device in addition to the match Other applications other than, for example, application of the input method, enabling its operation by the application of the interconnection where The other terminal device connected to the terminal device has other applications than the matching application corresponding to the interconnection application.
可选地，在本实施例的一个可能的实现方式中，所述第一终端设备优选为车载终端设备；所述第二终端设备优选为用户终端设备。Optionally, in a possible implementation manner of the embodiment, the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
反过来，所述第一终端设备也可以为用户终端设备；所述第二终端设备也可以为车载终端设备。但是，在实际应用中，用户终端设备上所安装的应用都可以单独执行，无需依赖与其连接的另一个终端设备才能正常使用，或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。Conversely, the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device. However, in practical applications, the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
本发明中，第一终端设备与第二终端设备通过但不限于蓝牙连接、通用串行总线(Universal Serial Bus，USB)连接和无线相容性认证(Wireless Fidelity，WI-FI)连接中的至少一项进行连接，本实施例对此不进行特别限定。In the present invention, the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection. One of the connections is not specifically limited in this embodiment.
在完成第一终端设备与第二终端设备之间的设备连接建立之后，基于所建立的设备连接，还需要进一步建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接。可以理解的是，所述通信连接可以包括但不限于蓝牙连接、USB连接和WI-FI连接中的至少一项，本实施例对此不进行特别限定。After the device connection between the first terminal device and the second terminal device is established, based on the established device connection, it is further required to further establish a connection between the interconnected application on the first terminal device and the coordinated application on the second terminal device. Communication connection. It is to be understood that the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
可选地，在本实施例的一个可能的实现方式中，在101中，具体可以基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。Optionally, in a possible implementation manner of this embodiment, in 101, specifically, the user may obtain an operation by using an interconnected application on the first terminal device based on a communication connection with the interconnected application. Operation event data of the second terminal device.
本发明中，所谓的用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，是指用户在第一终 端设备上的互联应用中所进行的操作行为，例如，单击、双击、拖动等操作，映射到第二终端设备的显示装置上的操作事件的相关数据，可以包括但不限于操作事件和所述操作事件的坐标数据。In the present invention, the so-called operation event data of the second terminal device connected to the first terminal device by the user on the first terminal device means that the user is in the first end. The operation behaviors performed in the interconnection application on the end device, for example, clicking, double-clicking, dragging, etc., mapping data to the operation events on the display device of the second terminal device may include, but are not limited to, operation events and The coordinate data of the operation event.
在一个具体的实现过程中，第一终端设备上的互联应用，可以通过第二终端设备上的该互联应用所对应的配合应用，在第一终端设备的显示装置上投射第二终端设备的显示装置所输出的界面，用户可以通过在互联应用中所投射的界面上进行操作，例如，触控操作或物理按键操作等，这样，就可以实现操作与其所在第一终端设备连接的第二终端设备上的全部应用，即该互联应用所对应的配合应用和除了该互联应用所对应的配合应用之外的其他应用。In a specific implementation process, the interconnection application on the first terminal device may project the display of the second terminal device on the display device of the first terminal device by using the cooperation application corresponding to the interconnection application on the second terminal device. The interface output by the device can be operated by the user on the interface projected in the interconnection application, for example, a touch operation or a physical button operation, so that the second terminal device connected to the first terminal device connected thereto can be realized. All the applications on the network, that is, the cooperation application corresponding to the interconnection application and other applications other than the cooperation application corresponding to the interconnection application.
在另一个具体的实现过程中，第一终端设备上的互联应用，还可以通过第二终端设备上的该互联应用所对应的配合应用，作为一个操作端例如，鼠标或遥控器等，用户可以通过在互联应用中进行操作，例如，触控操作或物理按键操作等，这样，就可以实现操作与其所在第一终端设备连接的第二终端设备上的全部应用，即该互联应用所对应的配合应用和除了该互联应用所对应的配合应用之外的其他应用。In another specific implementation process, the interconnection application on the first terminal device may also be used as an operation terminal, for example, a mouse or a remote controller, by using a matching application corresponding to the interconnection application on the second terminal device, and the user may By operating in an interconnected application, for example, a touch operation or a physical key operation, etc., it is possible to implement all applications on the second terminal device connected to the first terminal device, that is, the corresponding cooperation of the interconnection application. The application and other applications than the corresponding application corresponding to the interconnected application.
可以理解的是，具体可以根据第一终端设备的显示装置的显示尺寸与第二终端设备的显示装置的显示尺寸的比值，将用户在第一终端设备上的互联应用中所进行的操作行为的坐标数据，映射到第二终端设备的显示装置上的操作事件的坐标数据。It can be understood that, according to the ratio of the display size of the display device of the first terminal device to the display size of the display device of the second terminal device, the operation behavior of the user in the interconnected application on the first terminal device may be specifically The coordinate data is mapped to coordinate data of an operation event on the display device of the second terminal device.
通常，目前的终端设备都是触控类型的终端设备，其显示装置除了具有显示功能之外，还具有触控输入功能。在终端设备的显示装置上的任何一个操作行为，都需要被分解为若干个操作事件的集合，操作系统 才能够对这些操作事件的相关数据进行相应处理。具体地，所述操作事件包括下列事件中的至少一项：Generally, the current terminal devices are all touch-type terminal devices, and the display device has a touch input function in addition to the display function. Any operational behavior on the display device of the terminal device needs to be broken down into a collection of several operational events, the operating system The relevant data of these operational events can be processed accordingly. Specifically, the operation event includes at least one of the following events:
Down事件；Down event;
Up事件；以及Up event; and
Move事件。Move event.
所谓的Down事件，在一次操作行为中仅会触发一次，是在手指刚接触终端设备的显示装置时触发。The so-called Down event is triggered only once in one operation, and is triggered when the finger just touches the display device of the terminal device.
所谓的Up事件，在一次操作行为中仅会触发一次，是在手指离开终端设备的显示装置时触发。The so-called Up event is triggered only once in one operation, and is triggered when the finger leaves the display device of the terminal device.
所谓的Move事件，在一次操作行为的过程中会触发0个、1个或者多个Move事件，如果手指一直在终端设备的显示装置上移动，就会一直触发Move事件，而且都是在Down事件之后与Up事件之前。The so-called Move event will trigger 0, 1 or more Move events during an operation. If the finger has been moving on the display device of the terminal device, the Move event will be triggered all the time, and both are in the Down event. After the event with the Up.
可选地，在本实施例的一个可能的实现方式中，若所述第二终端设备的操作系统为安卓(Android)操作系统，那么，所述事件模拟接口可以为Instrumentation接口；若所述第二终端设备的操作系统为IOS操作系统，那么，所述事件模拟接口可以为UITouch类接口或UIEvent类接口，本实施例对此不进行特别限定。Optionally, in a possible implementation manner of this embodiment, if the operating system of the second terminal device is an Android operating system, the event simulation interface may be an Instrumentation interface; The operating system of the second terminal device is an IOS operating system. The event simulation interface may be a UITouch class interface or a UIEvent class interface, which is not specifically limited in this embodiment.
可选地，在本实施例的一个可能的实现方式中，在建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接的同时，或者之后，还需要进一步建立第二终端设备上的配合应用与第二终端设备的操作系统的输入模块之间的Socket连接。这样，能够配合应用与输入模块之间，不间断的有状态的通信连接，从而保证了顺序传输消息的可靠性。 Optionally, in a possible implementation manner of this embodiment, when establishing a communication connection between the interconnected application on the first terminal device and the coordinated application on the second terminal device, or afterwards, further establishment is required. A Socket connection between the mating application on the second terminal device and the input module of the operating system of the second terminal device. In this way, an uninterrupted stateful communication connection between the application and the input module can be matched, thereby ensuring the reliability of sequentially transmitting messages.
相应地，在102中，具体可以基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。Correspondingly, in 102, the operation event data may be sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
本实施例中，通过获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，进而通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理，若接收到所述事件分发模块返回的异常指示，使得能够向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理，由于能够直接向与第一终端设备连接的第二终端设备的操作系统的输入模块发送用户通过第一终端设备上的互联应用操作与第一终端设备连接的第二终端设备的操作事件数据，使得用户在互联应用中所触发的操作与其所在终端设备连接的另一个终端设备的操作事件数据，能够传递到另一个终端设备上除了该配合应用之外的其他应用，例如，输入法应用等，从而实现了通过互联应用操作与其所在终端设备连接的另一个终端设备上除了该互联应用所对应的配合应用之外的其他应用。In this embodiment, the operation event data of the second terminal device connected to the first terminal device is operated by the user through the interconnection application on the first terminal device, and then the event is simulated to the second terminal device through the event simulation interface. The event distribution module of the operating system sends the operation event data to cause the event distribution module to perform an input process according to the operation event data, and if the abnormality indication returned by the event distribution module is received, enabling the operation The input module of the system sends the operation event data, so that the input module performs an input process according to the operation event data, because it can directly send to an input module of an operating system of the second terminal device connected to the first terminal device. The operation operation data of the second terminal device connected to the first terminal device is operated by the user on the first terminal device, so that the operation triggered by the user in the interconnection application is an operation event of another terminal device connected to the terminal device Data that can be passed to another terminal device Other than the application with the application, e.g., application input, enabling the other applications on another terminal apparatus via the Internet where the application operating its terminal connected with the application in addition to the corresponding network application.
另外，采用本发明所提供的技术方案，由于利用了操作系统的输入模块对外所开放的特殊接口，直接将操作事件数据发送给操作系统的输入模块进行输入处理，无需互联应用对操作事件数据进行复杂的输入相关处理，能够有效降低互联应用的处理负担。In addition, according to the technical solution provided by the present invention, since the special interface opened by the input module of the operating system is utilized, the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application. Complex input-related processing can effectively reduce the processing load of interconnected applications.
另外，采用本发明所提供的技术方案，由于不同操作系统对与操作事件数据的处理方式不同，因此，由操作系统的输入模块亲自对操作事件数据进行复杂的输入相关处理，无需进行适配处理，能够有效提高输 入处理的可靠性和效率。In addition, according to the technical solution provided by the present invention, since different operating systems deal with the operation event data in different manners, the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the loss The reliability and efficiency of the processing.
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明并不受所描述的动作顺序的限制，因为依据本发明，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本发明所必须的。It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
在所述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。In the embodiment, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.
图2为本发明另一实施例提供的互联应用的操作处理装置的结构示意图，如图2所示。本实施例的互联应用的操作处理装置可以包括获取单元21、正常发送单元22和异常发送单元23。其中，获取单元21，用于获取用户通过第一终端设备操作第二终端设备的操作事件数据；正常发送单元22，用于通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；异常发送单元23，用于若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。FIG. 2 is a schematic structural diagram of an operation processing apparatus of an interconnection application according to another embodiment of the present invention, as shown in FIG. 2 . The operation processing device of the interconnection application of the present embodiment may include an acquisition unit 21, a normal transmission unit 22, and an abnormality transmission unit 23. The obtaining unit 21 is configured to acquire operation event data of the second terminal device operated by the user by using the first terminal device, and the normal sending unit 22 is configured to distribute the event to the operating system of the second terminal device by using the event simulation interface. The module sends the operation event data, so that the event distribution module performs an input process according to the operation event data; the abnormality sending unit 23 is configured to: if receiving the abnormality indication returned by the event distribution module, to the operation The input module of the system transmits the operation event data to cause the input module to perform an input process according to the operation event data.
需要说明的是，本实施例的互联应用的操作处理装置可以为位于第二终端设备的应用即互联应用所对应的配合应用，或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit，SDK)等功能单元，本 实施例对此不进行特别限定。It should be noted that the operation processing device of the interconnection application of the embodiment may be an application corresponding to the application of the second terminal device, that is, the corresponding application, or may be an application located at the second terminal device (ie, the interconnection application) The plug-in in the corresponding application) or the functional unit such as the Software Development Kit (SDK), The embodiment is not particularly limited thereto.
可以理解的是，所述应用可以是安装在第二终端设备上的本地程序(nativeApp)，或者还可以是第二终端设备上的浏览器的一个网页程序(webApp)，本实施例对此不进行特别限定。It can be understood that the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
可选地，在本实施例的一个可能的实现方式中，所述第一终端设备优选为车载终端设备；所述第二终端设备优选为用户终端设备。Optionally, in a possible implementation manner of the embodiment, the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
反过来，所述第一终端设备也可以为用户终端设备；所述第二终端设备也可以为车载终端设备。但是，在实际应用中，用户终端设备上所安装的应用都可以单独执行，无需依赖与其连接的另一个终端设备才能正常使用，或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。Conversely, the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device. However, in practical applications, the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
本发明中，第一终端设备与第二终端设备通过但不限于蓝牙连接、通用串行总线(Universal Serial Bus，USB)连接和无线相容性认证(Wireless Fidelity，WI-FI)连接中的至少一项进行连接，本实施例对此不进行特别限定。In the present invention, the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection. One of the connections is not specifically limited in this embodiment.
在完成第一终端设备与第二终端设备之间的设备连接建立之后，基于所建立的设备连接，还需要进一步建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接。可以理解的是，所述通信连接可以包括但不限于蓝牙连接、USB连接和WI-FI连接中的至少一项，本实施例对此不进行特别限定。After the device connection between the first terminal device and the second terminal device is established, based on the established device connection, it is further required to further establish a connection between the interconnected application on the first terminal device and the coordinated application on the second terminal device. Communication connection. It is to be understood that the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
可选地，在本实施例的一个可能的实现方式中，所述获取单元21，具体可以用于基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。 Optionally, in a possible implementation manner of the embodiment, the acquiring unit 21 may be specifically configured to acquire, by using the communication connection with the interconnected application, the user by using the first terminal device. The interconnection application operates the operation event data of the second terminal device.
本发明中，所谓的用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，是指用户在第一终端设备上的互联应用中所进行的操作行为，例如，单击、双击、拖动等操作，映射到第二终端设备的显示装置上的操作事件的相关数据，可以包括但不限于操作事件和所述操作事件的坐标数据。In the present invention, the so-called operation event data of the second terminal device connected to the first terminal device by the user on the first terminal device is performed by the user in the interconnection application on the first terminal device. The operational behavior, for example, clicking, double-clicking, dragging, etc., mapping data to the operational events on the display device of the second terminal device may include, but is not limited to, operational events and coordinate data of the operational events.
可以理解的是，具体可以根据第一终端设备的显示装置的显示尺寸与第二终端设备的显示装置的显示尺寸的比值，将用户在第一终端设备上的互联应用中所进行的操作行为的坐标数据，映射到第二终端设备的显示装置上的操作事件的坐标数据。It can be understood that, according to the ratio of the display size of the display device of the first terminal device to the display size of the display device of the second terminal device, the operation behavior of the user in the interconnected application on the first terminal device may be specifically The coordinate data is mapped to coordinate data of an operation event on the display device of the second terminal device.
通常，目前的终端设备都是触控类型的终端设备，其显示装置除了具有显示功能之外，还具有触控输入功能。在终端设备的显示装置上的任何一个操作行为，都需要被分解为若干个操作事件的集合，操作系统才能够对这些操作事件的相关数据进行相应处理。具体地，所述操作事件包括下列事件中的至少一项：Generally, the current terminal devices are all touch-type terminal devices, and the display device has a touch input function in addition to the display function. Any operational behavior on the display device of the terminal device needs to be decomposed into a set of several operational events, and the operating system can process the relevant data of these operational events accordingly. Specifically, the operation event includes at least one of the following events:
Down事件；Down event;
Up事件；以及Up event; and
Move事件。Move event.
所谓的Down事件，在一次操作行为中仅会触发一次，是在手指刚接触终端设备的显示装置时触发。The so-called Down event is triggered only once in one operation, and is triggered when the finger just touches the display device of the terminal device.
所谓的Up事件，在一次操作行为中仅会触发一次，是在手指离开终端设备的显示装置时触发。The so-called Up event is triggered only once in one operation, and is triggered when the finger leaves the display device of the terminal device.
所谓的Move事件，在一次操作行为的过程中会触发0个、1个或者多个Move事件，如果手指一直在终端设备的显示装置上移动，就会 一直触发Move事件，而且都是在Down事件之后与Up事件之前。The so-called Move event will trigger 0, 1 or more Move events in the course of an operation. If the finger has been moving on the display device of the terminal device, it will The Move event is fired all the time, and is after the Down event and before the Up event.
可选地，在本实施例的一个可能的实现方式中，若所述第二终端设备的操作系统为安卓(Android)操作系统，那么，所述事件模拟接口可以为Instrumentation接口；若所述第二终端设备的操作系统为IOS操作系统，那么，所述事件模拟接口可以为UITouch类接口或UIEvent类接口，本实施例对此不进行特别限定。Optionally, in a possible implementation manner of this embodiment, if the operating system of the second terminal device is an Android operating system, the event simulation interface may be an Instrumentation interface; The operating system of the second terminal device is an IOS operating system. The event simulation interface may be a UITouch class interface or a UIEvent class interface, which is not specifically limited in this embodiment.
可选地，在本实施例的一个可能的实现方式中，在建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接的同时，或者之后，还需要进一步建立第二终端设备上的配合应用与第二终端设备的操作系统的输入模块之间的Socket连接。这样，能够配合应用与输入模块之间，不间断的有状态的通信连接，从而保证了顺序传输消息的可靠性。Optionally, in a possible implementation manner of this embodiment, when establishing a communication connection between the interconnected application on the first terminal device and the coordinated application on the second terminal device, or afterwards, further establishment is required. A Socket connection between the mating application on the second terminal device and the input module of the operating system of the second terminal device. In this way, an uninterrupted stateful communication connection between the application and the input module can be matched, thereby ensuring the reliability of sequentially transmitting messages.
相应地，所述异常发送单元23，具体可以用于基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。Correspondingly, the abnormal sending unit 23 may be specifically configured to send the operation event data to an input module of the operating system based on a Socket connection with an input module of the operating system.
需要说明的是，图1对应的实施例中方法，可以由本实施例提供的互联应用的操作处理装置实现。详细描述可以参见图1对应的实施例中的相关内容，此处不再赘述。It should be noted that the method in the embodiment corresponding to FIG. 1 can be implemented by the operation processing device of the interconnection application provided by this embodiment. For details, refer to related content in the embodiment corresponding to FIG. 1, and details are not described herein again.
本实施例中，通过获取单元获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，进而由正常发送单元通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理，若接收到所述事件分发模块返回的异 常指示，使得异常发送单元能够向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理，由于能够直接向与第一终端设备连接的第二终端设备的操作系统的输入模块发送用户通过第一终端设备上的互联应用操作与第一终端设备连接的第二终端设备的操作事件数据，使得用户在互联应用中所触发的操作与其所在终端设备连接的另一个终端设备的操作事件数据，能够传递到另一个终端设备上除了该配合应用之外的其他应用，例如，输入法应用等，从而实现了通过互联应用操作与其所在终端设备连接的另一个终端设备上除了该互联应用所对应的配合应用之外的其他应用。In this embodiment, the operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application operation on the first terminal device is obtained by the acquiring unit, and then the normal sending unit passes the event simulation interface to the office. The event distribution module of the operating system of the second terminal device sends the operation event data, so that the event distribution module performs input processing according to the operation event data, and receives the difference returned by the event distribution module. Often indicating that the abnormal sending unit can send the operation event data to an input module of the operating system, so that the input module performs an input process according to the operation event data, since the device can be directly connected to the first terminal device The input module of the operating system of the second terminal device sends the operation event data of the second terminal device that the user connects with the first terminal device through the interconnection application on the first terminal device, so that the operation triggered by the user in the connected application is The operation event data of another terminal device connected to the terminal device can be transmitted to another terminal device other than the cooperation application, for example, an input method application, etc., thereby realizing operation through the interconnection application and the terminal device thereof The other terminal device connected to the application other than the matching application corresponding to the interconnection application.
另外，采用本发明所提供的技术方案，由于利用了操作系统的输入模块对外所开放的特殊接口，直接将操作事件数据发送给操作系统的输入模块进行输入处理，无需互联应用对操作事件数据进行复杂的输入相关处理，能够有效降低互联应用的处理负担。In addition, according to the technical solution provided by the present invention, since the special interface opened by the input module of the operating system is utilized, the operation event data is directly sent to the input module of the operating system for input processing, and the operation event data is not required for the interconnection application. Complex input-related processing can effectively reduce the processing load of interconnected applications.
另外，采用本发明所提供的技术方案，由于不同操作系统对与操作事件数据的处理方式不同，因此，由操作系统的输入模块亲自对操作事件数据进行复杂的输入相关处理，无需进行适配处理，能够有效提高输入处理的可靠性和效率。In addition, according to the technical solution provided by the present invention, since different operating systems deal with the operation event data in different manners, the input module of the operating system personally performs complex input-related processing on the operation event data without performing adaptation processing. Can effectively improve the reliability and efficiency of input processing.
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，所述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the described system, the device and the unit can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本发明所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分， 实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative, for example, the division of the elements is merely a logical functional division, There may be additional divisions in actual implementation, for example multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。所述集成的单元既可以采用硬件的形式实现，也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
所述以软件功能单元的形式实现的集成的单元，可以存储在一个计算机可读取存储介质中。所述软件功能单元存储在一个存储介质中，包括若干指令用以使得一台计算机装置(可以是个人计算机，音频处理引擎，或者网络装置等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an audio processing engine, or a network device, etc.) or a processor to perform various embodiments of the present invention. Part of the steps of the method. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案 进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments Modifications are made, or equivalents are substituted for some of the technical features; and such modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (18)

  1. 一种互联应用的操作处理方法，其特征在于，包括：An operation processing method for an interconnection application, comprising:
    获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
    通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
    若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
  2. 根据权利要求1所述的方法，其特征在于，所述事件模拟接口包括Instrumentation接口或UITouch类接口或UIEvent类接口。The method of claim 1, wherein the event simulation interface comprises an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
  3. 根据权利要求1或2所述的方法，其特征在于，所述获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据，包括：The method according to claim 1 or 2, wherein the obtaining, by the user, the operation event data of the second terminal device connected to the first terminal device by using the interconnection application on the first terminal device comprises:
    基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。Acquiring operation event data of the second terminal device by the user through an interconnection application on the first terminal device based on a communication connection with the interconnection application.
  4. 根据权利要求3所述的方法，其特征在于，所述通信连接包括蓝牙连接、USB连接和WI-FI连接中的至少一项。The method of claim 3 wherein said communication connection comprises at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
  5. 根据权利要求1～4任一权利要求所述的方法，其特征在于，所述操作事件数据包括操作事件和所述操作事件的坐标数据。The method according to any one of claims 1 to 4, wherein the operational event data comprises an operational event and coordinate data of the operational event.
  6. 根据权利要求5所述的方法，其特征在于，所述操作事件包括下列事件中的至少一项： The method of claim 5 wherein the operational event comprises at least one of the following events:
    Down事件；Down event;
    Up事件；以及Up event; and
    Move事件。Move event.
  7. 根据权利要求1～6任一权利要求所述的方法，其特征在于，所述向所述操作系统的输入模块发送所述操作事件数据，包括：The method according to any one of claims 1 to 6, wherein the sending the operation event data to an input module of the operating system comprises:
    基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。The operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
  8. 根据权利要求1～7任一权利要求所述的方法，其特征在于，A method according to any of claims 1-7, characterized in that
    所述第一终端设备为车载终端设备；The first terminal device is an in-vehicle terminal device;
    所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
  9. 一种互联应用的操作处理装置，其特征在于，包括：An operation processing device for an interconnection application, comprising:
    获取单元，用于获取用户通过第一终端设备操作第二终端设备的操作事件数据；An acquiring unit, configured to acquire operation event data of a user operating the second terminal device by using the first terminal device;
    正常发送单元，用于通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；a normal sending unit, configured to send, by using an event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
    异常发送单元，用于若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。An abnormal sending unit, configured to send the operation event data to an input module of the operating system, if the abnormality indication returned by the event distribution module is received, so that the input module performs input processing according to the operation event data .
  10. 根据权利要求9所述的装置，其特征在于，所述事件模拟接口包括Instrumentation接口或UITouch类接口或UIEvent类接口。The apparatus according to claim 9, wherein the event simulation interface comprises an Instrumentation interface or a UITouch class interface or a UIEvent class interface.
  11. 根据权利要求9或10所述的装置，其特征在于，所述获取单元，具体用于 The device according to claim 9 or 10, wherein the obtaining unit is specifically configured to
    基于与所述互联应用之间的通信连接，获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的操作事件数据。Acquiring operation event data of the second terminal device by the user through an interconnection application on the first terminal device based on a communication connection with the interconnection application.
  12. 根据权利要求11所述的装置，其特征在于，所述通信连接包括蓝牙连接、USB连接和WI-FI连接中的至少一项。The apparatus of claim 11, wherein the communication connection comprises at least one of a Bluetooth connection, a USB connection, and a WI-FI connection.
  13. 根据权利要求9～12任一权利要求所述的装置，其特征在于，所述操作事件数据包括操作事件和所述操作事件的坐标数据。The apparatus according to any one of claims 9 to 12, wherein the operational event data comprises an operational event and coordinate data of the operational event.
  14. 根据权利要求13所述的装置，其特征在于，所述操作事件包括下列事件中的至少一项：The apparatus of claim 13 wherein said operational event comprises at least one of the following events:
    Down事件；Down event;
    Up事件；以及Up event; and
    Move事件。Move event.
  15. 根据权利要求9～14任一权利要求所述的装置，其特征在于，所述异常发送单元，具体用于The device according to any one of claims 9 to 14, wherein the abnormal sending unit is specifically configured to:
    基于与所述操作系统的输入模块之间的Socket连接，向所述操作系统的输入模块发送所述操作事件数据。The operational event data is sent to an input module of the operating system based on a Socket connection with an input module of the operating system.
  16. 根据权利要求9～15任一权利要求所述的装置，其特征在于，A device according to any of claims 9-15, wherein
    所述第一终端设备为车载终端设备；The first terminal device is an in-vehicle terminal device;
    所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
  17. 一种设备，包括：A device that includes:
    一个或者多个处理器；One or more processors;
    存储器；Memory
    一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时： One or more programs, the one or more programs being stored in the memory, when executed by the one or more processors:
    获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
    通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
    若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
  18. 一种非易失性计算机存储介质，所述非易失性计算机存储介质存储有一个或者多个程序，当所述一个或者多个程序被一个设备执行时，使得所述设备：A non-volatile computer storage medium storing one or more programs, when the one or more programs are executed by a device, causing the device to:
    获取用户通过第一终端设备上的互联应用操作与所述第一终端设备连接的第二终端设备的操作事件数据；Acquiring operation event data of the second terminal device connected to the first terminal device by the user through the interconnection application on the first terminal device;
    通过事件模拟接口，向所述第二终端设备的操作系统的事件分发模块发送所述操作事件数据，以使得所述事件分发模块根据所述操作事件数据，执行输入处理；Transmitting, by the event simulation interface, the operation event data to an event distribution module of an operating system of the second terminal device, so that the event distribution module performs an input process according to the operation event data;
    若接收到所述事件分发模块返回的异常指示，向所述操作系统的输入模块发送所述操作事件数据，以使得所述输入模块根据所述操作事件数据，执行输入处理。 And if the abnormality indication returned by the event distribution module is received, the operation event data is sent to an input module of the operating system, so that the input module performs an input process according to the operation event data.
PCT/CN2016/088138 2015-12-25 2016-07-01 Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium WO2017107429A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510994264.8 2015-12-25
CN201510994264.8A CN105607913B (en) 2015-12-25 2015-12-25 The operation processing method and device of interconnecting application

Publications (1)

Publication Number Publication Date
WO2017107429A1 true WO2017107429A1 (en) 2017-06-29

Family

ID=55987867

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088138 WO2017107429A1 (en) 2015-12-25 2016-07-01 Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium

Country Status (2)

Country Link
CN (1) CN105607913B (en)
WO (1) WO2017107429A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105607913B (en) * 2015-12-25 2019-05-28 百度在线网络技术（北京）有限公司 The operation processing method and device of interconnecting application
CN106844237B (en) * 2016-12-14 2019-12-24 百度在线网络技术（北京）有限公司 Input processing method and device for interconnection application
CN106815084B (en) * 2016-12-30 2023-06-23 百度在线网络技术（北京）有限公司 Operation processing method and device for interconnection application

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130249677A1 (en) * 2008-11-17 2013-09-26 Universal Electronics Inc. System and method for rapid configuration of a universal controlling device
CN103513950A (en) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 Multi-screen adapter, multi-screen display system and input method of multi-screen adapter
CN103677377A (en) * 2012-09-26 2014-03-26 北京鼎元丰和科技有限公司 System and device for achieving terminal display
CN103841140A (en) * 2012-11-22 2014-06-04 北京百度网讯科技有限公司 Inter-terminal information mutual-transmission method, system and device
CN104881120A (en) * 2015-05-27 2015-09-02 小米科技有限责任公司 Method and device for connecting external device
CN105607913A (en) * 2015-12-25 2016-05-25 百度在线网络技术（北京）有限公司 Operation processing method and device for interconnecting application

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102571731B (en) * 2010-12-31 2014-10-22 德讯科技股份有限公司 Object-oriented AJAX framework model system and processing method thereof
CN103516418B (en) * 2012-06-29 2016-06-08 深圳市快播科技有限公司 A kind of multimedia interaction communication system, method and the equipment of reception
CN104796773B (en) * 2015-03-20 2017-11-10 四川长虹电器股份有限公司 The transmission of more equipment incoming events and processing method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130249677A1 (en) * 2008-11-17 2013-09-26 Universal Electronics Inc. System and method for rapid configuration of a universal controlling device
CN103513950A (en) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 Multi-screen adapter, multi-screen display system and input method of multi-screen adapter
CN103677377A (en) * 2012-09-26 2014-03-26 北京鼎元丰和科技有限公司 System and device for achieving terminal display
CN103841140A (en) * 2012-11-22 2014-06-04 北京百度网讯科技有限公司 Inter-terminal information mutual-transmission method, system and device
CN104881120A (en) * 2015-05-27 2015-09-02 小米科技有限责任公司 Method and device for connecting external device
CN105607913A (en) * 2015-12-25 2016-05-25 百度在线网络技术（北京）有限公司 Operation processing method and device for interconnecting application

Also Published As

Publication number Publication date
CN105607913B (en) 2019-05-28
CN105607913A (en) 2016-05-25

Similar Documents

Publication Publication Date Title
US20210352059A1 (en) Message Display Method, Apparatus, and Device
CN102999385B (en) Multiprocessor cooperative processing method in computing equipment
CN109496419A (en) Document handling method, device and system
WO2017107429A1 (en) Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium
US20180129519A1 (en) Method and system for emulating application running in secondary device on primary device
CN113505520A (en) Method, device and system for supporting heterogeneous federated learning
CN106909327A (en) A kind of display control unit for industrial control equipment
CN107959932B (en) Method and device for processing wireless access point information and computer readable storage medium
CN102983889A (en) Method of information cooperative processing between smart mobile phone and computer through Bluetooth wireless pairing
WO2015184754A1 (en) Mobile terminal and method for exchanging calling cards between mobile terminals
US20170168796A1 (en) Method and electronic apparatus for transferring application program from pc to mobile apparatus
CN109271266A (en) Document transmission method, device and terminal device
JP2014194778A (en) Computer input system and method therefor
CN106815084B (en) Operation processing method and device for interconnection application
CN109963233B (en) Method and device for updating robot wake-up word and terminal equipment
CN111782445A (en) Configuration method and device of equipment debugging environment
CN110727654B (en) Data extraction method and device for distributed system, server and storage medium
CN109561146A (en) Document down loading method, device, terminal device
CN105898022B (en) Terminal application adaptation reminding method and terminal
CN104317606A (en) Remote operation system
CN116166298B (en) Firmware upgrading method, device, equipment and storage medium
CN109977364B (en) Method and device for obtaining robot wake-up word
CN208227336U (en) A kind of wireless communication system
CN106844237B (en) Input processing method and device for interconnection application
CN102387118A (en) Data output method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16877242

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16877242

Country of ref document: EP

Kind code of ref document: A1