WO2023011418A1 - 一种跨设备输入方法、设备及系统 - Google Patents

一种跨设备输入方法、设备及系统 Download PDF

Info

Publication number
WO2023011418A1
WO2023011418A1 PCT/CN2022/109475 CN2022109475W WO2023011418A1 WO 2023011418 A1 WO2023011418 A1 WO 2023011418A1 CN 2022109475 W CN2022109475 W CN 2022109475W WO 2023011418 A1 WO2023011418 A1 WO 2023011418A1
Authority
WO
WIPO (PCT)
Prior art keywords
target device
input
information
edit
interface
Prior art date
Application number
PCT/CN2022/109475
Other languages
English (en)
French (fr)
Inventor
陈刚
卞超
陈才龙
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023011418A1 publication Critical patent/WO2023011418A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/133—Protocols for remote procedure calls [RPC]

Definitions

  • the embodiments of the present application relate to the field of electronic technology, and in particular, to a cross-device input method, device, and system.
  • More and more electronic devices can be connected to the network, accept user input for searching or typing.
  • a television may be connected to a home network, receive a program name input by a user in a search box, search for a program corresponding to the program name through the home network, and play it.
  • the title of the program received by the TV is input by the user in the search box through the remote control.
  • the TV set 01 can receive the direction keys (A, B, C or D shown in FIG. Move on E) as shown in Figure 1, and thus enter the program name in the search box F.
  • the TV set 01 may receive the program name input by the user in the search box F through the input keyboard (G shown in FIG. 1 ) of the remote controller 02 .
  • the above-mentioned method of inputting the program name in the search box through the remote controller is cumbersome and inconvenient to use.
  • the present application provides a cross-device input method, device and system, which can realize arbitrary switching of a focus frame based on a single device during cross-device input, and the operation is simple.
  • a cross-device input method comprising: in response to receiving a user's operation for enabling a remote input function, the first device determines a target device according to interface information of one or more second devices; the first The device establishes a wireless connection with the target device for transmitting information input by the user sent by the first device to the target device; the first device displays a remote input interface, the remote input interface includes an input box and at least one option, and the at least one option is used for Adjust the focus frame on the target device.
  • the target device is one of the above-mentioned one or more second devices, and the interface of the target device includes one or more edit boxes.
  • the solution provided by the above first aspect can initiate a remote input to a target device (such as a large-screen device) based on a single device (such as the first device), without causing interference to other devices with strong input capabilities. Furthermore, for the case where the display interface of the target device includes multiple edit boxes, this method can realize arbitrary switching of the focus frame through a single device, and the operation is simple and the user experience is good.
  • the determining the target device by the first device according to interface information of one or more second devices includes: displaying device information by the first device according to interface information of multiple second devices. Wherein, among the plurality of second devices, multiple devices have edit boxes on their interfaces, and the device information includes identification information of one or more second devices whose interfaces have edit boxes.
  • the first device determines the target device according to the user's selection operation on the identification information in the device information.
  • the first device may present identification information of multiple second devices to the user, so that the user can select a target device.
  • the first device determines that the device with the edit box on its interface is the target device.
  • the first device may automatically determine the target device according to the presence of edit boxes on the interfaces of one or more second devices. For example, when only one second device has an edit box, it is directly determined that this device is the target device.
  • the above method further includes: the first device receives the information input by the user in the input box; the first device sends the information input by the user to the target device, and the user enters the information in the input box
  • the information entered in is used to populate the default focus box to the target device.
  • the first device may directly input corresponding information into the default focus frame of the target device according to the information input by the user in the input box for cross-device input.
  • the above method further includes: the first device responds to receiving the user's operation of selecting any one of the above options; the first device determines the switched focus frame; the first device sends the target device Focus frame switching information.
  • the focus frame switching information includes the identification information of the switched focus frame.
  • the first device switches the focus frame correspondingly according to the user's operation of switching the focus frame of the target device.
  • the above-mentioned first device determining the switched focus frame includes: determining, by the first device, the switched focus frame according to edit frame information; and the edit frame information includes priorities of multiple edit frames.
  • focus frame switching may be performed based on the priority of the edit frame.
  • the interface of the target device includes multiple edit boxes; the above method further includes: the first device receives position information of the multiple edit boxes from the target device; Position information determines the priority of multiple edit boxes.
  • the focus frame switching may be performed based on the position information of the edit frame. This solution conforms to the user's usage habits, for example, conforms to the user's habit of cross-device input to the edit box in the order from top to bottom and from left to right, thereby improving user experience.
  • the foregoing method further includes: the first device receives edit box information from the target device.
  • the first device may acquire edit frame information such as priority of the edit frame or position information of the edit frame from the target device, so as to improve the accuracy of the information based on which the focus frame is switched.
  • the at least one option includes at least one of an option for switching a next edit box or an option for switching a previous edit box.
  • the first device may provide an option for switching to the next and/or previous focus frame, so that the user can switch the focus frame as needed, so as to improve user experience.
  • the above at least one option includes an option for switching across edit boxes.
  • the first device may provide an option for switching between editing frames, so that the user can switch between focus frames as needed, so as to improve user experience.
  • the foregoing wireless connection is a point-to-point (peer to peer, P2P) connection.
  • P2P point-to-point
  • the method provided by the present application is applicable to the P2P network architecture, which can improve the applicability and compatibility of the method to different network architectures.
  • the foregoing wireless connection is based on a remote procedure call (remote procedure call, RPC) protocol.
  • RPC remote procedure call
  • the method provided by the present application is applicable to the wireless connection based on the RPC protocol, which can improve the applicability and compatibility of the method to different communication protocols.
  • a cross-device input method is provided, the method is applied to a target device, and the method includes: after the target device establishes a wireless connection with the first device, determining a default focus frame.
  • the foregoing wireless connection is used for the first device to send the information input by the user to the target device.
  • the target device receives the information sent by the first device through the wireless connection, and fills the information into the default focus frame.
  • the target device is one of one or more second devices.
  • the target device (such as a large-screen device) can establish a wireless connection with the first device for cross-device input, and the target device receives the remote input of the first device through the established wireless connection.
  • the establishment process of the wireless connection will not cause interference to other devices with strong input capabilities, the operation is simple, and the user experience is good.
  • the above method further includes: the target device receives focus frame switching information from the first device, the focus frame switching information includes the identification information of the focus frame; the target device switches the focus frame to the edited frame corresponding to the identification information frame.
  • the target device receives focus frame switching information from the first device, the focus frame switching information includes the identification information of the focus frame; the target device switches the focus frame to the edited frame corresponding to the identification information frame.
  • the above-mentioned default focus frame is the first edit frame on the interface of the target device; or, the default focus frame is the edit frame with the highest priority on the interface of the target device.
  • the default focus frame may be determined based on the priority of the edit frame.
  • the cross-device input of the edit box with a high degree of importance can be prioritized to improve user experience.
  • the default focus frame may be determined based on the position information of the edit frame. This solution conforms to the user's usage habits, for example, conforms to the user's habit of cross-device input to the edit box in the order from top to bottom and from left to right, thereby improving user experience.
  • the interface of the target device includes multiple edit boxes; the method further includes: the target device sends the position information of the multiple edit boxes to the first device; or, the target device sends the first device Sends the priority of the above multiple edit boxes.
  • the first device may acquire edit frame information such as priority of the edit frame or position information of the edit frame from the target device, so as to improve the accuracy of the information based on which the focus frame is switched.
  • the foregoing wireless connection is a P2P connection.
  • the method provided by the present application is applicable to the P2P network architecture, which can improve the applicability and compatibility of the method to different network architectures.
  • the foregoing wireless connection is based on the RPC protocol.
  • the method provided by the present application is applicable to the wireless connection based on the RPC protocol, which can improve the applicability and compatibility of the method to different communication protocols.
  • a first device in a third aspect, includes: a processing unit configured to: determine a target according to interface information of one or more second devices in response to receiving a user's operation for enabling a remote input function device; establishing a wireless connection with the target device for transmitting user-input information sent by the first device to the target device; a display unit configured to: display a remote input interface, the remote input interface includes an input box and at least one option, the at least An option to adjust the focus frame on said target device.
  • the target device is one of the above-mentioned one or more second devices, and the interface of the target device includes one or more edit boxes.
  • the solution provided by the above third aspect can initiate remote input to a target device (such as a large-screen device) based on a single device (such as the first device), without causing interference to other devices with strong input capabilities. Furthermore, for the case where the display interface of the target device includes multiple edit boxes, this method can realize arbitrary switching of the focus frame through a single device, and the operation is simple and the user experience is good.
  • the processing unit is specifically configured to: display device information according to interface information of multiple second devices; and determine a target device according to a user's selection operation on the identification information in the device information.
  • the processing unit is specifically configured to: display device information according to interface information of multiple second devices; and determine a target device according to a user's selection operation on the identification information in the device information.
  • multiple devices have edit boxes on their interfaces, and the device information includes identification information of one or more second devices whose interfaces have edit boxes.
  • the first device may present identification information of multiple second devices to the user, so that the user can select a target device.
  • the processing unit determines that the device with the edit box on its interface is the target device.
  • the first device may automatically determine the target device according to the presence of edit boxes on the interfaces of one or more second devices. For example, when only one second device has an edit box, it is directly determined that this device is the target device.
  • the processing unit is further configured to: receive information input by the user in the input box; send the information input by the user to the target device, and the information input by the user in the input box Used to populate the default focus box into the target device.
  • the first device may directly input corresponding information into the default focus frame of the target device according to the information input by the user in the input box for cross-device input.
  • the processing unit is further configured to: respond to receiving an operation of selecting any one of the at least one option by the user; determine a switched focus frame; and send focus frame switching information to the target device.
  • the focus frame switching information includes the identification information of the switched focus frame.
  • the first device switches the focus frame correspondingly according to the user's operation of switching the focus frame of the target device.
  • the above processing unit is specifically configured to: determine a switched focus frame according to edit frame information; the edit frame information includes priorities of multiple edit frames.
  • focus frame switching may be performed based on the priority of the edit frame.
  • the interface of the target device includes multiple edit boxes; the processing unit is further configured to: receive position information of the multiple edit boxes from the target device; determine multiple edit boxes according to the position information of the multiple edit boxes The priority of each edit box.
  • the focus frame switching may be performed based on the position information of the edit frame.
  • the foregoing first device further includes: a transceiver unit, configured to receive edit box information from the target device.
  • the first device may acquire edit frame information such as priority of the edit frame or position information of the edit frame from the target device, so as to improve the accuracy of the information based on which the focus frame is switched.
  • the at least one option includes at least one of an option for switching a next edit box or an option for switching a previous edit box.
  • the first device may provide an option for switching to the next and/or previous focus frame, so that the user can switch the focus frame as needed, so as to improve user experience.
  • the above at least one option includes an option for switching across edit boxes.
  • the first device may provide an option for switching between editing frames, so that the user can switch between focus frames as needed, so as to improve user experience.
  • the foregoing wireless connection is a P2P connection.
  • the method provided by the present application is applicable to the P2P network architecture, which can improve the applicability and compatibility of the method to different network architectures.
  • the foregoing wireless connection is based on the RPC protocol.
  • the method provided by the present application is applicable to the wireless connection based on the RPC protocol, which can improve the applicability and compatibility of the method to different communication protocols.
  • a target device in a fourth aspect, includes: a processing unit configured to establish a wireless connection with a first device; and determine a default focus frame.
  • the foregoing wireless connection is used for the first device to send the information input by the user to the target device.
  • the transceiver unit is configured to receive the information sent by the first device through the wireless connection, and fill the information into the default focus frame.
  • the target device is one of one or more second devices.
  • the target device (such as a large-screen device) can establish a wireless connection with the first device for cross-device input, and receive the remote input of the first device through the established wireless connection.
  • the establishment process of the wireless connection will not cause interference to other devices with strong input capabilities, the operation is simple, and the user experience is good.
  • the transceiving unit is further configured to: receive focus frame switching information from the first device, where the focus frame switching information includes identification information of the focus frame; the processing unit is further configured to: switch the focus frame to The edit box corresponding to the identification information.
  • the display interface of the target device includes multiple edit boxes, any switch of the focus frame can be realized through a single device, which is easy to operate and provides good user experience.
  • the above-mentioned default focus frame is the first edit frame on the interface of the target device; or, the default focus frame is the edit frame with the highest priority on the interface of the target device.
  • the default focus frame may be determined based on the priority of the edit frame.
  • the cross-device input of the edit box with a high degree of importance can be prioritized to improve user experience.
  • the default focus frame may be determined based on the position information of the edit frame. This solution conforms to the user's usage habits, for example, conforms to the user's habit of cross-device input to the edit box in the order from top to bottom and from left to right, thereby improving user experience.
  • the interface of the target device includes multiple edit boxes; the transceiver unit is further configured to: send the position information of the multiple edit boxes to the first device; or send the above-mentioned edit boxes to the first device.
  • the first device may acquire edit frame information such as priority of the edit frame or position information of the edit frame from the target device, so as to improve the accuracy of the information based on which the focus frame is switched.
  • the foregoing wireless connection is a P2P connection.
  • the method provided by the present application is applicable to the P2P network architecture, which can improve the applicability and compatibility of the method to different network architectures.
  • the foregoing wireless connection is based on the RPC protocol.
  • the method provided by the present application is applicable to the wireless connection based on the RPC protocol, which can improve the applicability and compatibility of the method to different communication protocols.
  • a first device in a fifth aspect, includes: a display screen; one or more processors; one or more memories; one or more programs are stored in the memories, and the one or more The program includes instructions, which, when executed by the one or more processors, cause the first device to execute the method according to any one of the first aspect and the first aspect.
  • a target device in a sixth aspect, includes: a display screen; one or more processors; one or more memories; the memory stores one or more programs, and the one or more programs include An instruction, when the instruction is executed by the one or more processors, causes the target device to execute the method according to any one of the second aspect and the second aspect. It should be understood that: the target device is one of one or more second devices.
  • a cross-device input method comprising: in response to receiving a user's operation for enabling a remote input function, the first device determines a target device according to interface information of one or more second devices, and the target device The device is one of the above-mentioned one or more second devices, and the interface of the target device includes one or more edit boxes; the first device establishes a wireless connection with the target device, and the wireless connection is used to transmit the first device to the target device information input by the user; the target device determines a default focus frame; the first device displays a remote input interface, the remote input interface includes an input box and at least one option, and the at least one option is used to adjust the focus frame on the target device. It should be understood that: the target device is one of one or more second devices.
  • the solution provided by the seventh aspect above can initiate a remote input to a target device (such as a large-screen device) based on a single device (such as the first device), without causing interference to other devices with strong input capabilities. Furthermore, for the case where the display interface of the target device includes multiple edit boxes, this method can realize arbitrary switching of the focus frame through a single device, and the operation is simple and the user experience is good.
  • the above method further includes: the first device receives the information input by the user in the input box; the first device sends the information input by the user in the input box to the target device, and the user enters the information in the input box
  • the entered information is used to populate the default focus frame of the target device; the target device populates the default focus frame with the above information.
  • the first device may directly input corresponding information into the default focus frame of the target device according to the information input by the user in the input box for cross-device input. Through this solution, the user experience during cross-device input can be improved.
  • the above method further includes: the first device responds to receiving the user's operation of selecting any one of the above options; the first device determines the switched focus frame; the first device sends the target device Focus frame switching information, where the focus frame switching information includes identification information of the switched focus frame; the target device switches the focus frame to an edit frame corresponding to the identification information.
  • the first device switches the focus frame correspondingly according to the user's operation of switching the focus frame of the target device.
  • the interface of the target device includes multiple edit boxes; the above method further includes: the target device sends the position information of the multiple edit boxes to the first device; or, the target device sends the first device The priority of multiple edit boxes.
  • the first device may acquire edit frame information such as priority of the edit frame or position information of the edit frame from the target device, so as to improve the accuracy of the information based on which the focus frame is switched.
  • a communication system in an eighth aspect, includes: the first device in any possible implementation manner of the third aspect or the fifth aspect, and any possible implementation manner of the fourth aspect or the sixth aspect
  • the target device in the implementation. It should be understood that: the target device is one of one or more second devices.
  • a computer-readable storage medium is provided.
  • Computer program code is stored on the computer-readable storage medium.
  • the processor implements any one of the first aspect or the second aspect. method in one possible implementation.
  • a chip system the chip system includes a processor, a memory, and computer program code is stored in the memory; when the computer program code is executed by the processor, the processor implements the first aspect or the first aspect.
  • the system-on-a-chip may consist of chips, or may include chips and other discrete devices.
  • a computer program product comprising computer instructions.
  • the computer instructions When the computer instructions are run on the computer, the computer is made to implement the method in any possible implementation manner of the first aspect or the second aspect.
  • FIG. 1 is an example diagram of a cross-device input method
  • FIG. 2 is a schematic diagram of a hardware structure of a large-screen device provided in an embodiment of the present application
  • FIG. 3 is a schematic diagram of a hardware structure of a mobile phone provided by an embodiment of the present application.
  • FIG. 4 is an example diagram of a cross-device input method provided by an embodiment of the present application.
  • FIG. 5 is an example diagram of a cross-device input scenario provided by an embodiment of the present application.
  • FIG. 6 is a structural block diagram of a mobile phone and a large-screen device provided in an embodiment of the present application
  • FIG. 7 is a flow chart 1 of a cross-device input method provided by an embodiment of the present application.
  • Figure 8 is a cross-device input example Figure 1 provided by the embodiment of the present application.
  • FIG. 9 is a flow chart II of a cross-device input method provided by an embodiment of the present application.
  • FIG. 10 is a third flowchart of a cross-device input method provided by the embodiment of the present application.
  • Figure 11 is a cross-device input example Figure 2 provided by the embodiment of this application.
  • Figure 12 is a cross-device input example Figure 3 provided by the embodiment of this application.
  • FIG. 13 is a structural block diagram of an electronic device provided by an embodiment of the present application.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, “plurality” means two or more.
  • An embodiment of the present application provides a cross-device input method, which is applied to a process of receiving input from a device with a strong input capability such as a mobile phone on a device with a weak input capability such as a large screen device.
  • weak input capability and strong input capability are relative concepts. For example, compared to mobile phones, televisions are devices with weak input capabilities; compared to smart watches, mobile phones are devices with strong input capabilities.
  • a large-screen device is used as a device with a weak input capability
  • a mobile phone is used as a device with a strong input capability as an example to introduce a cross-device input method provided in the embodiment of the present application.
  • the device with weak input capability in this application includes one or more display screens.
  • the device can be a television, a smart camera, a handheld computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an augmented reality (Augmented Reality, AR)/virtual reality ( Virtual Reality (VR) equipment, ultra-mobile personal computer (UMPC), smart bracelet, smart watch, etc.
  • the device may also be an electronic device of another type or structure including one or more display screens, which is not limited in this application.
  • FIG. 2 takes a television as an example to show a schematic diagram of a hardware structure of a large-screen device.
  • the large-screen device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a power management module 240, an antenna, and a wireless communication module 260, an audio module 270, a speaker 270A, a microphone 270C, a speaker interface 270B, a sensor module 280, a button 290, an indicator 291, a camera 293, and a display screen 292, etc.
  • a processor 210 an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a power management module 240, an antenna, and a wireless communication module 260, an audio module 270, a speaker 270A, a microphone 270C, a speaker interface 270B, a sensor module 280, a button 290, an indicator 29
  • the structure shown in this embodiment does not constitute a specific limitation on the large-screen device 200 .
  • the large-screen device 200 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the processor 210 may include an auxiliary module (such as the auxiliary module 2 shown in (b) of FIG. 6 ).
  • This auxiliary module can be used to send interface information to a strong input device (such as a mobile phone), bind with a strong input device (such as a mobile phone), request remote input from a strong input device (such as a mobile phone), and receive a message from a strong input device (such as a mobile phone) Input, and processing focus frame switching information from strong input devices (such as mobile phones).
  • the controller may be the nerve center and command center of the large-screen device 200 .
  • the controller can fetch instructions according to the instructions, generate operation control signals, and then execute the control of the instructions.
  • the controller can generate an operation control signal according to the instructions included in the control information from the strong input device (such as a mobile phone), and then complete the editing in the editing box (such as a search box) on the display screen of the large-screen device. enter.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is a cache memory.
  • the memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.
  • processor 210 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input/output (general-purpose input/output, GPIO) interface, and/or USB interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • USB interface etc.
  • the interface connection relationship between modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the large-screen device 200 .
  • the large-screen device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the power management module 240 is used for connecting power.
  • the charging management module 240 may also be connected with the processor 210, the internal memory 221, the display screen 294, the camera 293, the wireless communication module 260, and the like.
  • the power management module 241 receives power input and supplies power to the processor 210 , the internal memory 221 , the display screen 294 , the camera 293 and the wireless communication module 260 .
  • the power management module 241 can also be disposed in the processor 210 .
  • the wireless communication function of the large-screen device 200 can be realized through the antenna and the wireless communication module 260 .
  • the wireless communication module 260 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), Global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the large-screen device 200 can receive input information from a strong input device (such as a mobile phone) through the antenna and the wireless communication module 260, and then complete the edit box on the display screen of the large-screen device according to the received input information. input of.
  • a strong input device such as a mobile phone
  • the wireless communication module 260 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 260 receives electromagnetic waves through the antenna, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 260 can also receive the signal to be sent from the processor 210, frequency-modulate it, amplify it, and convert it into electromagnetic wave and radiate it through the antenna.
  • the antenna of the large-screen device 200 is coupled to the wireless communication module 260, so that the large-screen device 200 can communicate with the network and other devices through wireless communication technology.
  • the large-screen device 200 realizes the display function through the GPU, the display screen 292, and the application processor.
  • the GPU is a microprocessor for image processing, connected to the display screen 292 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 292 is used to display images, videos, etc., and the display screen 292 includes a display panel.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the large-screen device 200 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video. Large screen device 200 may support one or more video codecs. In this way, the large-screen device 200 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • the external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the large-screen device 400.
  • the external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 221 may be used to store computer-executable program codes including instructions.
  • the processor 210 executes various functional applications and data processing of the large-screen device 200 by executing instructions stored in the internal memory 221 .
  • the processor 210 may execute instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the large-screen device 200 .
  • the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the large-screen device 200 can implement audio functions through an audio module 270 , a speaker 270A, a microphone 270C, a speaker interface 270B, and an application processor. For example, music playback, recording, etc.
  • the structure shown in FIG. 2 does not constitute a specific limitation on the large-screen device. It may have more or fewer components than shown in FIG. 2 , may combine two or more components, or may have a different configuration of components.
  • the large-screen device may also include components such as a speaker and a remote control.
  • the various components shown in Figure 2 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing or application specific integrated circuits.
  • the strong input device in this application may be a smart phone, a netbook, a tablet computer, and the like.
  • the strong input device may also be an electronic device of another type or structure, which is not limited in this application.
  • FIG. 3 shows a schematic diagram of a hardware structure of a strong input device by taking the strong input device as a smart phone (hereinafter referred to as a mobile phone) as an example.
  • mobile phone 300 can comprise processor 310, memory (comprising external memory interface 320 and internal memory 321), universal serial bus (universal serial bus, USB) interface 330, charging management module 340, power management module 341 , battery 342, antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, earphone jack 370D, sensor module 380, button 390, motor 391, indicator 392 , a camera 393, a display screen 394, and a subscriber identification module (subscriber identification module, SIM) card interface 395, etc.
  • SIM subscriber identification module
  • the sensor module 380 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • the structure shown in the embodiment of the present invention does not constitute a specific limitation on the mobile phone.
  • the mobile phone may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • Processor 310 may include one or more processing units.
  • the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a flight controller, Video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
  • application processor application processor
  • AP application processor
  • modem processor graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • flight controller Video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is a cache memory.
  • the memory may hold instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 310 is reduced, thereby improving the efficiency of the system.
  • the processor 310 may include an auxiliary module (such as the auxiliary module 1 shown in (a) of FIG. 6 ).
  • the auxiliary module can be used to obtain interface information from the large-screen device, select the target device, bind with the target device, receive an input request from the target device, control the display screen 394 to display the remote input interface, and The input is input to the target device, and the switch is indicated to the target device according to the user's operation of changing the focus frame on the remote input interface.
  • processor 310 may include one or more interfaces.
  • the interface may include an integrated circuit I2C interface, an integrated circuit built-in audio I2S interface, a pulse code modulation PCM interface, a universal asynchronous transceiver transmitter UART interface, a mobile industry processor interface MIPI, a general-purpose input and output GPIO interface, a subscriber identity module SIM interface, and/or Or Universal Serial Bus USB interface, etc.
  • the wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in a cell phone can be used to cover single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G/6G applied to mobile phones.
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 350 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 350 may be set in the processor 310 .
  • at least part of the functional modules of the mobile communication module 350 and at least part of the modules of the processor 310 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs a sound signal through an audio device (not limited to a speaker 370A, a receiver 370B, etc.), or displays an image or video through a display screen 394 .
  • the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 310, and be set in the same device as the mobile communication module 350 or other functional modules.
  • the wireless communication module 360 can provide wireless communication solutions including WLAN (such as Wi-Fi network), Bluetooth BT, global navigation satellite system GNSS, FM, short-range wireless communication technology NFC, infrared technology IR, etc. applied on mobile phones.
  • the wireless communication module 360 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 360 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310 .
  • the wireless communication module 360 can also receive the signal to be sent from the processor 310 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the mobile phone is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the mobile phone can communicate with the network and other devices through wireless communication technology.
  • the mobile phone realizes the display function through the GPU, the display screen 394, and the application processor.
  • GPU is a microprocessor for image processing, connected to display screen 394 and application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 394 is used to display images, videos and the like.
  • Display 394 includes a display panel.
  • the mobile phone may include 1 or N display screens 394, where N is a positive integer greater than 1.
  • the mobile phone can realize the shooting function through ISP, camera component 393, video codec, GPU, display screen 394 and application processor.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone.
  • the external memory card communicates with the processor 310 through the external memory interface 320 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 321 may be used to store computer-executable program code, which includes instructions.
  • the internal memory 321 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone.
  • the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the processor 310 executes various functional applications and data processing of the mobile phone by executing instructions stored in the internal memory 321 and/or instructions stored in the memory provided in the processor.
  • the mobile phone can realize the audio function through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C and the application processor. Such as music playback, recording, etc.
  • the audio module 370 the speaker 370A, the receiver 370B and the microphone 370C, reference may be made to the introduction in conventional technologies.
  • the buttons 390 include a power button (also called a power button), a volume button, and the like.
  • the key 390 may be a mechanical key. It can also be a touch button.
  • the mobile phone can receive key input and generate key signal input related to user settings and function control of the mobile phone. For example, in the embodiment of the present application, the mobile phone may receive the simultaneous pressing of the power button and the volume button, and instruct the target device to switch the focus frame.
  • a mobile phone may also include other functional modules.
  • the large-screen device and the mobile phone may be connected to the same network, such as a home Wi-Fi network.
  • the large-screen device can receive input information from the mobile phone through Wi-Fi, and then complete the input in the editing box (such as a search box) on the display screen of the large-screen device according to the received input information.
  • the large-screen device 01 may display a search box F as shown in FIG. 4 .
  • the large-screen device 01 may trigger remote input when receiving the user's operation of using the remote control to move the input cursor to the search box F.
  • the large-screen device 01 sends broadcast information to one or more devices with strong input capabilities, for the one or more devices with strong input capabilities to display a remote input confirmation interface, so that the user can select the corresponding remote input device.
  • the device with strong input capability may pop up a remote input confirmation interface for the user to choose whether to use the device with strong input capability for remote input.
  • one or more devices with strong input capabilities that receive broadcast information may include the remote
  • the input wirelessly connected devices and/or the devices that have established a distributed network with the large-screen device 01 are not limited in this application.
  • a device with strong input capabilities detects that the user confirms the operation of using the device for remote input on the device, the mobile phone 04 can call the remote input service to display the input as shown in Figure 4 Interface H.
  • the large-screen device 01 can receive the text "Hello” edited by the user on the input interface H shown in FIG. Hello" and/or programs whose name is related to "Hello".
  • the mobile phone 04 can share input method capabilities with the large-screen device 01 , thereby breaking through hardware limitations.
  • the user when performing cross-device input, the user needs to use a remote controller and a mobile phone to realize remote input on a large-screen device, and many devices are used, and the operation process is complicated.
  • the display interface of a large-screen device includes multiple edit boxes
  • the user when cross-device input is performed based on the method shown in Figure 4, if the edit box needs to be replaced, the user needs to use the remote control to switch the focus frame to re-trigger
  • the one or more input-capable devices display a remote input confirmation interface.
  • the focus frame refers to the currently active edit frame.
  • the user needs to confirm the operation of using the device for remote input again on the remote input confirmation interface of a device with strong input capability (such as a mobile phone), before using the device to input information in the edit box after switching, and the device is frequently replaced , the operation process is cumbersome.
  • the large-screen device 01 when performing cross-device input based on the method shown in FIG. 4 or FIG. 5 , if the large-screen device 01 sends broadcast information to multiple devices with strong input capabilities, it will cause serious interference to other devices. Furthermore, for the case where the remote input confirmation interface is displayed on the pop-up window of the device, the long-term non-retirement of the pop-up window will cause serious interference to the user, especially for the device being used.
  • the embodiment of the present application provides a cross-device input method, which can initiate a remote input to a large-screen device (such as a target device) based on a single device (such as a first device), without affecting other strong inputs Capability equipment causing interference.
  • a large-screen device such as a target device
  • a single device such as a first device
  • the method can realize arbitrary switching of the focus frame through a single device, and the operation is simple.
  • strong input devices such as mobile phones
  • large-screen devices in the cross-device input process of the embodiment of the present application may include auxiliary modules.
  • the mobile phone may include an auxiliary module 1 .
  • the large-screen device may include an auxiliary module 2 .
  • the operating system of the mobile phone and the large-screen device may include an application program layer, an application program framework layer, a system library, an Android runtime and a kernel layer.
  • the above-mentioned auxiliary module 1 may be located in the application framework layer of the operating system of the mobile phone; the auxiliary module 2 may be located in the application framework layer of the operating system of the large-screen device.
  • the application framework layer can provide application programming interface (application programming interface, API) and programming framework for the application program of the application program layer.
  • a cross-device input method provided by an embodiment of the present application will be specifically introduced below with reference to the accompanying drawings, taking a mobile phone as an example of a strong input device.
  • the user can initiate a remote input on the mobile phone , and then initiate a connection between the mobile phone and the large-screen device.
  • the user may first enable the remote input function on the mobile phone, and then establish a wireless connection between the mobile phone and the large-screen device for remote input.
  • the wireless connection is specifically used to transmit information input by the user sent from the mobile phone (ie, the first device) to the large-screen device (ie, the second device).
  • a cross-device input method provided by the embodiment of the present application may include the following steps S701-S706:
  • the mobile phone receives a user's operation for enabling a remote input function.
  • the above-mentioned operation for enabling the remote input function may include, but not limited to: an operation in which the user turns on the remote input switch.
  • remote input APP an application program for remote input
  • the above operation for enabling the remote input function may be an operation for the user to open the remote input APP.
  • the above-mentioned operation for enabling the remote input function may be an operation for the user to turn on the remote input switch.
  • the above operation for enabling the remote input function may be an operation for the user to turn on the remote input switch on the remote input setting interface.
  • the above operation for enabling the remote input function may be an operation of the user turning on the remote input switch in the drop-down menu bar.
  • the mobile phone In response to receiving an operation for enabling the remote input function, acquires interface information of one or more large-screen devices (eg, one or more second devices).
  • one or more large-screen devices eg, one or more second devices.
  • the interface information may include, but not limited to, whether there is an edit box on the interface and/or the number of edit boxes on the interface.
  • the above one or more large-screen devices are large-screen devices in a distributed network.
  • distributed networking refers to a distributed device cluster composed of multiple devices that can communicate peer-to-peer (P2P).
  • the mobile phone in response to receiving the above-mentioned operation for enabling the remote input function, obtains the large-screen device 1, the interface information of large-screen device 2, and the interface information of large-screen device 3.
  • the above-mentioned one or more large-screen devices have established a wireless connection with the mobile phone for remote input within a preset time period (such as within 24 hours, within a week, within a month, or within half a year, etc.) large-screen devices.
  • the mobile phone in response to receiving the above-mentioned operation for enabling the remote input function, acquires large-screen devices that have established a wireless connection with the mobile phone for remote input within one week.
  • the above-mentioned one or more large-screen devices are N large-screen devices that have recently established a wireless connection with the mobile phone for remote input; N is a positive integer.
  • the mobile phone in response to receiving the above-mentioned operation for enabling the remote input function, the mobile phone obtains the interface information of three large-screen devices that have recently established wireless connections with the mobile phone for remote input.
  • the above-mentioned rules for the mobile phone to obtain the interface information of the large-screen device are only examples, and the embodiment of the present application does not limit the specific rules.
  • the rule for the mobile phone to obtain the interface information of the large-screen device can also be a combination of multiple conditions, for example, in response to receiving the above-mentioned operation for enabling the remote input function, the mobile phone obtains the information related to the mobile phone within a preset time period (such as within a week).
  • the mobile phone in response to receiving the above-mentioned operation for enabling the remote input function, obtains the interface information of the top three large-screen devices that have established wireless connections with the mobile phone for remote input within a preset period of time (such as within a week) .
  • the mobile phone can acquire interface information from one or more large-screen devices through the auxiliary module 1 .
  • the mobile phone may obtain interface information from one or more large-screen devices through a module for distributed connection (such as a device discovery module).
  • a module for distributed connection such as a device discovery module. This application does not limit the specific modules of information acquisition.
  • the mobile phone determines the target device.
  • the target device is one of the above-mentioned one or more large-screen devices.
  • the mobile phone can determine the The large screen device is the target device.
  • the mobile phone can also Displaying the identification information of the device to the user is used to notify that the large-screen device is a target device, or to designate the large-screen device as a target device by the user.
  • the mobile phone may receive the user's selection and determine the target device.
  • a mobile phone may display device information to a user, and the device information includes identification information of a large-screen device with an edit box on the interface.
  • the device information is used to show the user the large-screen devices that the mobile phone can input remotely, so that the user can select the target device from them.
  • the mobile phone can determine the target device according to the user's operation of selecting a certain large-screen device (such as the large-screen device 1 shown in FIG. 7 ) in the device information.
  • the mobile phone establishes a wireless connection with the target device for remote input.
  • the mobile phone and the target device can establish a wireless connection for remote input through their respective auxiliary modules.
  • the mobile phone with the structure shown in (a) in Figure 6 and the target device with the structure shown in (b) in Figure 6 as examples the above-mentioned mobile phone establishes a wireless connection for remote input through its own auxiliary module and the auxiliary module of the target device. connect.
  • the auxiliary module 1 of the mobile phone can establish a wireless connection with the auxiliary module 2 of the target device through a remote procedure call (remote procedure call, RPC). That is, the mobile phone establishes a wireless connection based on the RPC protocol with the target device.
  • RPC remote procedure call
  • the target device sends request information to the mobile phone, which is used to request the mobile phone to remotely input into the default focus frame of the target device.
  • the target device can send request information to the auxiliary module 1 of the mobile phone through the auxiliary module 2 .
  • the auxiliary module 2 of the target device may send request information to the auxiliary module 1 of the mobile phone through RPC.
  • the above request information includes identification information of the default focus frame of the target device (such as an edit frame identifier (identity, ID)) and a data channel interface of the default focus frame.
  • identification information of the default focus frame of the target device such as an edit frame identifier (identity, ID)
  • ID an edit frame identifier
  • the data channel interface is used for remote input.
  • the default focus box is the edit box.
  • the auxiliary module 2 of the target device is also used to focus the edit frame, that is, the auxiliary module 2 is also used to set the edit frame as a default focus frame.
  • the default focus frame may be the first edit box on the interface of the target device.
  • the target device may determine the first edit box according to the coordinate values of the multiple edit boxes in the preset coordinate system.
  • the coordinate origin of the preset coordinate system may be the lower left corner of the screen of the target device
  • the x-axis of the preset coordinate system may be the lower edge of the screen of the target device
  • the y-axis of the preset coordinate system may be the left side of the screen of the target device edge.
  • the first edit box may be one of multiple edit boxes that simultaneously satisfies the smallest x-coordinate value and the largest y-coordinate value.
  • the auxiliary module 2 of the target device is also used to make the first edit frame focus, that is, the auxiliary module 2 is also used to set the first edit frame as the focus frame
  • the default focus frame may also be the edit frame with the highest priority on the interface of the target device.
  • the above priority may be determined by the auxiliary module 2 of the target device based on at least one of information such as position information of multiple edit boxes, or historical input frequency, or default setting information.
  • the default focus frame can also be determined based on other rules or principles.
  • the application does not limit the specific setting rules for the initial focus frame (ie, the default focus frame) after the mobile phone establishes a wireless connection with the target device for remote input.
  • the default focus box may be visible to the user, so that the user knows which edit box to input information at any time.
  • the default focus frame may be visible to the user in the form of highlighting the edit frame, displaying a cursor in the edit frame, and thickening the edit frame (as shown in FIG. 8 ).
  • the mobile phone displays a remote input interface.
  • the remote input interface is used for the user to input information into the default focus frame through editing.
  • the remote input interface includes an input box and an input method window.
  • the embodiment of the present application provides a cross-device input method, which can initiate remote input to a large-screen device based on a single device (such as a mobile phone 04), without causing interference to other devices with strong input capabilities, and has a good user experience.
  • step S707-1 After the mobile phone executes step S706, for the case where the user directly inputs information into the default focus frame of the target device through the mobile phone, the mobile phone performs the following step S707-1:
  • the mobile phone In response to receiving the information entered by the user in the input box, the mobile phone sends the information entered by the user in the input box to the target device, and the information entered by the user in the input box is used to fill in the Default focus frame.
  • the mobile phone can send the user input in the input box to the auxiliary module 2 of the target device through the auxiliary module 1. information, so that the auxiliary module 2 can input corresponding information to the default focus frame of the target device.
  • FIG. 8 shows an example of cross-device input by taking the interface of the target device including multiple edit boxes as an example.
  • the default focus frame is edit frame 1
  • the remote input interface includes an input frame 801 and an input method window 802 shown in (a) in FIG. 8 .
  • mobile phone 04 can be according to user's operation in input method window 802, to the text edited in input box 801, input user name to edit box 1 (as (b) among Fig. 8 "Sun" shown).
  • the remote input interface may also include at least one option.
  • the at least one option is used for the user to switch the focus frame, that is, for the user to adjust the focus frame on the target device.
  • the remote input interface can also be used for the user to arbitrarily switch the focus frame among the multiple edit boxes.
  • the above at least one option includes an option for switching the next edit box and an option for switching the previous edit box.
  • the remote input interface on the mobile phone 04 includes "previous” and “next” buttons for the user to switch focus frames. To avoid the cumbersome process of using the remote control to switch the focus frame first, and then re-confirming on the phone side. Among them, the "previous” button is used to switch the edit box of the previous priority, and the “next” button is used to switch the edit box of the next priority.
  • the cross-device input method provided by the embodiment of the present application further includes the following steps S708-1, S709-1 and S710-1:
  • the mobile phone In response to the user's operation of changing the focus frame, the mobile phone sends focus frame switching information to the target device.
  • the focus frame switching information is used to indicate to switch the focus frame.
  • the focus frame switching information includes identification information (such as ID) of the switched focus frame.
  • the edit box information may be saved on the mobile phone side.
  • the edit box information includes the ID of each edit box on the interface of the target device and the priority of each edit box.
  • the mobile phone can determine the ID of the switched focus frame according to the edited frame information, and send it to the target device through the focus frame switching information.
  • the edit box information saved on the mobile phone side may be as shown in Table 1 below:
  • the mobile phone will then click the "Next" button on the remote input interface.
  • the frame information determines that the next priority edit frame of the current focus frame (namely, edit frame 1) is edit frame 2, and then the mobile phone can determine that the ID of the switched focus frame is the ID of edit frame 2.
  • the mobile phone according to The edit frame information saved on the mobile phone side determines that the edit frame with the previous priority of the current focus frame (namely edit frame 3) is edit frame 2, then the mobile phone can determine that the ID of the switched focus frame is the ID of edit frame 2.
  • the above edit box information saved on the mobile phone side can be calculated by the mobile phone itself, can also be specified by the target device, or can be preset in the mobile phone by the developer, which is not limited in this application.
  • the target device can send identification information (such as edit box IDs) and position information of multiple edit boxes on the target device interface to the mobile phone , for the mobile phone to determine the priority of multiple edit boxes according to the location information of the multiple edit boxes.
  • identification information such as edit box IDs
  • position information of multiple edit boxes on the target device interface to the mobile phone , for the mobile phone to determine the priority of multiple edit boxes according to the location information of the multiple edit boxes.
  • the position information of the edit box may be a coordinate value of the edit box in a preset coordinate system.
  • the x-axis of the preset coordinate system is the lower edge of the screen of the target device
  • the y-axis of the preset coordinate system is the left edge of the screen of the target device as an example
  • the larger the y-axis coordinate value of the edit box and the smaller the x-axis coordinate value the higher the priority of the edit box.
  • the target device can send identification information (such as edit box IDs) and history of multiple edit boxes on the target device interface to the mobile phone.
  • the input data is used for the mobile phone to determine the priority of multiple edit boxes according to the historical input data of multiple edit boxes.
  • the historical input data of the above-mentioned multiple edit boxes may include, but not limited to, one or more of the input frequency of the multiple edit boxes and the default setting information in the background statistics within a preset time period. Exemplarily, within a preset period of time, the higher the input frequency of background statistics, the higher the priority of the edit box.
  • the target device may send the above edit box information to the mobile phone.
  • the edit box information is calculated and determined by the target device.
  • the edit box information is determined by the target device according to the position information of multiple edit boxes.
  • the edit box information is determined by the target device according to the historical input data of multiple edit boxes.
  • the edit box information may also be preset in the target device by the developer.
  • the mobile phone 04 may instruct the target device to switch the focus frame according to the edited frame information.
  • the focus frame By switching the focus frame based on priority, it can ensure that the edit frame with higher priority is edited first, improving user experience.
  • the target device switches the focus frame according to the focus frame switching information.
  • the auxiliary module 2 of the target device After the auxiliary module 2 of the target device receives the focus frame switching information from the mobile phone, it can according to the information of the switched focus frame carried in the focus frame switching information. Identification information (such as ID) toggles the focus frame.
  • the default focus frame is edit box 1, assuming that the edit box with the next priority of edit box 1 is edit box 2, then the mobile phone 04 can click "down" in the input box 801 according to the user
  • the operation of a " button switches the focus frame to the edit frame 2 shown in (c) in Fig. 8 .
  • the input box 801 shown in (c) in FIG. 8 is used to input a password into the switched focus box (namely, edit box 2).
  • the mobile phone In response to the user's input operation on the remote input interface, the mobile phone inputs information into the switched focus frame.
  • the mobile phone 04 in response to the user's input operation, enters the password into the switched focus frame (ie, edit box 2) 123456.
  • the mobile phone In response to the user's operation of changing the focus frame, the mobile phone sends focus frame switching information to the target device.
  • the focus frame switching information is used to indicate to switch the focus frame.
  • the focus frame switching information includes identification information (such as ID) of the switched focus frame.
  • the target device switches the focus frame according to the focus frame switching information.
  • the current focus frame is edit box 1, assuming that the user abandons editing text in input box 801 shown in (a) in Figure 11 , but clicks in input box 801 Assuming that the edit box with the next priority of edit box 1 is edit box 2, the mobile phone 04 can switch the focus box to the one shown in Fig. Edit box 2 shown in (b) in 11. Wherein, the input box 801 shown in (b) in FIG. 11 is used to input a password into the switched focus box (namely, edit box 2).
  • the mobile phone In response to the user's input operation on the remote input interface, the mobile phone inputs information into the switched focus frame.
  • the mobile phone 04 in response to the user's input operation, enters the password into the switched focus frame (ie, edit box 2) 123456.
  • the cross-device input method provided by the embodiment of the present application can realize arbitrary switching of the focus frame based on a single device when the display interface of a large-screen device includes multiple edit boxes, and the operation is simple and the user experience is good.
  • clicking the "previous” and “next” buttons shown in FIG. 8 is only used as an example of the way to change the focus frame, and the present application does not limit the specific way of changing the focus frame.
  • the focus frame can also be changed by pressing a physical button (such as pressing the power button and the volume button at the same time), a preset sliding gesture (such as a gesture of sliding to the left), and the like.
  • a physical button such as pressing the power button and the volume button at the same time
  • a preset sliding gesture such as a gesture of sliding to the left
  • the focus frame can also be changed by double-clicking the "previous” or “next” button shown in FIG. 8 and long pressing the “previous” or “next” button shown in FIG. 8.
  • how to change the focus frame may be determined according to specific settings.
  • the above at least one option may further include an option for switching across edit boxes.
  • the above at least one option may be in the form of a menu, a button, or a preset operation, which is not limited in the present application.
  • the user can switch across the edit boxes to achieve the focus of the edit box, such as jumping two edit boxes to get focus, or returning to the first edit box on the interface .
  • the current focus frame is the edit frame 3 .
  • the user wants to return to edit box 1 to modify the user name after completing the remote input to edit box 3, assuming that the operation of long pressing the "Previous" button is used to return to the first edit box on the interface or jump forward two times.
  • edit box as shown in (b) in Figure 12, in response to the operation of the user pressing the "previous" button for a long time, the mobile phone 04 instructs the large-screen device 01 to edit the first edit box on the interface (that is, edit box 1 ) to switch to the focus frame.
  • the operation of clicking the "Previous” button twice will trigger the confirmation of the edit box ID of the mobile phone 04 and the sending of the focus frame switching information;
  • the operation of the "Previous” button will also trigger another confirmation of the edit frame ID of the mobile phone 04 and the transmission of focus frame switching information.
  • the operation of long pressing the "previous” button only one time will be triggered to determine the ID of the editing frame of the mobile phone 04 and send the switching information of the focus frame, so the operation complexity can be reduced, the operation efficiency can be improved, and the jump switching can be realized to improve the switching efficiency.
  • serial numbers of the above-mentioned processes do not mean the order of execution, and the order of execution of the processes should be determined by their functions and internal logic, and should not be implemented in this application.
  • the implementation of the examples constitutes no limitation.
  • the electronic device (such as the first device or the second device) includes corresponding hardware structures and/or software modules for performing various functions.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software in combination with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
  • the functional modules of the electronic device can be divided, for example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.
  • FIG. 13 it is a structural block diagram of an electronic device provided by an embodiment of the present application.
  • the electronic device may be a first device or a second device (eg, a target device).
  • the electronic device may include a transceiver unit 1310 , a processing unit 1320 , a storage unit 1330 and a display unit 1340 .
  • the transceiver unit 1310 is used to support the first device to complete the above steps S704, S705, S707-1, S707-2, S708-1, S709-2, S710-1, and/or Other processes related to the embodiment of this application.
  • the processing unit 1320 is configured to support the first device to execute the above steps S701, S702, S703, S704, S709-1, S708-2, and/or other processes related to this embodiment of the present application.
  • the display unit 1340 is configured to support the first device to execute the above step S706, and/or other interfaces related to the embodiment of the present application.
  • the transceiver unit 1310 is used to support the target device to establish a wireless connection with the first device, receive information sent by the first device through the wireless connection, and receive focus frame switching information from the first device , sending the position information of multiple edit boxes to the first device, sending the priorities of the multiple edit boxes to the first device, and/or other processes related to the embodiment of the present application.
  • the processing unit 1320 is configured to support the second device (such as the target device) to determine a default focus frame after the transceiver unit 1310 establishes a wireless connection with the first device, and fill the default focus frame with information sent by the first device to the default focus frame through the wireless connection, Switching the focus frame to the edit frame corresponding to the identification information, and/or other processes related to the embodiment of the present application.
  • the display unit 1340 is configured to support the second device (such as the target device) to display an interface including at least one edit box, and/or other interfaces related to the embodiment of the present application.
  • the storage unit 1330 is used to store computer programs and implement processing data and/or processing results in the methods provided in the embodiments of the present application.
  • the transceiver unit 1310 may include a radio frequency circuit.
  • the electronic device such as the first device or the second device
  • radio frequency circuitry includes, but is not limited to, an antenna, at least one amplifier, transceiver, coupler, low noise amplifier, duplexer, and the like.
  • radio frequency circuits can also communicate with other devices through wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile Communications, General Packet Radio Service, Code Division Multiple Access, Wideband Code Division Multiple Access, Long Term Evolution, Email, Short Message Service, etc.
  • each module in the electronic device may be implemented in the form of software and/or hardware, which is not specifically limited. In other words, electronic equipment is presented in the form of functional modules.
  • the "module” here may refer to an application-specific integrated circuit ASIC, a circuit, a processor and memory executing one or more software or firmware programs, an integrated logic circuit, and/or other devices that can provide the above-mentioned functions.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.).
  • the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media integrated.
  • the available medium can be a magnetic medium, (such as a floppy disk, a hard disk, etc. , tape), optical media (such as digital video disk (digital video disk, DVD)), or semiconductor media (such as solid state disk (SSD)), etc.
  • the steps of the methods or algorithms described in conjunction with the embodiments of the present application may be implemented in hardware, or may be implemented in a manner in which a processor executes software instructions.
  • the software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, mobile hard disk, CD-ROM or any other form of storage known in the art medium.
  • An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
  • the storage medium may also be a component of the processor.
  • the processor and storage medium can be located in the ASIC.
  • the ASIC may be located in the electronic device.
  • the processor and the storage medium can also exist in the electronic device as discrete components.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种跨设备输入方法、设备及系统，涉及电子技术领域，可以提高跨设备输入时的便捷性和效率。该方案可以基于单个设备(如第一设备)发起向目标设备(如大屏设备)的远程输入，而不会对其他强输入能力设备造成干扰。进一步的，对于目标设备的显示界面包括有多编辑框的情况，该方法可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。

Description

一种跨设备输入方法、设备及系统
本申请要求于2021年8月3日提交国家知识产权局、申请号为202110888389.8、申请名称为“一种跨设备输入方法、设备及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子技术领域，尤其涉及一种跨设备输入方法、设备及系统。
背景技术
越来越多的电子设备可以连接到网络，接受用户的输入进行搜索或输入。例如，电视机可以连接到家庭网络，接收用户在搜索框中输入的节目名称，通过家庭网络搜索到节目名称对应的节目并播放。通常电视机接收的节目名称是用户通过遥控器在搜索框中输入的。
在一些示例中，如图1所示，电视机01可以接收用户通过遥控器02的方向键(如图1所示A，B，C或D)，控制电视机01上光标在输入键盘(如图1所示E)上的移动，从而在搜索框F中输入的节目名称。在另一些示例中，如图1所示，电视机01可以接收用户通过遥控器02的输入键盘(如图1所示G)，在搜索框F中输入的节目名称。但是，上述通过遥控器在搜索框中输入节目名称的方法操作繁琐，使用不方便。
发明内容
本申请提供一种跨设备输入方法、设备及系统，可以在跨设备输入时，基于单个设备实现焦点框的任意切换，操作简单。
为达到上述目的，本申请实施例采用如下技术方案：
第一方面，提供一种跨设备输入方法，该方法包括：响应于接收到用户用于开启远程输入功能的操作，第一设备根据一个或多个第二设备的界面信息确定目标设备；第一设备与目标设备建立用于传输第一设备向目标设备发送的用户输入的信息的无线连接；第一设备显示远程输入界面，该远程输入界面包括输入框以及至少一个选项，该至少一个选项用于调整所述目标设备上的焦点框。其中，目标设备是上述一个或多个第二设备中的一个，目标设备的界面上包括一个或多个编辑框。
上述第一方面提供的方案，可以基于单个设备(如第一设备)发起向目标设备(如大屏设备)的远程输入，而不会对其他强输入能力设备造成干扰。进一步的，对于目标设备的显示界面包括有多编辑框的情况，该方法可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。
在一种可能的实现方式中，上述第一设备根据一个或多个第二设备的界面信息确定目标设备，包括：上述第一设备根据多个第二设备的界面信息显示设备信息。其中，上述多个第二设备中有多个设备的界面上具有编辑框，上述设备信息包括界面具有编辑框的一个或多个第二设备的标识信息。第一设备根据用户对上述设备信息中标识信息的选择操作，确定目标设备。作为一种实现方式，第一设备可以向用户展示多个第二设备的标识信息，以便用户选择目标设备。通过上述用户界面(user interface，UI)互动，可以更加人性化的为用户服务，提高用户体验。
在一种可能的实现方式中，上述一个或多个第二设备中仅有一个设备的界面上具有编辑框，则上述第一设备确定界面上具有编辑框的设备是目标设备。作为一种实现方式，第一设备可以自动根据一个或多个第二设备的界面上具有编辑框的情况确定目标设备。例如在只有一个第二设备上具有编辑框时，直接确定该设备是目标设备。通过该方案，可以简化跨设备输入的操作，提高跨设备输入的效率，提升用户体验。
在一种可能的实现方式中，上述方法还包括：第一设备接收用户在上述输入框中输入的信息；第一设备向目标设备发送用户在输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框。作为一种可能性，第一设备可以直接根据用户在用于跨设备输入的输入框中输入的信息，向目标设备的默认焦点框中输入对应信息。通过该方案，可以提高跨设备输入时用户的体验度。
在一种可能的实现方式中，上述方法还包括：第一设备响应于接收到用户选择上述至少一个选项中任一个的操作；第一设备确定切换后的焦点框；第一设备向目标设备发送焦点框切换信息。其中，焦点框切换信息包括上述切换后的焦点框的标识信息。作为一种可能性，第一设备根据用户切换目标设备焦点框的操作，对应的进行焦点框切换。通过该方案，可以简化跨设备输入时焦点框切换的流程和操作，提高跨设备输入的效率，提升用户体验。
在一种可能的实现方式中，上述第一设备确定切换后的焦点框，包括：第一设备根据编辑框信息确定切换后的焦点框；编辑框信息包括多个编辑框的优先级。作为一种实现方式，可以基于编辑框的优先级情况进行焦点框切换。通过该方案，可以优先进行重要程度较高的编辑框的跨设备输入，提升用户体验。
在一种可能的实现方式中，上述目标设备的界面上包括多个编辑框；上述方法还包括：第一设备从目标设备接收多个编辑框的位置信息；第一设备根据多个编辑框的位置信息确定多个编辑框的优先级。作为一种实现方式，可以基于编辑框的位置信息进行焦点框切换。该方案符合用户的使用习惯，例如符合用户按照从上到下、从左到右的顺序进行对编辑框的跨设备输入的习惯，提升用户体验。
在一种可能的实现方式中，上述方法还包括：第一设备从目标设备接收编辑框信息。作为一种实现方式，第一设备可以从目标设备获取例如编辑框的优先级或编辑框的位置信息等编辑框信息，以提高焦点框切换所依据的信息的准确性。
在一种可能的实现方式中，上述至少一个选项包括用于切换下一个编辑框的选项或用于切换上一个编辑框的选项中的至少一个。作为一种实现方式，第一设备可以提供用于切换至下一个和/或上一个焦点框的选项，供用户根据需要进行焦点框切换，提高用户体验度。
在一种可能的实现方式中，上述至少一个选项包括用于跨编辑框切换的选项。作为一种实现方式，第一设备可以提供用于跨编辑框切换的选项，供用户根据需要进行焦点框切换，提高用户体验度。
在一种可能的实现方式中，上述无线连接是点对点(peer to peer，P2P)连接。作为一种可能性，本申请提供的方法适用于P2P的网络架构，可以提高该方法对不同网络架构的适用性和兼容性。
在一种可能的实现方式中，上述无线连接基于远程过程调用(remote procedure call， RPC)协议。作为一种可能性，本申请提供的方法适用于基于RPC协议的无线连接，可以提高该方法对不同通信协议的适用性和兼容性。
第二方面，提供一种跨设备输入方法，该方法应用于目标设备，该方法包括：目标设备在与第一设备建立无线连接之后，确定默认焦点框。其中，上述无线连接用于第一设备向目标设备发送用户输入的信息。目标设备接收第一设备通过上述无线连接发送的信息，并将所述信息填充到默认焦点框。应理解：目标设备为一个或多个第二设备中的一个设备。
上述第二方面提供的方案，目标设备(如大屏设备)可以与第一设备建立用于跨设备输入的无线连接，目标设备通过建立的无线连接接收第一设备的远程输入。该方法中，无线连接的建立过程不会对其他强输入能力设备造成干扰，操作简单，用户体验佳。
在一种可能的实现方式中，上述方法还包括：目标设备从第一设备接收焦点框切换信息，该焦点框切换信息包括焦点框的标识信息；目标设备将焦点框切换为标识信息对应的编辑框。作为一种实现方式，例如对于目标设备的显示界面包括有多编辑框的情况，可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。
在一种可能的实现方式中，上述默认焦点框是目标设备的界面上的第一个编辑框；或者，默认焦点框是目标设备的界面上优先级最高的编辑框。作为一种实现方式，可以基于编辑框的优先级情况确定默认焦点框。通过该方案，可以优先进行重要程度较高的编辑框的跨设备输入，提升用户体验。作为另一种实现方式，可以基于编辑框的位置信息确定默认焦点框。该方案符合用户的使用习惯，例如符合用户按照从上到下、从左到右的顺序进行对编辑框的跨设备输入的习惯，提升用户体验。
在一种可能的实现方式中，上述目标设备的界面上包括多个编辑框；上述方法还包括：目标设备向第一设备发送上述多个编辑框的位置信息；或者，目标设备向第一设备发送上述多个编辑框的优先级。作为一种实现方式，第一设备可以从目标设备获取例如编辑框的优先级或编辑框的位置信息等编辑框信息，以提高焦点框切换所依据的信息的准确性。
在一种可能的实现方式中，上述无线连接是P2P连接。作为一种可能性，本申请提供的方法适用于P2P的网络架构，可以提高该方法对不同网络架构的适用性和兼容性。
在一种可能的实现方式中，上述无线连接基于RPC协议。作为一种可能性，本申请提供的方法适用于基于RPC协议的无线连接，可以提高该方法对不同通信协议的适用性和兼容性。
第三方面，提供一种第一设备，该第一设备包括：处理单元，用于：响应于接收到用户用于开启远程输入功能的操作，根据一个或多个第二设备的界面信息确定目标设备；与目标设备建立用于传输第一设备向目标设备发送的用户输入的信息的无线连接；显示单元，用于：显示远程输入界面，该远程输入界面包括输入框以及至少一个选项，该至少一个选项用于调整所述目标设备上的焦点框。其中，目标设备是上述一个或多个第二设备中的一个，目标设备的界面上包括一个或多个编辑框。
上述第三方面提供的方案，可以基于单个设备(如第一设备)发起向目标设备(如 大屏设备)的远程输入，而不会对其他强输入能力设备造成干扰。进一步的，对于目标设备的显示界面包括有多编辑框的情况，该方法可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。
在一种可能的实现方式中，上述处理单元具体用于：根据多个第二设备的界面信息显示设备信息；以及根据用户对上述设备信息中标识信息的选择操作，确定目标设备。其中，上述多个第二设备中有多个设备的界面上具有编辑框，上述设备信息包括界面具有编辑框的一个或多个第二设备的标识信息。作为一种实现方式，第一设备可以向用户展示多个第二设备的标识信息，以便用户选择目标设备。通过上述UI互动，可以更加人性化的为用户服务，提高用户体验。
在一种可能的实现方式中，上述一个或多个第二设备中仅有一个设备的界面上具有编辑框，则上述处理单元确定界面上具有编辑框的设备是目标设备。作为一种实现方式，第一设备可以自动根据一个或多个第二设备的界面上具有编辑框的情况确定目标设备。例如在只有一个第二设备上具有编辑框时，直接确定该设备是目标设备。通过该方案，可以简化跨设备输入的操作，提高跨设备输入的效率，提升用户体验。
在一种可能的实现方式中，上述处理单元还用于：接收用户在上述输入框中输入的信息；向目标设备发送用户在输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框。作为一种可能性，第一设备可以直接根据用户在用于跨设备输入的输入框中输入的信息，向目标设备的默认焦点框中输入对应信息。通过该方案，可以提高跨设备输入时用户的体验度。
在一种可能的实现方式中，上述处理单元还用于：响应于接收到用户选择上述至少一个选项中任一个的操作；确定切换后的焦点框；向目标设备发送焦点框切换信息。其中，焦点框切换信息包括上述切换后的焦点框的标识信息。作为一种可能性，第一设备根据用户切换目标设备焦点框的操作，对应的进行焦点框切换。通过该方案，可以简化跨设备输入时焦点框切换的流程和操作，提高跨设备输入的效率，提升用户体验。
在一种可能的实现方式中，上述处理单元具体用于：根据编辑框信息确定切换后的焦点框；编辑框信息包括多个编辑框的优先级。作为一种实现方式，可以基于编辑框的优先级情况进行焦点框切换。通过该方案，可以优先进行重要程度较高的编辑框的跨设备输入，提升用户体验。
在一种可能的实现方式中，上述目标设备的界面上包括多个编辑框；上述处理单元还用于：从目标设备接收多个编辑框的位置信息；根据多个编辑框的位置信息确定多个编辑框的优先级。作为一种实现方式，可以基于编辑框的位置信息进行焦点框切换。该方案符合用户的使用习惯，例如符合用户按照从上到下、从左到右的顺序进行对编辑框的跨设备输入的习惯，提升用户体验。
在一种可能的实现方式中，上述第一设备还包括：收发单元，用于从目标设备接收编辑框信息。作为一种实现方式，第一设备可以从目标设备获取例如编辑框的优先级或编辑框的位置信息等编辑框信息，以提高焦点框切换所依据的信息的准确性。
在一种可能的实现方式中，上述至少一个选项包括用于切换下一个编辑框的选项或用于切换上一个编辑框的选项中的至少一个。作为一种实现方式，第一设备可以提 供用于切换至下一个和/或上一个焦点框的选项，供用户根据需要进行焦点框切换，提高用户体验度。
在一种可能的实现方式中，上述至少一个选项包括用于跨编辑框切换的选项。作为一种实现方式，第一设备可以提供用于跨编辑框切换的选项，供用户根据需要进行焦点框切换，提高用户体验度。
在一种可能的实现方式中，上述无线连接是P2P连接。作为一种可能性，本申请提供的方法适用于P2P的网络架构，可以提高该方法对不同网络架构的适用性和兼容性。
在一种可能的实现方式中，上述无线连接基于RPC协议。作为一种可能性，本申请提供的方法适用于基于RPC协议的无线连接，可以提高该方法对不同通信协议的适用性和兼容性。
第四方面，提供一种目标设备，该目标设备包括：处理单元，用于与第一设备建立无线连接；确定默认焦点框。其中，上述无线连接用于第一设备向目标设备发送用户输入的信息。收发单元，用于接收第一设备通过上述无线连接发送的信息，并将所述信息填充到默认焦点框。应理解：目标设备为一个或多个第二设备中的一个设备。
上述第四方面提供的方案，目标设备(如大屏设备)可以与第一设备建立用于跨设备输入的无线连接，通过建立的无线连接接收第一设备的远程输入。该方法中，无线连接的建立过程不会对其他强输入能力设备造成干扰，操作简单，用户体验佳。
在一种可能的实现方式中，上述收发单元还用于：从第一设备接收焦点框切换信息，该焦点框切换信息包括焦点框的标识信息；上述处理单元还用于：将焦点框切换为标识信息对应的编辑框。作为一种实现方式，例如对于目标设备的显示界面包括有多编辑框的情况，可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。
在一种可能的实现方式中，上述默认焦点框是目标设备的界面上的第一个编辑框；或者，默认焦点框是目标设备的界面上优先级最高的编辑框。作为一种实现方式，可以基于编辑框的优先级情况确定默认焦点框。通过该方案，可以优先进行重要程度较高的编辑框的跨设备输入，提升用户体验。作为另一种实现方式，可以基于编辑框的位置信息确定默认焦点框。该方案符合用户的使用习惯，例如符合用户按照从上到下、从左到右的顺序进行对编辑框的跨设备输入的习惯，提升用户体验。
在一种可能的实现方式中，上述目标设备的界面上包括多个编辑框；上述收发单元还用于：向第一设备发送上述多个编辑框的位置信息；或者，向第一设备发送上述多个编辑框的优先级。作为一种实现方式，第一设备可以从目标设备获取例如编辑框的优先级或编辑框的位置信息等编辑框信息，以提高焦点框切换所依据的信息的准确性。
在一种可能的实现方式中，上述无线连接是P2P连接。作为一种可能性，本申请提供的方法适用于P2P的网络架构，可以提高该方法对不同网络架构的适用性和兼容性。
在一种可能的实现方式中，上述无线连接基于RPC协议。作为一种可能性，本申请提供的方法适用于基于RPC协议的无线连接，可以提高该方法对不同通信协议的适用性和兼容性。
第五方面，提供一种第一设备，该第一设备包括：显示屏；一个或多个处理器；一个或多个存储器；所述存储器存储有一个或多个程序，所述一个或多个程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述第一设备执行如第一方面和第一方面中任一项所述的方法。
第六方面，提供一种目标设备，该目标设备包括：显示屏；一个或多个处理器；一个或多个存储器；所述存储器存储有一个或多个程序，所述一个或多个程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述目标设备执行如第二方面和第二方面中任一项所述的方法。应理解：目标设备为一个或多个第二设备中的一个设备。
第七方面，提供一种跨设备输入方法，该方法包括：响应于接收到用户用于开启远程输入功能的操作，第一设备根据一个或多个第二设备的界面信息确定目标设备，该目标设备是上述一个或多个第二设备中的一个，目标设备的界面上包括一个或多个编辑框；第一设备与目标设备建立无线连接，该无线连接用于传输第一设备向目标设备发送的用户输入的信息；目标设备确定默认焦点框；第一设备显示远程输入界面，该远程输入界面包括输入框以及至少一个选项，该至少一个选项用于调整目标设备上的焦点框。应理解：目标设备为一个或多个第二设备中的一个设备。
上述第七方面提供的方案，可以基于单个设备(如第一设备)发起向目标设备(如大屏设备)的远程输入，而不会对其他强输入能力设备造成干扰。进一步的，对于目标设备的显示界面包括有多编辑框的情况，该方法可以通过单个设备实现焦点框的任意切换，操作简单，用户体验佳。
在一种可能的实现方式中，上述方法还包括：第一设备接收用户在输入框中输入的信息；第一设备向目标设备发送用户在输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框；目标设备将上述信息填充到默认焦点框。作为一种可能性，第一设备可以直接根据用户在用于跨设备输入的输入框中输入的信息，向目标设备的默认焦点框中输入对应信息。通过该方案，可以提高跨设备输入时用户的体验度。
在一种可能的实现方式中，上述方法还包括：第一设备响应于接收到用户选择上述至少一个选项中任一个的操作；第一设备确定切换后的焦点框；第一设备向目标设备发送焦点框切换信息，焦点框切换信息包括切换后的焦点框的标识信息；目标设备将焦点框切换为标识信息对应的编辑框。作为一种可能性，第一设备根据用户切换目标设备焦点框的操作，对应的进行焦点框切换。通过该方案，可以简化跨设备输入时焦点框切换的流程和操作，提高跨设备输入的效率，提升用户体验。
在一种可能的实现方式中，上述目标设备的界面上包括多个编辑框；上述方法还包括：目标设备向第一设备发送多个编辑框的位置信息；或者，目标设备向第一设备发送多个编辑框的优先级。作为一种实现方式，第一设备可以从目标设备获取例如编辑框的优先级或编辑框的位置信息等编辑框信息，以提高焦点框切换所依据的信息的准确性。
第八方面，提供一种通信系统，该通信系统包括：如第三方面或第五方面任一种可能的实现方式中的第一设备，以及如第四方面或第六方面任一种可能的实现方式中 的目标设备。应理解：目标设备为一个或多个第二设备中的一个设备。
第九方面，提供一种计算机可读存储介质，该计算机可读存储介质上存储有计算机程序代码，该计算机程序代码被处理器执行时，使得处理器实现如第一方面或第二方面任一种可能的实现方式中的方法。
第十方面，提供一种芯片系统，该芯片系统包括处理器、存储器，存储器中存储有计算机程序代码；所述计算机程序代码被所述处理器执行时，使得处理器实现如第一方面或第二方面任一种可能的实现方式中的方法。该芯片系统可以由芯片构成，也可以包含芯片和其他分立器件。
第十一方面，提供一种计算机程序产品，该计算机程序产品包括计算机指令。当该计算机指令在计算机上运行时，使得计算机实现如第一方面或第二方面任一种可能的实现方式中的方法。
附图说明
图1为一种跨设备输入方法示例图；
图2为本申请实施例提供的一种大屏设备的硬件结构示意图；
图3为本申请实施例提供的一种手机的硬件结构示意图；
图4为本申请实施例提供的一种跨设备输入方法示例图；
图5为本申请实施例提供的一种跨设备输入场景示例图；
图6为本申请实施例提供的一种手机和大屏设备的结构框图；
图7为本申请实施例提供的一种跨设备输入方法流程图一；
图8为本申请实施例提供的一种跨设备输入示例图一；
图9为本申请实施例提供的一种跨设备输入方法流程图二；
图10为本申请实施例提供的一种跨设备输入方法流程图三；
图11为本申请实施例提供的一种跨设备输入示例图二；
图12为本申请实施例提供的一种跨设备输入示例图三；
图13为本申请实施例提供的一种电子设备的结构框图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。
本申请实施例提供一种跨设备输入方法，该方法应用于大屏设备等弱输入能力设备接受手机等强输入能力设备输入的过程中。
其中，在本申请实施例中，弱输入能力和强输入能力是相对的概念。例如，相对于手机，电视机是弱输入能力设备；相对于智能手表，手机是强输入能力设备。本申 请实施例以下以大屏设备作为弱输入能力设备，以手机作为强输入能力设备为例，对本申请实施例提供的一种跨设备输入方法进行介绍。
其中，本申请中的弱输入能力设备包括一个或多个显示屏。例如，该设备可以是电视机、智能相机、掌上电脑、个人数字助理(personal digital assistant，PDA)、便携式多媒体播放器(portable multimedia player，PMP)、增强现实(Augmented Reality，AR)/虚拟现实(Virtual Reality，VR)设备、超级移动个人计算机(ultra-mobile personal computer，UMPC)、智能手环、智能手表等。或者，该设备还可以是其它类型或结构的包括一个或多个显示屏的电子设备，本申请不限定。
请参考图2，图2以电视机为例，示出一种大屏设备的硬件结构示意图。如图2所示，大屏设备200可以包括：处理器210，外部存储器接口220，内部存储器221，通用串行总线(universal serial bus，USB)接口230，电源管理模块240，天线，无线通信模块260，音频模块270，扬声器270A，麦克风270C，音箱接口270B，传感器模块280，按键290，指示器291，摄像头293，以及显示屏292等。
可以理解的是，本实施例示意的结构并不构成对大屏设备200的具体限定。在另一些实施例中，大屏设备200可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器210可以包括一个或多个处理单元，例如：处理器210可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
在本申请实施例中，处理器210可以包括辅助模块(如图6中的(b)所示辅助模块2)。该辅助模块可以用于向强输入设备(如手机)发送界面信息，与强输入设备(如手机)绑定，向强输入设备(如手机)请求远程输入，接收强输入设备(如手机)的输入，以及处理来自强输入设备(如手机)的焦点框切换信息等。
控制器可以是大屏设备200的神经中枢和指挥中心。控制器可以根据指令完成取指令，产生操作控制信号，进而执行指令的控制。在本申请实施例中，控制器可以根据来自强输入设备(如手机)的控制信息中包括的指令以及产生操作控制信号，进而完成在大屏设备显示屏上编辑框(如搜索框)中的输入。
处理器210中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器210的等待时间，因而提高了系统的效率。在一些实施例中，处理器210可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口 (mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，和/或USB接口等。
可以理解的是，本实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对大屏设备200的结构限定。在另一些实施例中，大屏设备200也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
电源管理模块240用于连接电源。充电管理模块240还可以与处理器210、内部存储器221、显示屏294、摄像头293和无线通信模块260等连接。电源管理模块241接收电源的输入，为处理器210、内部存储器221、显示屏294、摄像头293和无线通信模块260等供电。在一些实施例中，电源管理模块241也可以设置于处理器210中。
大屏设备200的无线通信功能可以通过天线和无线通信模块260等实现。其中，无线通信模块260可以提供应用在大屏设备200上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。在本申请实施例中，大屏设备200可以通过天线和无线通信模块260接收来自强输入设备(如手机)的输入信息，进而根据接收到的输入信息完成在大屏设备显示屏上编辑框中的输入。
无线通信模块260可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块260经由天线接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器210。无线通信模块260还可以从处理器210接收待发送的信号，对其进行调频，放大，经天线转为电磁波辐射出去。在一些实施例中，大屏设备200的天线和无线通信模块260耦合，使得大屏设备200可以通过无线通信技术与网络以及其他设备通信。
大屏设备200通过GPU，显示屏292，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏292和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器210可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。显示屏292用于显示图像，视频等，该显示屏292包括显示面板。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当大屏设备200在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。视频编解码器用于对数字视频压缩或解压缩。大屏设备200可以支持一种或多种视频编解码器。这样，大屏设备200可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
外部存储器接口220可以用于连接外部存储卡，例如Micro SD卡，实现扩展大屏设备400的存储能力。外部存储卡通过外部存储器接口220与处理器210通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器221可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器210通过运行存储在内部存储器221的指令，从而执行大屏设备200的各种功能应用以及数据处理。例如，在本申请实施例中，处理器210可以通过执行存 储在内部存储器221中的指令，内部存储器221可以包括存储程序区和存储数据区。
其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储大屏设备200使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器221可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
大屏设备200可以通过音频模块270，扬声器270A，麦克风270C，音箱接口270B，以及应用处理器等实现音频功能。例如，音乐播放，录音等。
可以理解的是，图2示意的结构并不构成对大屏设备的具体限定。其可以具有比图2中所示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。例如，该大屏设备还可以包括音箱、遥控器等部件。图2中所示出的各种部件可以在包括一个或多个信号处理或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
示例性的，本申请中的强输入设备可以是智能手机、上网本、平板电脑等。或者，强输入设备还可以是其它类型或结构的电子设备，本申请不限定。
请参考图3，图3以强输入设备是智能手机(以下简称手机)为例，示出了一种强输入设备的硬件结构示意图。如图3所示，手机300可以包括处理器310，存储器(包括外部存储器接口320和内部存储器321)，通用串行总线(universal serial bus，USB)接口330，充电管理模块340，电源管理模块341，电池342，天线1，天线2，移动通信模块350，无线通信模块360，音频模块370，扬声器370A，受话器370B，麦克风370C，耳机接口370D，传感器模块380，按键390，马达391，指示器392，摄像头393，显示屏394，以及用户标识模块(subscriber identification module，SIM)卡接口395等。其中传感器模块380可以包括压力传感器，陀螺仪传感器，气压传感器，磁传感器，加速度传感器，距离传感器，接近光传感器，指纹传感器，温度传感器，触摸传感器，环境光传感器，骨传导传感器等。
可以理解的是，本发明实施例示意的结构并不构成对手机的具体限定。在本申请另一些实施例中，手机可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器310可以包括一个或多个处理单元。例如：处理器310可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，飞行控制器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
处理器310中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器310的等待时间，因而提高了系统的效率。
在本申请实施例中，处理器310可以包括辅助模块(如图6中的(a)所示辅助模块1)。该辅助模块可以用于从大屏设备获取界面信息，进行目标设备选择，与目标设备绑定，接收来自目标设备的输入请求，控制显示屏394显示远程输入界面，根据用户在远程输入界面上的输入向目标设备输入，以及根据用户在远程输入界面上的更换焦点框的操作向目标设备指示切换等。
在一些实施例中，处理器310可以包括一个或多个接口。接口可以包括集成电路I2C接口，集成电路内置音频I2S接口，脉冲编码调制PCM接口，通用异步收发传输器UART接口，移动产业处理器接口MIPI，通用输入输出GPIO接口，用户标识模块SIM接口，和/或通用串行总线USB接口等。
手机的无线通信功能可以通过天线1，天线2，移动通信模块350，无线通信模块360，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。手机中的每个天线可用于覆盖单个或多个通信频段。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块350可以提供应用在手机上的包括2G/3G/4G/5G/6G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块350可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块350还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块350的至少部分功能模块可以被设置于处理器310中。在一些实施例中，移动通信模块350的至少部分功能模块可以与处理器310的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器370A、受话器370B等)输出声音信号，或通过显示屏394显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器310，与移动通信模块350或其他功能模块设置在同一个器件中。
无线通信模块360可以提供应用在手机上的包括WLAN(如Wi-Fi网络)，蓝牙BT，全球导航卫星系统GNSS，调频FM，近距离无线通信技术NFC，红外技术IR等无线通信的解决方案。无线通信模块360可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块360经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器310。无线通信模块360还可以从处理器310接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，手机的天线1和移动通信模块350耦合，天线2和无线通信模块360耦合，使得手机可以通过无线通信技术与网络以及其他设备通信。
手机通过GPU，显示屏394，以及应用处理器等实现显示功能。GPU为图像处理 的微处理器，连接显示屏394和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器310可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏394用于显示图像，视频等。显示屏394包括显示面板。在一些实施例中，手机可以包括1个或N个显示屏394，N为大于1的正整数。
手机可以通过ISP，摄像组件393，视频编解码器，GPU，显示屏394以及应用处理器等实现拍摄功能。
外部存储器接口320可以用于连接外部存储卡，例如Micro SD卡，实现扩展手机的存储能力。外部存储卡通过外部存储器接口320与处理器310通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器321可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。内部存储器321可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储手机使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器321可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。处理器310通过运行存储在内部存储器321的指令，和/或存储在设置于处理器中的存储器的指令，执行手机的各种功能应用以及数据处理。
手机可以通过音频模块370，扬声器370A，受话器370B，麦克风370C以及应用处理器等实现音频功能。例如音乐播放，录音等。关于音频模块370，扬声器370A，受话器370B和麦克风370C的具体工作原理和作用，可以参考常规技术中的介绍。
按键390包括开机键(也称电源键)，音量键等。按键390可以是机械按键。也可以是触摸式按键。手机可以接收按键输入，产生与手机的用户设置以及功能控制有关的键信号输入。例如，在本申请实施例中，手机可以接收同时按压开机键和音量键，指示目标设备进行焦点框切换。
关于充电管理模块340、电源管理模块341、马达391、指示器392和SIM卡接口395等的具体工作原理和作用，可以参考常规技术中的介绍，本申请实施例不做赘述。
需要说明的是，图3所示手机包括的硬件模块只是示例性地描述，并不对手机的具体结构做出限定。例如，手机还可以包括其他功能模块。
作为一种示例，本申请实施例中，大屏设备和手机可以连接到同一网络，例如家庭Wi-Fi网络。大屏设备可以通过Wi-Fi接收来自手机的输入信息，进而根据接收到的输入信息完成在大屏设备显示屏上编辑框(如搜索框)中的输入。
示例性的，大屏设备01上可以显示如图4所示的搜索框F。大屏设备01可以在接收到用户使用遥控器将输入光标移动到搜索框F的操作时，触发远程输入。大屏设备01向一个或多个强输入能力设备发送广播信息，用于该一个或多个强输入能力设备显示远程输入确认界面，以便用户选择对应的远程输入设备。在一些示例中，强输入能力设备在接收到来自大屏设备01的广播信息之后，可以弹窗远程输入确认界面供用户选择是否使用该强输入能力设备进行远程输入。
其中，在一些示例中，基于例如图4所示方法进行跨设备输入时，接收到广播信息的一个或多个强输入能力设备可以包括预设时间段内与大屏设备01建立过用于远 程输入的无线连接的设备，和/或与大屏设备01建立了分布式组网的设备等，本申请不限定。
进一步的，在某一强输入能力设备(如图4所示手机04)检测到用户在该设备上确认使用该设备进行远程输入的操作时，手机04可以调用远程输入服务显示图4所示输入界面H。进一步的，大屏设备01可以接收用户在图4所示输入界面H上编辑的文字“你好”，在大屏设备01的搜索框F中输入“你好”，以及进一步地搜索名称包括“你好”和/或名称与“你好”相关的节目。
在如图4所示的示例中，手机04可以将输入法能力共享给大屏设备01，从而突破硬件上的限制。但是，在如图4所示的示例中，进行跨设备输入时，用户需要使用遥控器和手机共同实现在大屏设备上的远程输入，使用的设备较多，且操作过程复杂。
另外，对于大屏设备的显示界面包括有多编辑框的情况，基于例如图4所示方法进行跨设备输入时，若要更换编辑框，需要用户先使用遥控器进行焦点框切换，以重新触发一个或多个强输入能力设备显示远程输入确认界面。其中，焦点框是指当前活动编辑框。进一步的，用户需要再次在某一强输入能力设备(如手机)的远程输入确认界面上确认使用该设备进行远程输入的操作，才能使用该设备在切换后的编辑框中输入信息，设备更换频繁，操作过程繁琐。
例如，在图5所示的账号注册的跨设备输入场景中，假设大屏设备01上显示有4个编辑框，包括编辑框1、编辑框2、编辑框3和编辑框4。示例性的，当用户使用手机04在编辑框3中完成电话号码的输入后(如图5中的(a)所示)，若用户想要修改编辑框1中的用户名，则需要进行以下操作(A)～(D)：(A)放下手机04→(B)拿起遥控器→(C)使用遥控器将焦点框切换为编辑框1→(D)拿起手机04确认使用该设备进行远程输入之后，才能在手机04显示输入界面后修改编辑框1中的用户名(如图5中的(b)所示)。
进一步的，基于例如图4或图5所示方法进行跨设备输入时，若大屏设备01向多个强输入能力设备均发送广播信息，则会对其他设备造成严重干扰。进一步的，对于设备弹窗显示远程输入确认界面的情况，弹窗的长时间不隐退会对用户造成严重干扰，尤其是对正在被使用的设备而言。
为解决上述问题，本申请实施例提供一种跨设备输入方法，该方法可以基于单个设备(如第一设备)发起向大屏设备(如目标设备)的远程输入，而不会对其他强输入能力设备造成干扰。另外，对于大屏设备的显示界面包括有多编辑框的情况，该方法可以通过单个设备实现焦点框的任意切换，操作简单。
如图6所示，本申请实施例跨设备输入流程中的强输入设备(如手机)和大屏设备可以包括辅助模块。示例性的，如图6中的(a)所示，手机可以包括辅助模块1。如图6中的(b)所示，大屏设备可以包括辅助模块2。
示例性的，以包括分层架构的Android系统的手机和大屏设备为例，手机和大屏设备的操作系统可以包括应用程序层，应用程序框架层，系统库，安卓运行时和内核层。其中，上述辅助模块1可以位于手机操作系统的应用程序框架层；辅助模块2可以位于大屏设备操作系统的应用程序框架层。其中，应用程序框架层可以为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。 关于操作系统以及各个层(如Android系统的应用程序层，应用程序框架层，系统库，安卓运行时和内核层等)的具体介绍，可以参考常规技术中的解释和说明，本申请实施例不做赘述。
以下将结合附图，以强输入设备为手机为例，对本申请实施例提供的一种跨设备输入方法进行具体介绍。
可以理解，在本申请实施例中，假设用户希望使用手机(即第一设备)对某一大屏设备(即第二设备)上的编辑框进行远程输入，则用户可以在手机上发起远程输入，进而发起手机与该大屏设备之间的连接。例如，用户可以首先在手机上开启远程输入功能，然后在手机上建立与该大屏设备之间的，用于远程输入的无线连接。具体的，在本申请实施例中，该无线连接具体用于传输手机(即第一设备)向大屏设备(即第二设备)发送的用户输入的信息。
如图7示，本申请实施例提供的一种跨设备输入方法可以包括以下步骤S701-S706：
S701、手机接收用户用于开启远程输入功能的操作。
示例性的，上述用于开启远程输入功能的操作可以包括但不限于：用户打开远程输入开关的操作。
例如，假设手机上安装有用于远程输入的应用程序(以下简称“远程输入APP”)，上述用于开启远程输入功能的操作可以是用户打开远程输入APP的操作。
又如，假设手机上安装的远程输入APP的应用界面上包括远程输入开关，上述用于开启远程输入功能的操作可以是用户打开该远程输入开关的操作。
又如，假设手机上集成有远程输入的设置功能，上述用于开启远程输入功能的操作可以是用户在远程输入的设置界面上打开远程输入开关的操作。
又如，假设手机的下拉菜单栏中设置有远程输入开关，上述用于开启远程输入功能的操作可以是用户在下拉菜单栏中打开远程输入开关的操作。
可以理解，上述用于开启远程输入功能的操作仅作为示例，本申请对操作的具体形式不做限定。
S702、响应于接收到用于开启远程输入功能的操作，手机获取一个或多个大屏设备(如一个或多个第二设备)的界面信息。
其中，界面信息可以包括但不限于界面上是否具有编辑框的信息和/或界面上具有编辑框的数量。
在一些实施例中，上述一个或多个大屏设备是分布式组网中的大屏设备。其中，分布式组网是指由多个设备组成的可以点对点(peer to peer，P2P)通信的分布式设备集群。
例如，如图7所示，假设分布式组网中包括大屏设备1、大屏设备2和大屏设备3，则响应于接收到上述用于开启远程输入功能的操作，手机获取大屏设备1的界面信息、大屏设备2的界面信息和大屏设备3的界面信息。
在另一些实施例中，上述一个或多个大屏设备是在预设时间段(如24小时内、一周内、一个月内或者半年内等)内与手机建立过用于远程输入的无线连接的大屏设备。
例如，假设上述预设时间段为一周内，则响应于接收到上述用于开启远程输入功能的操作，手机获取一周内与手机建立过用于远程输入的无线连接的大屏设备。
在另一些实施例中，上述一个或多个大屏设备是最近与手机建立过用于远程输入的无线连接的N个大屏设备；N为正整数。
例如，假设上述N为预设值3，则响应于接收到上述用于开启远程输入功能的操作，手机获取最近与手机建立过用于远程输入的无线连接的3个大屏设备的界面信息。
需要说明的是，上述手机获取大屏设备的界面信息的规则仅作为示例，本申请实施例对具体规则不做限定。例如，手机获取大屏设备的界面信息的规则还可以是多个条件的组合，例如响应于接收到上述用于开启远程输入功能的操作，手机获取预设时间段内(如一周内)与手机建立过用于远程输入的无线连接的N(如N＝3)个大屏设备的界面信息。又如，响应于接收到上述用于开启远程输入功能的操作，手机获取预设时间段内(如一周内)与手机建立用于远程输入的无线连接次数前三名的大屏设备的界面信息。
作为一种实现方式，手机可以通过辅助模块1从一个或多个大屏设备获取界面信息。
作为另一种实现方式，手机可以通过用于分布式连接的模块(如设备发现模块)从一个或多个大屏设备获取界面信息。本申请对信息获取的具体模块不做限定。
S703、手机确定目标设备。
其中，目标设备是上述一个或多个大屏设备中的一个。
在一些实施例中，假设手机获取的一个或多个大屏设备的界面信息表明仅有一个大屏设备(如图7所示大屏设备1)的界面上具有编辑框，则手机可以确定该大屏设备为目标设备。
在另一些实施例中，假设手机获取的一个或多个大屏设备的界面信息表明仅有一个大屏设备(如图7所示大屏设备1)的界面上具有编辑框，则手机还可以向用户展示该设备的标识信息，用于通知该大屏设备为目标设备，或者用于用户指定该大屏设备为目标设备。
在另一些实施例中，手机可以接收用户的选择，确定目标设备。例如，手机可以向用户展示设备信息，该设备信息包括界面上具有编辑框的大屏设备的标识信息。该设备信息用于向用户展示手机可远程输入的大屏设备，以便用户从中选择目标设备。手机可以根据用户在设备信息中选择某一大屏设备(如图7所示大屏设备1)的操作，确定目标设备。
S704、手机与目标设备建立用于远程输入的无线连接。
作为一种示例，手机与目标设备可以通过各自的辅助模块建立用于远程输入的无线连接。以图6中的(a)所示结构的手机和图6中的(b)所示结构的目标设备为例，上述手机通过自己的辅助模块与目标设备的辅助模块建立用于远程输入的无线连接。
示例性的，对于手机与目标设备分布式组网的情况，手机的辅助模块1可以通过远程过程调用(remote procedure call，RPC)与目标设备的辅助模块2建立无线连接。即，所述手机与所述目标设备建立基于RPC协议的无线连接。关于RPC的介绍，可以参考常规技术中的解释和说明，本申请实施例不做赘述。
S705、目标设备向手机发送请求信息，用于请求手机向目标设备的默认焦点框远程输入。
以图6中的(a)所示结构的手机和图6中的(b)所示结构的目标设备为例，目标设备可以通过辅助模块2向手机的辅助模块1发送请求信息。例如，对于手机与目标设备分布式组网的情况，目标设备的辅助模块2可以通过RPC向手机的辅助模块1发送请求信息。
其中，上述请求信息包括目标设备的默认焦点框的标识信息(如编辑框标识(identity，ID))和默认焦点框的数据通道接口。其中，数据通道接口用于远程输入。
在一些实施例中，假设目标设备的界面仅包括一个编辑框，则默认焦点框即该编辑框。对于这种情况，在步骤S705之前，目标设备的辅助模块2还用于使该编辑框获焦，即辅助模块2还用于将该编辑框设置为默认焦点框。
在另一些实施例中，假设目标设备的界面包括多个编辑框，则作为一种情况，则默认焦点框可以是目标设备的界面上的第一个编辑框。示例性的，目标设备可以根据多个编辑框在预设坐标系中的坐标值确定第一个编辑框。例如预设坐标系的坐标原点可以是目标设备的屏幕的左下角，预设坐标系的x轴可以是目标设备的屏幕的下边缘，预设坐标系的y轴可以是目标设备的屏幕的左边缘。例如第一个编辑框可以是多个编辑框中，同时满足x坐标值最小且y坐标值最大的编辑框。对于这种情况，在步骤S705之前，目标设备的辅助模块2还用于使该第一个编辑框获焦，即辅助模块2还用于将第一个编辑框设置为焦点框
作为另一种情况，默认焦点框还可以是目标设备的界面上的优先级最高的编辑框。示例性的，上述优先级可以由目标设备的辅助模块2基于多个编辑框的位置信息，或，历史输入频次，或，默认设置信息等信息中至少一个确定。
或者，默认焦点框还可以基于其他规则或原则确定，对于手机与目标设备建立用于远程输入的无线连接之后的初始焦点框(即默认焦点框)的具体设定规则，本申请不做限定。
需要说明的是，在本申请实施例中，默认焦点框对于用户可以是可见的，以便用户随时知道要向哪一个编辑框输入信息。例如，默认焦点框可以以编辑框高亮、编辑框内显示光标、编辑框加粗(如图8所示)等形式对用户可见。
S706、手机显示远程输入界面。
其中，远程输入界面用于用户通过编辑向默认焦点框输入信息。示例性的，远程输入界面包括输入框和输入法窗口。
本申请实施例提供一种跨设备输入方法，该方法可以基于单个设备(如手机04)发起向大屏设备的远程输入，而不会对其他强输入能力设备造成干扰，用户体验佳。
如图7所示，在手机执行步骤S706之后，对于用户直接通过手机向目标设备的默认焦点框输入信息的情况，手机执行以下步骤S707-1：
S707-1、响应于接收到用户在输入框中输入的信息，手机向目标设备发送用户在输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框。
以图6中的(a)所示结构的手机和图6中的(b)所示结构的目标设备为例，手机可以通过辅助模块1向目标设备的辅助模块2发送用户在输入框中输入的信息，以便辅助模块2向目标设备的默认焦点框输入对应信息。
请参考图8，图8以目标设备的界面包括多个编辑框为例，示出了一种跨设备输入示例。如图8中的(a)所示，默认焦点框是编辑框1，远程输入界面包括图8中的(a)所示输入框801和输入法窗口802。如图8中的(b)所示，手机04可以根据用户在输入法窗口802中的操作，向输入框801中编辑的文字，向编辑框1输入用户名(如图8中的(b)所示“太阳”)。
在一些实施例中，远程输入界面还可以包括至少一个选项。该至少一个选项用于用户进行焦点框切换，即用于用户调整目标设备上的焦点框。示例性的，对于目标设备的界面包括多个编辑框的情况，远程输入界面还可以用于用户在多个编辑框中任意切换焦点框。
在一些实施例中，上述至少一个选项包括用于切换下一个编辑框的选项和用于切换上一个编辑框的选项。如图8所示，手机04上的远程输入界面包括“上一个”和“下一个”按钮，用于用户进行焦点框切换。以避免需要使用遥控器先进行焦点框切换，再重新在手机侧确认的繁琐流程。其中，“上一个”按钮用于切换上一个优先级的编辑框的，“下一个”按钮用于切换下一个优先级的编辑框。
作为另一种示例，在用户在图8所示远程输入界面上向编辑框1输入用户名之后，假设用户想要向其它编辑框输入信息，则如图9所示，在手机执行步骤S707-1之后，本申请实施例提供的跨设备输入方法还包括以下步骤S708-1、S709-1和S710-1：
S708-1、响应于用户更换焦点框的操作，手机向目标设备发送焦点框切换信息。
其中，焦点框切换信息用于指示切换焦点框。焦点框切换信息包括切换后的焦点框的标识信息(如ID)。
在一些实施例中，手机侧可以保存有编辑框信息。其中，该编辑框信息包括目标设备界面上每一个编辑框的ID和每一个编辑框的优先级。响应于用户更换焦点框的操作，手机可以根据该编辑框信息确定切换后的焦点框的ID，并通过焦点框切换信息发送给目标设备。
示例性的，以图8所示目标设备界面为例，手机侧保存的编辑框信息可以如以下表1所示：
表1
编辑框ID 优先级
编辑框1的ID 1
编辑框2的ID 2
编辑框3的ID 3
编辑框4的ID 4
例如，假设用户更换焦点框的操作是在图8所示目标设备界面和手机远程输入界面情况下，用户单击远程输入界面上的“下一个”按钮的操作，则手机根据手机侧保存的编辑框信息确定当前焦点框(即编辑框1)的下一个优先级的编辑框为编辑框2，则手机可以确定切换后的焦点框的ID为编辑框2的ID。
又如，假设图8所示目标设备的当前焦点框是编辑框3，用户更换焦点框的操作在图8所示手机远程输入界面上，用户单击“上一个”按钮的操作，则手机根据手机侧保存的编辑框信息确定当前焦点框(即编辑框3)的上一个优先级的编辑框为编辑框2， 则手机可以确定切换后的焦点框的ID为编辑框2的ID。
需要说明的是，上述手机侧保存的编辑框信息可以由手机自行计算得到，也可以由目标设备指定，还可以由开发者预先设置在手机中，本申请不限定。
例如，在步骤S704手机与目标设备建立用于远程输入的无线连接之后，目标设备可以向手机发送目标设备界面上多个编辑框的标识信息(如编辑框ID)和多个编辑框的位置信息，用于手机根据多个编辑框的位置信息确定多个编辑框的优先级。示例性的，编辑框的位置信息可以是编辑框在预设坐标系中的坐标值。
以预设坐标系的坐标原点是目标设备的屏幕的左下角，预设坐标系的x轴是目标设备的屏幕的下边缘，预设坐标系的y轴是目标设备的屏幕的左边缘为例，示例性的，编辑框的y轴坐标值越大，x轴坐标值越小，则编辑框的优先级越高。
又如，在步骤S704手机与目标设备建立用于远程输入的无线连接之后，目标设备可以向手机发送目标设备界面上多个编辑框的标识信息(如编辑框ID)和多个编辑框的历史输入数据，用于手机根据多个编辑框的历史输入数据确定多个编辑框的优先级。示例性的，上述多个编辑框的历史输入数据可以包括但不限于预设时间段内，后台统计的多个编辑框的输入频次，默认设置信息中的一种或多种。示例性的，预设时间段内，后台统计的输入频次越高，则编辑框的优先级越高。
又如，在步骤S704手机与目标设备建立用于远程输入的无线连接之后，目标设备可以向手机发送上述编辑框信息。
作为一种实现方式，该编辑框信息由目标设备计算并确定。例如该编辑框信息由目标设备根据多个编辑框的位置信息确定。又如该编辑框信息由目标设备根据多个编辑框的历史输入数据确定。
作为另一种实现方式，该编辑框信息还可以由开发者预先设置在目标设备中。
在本申请实施例中，在进行焦点框切换时，手机04可以根据编辑框信息指示目标设备进行焦点框切换。通过焦点框切换基于优先级这样的方式，可以保证优先级较高的编辑框优先被编辑，提高用户体验。
S709-1、目标设备根据焦点框切换信息切换焦点框。
以图6中的(b)所示结构的目标设备为例，目标设备的辅助模块2在接收到来自手机的焦点框切换信息之后，可以根据焦点框切换信息中携带的切换后的焦点框的标识信息(如ID)切换焦点框。
如图8中的(b)所示，默认焦点框是编辑框1，假设编辑框1下一优先级的编辑框是编辑框2，则手机04可以根据用户在输入框801中单击“下一个”按钮的操作，将焦点框切换为图8中的(c)所示编辑框2。其中，图8中的(c)所示的输入框801用于向切换后的焦点框(即编辑框2)中输入密码。
S710-1、响应于用户在远程输入界面上的输入操作，手机向切换后的焦点框输入信息。
例如，假设用户在图8中的(c)所示的输入框801中输入“123456”，则手机04响应于用户的输入操作，向切换后的焦点框(即编辑框2)中输入该密码123456。
作为另一种示例，对于用户放弃向默认焦点框输入信息，而是更换焦点框的情况，如图10所示，在目标设备执行步骤S706之后，本申请实施例提供的跨设备输入方法 还包括以下步骤S707-2，S708-2和S709-2：
S707-2、响应于用户更换焦点框的操作，手机向目标设备发送焦点框切换信息。
其中，焦点框切换信息用于指示切换焦点框。焦点框切换信息包括切换后的焦点框的标识信息(如ID)。
S708-2、目标设备根据焦点框切换信息切换焦点框。
例如，如图11中的(a)所示，当前焦点框是编辑框1，假设用户放弃在图11中的(a)所示的输入框801中编辑文字，而是单击输入框801中的“下一个”按钮，假设编辑框1下一优先级的编辑框是编辑框2，则手机04可以根据用户在输入框801中单击“下一个”按钮的操作，将焦点框切换为图11中的(b)所示编辑框2。其中，图11中的(b)所示输入框801用于向切换后的焦点框(即编辑框2)中输入密码。
S709-2、响应于用户在远程输入界面上的输入操作，手机向切换后的焦点框输入信息。
例如，假设用户在图11中的(b)所示的输入框801中输入“123456”，则手机04响应于用户的输入操作，向切换后的焦点框(即编辑框2)中输入该密码123456。
关于上述步骤S707-2，S708-2和S709-2的具体介绍，可以分别参考本申请实施例中的上述步骤S708-1、S709-1和S710-1，这里不做赘述。
本申请实施例提供的一种跨设备输入方法对于大屏设备的显示界面包括有多编辑框的情况，可以基于单个设备实现焦点框的任意切换，操作简单，用户体验佳。
需要说明的是，在本申请实施例中，单击图8所示“上一个”和“下一个”按钮仅作为用于更换焦点框的方式示例，本申请不限定更换焦点框的具体方式。
例如，还可以通过按压物理按键(如同时按压电源键和音量键)，预设滑动手势(如向左滑动的手势)等方式更换焦点框。
又如，还可以通过双击图8所示“上一个”或“下一个”按钮，长按图8所示“上一个”或“下一个”按钮等方式更换焦点框。其中，响应于用户双击、长按“上一个”或“下一个”按钮等操作，具体如何更换焦点框，可以根据具体设置而定。
示例性的，在本申请实施例中，上述至少一个选项还可以包括用于跨编辑框切换的选项。
需要说明的是，在本申请实施例中，上述至少一个选项可以是菜单的形式、按钮形式，还可以是预设操作的形式，本申请不限定。例如，通过用户双击或长按“上一个”按钮的操作，可以跨编辑框切换，实现编辑框的跳跃获焦，例如跳跃两个编辑框获焦，又如返回界面上的第一个编辑框。
以图12所示示例为例，如图12中的(a)所示，当前焦点框是编辑框3。假设用户在完成对编辑框3的远程输入之后，想要返回编辑框1修改用户名，假设长按“上一个”按钮的操作用于实现返回界面上的第一个编辑框或者向前跳跃两个编辑框，则如图12中的(b)所示，响应于用户长按“上一个”按钮的操作，手机04指示大屏设备01将界面上的第一个编辑框(即编辑框1)切换为焦点框。其中，图12中的(b)所示输入框801用于编辑切换后的焦点框(即编辑框1)中的用户名。基于图12中的(b)所示界面，用户可以使用手机04进行用户名的远程修改，例如将“太阳”修改为“月亮”。
以图12所示示例为例，可以理解，假设用户在完成对编辑框3的远程输入之后，想要返回编辑框1修改用户名，用户还可以通过单击“上一个”按钮两次的操作使得编辑框1获焦。但是，对于跨设备输入来说，长按“上一个”按钮的操作相比于单击“上一个”按钮两次的操作，可以节省手机04的算力以及手机04与大屏设备01之间的交互。例如，对于单击“上一个”按钮两次的操作，第一次单击“上一个”按钮的操作会触发一次手机04的编辑框ID确定和焦点框切换信息发送；第二次单击“上一个”按钮的操作还会触发又一次手机04的编辑框ID确定和焦点框切换信息发送。而对于长按“上一个”按钮的操作，仅会触发一次手机04的编辑框ID确定和焦点框切换信息发送，因此可以降低操作复杂程度，提高操作效率，以及实现跳跃切换，提高切换效率。
需要说明的是，上述用于跨编辑框切换的操作仅作为示例，本申请实施例对具体触发形式并不做限定。
应理解，本申请实施例的各个方案可以进行合理的组合使用，并且实施例中出现的各个术语的解释或说明可以在各个实施例中互相参考或解释，对此不作限定。
还应理解，在本申请的各种实施例中，上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
可以理解的是，电子设备(如第一设备或第二设备)为了实现上述任一个实施例的功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
本申请实施例可以对电子设备(如第一设备或第二设备)进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
比如，以采用集成的方式划分各个功能模块的情况下，如图13所示，为本申请实施例提供的一种电子设备的结构框图。例如，该电子设备可以是第一设备或第二设备(如目标设备)。如图13所示，该电子设备可以包括收发单元1310、处理单元1320、存储单元1330和显示单元1340。
其中，在电子设备为第一设备时，收发单元1310用于支持第一设备完成上述步骤S704、S705、S707-1、S707-2、S708-1、S709-2、S710-1，和/或与本申请实施例相关的其他过程。处理单元1320用于支持第一设备执行上述步骤S701、S702、S703、S704、S709-1、S708-2，和/或与本申请实施例相关的其他过程。显示单元1340用于支持第一设备执行上述步骤S706，和/或与本申请实施例相关的其他界面。
在电子设备为第二设备(如目标设备)时，收发单元1310用于支持目标设备与第一设备建立无线连接，接收第一设备通过无线连接发送的信息，从第一设备接收焦点 框切换信息，向第一设备发送多个编辑框的位置信息，向第一设备发送多个编辑框的优先级，和/或与本申请实施例相关的其他过程。处理单元1320用于支持第二设备(如目标设备)在收发单元1310与第一设备建立无线连接之后确定默认焦点框，向默认焦点框填充第一设备通过无线连接向默认焦点框发送的信息，将焦点框切换为标识信息对应的编辑框，和/或与本申请实施例相关的其他过程。显示单元1340用于支持第二设备(如目标设备)显示包括至少一个编辑框的界面，和/或与本申请实施例相关的其他界面。
存储单元1330用于存储计算机程序和实现本申请实施例提供的方法中的处理数据和/或处理结果等。
需要说明的是，上述收发单元1310可以包括射频电路。具体的，电子设备(如第一设备或第二设备)可以通过射频电路进行无线信号的接收和发送。通常，射频电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外，射频电路还可以通过无线通信和其他设备通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统、通用分组无线服务、码分多址、宽带码分多址、长期演进、电子邮件、短消息服务等。
应理解，电子设备中的各个模块可以通过软件和/或硬件形式实现，对此不作具体限定。换言之，电子设备是以功能模块的形式来呈现。这里的“模块”可以指特定应用集成电路ASIC、电路、执行一个或多个软件或固件程序的处理器和存储器、集成逻辑电路，和/或其他可以提供上述功能的器件。
在一种可选的方式中，当使用软件实现数据传输时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地实现本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线((digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如软盘、硬盘、磁带)、光介质(例如数字化视频光盘(digital video disk，DVD))、或者半导体介质(例如固态硬盘solid state disk(SSD))等。
结合本申请实施例所描述的方法或者算法的步骤可以硬件的方式来实现，也可以是由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成，软件模块可以被存放于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的存储介质中。一种示例性的存储介质耦合至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息。当然，存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外，该ASIC可以位于电子设备中。当然，处理器 和存储介质也可以作为分立组件存在于电子设备中。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。

Claims (22)

  1. 一种跨设备输入方法，其特征在于，所述方法包括：
    响应于接收到用户用于开启远程输入功能的操作，所述第一设备根据一个或多个第二设备的界面信息确定目标设备，所述目标设备是所述一个或多个第二设备中的一个，所述目标设备的界面上包括一个或多个编辑框；
    所述第一设备与所述目标设备建立无线连接，所述无线连接用于传输所述第一设备向所述目标设备发送的用户输入的信息；
    所述第一设备显示远程输入界面，所述远程输入界面包括输入框以及至少一个选项，所述至少一个选项用于调整所述目标设备上的焦点框。
  2. 根据权利要求1所述的方法，其特征在于，所述第一设备根据一个或多个第二设备的界面信息确定目标设备，包括：
    所述第一设备根据多个第二设备的界面信息显示设备信息，所述多个第二设备中有多个设备的界面上具有编辑框，所述设备信息包括界面具有编辑框的一个或多个第二设备的标识信息；
    所述第一设备根据用户对所述设备信息中标识信息的选择操作，确定所述目标设备。
  3. 根据权利要求1所述的方法，其特征在于，所述一个或多个第二设备中仅有一个设备的界面上具有编辑框，则所述第一设备确定界面上具有编辑框的设备是所述目标设备。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一设备接收用户在所述输入框中输入的信息；
    所述第一设备向所述目标设备发送用户在所述输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框。
  5. 根据权利要求1-4中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一设备响应于接收到用户选择所述至少一个选项中任一个的操作；
    所述第一设备确定切换后的焦点框；
    所述第一设备向所述目标设备发送焦点框切换信息，所述焦点框切换信息包括所述切换后的焦点框的标识信息。
  6. 根据权利要求5所述的方法，其特征在于，所述第一设备确定切换后的焦点框，包括：
    所述第一设备根据编辑框信息确定所述切换后的焦点框；所述编辑框信息包括多个编辑框的优先级。
  7. 根据权利要求6所述的方法，其特征在于，所述目标设备的界面上包括多个编辑框；所述方法还包括：
    所述第一设备从所述目标设备接收所述多个编辑框的位置信息；
    所述第一设备根据所述多个编辑框的位置信息确定所述多个编辑框的优先级。
  8. 根据权利要求6所述的方法，其特征在于，所述方法还包括：
    所述第一设备从所述目标设备接收所述编辑框信息。
  9. 根据权利要求1-8中任一项所述的方法，其特征在于，所述至少一个选项包 括用于切换下一个编辑框的选项或用于切换上一个编辑框的选项中的至少一个。
  10. 根据权利要求1-8中任一项所述的方法，其特征在于，所述至少一个选项包括用于跨编辑框切换的选项。
  11. 一种跨设备输入方法，其特征在于，应用于目标设备，所述目标设备的界面上包括一个或多个编辑框；所述方法包括：
    所述目标设备在与第一设备建立无线连接之后，确定默认焦点框；所述无线连接用于所述第一设备向所述目标设备发送用户输入的信息；
    所述目标设备接收所述第一设备通过所述无线连接发送的信息，并将所述信息填充到默认焦点框。
  12. 根据权利要求11所述的方法，其特征在于，所述方法还包括：
    所述目标设备从所述第一设备接收焦点框切换信息，所述焦点框切换信息包括焦点框的标识信息；
    所述目标设备将焦点框切换为所述标识信息对应的编辑框。
  13. 根据权利要求11或12所述的方法，其特征在于，
    所述默认焦点框是所述目标设备的界面上的第一个编辑框；或者，
    所述默认焦点框是所述目标设备的界面上优先级最高的编辑框。
  14. 根据权利要求11-13中任一项所述的方法，其特征在于，所述目标设备的界面上包括多个编辑框；所述方法还包括：
    所述目标设备向所述第一设备发送所述多个编辑框的位置信息；或者，
    所述目标设备向所述第一设备发送所述多个编辑框的优先级。
  15. 一种跨设备输入方法，其特征在于，所述方法包括：
    响应于接收到用户用于开启远程输入功能的操作，所述第一设备根据一个或多个第二设备的界面信息确定目标设备，所述目标设备是所述一个或多个第二设备中的一个，所述目标设备的界面上包括一个或多个编辑框；
    所述第一设备与所述目标设备建立无线连接，所述无线连接用于传输所述第一设备向所述目标设备发送的用户输入的信息；
    所述目标设备确定默认焦点框；
    所述第一设备显示远程输入界面，所述远程输入界面包括输入框以及至少一个选项，所述至少一个选项用于调整所述目标设备上的焦点框。
  16. 根据权利要求15所述的方法，其特征在于，所述方法还包括：
    所述第一设备接收用户在所述输入框中输入的信息；
    所述第一设备向所述目标设备发送用户在所述输入框中输入的信息，用户在所述输入框中输入的信息用于填充到所述目标设备的默认焦点框；
    所述目标设备将所述信息填充到默认焦点框。
  17. 根据权利要求15或16所述的方法，其特征在于，所述方法还包括：
    所述第一设备响应于接收到用户选择所述至少一个选项中任一个的操作；
    所述第一设备确定切换后的焦点框；
    所述第一设备向所述目标设备发送焦点框切换信息，所述焦点框切换信息包括所述切换后的焦点框的标识信息；
    所述目标设备将焦点框切换为所述标识信息对应的编辑框。
  18. 根据权利要求15-17中任一项所述的方法，其特征在于，所述目标设备的界面上包括多个编辑框；所述方法还包括：
    所述目标设备向所述第一设备发送所述多个编辑框的位置信息；或者，
    所述目标设备向所述第一设备发送所述多个编辑框的优先级。
  19. 一种第一设备，其特征在于，所述第一设备包括：
    显示屏；
    一个或多个处理器；
    一个或多个存储器；
    所述存储器存储有一个或多个程序，当所述一个或者多个程序被所述一个或多个处理器执行时，使得所述第一设备执行权利要求1至10中任一项所述的方法。
  20. 一种目标设备，其特征在于，所述目标设备包括：
    显示屏；
    一个或多个处理器；
    一个或多个存储器；
    所述存储器存储有一个或多个程序，当所述一个或者多个程序被所述一个或多个处理器执行时，使得所述目标设备执行权利要求11-14中任一项所述的方法。
  21. 一种通信系统，其特征在于，所述通信系统包括：
    如权利要求19所述的第一设备；以及，
    如权利要求20所述的目标设备。
  22. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有计算机程序代码，所述计算机程序代码被处理电路执行时实现如权利要求1-10或权利要求11-14中任一项所述的方法。
PCT/CN2022/109475 2021-08-03 2022-08-01 一种跨设备输入方法、设备及系统 WO2023011418A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110888389.8 2021-08-03
CN202110888389.8A CN115705128A (zh) 2021-08-03 2021-08-03 一种跨设备输入方法、设备及系统

Publications (1)

Publication Number Publication Date
WO2023011418A1 true WO2023011418A1 (zh) 2023-02-09

Family

ID=85154439

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/109475 WO2023011418A1 (zh) 2021-08-03 2022-08-01 一种跨设备输入方法、设备及系统

Country Status (2)

Country Link
CN (1) CN115705128A (zh)
WO (1) WO2023011418A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020067338A1 (en) * 2000-04-24 2002-06-06 Microsoft Corporation Method for activating an application in context on a remote input/output device
CN102638716A (zh) * 2012-03-21 2012-08-15 华为技术有限公司 实现移动终端遥控电视的方法、装置和系统
CN104375666A (zh) * 2014-12-11 2015-02-25 上海触乐信息科技有限公司 跨设备的输入方法、处理装置、输入设备及智能显示设备
WO2017190233A1 (en) * 2016-05-05 2017-11-09 Nanoport Technology Inc. Cross-device interaction verification
CN110417992A (zh) * 2019-06-20 2019-11-05 华为技术有限公司 一种输入方法、电子设备和投屏系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020067338A1 (en) * 2000-04-24 2002-06-06 Microsoft Corporation Method for activating an application in context on a remote input/output device
CN102638716A (zh) * 2012-03-21 2012-08-15 华为技术有限公司 实现移动终端遥控电视的方法、装置和系统
CN104375666A (zh) * 2014-12-11 2015-02-25 上海触乐信息科技有限公司 跨设备的输入方法、处理装置、输入设备及智能显示设备
WO2017190233A1 (en) * 2016-05-05 2017-11-09 Nanoport Technology Inc. Cross-device interaction verification
CN110417992A (zh) * 2019-06-20 2019-11-05 华为技术有限公司 一种输入方法、电子设备和投屏系统

Also Published As

Publication number Publication date
CN115705128A (zh) 2023-02-17

Similar Documents

Publication Publication Date Title
US11861161B2 (en) Display method and apparatus
WO2020244495A1 (zh) 一种投屏显示方法及电子设备
WO2021078284A1 (zh) 一种内容接续方法及电子设备
WO2018113675A1 (zh) 视频播放的方法及终端设备
US9100541B2 (en) Method for interworking with dummy device and electronic device thereof
CN113676269B (zh) 电子设备的数据传输方法及其介质和电子设备
WO2023179425A1 (zh) 一种输入设备的连接方法、设备及系统
KR20170099665A (ko) 디스플레이 장치 및 디스플레이 장치의 동작 채널 설정방법
US11349976B2 (en) Information processing method, file transmission method, electronic apparatus, and computing apparatus
WO2023279882A1 (zh) 一种可穿戴设备控制电子设备的方法及通信系统
CN113672133A (zh) 一种多指交互方法及电子设备
WO2022135186A1 (zh) 设备控制方法和终端设备
CN111435318A (zh) 应用程序的dex优化方法及终端
EP3968671B1 (en) Method for information transmission and electronic device
WO2024037025A1 (zh) 无线通信电路、蓝牙通信切换方法和电子设备
WO2023011418A1 (zh) 一种跨设备输入方法、设备及系统
KR102648102B1 (ko) 전자 장치와 외부 서버 간에 어플리케이션 프로그램에 관한 작업 환경을 제공하는 방법 및 장치
WO2022247638A1 (zh) 一种手写笔的连接控制方法和电子设备
WO2022135163A1 (zh) 一种投屏显示方法及电子设备
WO2022206848A1 (zh) 一种应用小部件的显示方法及设备
KR20160115699A (ko) 디바이스 대 디바이스 방식을 지원하는 통신 시스템에서 디바이스 대 디바이스 탐색 메시지 송신 장치 및 방법
CN114900737A (zh) 视频进度调整方法及电子设备
CN108563752B (zh) 数据交互方法、装置、终端设备及存储介质
US20160188281A1 (en) System and method for external display
WO2023066036A1 (zh) 一种跨设备文件显示方法、设备及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22852130

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE