WO2022206515A1 - 辅助输入方法、电子设备以及系统 - Google Patents

辅助输入方法、电子设备以及系统 Download PDF

Info

Publication number
WO2022206515A1
WO2022206515A1 PCT/CN2022/082534 CN2022082534W WO2022206515A1 WO 2022206515 A1 WO2022206515 A1 WO 2022206515A1 CN 2022082534 W CN2022082534 W CN 2022082534W WO 2022206515 A1 WO2022206515 A1 WO 2022206515A1
Authority
WO
WIPO (PCT)
Prior art keywords
auxiliary
information
assisted
input
electronic device
Prior art date
Application number
PCT/CN2022/082534
Other languages
English (en)
French (fr)
Inventor
刘洋
李�真
杨云帆
李思玙
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022206515A1 publication Critical patent/WO2022206515A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0227Cooperation and interconnection of the input arrangement with other functional units of a computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present application relates to the technical field of terminals and communications, and in particular, to an auxiliary input method, an electronic device, and a system.
  • the user may interact with the large-screen electronic device through some other electronic device (eg, a remote control). For example, a user can input information in an input box of a large-screen electronic device through a remote control.
  • a remote control when more information needs to be input to a large-screen device, using a remote control will result in low input efficiency.
  • a user can use an electronic device with friendly input experience (such as a mobile phone) as an auxiliary device to assist a large-screen device to complete input.
  • the information input to the large-screen device is completed by inputting the information in the mobile phone and then displaying it on the large-screen device.
  • the large-screen device in the prior art can only perform auxiliary input through an auxiliary device, and the auxiliary device can send the information displayed in the input box to the screen-emitting device.
  • the auxiliary device starts other processes, the auxiliary input cannot be performed.
  • large-screen devices still need to use the remote control for information input.
  • the present application provides an auxiliary input method, electronic device and system.
  • the first auxiliary device can perform auxiliary input with the assisted device, and send the first information displayed in the input box of the local machine to the assisted device.
  • the assisted device can send the information displayed in the focus display box to the second auxiliary device that is idle in the device group, and then perform auxiliary input with the second auxiliary device.
  • the present application provides an assisting method, comprising: an assisting device displaying first information sent by a first assisting device in a focus input box; when the assisting device determines that the device state of the first assisting device is switched to When busy, the assisted device sends the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or information obtained by processing the first information; the The second auxiliary device is the auxiliary device with the highest priority among the auxiliary devices whose device status is idle in the device group; the auxiliary device displays the third information sent by the second auxiliary device in the focus input box, so The third information is the second information or information obtained by processing according to the second information.
  • the first auxiliary device has already performed auxiliary input with the auxiliary device, and has sent the information in the input box of the local machine to the auxiliary device.
  • the assisted device can perform auxiliary input with the second auxiliary device, and can send the second information displayed in the focus display box to the second auxiliary device, and the second auxiliary device can display the first auxiliary device in the input box.
  • Second information on the basis of the second information, the second information is processed, and then the processed information can be sent to the assisted device. In this way, as long as there is an idle auxiliary device in the device group, the auxiliary device can be assisted for input.
  • the second information is the first information or information obtained by processing the first information, specifically including: when the assisted electronic device does not process the first information , the first information is the same as the second information; when the assisted electronic device processes the first information, the first information is different from the second information.
  • the assisted device may process the first information, such as deleting, adding, etc., to change the content of the first information, and obtain the second information.
  • the method further includes: the auxiliary device sends an auxiliary input request to the first auxiliary device.
  • the method before the assisted device displays the first information sent by the first auxiliary device in the focus input box, the method further includes: when the assisted device receives the device status of the first auxiliary device as busy information, the assisted device updates the device state of the first auxiliary device as busy in the device state information.
  • the assisted device records the device state of the auxiliary device in the device group by using the device state information, so that the state of the auxiliary device can be easily found.
  • the method before the assisted device sends the second information displayed in the focus input box to the second auxiliary device, the method further includes: in the assisted device updating the device status information, the first The device state of the second auxiliary device is idle.
  • the assisted device records the device state of the auxiliary device in the device group by using the device state information, so that the state of the auxiliary device can be conveniently updated.
  • the assisted device displays the first information sent by the first auxiliary device in the focus input box, which specifically includes: the assisted device determines a focus input box, and the focus input box is used for displaying information; The assisted device receives the first information sent by the first auxiliary device, and the first information is all the information displayed in the input box of the assisted device; the assisted device displays all the information in the focus input box. the first information.
  • the auxiliary device can send the information displayed in the input box to the assisted device in real time, and the auxiliary device sends all the information displayed in the input box to the assisted device.
  • the assistive device can display this information in the focus display box.
  • the assisted device sending the second information displayed in the focus input box to the second auxiliary device specifically includes: the assisted device sending the second information displayed in the focus input box to the second auxiliary device.
  • Second auxiliary device, the second information is all the information displayed in the focus input box.
  • the assisted device can send all the information in the focus display frame to the second auxiliary device, so that the second auxiliary device can obtain the information in the focus display frame of the assisted device, and then process the information, Continue to make auxiliary input with the assisted device.
  • the method further includes: the assisted device receives the device status of the first auxiliary device When the information is idle, the assisted device updates the device state of the first auxiliary device in the device state information to be idle; the assisted device sends an auxiliary input switching request to the second auxiliary device; the auxiliary device The input switching request is used to ask the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle An auxiliary device; the assisted device continues to perform auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.
  • the assisted device when the electronic device with the highest device priority in the device group is in an idle state, the assisted device can send an auxiliary input switching request to the auxiliary device that is currently performing auxiliary input with it, hoping to switch to the device priority
  • the highest auxiliary equipment is used for auxiliary input, which can maximize the efficiency of auxiliary input.
  • the assisted device continues to perform auxiliary input with the second auxiliary device or performs auxiliary input with the first auxiliary device, which specifically includes: when the assisted device receives an information sent by the second auxiliary device When switching to the information of the first auxiliary device for auxiliary input, the assisted device selects the first auxiliary device for auxiliary input; when the assisted device receives the information sent by the second auxiliary device, it does not switch to the first auxiliary device.
  • the assisted device continues to perform auxiliary input with the second auxiliary device.
  • the method further includes: when the first auxiliary device refuses to perform auxiliary input with the assisted device, then The assisted device continues to perform auxiliary input with the second auxiliary device.
  • the auxiliary device can refuse to perform auxiliary input with the assisted device, so that the safety of the auxiliary device can be guaranteed.
  • the assisted device when the first auxiliary device refuses to perform auxiliary input with the assisted device, the assisted device continues to perform auxiliary input with the second auxiliary device, which specifically includes: when the first auxiliary device refuses to perform auxiliary input with the assisted device.
  • the auxiliary device does not respond within a period of time after receiving the assistance request from the assisted device, the assisted device continues to perform auxiliary input with the second auxiliary device.
  • the assisted device can select other auxiliary devices to be the auxiliary device, which makes the auxiliary input more intelligent and efficient.
  • the present application provides an assisted device, the assisted device comprising: a memory and one or more processors; the memory is coupled to the one or more processors, and the memory is used for storing Computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the assisted device to execute: displaying the first information sent by the first auxiliary device in the focus input box ; When it is determined that the device state of the first auxiliary device is switched to busy, send the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or is processed according to the first information The obtained information; the second auxiliary device is the auxiliary device with the highest priority among the auxiliary devices whose device status is idle in the device group; the third information sent by the second auxiliary device is displayed in the focus input box, The third information is the second information or information obtained by processing according to the second information.
  • the first auxiliary device has already performed auxiliary input with the auxiliary device, and has sent the information in the input box of the local machine to the auxiliary device.
  • the assisted device can perform auxiliary input with the second auxiliary device, and can send the second information displayed in the focus display box to the second auxiliary device, and the second auxiliary device can display the first auxiliary device in the input box.
  • Second information on the basis of the second information, the second information is processed, and then the processed information can be sent to the assisted device. In this way, as long as there is an idle auxiliary device in the device group, the auxiliary device can be assisted for input.
  • the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to execute: when the first information is not processed, the first information and the The second information is the same; when the first information is processed, the first information and the second information are different.
  • the one or more processors are further configured to invoke the computer instructions to cause the auxiliary device to execute: Sending an auxiliary input request to the first auxiliary device.
  • the one or more processors are further configured to invoke the computer instructions to cause the auxiliary device to execute: When receiving the information that the device state of the first auxiliary device is busy, the device state of the first auxiliary device is updated to be busy in the device state information.
  • the one or more processors are further configured to invoke the computer instructions to cause the auxiliary device to execute : In updating the device state information, the device state of the second auxiliary device is idle.
  • the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: determine a focus input box, the focus input box is used to display information; receive the The first information sent by the first auxiliary device is all the information displayed in the input box of the assisted device; the first information is displayed in the focus input box.
  • the one or more processors are specifically configured to invoke the computer instructions to cause the auxiliary device to execute: send the second information displayed in the focus input box to the second auxiliary device,
  • the second information is all the information displayed in the focus input box.
  • the one or more processors are further configured to invoke the computer instructions to cause the auxiliary device to execute : when receiving the information that the device state of the first auxiliary device is idle, update the device state of the first auxiliary device as idle in the device state information; send an auxiliary input switching request to the second auxiliary device; the auxiliary device The input switching request is used to ask the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle Auxiliary device; continue to perform auxiliary input with the second auxiliary device or select the first auxiliary device for auxiliary input.
  • the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to execute: switching to the first auxiliary device when receiving the information sent by the second auxiliary device.
  • auxiliary input information select the first auxiliary device to perform auxiliary input; when receiving the information sent by the second auxiliary device not to switch to the first auxiliary device for auxiliary input, continue to perform auxiliary input with the second auxiliary device.
  • Auxiliary input select the first auxiliary device to perform auxiliary input; when receiving the information sent by the second auxiliary device not to switch to the first auxiliary device for auxiliary input, continue to perform auxiliary input with the second auxiliary device.
  • the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: when the first auxiliary device is used When the auxiliary device refuses to carry out auxiliary input with the assisted device, it continues to carry out auxiliary input with the second auxiliary device.
  • the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to execute: when the first auxiliary device receives assistance from the assisted device When there is no response within a period of time after the request, the auxiliary input with the second auxiliary device is continued.
  • an embodiment of the present application provides an auxiliary input method, including: a first auxiliary device sending first information to an assisted device; the first information is all information displayed in an input box of the first auxiliary device ; the assisted device displays the first information sent by the first auxiliary device in the focus input box; when the assisted device determines that the device state of the first auxiliary device is switched to busy, the assisted device Send the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or the information processed according to the first information; the second auxiliary device is a device group The auxiliary device with the highest priority among the auxiliary devices whose device status is idle; the auxiliary device displays the third information sent by the second auxiliary device in the focus input box, and the third information is the first auxiliary device. Second information or information obtained by processing according to the second information.
  • the method further includes: the auxiliary device sends an auxiliary input request to the first auxiliary device equipment.
  • the first auxiliary device receives an auxiliary input request sent by the auxiliary device.
  • the method further includes: the first auxiliary device notifies the assisted device of the local machine The device status of the assisted device is busy; when the assisted device receives the information that the device state of the first auxiliary device is busy, the assisted device updates the device state of the first auxiliary device as busy in the device state information.
  • the method further includes: the second auxiliary device notifies the assisted device The device state of the device itself is idle; in the device state information updated by the assisted device, the device state of the second auxiliary device is idle.
  • the assisted device displays the first information sent by the first auxiliary device in the focus input box, which specifically includes: the assisted device determines a focus input box, and the focus input box is used to display the first information sent by the first auxiliary device. information; the first auxiliary device sends the first information to the assisted device; the assisted device receives the first information sent by the first auxiliary device, and the first information is displayed in the input box of the assisted device all the information; the assisted device displays the first information in the focus input box.
  • the assisted device sends the second information displayed in the focus input box to the second auxiliary device, which specifically includes: the assisted device sends the second information displayed in the focus input box sent to the second auxiliary device, the second information is all the information displayed in the focus input box; the second auxiliary device receives the second information; the second auxiliary device displays the information in the input box second information.
  • the method further includes: the first auxiliary device notifies the assisted device The device state of the device itself is idle; when the assisted device receives the information that the device state of the first auxiliary device is idle, the assisted device updates the device state of the first auxiliary device in the device state information to be Idle; the assisted device sends an auxiliary input switching request to the second auxiliary device; the auxiliary input switching request is used to ask the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; the The second auxiliary device receives the auxiliary device switching request; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle; the assisted device continues to communicate with the first auxiliary device.
  • the second auxiliary device performs auxiliary input or the first auxiliary device is selected for auxiliary input.
  • the assisted device continues to perform auxiliary input with the second auxiliary device or performs auxiliary input with the first auxiliary device, specifically including: the second auxiliary device notifies the assisted device to switch to The first auxiliary device performs auxiliary input; when the assisted device receives the information of switching to the first auxiliary device for auxiliary input sent by the second auxiliary device, the assisted device selects the first auxiliary device The device performs auxiliary input; the second auxiliary device notifies the auxiliary device and does not switch to the first auxiliary device for auxiliary input; when the auxiliary device receives the information sent by the second auxiliary device, it does not switch to the first auxiliary device.
  • the assisted device continues to perform auxiliary input with the second auxiliary device.
  • the present application provides a system, the system includes: an assisted device, a first auxiliary device, and a second auxiliary device; the assisted device, the first auxiliary device, and the second auxiliary device include: a memory, a first auxiliary device, and a second auxiliary device.
  • the first auxiliary device sends first information to the assisted device; the first information is an input to the first auxiliary device All information displayed in the box; the assisted device displays the first information sent by the first auxiliary device in the focus input box; when the assisted device determines that the device status of the first auxiliary device is switched to busy, The assisted device sends the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or information processed according to the first information; the second auxiliary device
  • the device is the auxiliary device with the highest priority among the auxiliary devices whose device status is idle in the device group; the auxiliary device displays the third information sent by the second auxiliary device in the focus input box, and the third auxiliary device displays the third information sent by the second auxiliary device.
  • the information is the second
  • the present application provides a system-on-chip, the system-on-chip is applied to an electronic device, the system-on-chip includes one or more processors, and the processors are configured to invoke computer instructions to cause the electronic device to execute the The method of any of claims 1-11.
  • the present application provides a computer program product comprising instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute any one of claims 1-11 the method described.
  • the present application provides a computer-readable storage medium, comprising instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to perform any one of claims 1-11 the method described.
  • the assisted device provided by the second aspect the method provided by the third aspect, the system provided by the fourth aspect, the chip system provided by the fifth aspect, the computer program product provided by the sixth aspect, and the computer program product provided by the seventh aspect.
  • All computer-readable storage media are used to execute the methods provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.
  • FIG. 1 is a schematic diagram of a device group provided by an embodiment of the present application.
  • FIGS. 2a-2c are schematic diagrams of device states of an electronic device provided by an embodiment of the present application.
  • 3a-3c are schematic diagrams of a scenario of an auxiliary input method in a solution provided by an embodiment of the present application.
  • 4a and 4b are schematic diagrams of a scene of an auxiliary input method in an embodiment of the present application.
  • 5a-5k are a set of exemplary user interfaces of the assistance method provided by the embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of a communication system 100 provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a hardware structure of a first electronic device provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a hardware structure of a second electronic device provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of signaling interaction of application scenario 1 provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of an interactive information flow of application scenario 1 provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of signaling interaction of application scenario 2 provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • multiple electronic devices are first connected through a network to form a distributed collaboration scenario. Then, after the multiple electronic devices complete the input method collaboration, a device group can be formed. Specifically, the assisted device can send an input method coordination request to each auxiliary device. After the auxiliary device receives the request, the input method of the auxiliary device can cooperate with the input method of the assisted device to complete the same information input. It may include text information, image information, etc., which is not limited in this embodiment of the present application.
  • the auxiliary device refers to an electronic device that can directly complete the information input by the machine, such as a mobile phone, a tablet computer, and the like.
  • Assisted devices refer to electronic devices that are not efficient when inputting information through the machine, but can complete information input through auxiliary devices, such as smart screens.
  • the device group includes two or more auxiliary devices, and one or more auxiliary devices.
  • the auxiliary devices in the device group can assist the assisted device in inputting by using the auxiliary input method in this embodiment of the present application.
  • the device group can be composed in many ways:
  • multiple electronic devices logged into the same network account can be set to form a distributed collaboration scenario, and then, after the multiple electronic devices complete the input method collaboration, they can form a device group.
  • multiple electronic devices in the same local area network can be set to form a distributed collaboration scenario, and then, after the multiple electronic devices complete the input method collaboration, they can form a device group.
  • multiple electronic devices with the same specific identifier can be set to form a distributed collaboration scenario, and then, after the multiple electronic devices complete the input method collaboration, they can form a device group.
  • a device group may also be obtained by combining the above-mentioned manners of forming a device group.
  • FIG. 1 is a schematic diagram of a device group in an embodiment of the present application.
  • the device group includes multiple electronic devices such as smart screens, mobile phones, and tablet computers.
  • smart screens are assisted devices, and mobile phones, tablet computers, etc. are auxiliary devices.
  • Mobile phones and tablet computers can assist the smart screen for input.
  • the device status of the electronic device includes: busy, idle, and input.
  • auxiliary input cannot be performed.
  • the electronic device starts other processes that cannot be simultaneously performed with the auxiliary input, the electronic device is busy, such as a call process, a chat process, and the like.
  • FIG. 2a shows a schematic diagram of an exemplary user interface when the device state of the electronic device is busy.
  • the electronic device starts the call process and cannot assist the assisted device in inputting.
  • auxiliary input can be performed, but the electronic device does not perform auxiliary input at this time. For example, when the electronic device does not have any processes started.
  • FIG. 2b shows a schematic diagram of an exemplary user interface when the device state of the electronic device is idle.
  • the electronic device displays a home screen, and no other processes are started.
  • the electronic device status of the electronic device When the device status of the electronic device is input, it means that the electronic device is performing auxiliary input.
  • FIG. 2c shows a schematic diagram of an exemplary user interface when the device state of the electronic device is inputting.
  • the input method of the electronic device is turned on, and auxiliary input is being performed.
  • the device state information is used to indicate the correspondence between the identifiers of the auxiliary devices in the device group and the device states.
  • the device state information may be stored in the memory of the assisted device.
  • the identifier of the auxiliary device is used to uniquely identify an auxiliary device in the device group.
  • the identifier of the auxiliary device may be one of a device name, a physical address of the device, a mobile equipment identifier (MEID), an international mobile equipment identity (IMEI), or a combination thereof, etc. , which is not limited here.
  • MEID mobile equipment identifier
  • IMEI international mobile equipment identity
  • Table 1 is an example of the state information of the device in the embodiment of the application:
  • the device status information shown in Table 1 it can be determined that: the device status of device 1 is busy; the device status of device 2 is idle and the device status of device 3 is input.
  • the auxiliary device when the device state of any auxiliary device in the device group is updated from other states to busy, the auxiliary device may be triggered to delete the information of the auxiliary device in the device state information.
  • the auxiliary device when the device state of any auxiliary device in the device group is updated from other states to busy, the auxiliary device may be triggered to delete the information of all auxiliary devices whose device states are busy in the device state information.
  • the assisted device may periodically acquire the device information, and delete the information of the auxiliary device in which the device status is busy.
  • the auxiliary device when any auxiliary device in the device group exits the device group, the auxiliary device may be triggered to delete the information of the auxiliary device in the device state information.
  • Table 1 is only an exemplary illustration of the device status information.
  • the device status information can also be stored in many other different forms, such as arrays, matrices, databases, etc., which are implemented in this application. The example does not limit this.
  • the assisted device may set the initial device state of the auxiliary device of the device group to busy green.
  • the device priority information is used to indicate the correspondence between the identifiers of the electronic devices in the device group and the device priorities.
  • the device priority information may be stored in the memory of the assisted device.
  • the device priority refers to the order of auxiliary input between the assisted electronic device and the auxiliary electronic device.
  • the assisted device can only perform auxiliary input with one auxiliary device at a time, and the assisted device can first perform auxiliary input with the assisted electronic device.
  • Auxiliary devices for which the device performs auxiliary input have the highest device priority, and so on.
  • the priority of the first device may be marked as "1", the priority of the second device may be marked as "2", and so on.
  • the device priority may also be expressed in other manners, which is not limited in this embodiment of the present application.
  • the identification of the electronic device has the same meaning as the identification of the auxiliary device, and is used to uniquely identify an electronic device in the device group.
  • Table 2 is an example of the priority information of the device in the embodiment of the application:
  • the device priority information shown in Table 2 it can be determined that the device priority of device 1 is the highest; the device priority of device 2 is next, and the device priority of device 3 is the lowest.
  • the device priority information stored in an auxiliary device may not contain the device priority information of the local device.
  • an assisted device may include local device priority information. This embodiment of the present application does not limit this.
  • Table 2 is only an exemplary illustration of the device priority information. In practical applications, many other different forms can also be used to store the device priority information, such as arrays, matrices, databases, etc. This is not limited in the application examples.
  • Figures 3a-3c exemplarily show a schematic diagram of a scenario of an auxiliary input method in a solution.
  • the first electronic device is an auxiliary device
  • the second electronic device is an auxiliary device
  • the user interface 30a is a search interface of the first electronic device, and an input box 301 may be displayed in the search interface, and the input box 301 is used to display the information that the electronic device has acquired.
  • the user interface 30b is an information input interface of the second electronic device.
  • the information input interface can display an input method keyboard 302 , an input prompt box 303 and an input box 304 .
  • the text information the user wants to input at this time is "you"
  • the text information corresponding to the user's operation can be displayed in the input prompt box 303, for example; " I want you to have time.”
  • the text information 304a of "you” may be displayed in the input box 304 .
  • the second electronic device can send the text information 304a to the first electronic device, and then the text information 304a can be displayed in the input box 301 of the user interface 30a of the first electronic device.
  • the second electronic device accesses the phone.
  • the electronic device can start the call process and display the user interface 32b as shown in FIG. 3c.
  • the second electronic device can make a call, and can no longer assist the first electronic device in inputting.
  • the first electronic device when the device state of the second electronic device is busy, the first electronic device cannot be assisted in inputting. At this time, the first electronic device cannot perform auxiliary input with other auxiliary devices, so the first electronic device can only use the original input mode for input, for example, input through a remote control. As a result, the input efficiency of the first electronic device is low.
  • the assisted electronic device can be assisted in inputting.
  • Fig. 4a and Fig. 4b exemplarily show a scene diagram of the auxiliary input method in the solution involved in the embodiment of the present application.
  • the first electronic device is an auxiliary device
  • the second electronic device is an auxiliary device with the highest device priority
  • the third electronic device is an auxiliary device with a second device priority.
  • the second electronic device initially assists the first electronic device in inputting, and then the second electronic device starts to make a call.
  • the second electronic device can no longer assist the first electronic device in inputting because of the call.
  • the first electronic device may send the text information 401a in the input box 401 displayed in the user interface 40a to the third electronic device of the second device priority.
  • text information 401a may be displayed.
  • the third electronic device can assist the first electronic device to perform input.
  • the third electronic device may display the user interface 41c shown in FIG. 4b , an input box 402 can be displayed in the user interface 41c, text information 411a can be displayed in the input box 402, and the third electronic device can send the text information 411a to the first electronic device, as shown in the user interface 41a in FIG. 4b , the text information 411a can be displayed in the input box 401 of the first electronic device.
  • the second electronic device is in a busy state.
  • the assisted device can select the auxiliary device to perform auxiliary input according to the device priority. As long as the device status of any auxiliary device in the device group is inputting or idle, Can assist assisted equipment with input.
  • 5a-5k are a set of exemplary user interfaces of the auxiliary input method in the embodiment of the present application.
  • the first electronic device is the assisted electronic device
  • the second electronic device is the auxiliary device with the first device priority and the device status is idle
  • the third electronic device is the auxiliary device with the second device priority and the device status is idle equipment.
  • the first electronic device first performs auxiliary input with the second electronic device, and when the device state of the second electronic device is busy, the first electronic device can perform auxiliary input with the third electronic device.
  • the first electronic device may display a user interface 51a as shown in FIG. 5a.
  • a prompt cursor 501a may be displayed in the input box 501, and the prompt cursor 501a is used to prompt the user that the input box 501 has been determined as the focus input box at this time, and when the first electronic device obtains the information, it will be displayed in the input box 501 , and is displayed after the prompt cursor 501a.
  • a prompt box 503 may pop up on the user interface 50b of the second electronic device, and the prompt box 503 may include prompt information 503a, an approval control 503b, and a rejection control 503c.
  • the prompt information 503a is used to prompt the user: "whether you agree to pull up the local input to assist the input of the first electronic device".
  • the consent control 503b is used for the first electronic device to agree to pull up the local input to assist the first electronic device to input.
  • the rejection control 503c is used for the first electronic device to refuse to pull up the local input to assist the first electronic device to input.
  • the second electronic device may display a user interface 51b as shown in FIG. 5b, where an input box 511 may be displayed in the user interface 51b, and the second electronic device
  • the keyboard 512 of the device's input method can be used for inputting text information to the second electronic device, and the input box 511 can be used for the second electronic device to display the text information input by the keyboard 512 .
  • the second electronic device in response to the user's operation on the keyboard 512 (such as a click operation), the second electronic device can display the user interface 52b shown in Fig. 5c, and the input prompt box 521 can display the operation with the user Corresponding text message, for example; "your I want to have time”.
  • the text information 511a of "you” may be displayed in the input box 511 .
  • the second electronic device can send the text information 511a to the first electronic device, and then the text information 511a can be displayed in the input box 501 in the user interface 52a of the first electronic device.
  • the second electronic device is connected to a phone, and in response to the user's operation (eg, a click operation) on the answer control 531a in the caller ID frame 531 of the user interface 53b, the electronic device can initiate a call process, at this time, the device status of the second electronic device is busy, and the user interface 54b as shown in FIG. 5e can be displayed. At this time, the first electronic device may still display the user interface 52a.
  • the user's operation eg, a click operation
  • the third electronic device when the first electronic device and the second electronic device perform auxiliary input, the third electronic device can always display the user interface 50c, and the device state of the third electronic device can always be the same. is idle and cannot perform auxiliary input with the first electronic device.
  • FIG. 5e shows a user interface 54b when the second electronic device is making a call.
  • the device status is switched from input to busy, and the second electronic device can no longer assist the first electronic device to perform input.
  • the first electronic device may continue to display the user interface 52a. Then, the first electronic device may perform auxiliary input with the third electronic device of the second device priority.
  • a prompt box 541 may pop up on the user interface 54c of the third electronic device, and the prompt box 541 may include prompt information 541a, an approval control 541b, and a rejection control 541c.
  • the first electronic device may send the text information 511a displayed in the input box 501 to the third electronic device.
  • the third electronic device may display a user interface 55c as shown in FIG. 5f, in which an input box 551 may be displayed, and the input box may display text information 511a, and the input method of the third electronic device keyboard 552.
  • the first electronic device can still select another auxiliary device for auxiliary input, and send the information displayed in the current focus input box to the other auxiliary device, so that the Other auxiliary devices can continue to perform auxiliary input with the first electronic device on the previous basis.
  • the first electronic device when the first electronic device and the third electronic device perform auxiliary input, and the device state of the second electronic device with the highest device priority is idle, the first electronic device can switch to the second electronic device Carry out auxiliary input, or continue to carry out auxiliary input with the third electronic device.
  • the third electronic device may display the user interface 56c shown in FIG. 5g, and the input prompt box 561 may display the operation with the user Corresponding text information, for example; "their answers”.
  • the text information 511b of "your" may be displayed in the input box 511 .
  • the third electronic device can send the text information 511b to the first electronic device, and then the text information 511b can be displayed in the input box 501 in the user interface 56a of the first electronic device.
  • the second electronic device when the first electronic device and the third electronic device perform auxiliary input, can always display the user interface 54b, which can indicate the device status of the second electronic device. Busy all the time, unable to make auxiliary input with the first electronic device.
  • the second electronic device may end the call process, displaying the user interface 57b shown in Figure 5h.
  • the user interface 57b is the main interface of the second electronic device.
  • the device state of the second electronic device is switched from busy to idle. Since the device priority of the third electronic device is lower than that of the first electronic device, the first electronic device will initiate a switch to the third electronic device A request for auxiliary input to the second electronic device. At this time, the third electronic device may display the user interface 57c as shown in FIG. 5h.
  • a prompt box 571 may pop up in the user interface 57c, and the prompt box 571 may include prompt information 571a, a no control 571b, and a yes control 572c.
  • the prompt information 571a is used to prompt the user: "whether to return to the second electronic device for input".
  • the No control 571b is used by the third electronic device to reject the request of switching to the second electronic device for auxiliary input. This is the request of the control 571c for the third electronic device to agree to switch to the second electronic device for auxiliary input.
  • the third electronic device can continue to perform auxiliary input with the first electronic device in response to the user's operation on the No control 571b (eg, a click operation), for this scenario, reference may be made to the description of FIG. 5i below. If in response to a user's operation on the yes control 571c (such as a click operation), the third electronic device may stop performing auxiliary input with the first electronic device, and then the second electronic device may continue to perform auxiliary input with the first electronic device.
  • This scenario Reference may be made to the following description of Figures 5j and 5k.
  • the third electronic device may display the user interface 58c, continue to obtain text information, and assist the first electronic device in inputting.
  • the first electronic device may display the user interface 56a.
  • the second electronic device continues to display the user interface 54b, and the device state is still idle, and cannot perform auxiliary input with the first electronic device.
  • the first electronic device may display a user interface 56a.
  • the third electronic device can display a user interface 59c, which is the main interface of the third electronic device.
  • the device state of the third electronic device is switched from input to idle, and the third electronic device cannot communicate with the first electronic device.
  • the second electronic device may display the user interface 59b.
  • a prompt box 503 may pop up in the user interface 59b, and the prompt box is used to prompt the user whether to agree to pull up the local input method to assist the input of the first electronic device.
  • the first electronic device may send the text information 511b displayed in the input box 501 to the second electronic device. Then, the second electronic device may display a user interface 510b as shown in FIG. 5k.
  • the user interface 510b is a user interface when the second electronic device assists the first electronic device in inputting, the user interface 510b can display an input box 5101, and the input box 5101 can display the first electronic device sending text message 511b.
  • the first electronic device may continue to display the user interface 56a.
  • the third electronic device may continue to display the user interface 59c.
  • the second electronic device can assist the first electronic device to perform auxiliary input.
  • the first electronic device can select the auxiliary device with the highest device priority for auxiliary input. In this way, the first electronic device can select a more appropriate auxiliary device to improve the efficiency of auxiliary input.
  • FIG. 6 is a schematic structural diagram of a communication system 100 provided by an embodiment of the present application.
  • the communication system 100 includes: a plurality of electronic devices, such as a first electronic device, a second electronic device, a third electronic device, a fourth electronic device, and a server.
  • a plurality of electronic devices such as a first electronic device, a second electronic device, a third electronic device, a fourth electronic device, and a server.
  • the first electronic device in the embodiment of the present application may be a terminal device equipped with Android, Huawei HarmonyOS, iOS, Microsoft, or other operating systems, and the first electronic device can only complete information input through other electronic devices .
  • the first electronic device may serve as the assisted device involved in the embodiments of this application.
  • the second electronic device, the third electronic device and the fourth electronic device may be terminal devices equipped with Android, Huawei HarmonyOS, iOS, Microsoft or other operating systems, and the electronic devices that can directly complete the information input by the machine, Such as mobile phones, tablets, etc.
  • the second electronic device, the third electronic device, and the fourth electronic device may serve as auxiliary devices involved in the embodiments of the present application.
  • the electronic devices in the communication system 100 are all installed with the first APP.
  • the first APP is an input method application.
  • the first APP may provide an information input function.
  • the first APP may be, for example, Huawei's "input method” or the like.
  • the user can log in to the first APP in the electronic device through his or her own identification, for example, the identification may be an account (such as name, Huawei identity (ID), mobile phone number, etc.) and password, face image, voiceprint, fingerprint and many more. After logging in to the first APP, the user can input information to the first electronic device through the first APP.
  • the server is used to provide various services for electronic devices, such as connection services, communication services (data transmission, etc.) and so on.
  • Electronic devices can access servers by accessing the Internet, and electronic devices can use 3G, 4G, 5G and other cellular mobile communication technologies, wide area network (WAN) technology, local area network (LAN) technology or wireless local area network technology ( wireless LAN, WLAN) technology, etc. to communicate with the server.
  • 3G, 4G, 5G and other cellular mobile communication technologies wide area network (WAN) technology, local area network (LAN) technology or wireless local area network technology ( wireless LAN, WLAN) technology, etc. to communicate with the server.
  • WAN wide area network
  • LAN local area network
  • WLAN wireless local area network technology
  • FIG. 7 is a schematic diagram of a hardware structure of a first electronic device provided by an embodiment of the present application.
  • the first electronic device may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations.
  • the various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the first electronic device may include: a processor 122 , a memory 123 , a wireless communication processing module 124 , a power switch 125 , a wired LAN communication processing module 126 , a USB communication processing module 127 and a display screen 128 . in:
  • the processor 122 may be used to read and execute computer readable instructions.
  • the processor 122 may mainly include a controller, an arithmetic unit and a register.
  • the controller is mainly responsible for instruction decoding, and sends out control signals for the operations corresponding to the instructions.
  • the arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logical operations, and can also perform address operations and conversions.
  • Registers are mainly responsible for saving register operands and intermediate operation results temporarily stored during instruction execution.
  • the hardware architecture of the processor 122 may be an application specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, an NP architecture, or the like.
  • ASIC application specific integrated circuit
  • the processor 122 can be used to parse the signals received by the wireless communication processing module 124 and/or the wired LAN communication processing module 126, such as a video call request sent by the first electronic device, a request for capturing an image sequence, and processing a video stream. Request (3D noise reduction, codec, etc.), transmit video stream request, play video stream request, etc.
  • the processor 122 may be configured to perform corresponding processing operations according to the analysis results, such as driving the camera 127 to acquire images according to a video call request, or driving the display screen 128 to perform display according to the display request or display instruction.
  • the processor 122 may also be configured to generate a signal sent by the wireless communication processing module 124 and/or the wired LAN communication processing module 126, such as a signal for starting a video call, a signal for parameter negotiation, and the like.
  • Memory 123 is coupled to processor 122 for storing various software programs and/or sets of instructions.
  • memory 123 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • the memory 123 may store an operating system, such as an embedded operating system such as a real time multi-tasking operation system (uCOS).
  • the memory 123 can also store an auxiliary input program, which can be used to perform auxiliary input with the assisted device and the auxiliary device.
  • the wireless communication processing module 124 may include one or more of a Bluetooth (bluetooth, BT) communication processing module 124A and a WLAN communication processing module 124B, and is used to establish a wireless communication connection with a server that provides an instant messaging service.
  • BT Bluetooth
  • WLAN wireless communication processing module
  • the wireless communication processing module 124 can be used to send text information to other electronic devices.
  • the first electronic device may send text information to the second electronic device and the third electronic device through the wireless communication processing module.
  • the wireless communication processing module 124 is also used for receiving text information sent by other electronic devices.
  • the first electronic device may receive text information sent by the second electronic device and the third electronic device.
  • the power switch 125 may be used to control the power supply from the power source to the first electronic device.
  • the wired LAN communication processing module 126 can be used to communicate with other electronic devices in the same LAN through the wired LAN, and can also be used to connect to the WAN through the wired LAN, and can communicate with devices in the WAN.
  • the USB communication processing module 127 may be used to communicate with other devices through a USB interface (not shown).
  • Display screen 128 may be used for textual information, images, and the like.
  • the display screen 128 can be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED) display, an active-matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED) Display, flexible light-emitting diode (flexible light-emitting diode, FLED) display, quantum dot light emitting diode (quantum dot light emitting diodes, QLED) display, etc.
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED active-matrix organic light emitting diode
  • flexible light-emitting diode flexible light-emitting diode
  • FLED flexible light-emitting diode
  • QLED quantum dot light emitting diode
  • the processor 122 may call the computer instructions stored in the internal memory 123, so that the first electronic device executes the auxiliary input method in the embodiment of the present application.
  • FIG. 8 is a schematic diagram of a hardware structure of a second electronic device provided by an embodiment of the present application.
  • the second electronic device may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations.
  • the various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • auxiliary devices such as the third electronic device and the fourth electronic device may have the same structure as the second electronic device.
  • the second electronic device may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194 And a subscriber identification module (subscriber identification module, SIM) card interface 195 and so on.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the second electronic device.
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the second electronic device may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the second electronic device.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the second electronic device including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation Satellite system
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the second electronic device by executing the instructions stored in the internal memory 121 .
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application required for at least one function (such as a face recognition function, a fingerprint recognition function, a mobile payment function, etc.) and the like.
  • the storage data area can store data created during the use of the second electronic device (such as face information template data, fingerprint information template, etc.) and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 180A may be provided on the display screen 194 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the second electronic device determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the second electronic device detects the intensity of the touch operation according to the pressure sensor 180A.
  • the second electronic device may also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the second electronic device, which is different from the position where the display screen 194 is located.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key.
  • the second electronic device may receive key input and generate key signal input related to user settings and function control of the second electronic device.
  • the processor 110 may call the computer instructions stored in the internal memory 121, so that the second electronic device executes the auxiliary input method in the embodiment of the present application.
  • Application scenario 1 Because the second electronic device is an auxiliary device with the highest device priority in the device group and the device status is idle, all the first electronic devices first perform auxiliary input. Then, after the second electronic device starts the call process and can no longer assist the first electronic device in inputting, the first electronic device sends the text information in the input box to the third device whose priority is the second device and whose device status is idle. The electronic device performs auxiliary input with the third electronic device.
  • FIG. 9 is a schematic diagram of a signaling interaction of application scenario 1 in an embodiment of the present application.
  • FIG. 10 shows a schematic diagram of an interactive information flow of application scenario 1.
  • the software modules of the first electronic device may include: an input box management module 911 , an input method framework service module 912 , and a multi-device data transmission service module 913 .
  • the input method framework service module 912 includes an input management module 912a and a device group state management module 912b.
  • the second electronic device may include an input box management module 921 , an auxiliary input module 922 , and a multi-device data transmission service module 923 .
  • the auxiliary input module 922 includes an input management module 922a and a state information management module 922b.
  • the third electronic device may include an input box management module 931 , an auxiliary input module 932 , and a multi-device data transmission service module 933 .
  • the auxiliary input module 932 includes an input management module 932a and a state information management module 932b.
  • scenario 1 The process of scenario 1 is shown in FIG. 9 , and the process includes steps S101 to S1024.
  • steps S101 to S1024 The following describes steps S101 to S1024 in detail with reference to the schematic diagram of the interaction information flow shown in FIG. 10 :
  • the first electronic device, the second electronic device, and the third electronic device establish a device group
  • a device group is established.
  • the input management module 912a in the input method framework service module 912 of the first electronic device can send an input method coordination request to the local multi-device data transmission service module 913, and the multi-device data transmission service module 913 can request the request Sent to the multi-device data transmission service module 923 of the second electronic device, the request is used to ask the second electronic device whether to cooperate with the input method of the local device and the input method of the first electronic device to complete the same information input.
  • the multi-device data transmission service module 923 of the second electronic device can send the request to the input management module 922a in the auxiliary input module 922 of the local machine.
  • the input management module 922a of the second electronic device can send the response of the input method cooperation with the first electronic device to the local multi-device data transmission service module 923, and then the multi-device data transmission service module 923 can send the response
  • the multi-device data transmission service module 913 can send the request to the input management module 912a of the first electronic device. In this way, the first electronic device and the second electronic device complete the input method cooperation.
  • the first electronic device can also complete the input method collaboration with the third electronic device, and the process can refer to the above description, which is not repeated here.
  • the first electronic device sets device priorities of the second electronic device and the third electronic device;
  • the input management module 912a of the first electronic device can set the device priority of the electronic devices in the device group. Then, send the set device priority to the device group state management module 912b in the input method framework module 912, and the device group state management module 912b can set the priority of the electronic device in the device priority information to correspond to device priority.
  • the user may directly select the priority of the electronic devices in the device group.
  • the first electronic device in response to an operation by the user to set the second electronic device to the first device priority, the first electronic device may set the device priority of the second electronic device to the first device priority.
  • the first electronic device may set device priorities of other electronic devices in the device group according to the strength of the network signal of the electronic devices in the device group. Then, the device priority of the local machine is set to the lowest priority, for example, the electronic device may set the electronic device with the strongest network signal as the first device priority.
  • the first electronic device may set other electronic devices in the device group according to the strength of the network signal of the electronic devices in the device group, without setting the device priority of the device.
  • the device priority information can be expressed as:
  • the first electronic device sets the device priority of the second electronic device as the first device priority, and sets the device priority of the third electronic device as the second device priority, The device priority of this machine is not set.
  • the first electronic device determines a focus input box
  • a focused input box is an input box used by an auxiliary device to display information. This information can include sent by auxiliary devices, as well as input from the machine.
  • the input box management module 911 of the first electronic device may set the input box as the focus input box.
  • the second electronic device notifies the first electronic device that the local device state is idle;
  • the second electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the second electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device.
  • Electronic equipment When the second electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the second electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device.
  • the state information management module 922b of the second electronic device may set the device state of the local device to be idle. Then, the device status is sent to the multi-device data transmission service module 923 of the local machine.
  • the multi-device data transmission service module 923 of the second electronic device may send the device state of the local machine to the multi-device data transmission service module 913 of the first electronic device.
  • the first electronic device updates the device state of the second electronic device in the device state information to be idle;
  • the multi-device data transmission service module 913 of the first electronic device can send the device state of the second electronic device to the device group state management module 912b of the local device, and the device group state management module 912b can send the device state information In the second electronic device from the initialization device state to busy update device state to idle;
  • the device state of the second electronic device in the device group is idle, and the device state of the third electronic device may still be the initialization device state, that is, busy.
  • the device status information can be expressed as:
  • the first electronic device sends an auxiliary input request to the second electronic device
  • the first electronic device can select the auxiliary device with the highest device priority among the auxiliary devices in the device group whose device status is idle to perform auxiliary input , so, here, the first electronic device selects the second electronic device for auxiliary input.
  • the first electronic device may send an auxiliary input request to the second electronic device.
  • the input management module 912a of the first electronic device can obtain the device priority information and device state information through the device group state management module 912b, and determine that the second electronic device is the auxiliary device with the highest priority among the auxiliary devices whose device state is idle. Auxiliary equipment. Then, the input management module 912a can send the identification of the second electronic device and the auxiliary input request to the multi-device data transmission service module 913 of the local machine.
  • the multi-device data transmission service module 913 of the first electronic device may send an auxiliary input request to the multi-device data transmission service module 923 of the second electronic device according to the identifier of the second electronic device.
  • the second electronic device may display the user interface 50b of the second electronic device as shown in FIG. 5a , and reference may be made to the foregoing corresponding descriptions, which will not be repeated here.
  • the second electronic device pulls up the input method
  • the multi-device data transmission service module 923 of the second electronic device can send the auxiliary input request to the input management module 922a of the local machine, and the input management module 922a can activate the input method of the second electronic device.
  • the second electronic device for the second electronic device to pull up a user interface of the local input method, reference may be made to the foregoing description of the user interface 51b of the second electronic device in FIG. 5b, which will not be repeated here.
  • the second electronic device notifies the first electronic device that the device state of the local machine is being input;
  • the second electronic device when the second electronic device can perform auxiliary input with the first electronic device, the second electronic device can set the device state of the machine as input, and then send the device state to the first electronic device.
  • step S108 is similar to the process in the foregoing step S104, and reference may be made to the foregoing description of the step S104, which will not be repeated here.
  • the first electronic device updates the device state of the second electronic device in the device state information as being input;
  • step S109 is similar to the process in the foregoing step S105, and reference may be made to the foregoing description of the step S105, and details are not repeated here.
  • the device status information can be expressed as:
  • the device state of the second electronic device in the device group is input, and the device state of the third electronic device may still be the initialization device state, that is, busy.
  • step S108 may not be performed.
  • the first electronic device may directly set the state information of the second electronic device in the device state information as input.
  • the second electronic device obtains the first information
  • the first information is all the information displayed in the input box of the second electronic device.
  • the first information may be text information.
  • the second electronic device can acquire the first information, and then display the first information in the input box of the machine.
  • the input box management module 922a of the second electronic device may acquire the first information, and then display the first information in the input box of the machine.
  • the second electronic device sends the first information to the first electronic device
  • the input box management module 922a of the second electronic device can send the first information to the local input management module 922a, and then the input management module 922a can send the first information to the local multi-device data transmission Service module 923. Then the multi-device data transmission service module 923 may send the first information to the multi-device data transmission service module 913 of the first electronic device.
  • the first electronic device displays the first information in the focus input box
  • the multi-device data transmission service module 913 of the first electronic device can send the first information to the input management module 912a of the local device. Then, the input management module 912a can send the information to the input box management module 911 of the local machine, and the input box management module 911 can display the information in the focus input box.
  • the second electronic device starts a call process
  • the process may be described above for the user interface of the second electronic device in FIGS. 5d to 5f , which will not be repeated here.
  • the second electronic device notifies the first electronic device that the local device status is busy
  • the second electronic device cannot perform auxiliary input with the first electronic device, and the second electronic device can set the device state of the machine to busy, and then send the device state to the first electronic device.
  • step S1014 is similar to the process in the foregoing step S104, and reference may be made to the foregoing description of the step S104, which will not be repeated here.
  • the first electronic device updates the device state of the second electronic device in the device state information to be busy
  • step S1015 is similar to the process in the foregoing step S105, and reference may be made to the foregoing description of the step S105, and details are not repeated here.
  • the device status information can be expressed as:
  • the device state of the second electronic device in the device group is busy, and the device state of the third electronic device may still be the initialization device state, that is, busy.
  • the first electronic device deletes the information of the second electronic device in the device state information
  • the first electronic device may be triggered to delete the information of the second electronic device in the device state information.
  • the device group state management module 912b of the first electronic device can delete the state information of the second electronic device in the device state information.
  • the third electronic device notifies the first electronic device that the local device state is idle;
  • the third electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the third electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device.
  • Electronic equipment When the third electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the third electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device. Electronic equipment.
  • the state information management module 932b in the auxiliary input module 932 in the third electronic device can set the device state of the local machine to be idle. Then, the device status is sent to the multi-device data transmission service module 933 of the local machine.
  • the multi-device data transmission service module 933 of the third electronic device may send the device state of the local machine to the multi-device data transmission service module 913 of the first electronic device.
  • the first electronic device updates the device state of the third electronic device in the device state information to be idle;
  • step S1018 is similar to the process in the foregoing step S105, and reference may be made to the foregoing description of the step S105, which will not be repeated here.
  • the device status information can be expressed as:
  • the information of the second electronic device in the device group has been deleted, and the device status of the third electronic device is updated from busy to idle.
  • the first electronic device sends an auxiliary input request to the third electronic device;
  • the input management module 912a of the first electronic device can obtain the device priority information and device status information through the device group status management module 912b, and determine that the third electronic device is the auxiliary device with the highest priority among the auxiliary devices whose device status is idle. Auxiliary equipment. Then, the input management module 912a can send the identification of the third electronic device and the auxiliary input request to the multi-device data transmission service module 913 of the local machine.
  • the multi-device data transmission service module 913 of the first electronic device may send an auxiliary input request to the multi-device data transmission service module 933 of the third electronic device according to the identifier of the third electronic device.
  • the third electronic device may display the user interface 54c of the third electronic device as shown in FIG.
  • the first electronic device sends the second information to the third electronic device;
  • the second information is all the information displayed in the focus input box.
  • the second information may be the first information or information obtained by processing according to the first information;
  • the input management module 912 of the first electronic device can send the second information to the multi-device data transmission service module 913 of the local machine, and the multi-device data transmission service module 913 of the first electronic device can send the second information to the third The multi-device data transmission service module 933 of the electronic device.
  • step S1012 all the information displayed in the focus input box of the first electronic device is still the first information, the second information is the first information.
  • step S1012 all the information displayed in the focus input box of the first electronic device may no longer be the first information.
  • the first electronic device processes the first information, such as an operation of deleting a part of the content in the first information
  • the second information is a part of the first information.
  • the first information is different from the second information.
  • the third electronic device pulls up the input method to display the second information
  • the multi-device data transmission service module 933 of the third electronic device can send an auxiliary input request to the input management module 932a of the local machine, and the input management module 932a can pull up the input of the second electronic device Law.
  • the multi-device data transmission service module 933 of the third electronic device can send the second information to the input management module 932a of the local machine, and the input management module 932a can send the second information to the input box management module 931 of the local machine , the input box management module 931 can display the second information in the input box.
  • the multi-device data transmission service module 933 sends the auxiliary input request and the second information to the input management module 932a of the local machine.
  • the third electronic device obtains third information
  • the third information is all the information displayed in the input box of the third electronic device.
  • the information may be text information.
  • the second electronic device can perform operations such as adding and deleting the second information according to the information to obtain the third information, and then display the third information in the input box of the machine.
  • the input box management module 932a of the third electronic device may acquire the third information, and then display the third information in the input box of the local machine.
  • the third electronic device sends third information to the first electronic device
  • step S1023 is similar to the process in the foregoing step S1011, and reference may be made to the foregoing description of the step S1011, which will not be repeated here.
  • the first electronic device displays third information in the focus input box
  • step S1024 is similar to the process in the foregoing step S1012, and reference may be made to the foregoing description of the step S1012, which will not be repeated here.
  • step S105 only needs to occur after step S104, and step S104 only needs to occur after step S101; step S1018 only needs to occur after step S1017, and step S1017 only needs to occur after step S101; step S109 only needs to occur after Step S108 may be followed; step S1015 may only be performed after step S1014; step S1016 may not be performed, if performed only after step S1015; there is no sequence between step S1019 and step S1020, and may be performed simultaneously.
  • Application scenario 2 Combined with application scenario 1, assuming that the second electronic device ends the call process at this time, the first electronic device can switch to the second electronic device with the priority of the first device for auxiliary input, or continue to have priority with the second device. stage third electronics for auxiliary input.
  • FIG. 11 is a signaling interaction diagram of application scenario 2 in an embodiment of the present application.
  • the information flow between the electronic devices in the device group may refer to FIG. 10 .
  • scenario 2 is shown in Figure 10, which includes steps S201 to S2013.
  • steps S201 to S2013 in detail with reference to the schematic diagram of the interactive information flow shown in Figure 10:
  • the process may be described above for the user interface of the second electronic device in FIGS. 5f-5g, which will not be repeated here.
  • the second electronic device notifies the first electronic device that the local device state is idle;
  • the second electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the second electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device.
  • Electronic equipment When the second electronic device can perform auxiliary input with the first electronic device, but does not perform auxiliary input with the first electronic device, the second electronic device can set the device state of the machine to idle, and then send the device state to the first electronic device.
  • step S202 is the same as the process in the foregoing step S104, and reference may be made to the foregoing description of the step S104, which will not be repeated here.
  • the first electronic device updates the device state of the second electronic device in the device state information to be idle;
  • step S1016 if the first electronic device deletes the information of the second electronic device in the device state information when the device state of the second electronic device is updated from the input to busy. At this time, the first electronic device needs to re-add the device state of the second electronic device and initialize it to busy, and then update the device state of the second electronic device to idle.
  • step S1016 is not performed, and the first electronic device updates the device state of the second electronic device in the device state information from busy to idle.
  • step S203 it can be understood that, for the process involved in step S203, reference may be made to the foregoing description, and details are not repeated here.
  • the device status information can be expressed as:
  • the device state of the second electronic device in the device group is idle, and the device state of the third electronic device may still be input.
  • the first electronic device sends an auxiliary input switching request to the third electronic device;
  • the first electronic device can send the auxiliary device to the auxiliary device that is in the process of auxiliary input.
  • Auxiliary input switching request This request is used to ask the auxiliary device that is performing auxiliary input whether to switch to the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle to perform auxiliary input.
  • the first electronic device may send an auxiliary input switching request to the third electronic device, the request being used for Ask the third electronic device whether to switch to the second electronic device for auxiliary input.
  • the input management module 912a of the first electronic device can obtain the device priority information and device state information through the device group state management module 912b, and determine that the second electronic device is the auxiliary device with the highest priority among the auxiliary devices whose device state is idle. The device status of the auxiliary device, and the third electronic device is input. Then, the input management module 912a can send the identification of the third electronic device and the auxiliary input switching request to the multi-device data transmission service module 913 of the local machine.
  • the multi-device data transmission service module 913 of the first electronic device may send the auxiliary input switching request to the multi-device data transmission service module 933 of the third electronic device according to the identifier of the third electronic device.
  • the third electronic device determines whether to switch to the second electronic device
  • the multi-device data transmission service module 933 of the third electronic device can send the auxiliary input switching request to the input management module 932a of the local machine, and the input management module 932a can determine whether the third electronic device is switched to the second electronic device equipment.
  • the third electronic device may determine to switch to the second electronic device for auxiliary input.
  • the third electronic device may determine not to switch to the second electronic device for auxiliary input.
  • a user interface of this process reference may be made to the foregoing description of the user interface 57c of the third electronic device in 5h, which will not be repeated here.
  • step S206-S209 If the third electronic device determines to switch to the second electronic device for auxiliary input, execute steps S206-S209; if the third electronic device determines not to switch to the second electronic device for auxiliary input, execute steps S2010-S2013.
  • the third electronic device notifies the first electronic device to switch to the second electronic device for auxiliary input;
  • the input management module 932a of the third electronic device may send the response that the third electronic device determines to switch to the second electronic device for auxiliary input to the multi-device data transmission service module 933 of the local machine.
  • the multi-device data transmission service module 933 can then send the response to the multi-device data transmission service module 913 of the first electronic device.
  • the first electronic device sends an auxiliary input instruction to the second electronic device
  • the first electronic device selects to perform auxiliary input with the second electronic device, and sends an auxiliary input instruction to the second electronic device.
  • the multi-device data transmission service module 913 of the first electronic device may send the response that the third electronic device determines to switch to the second electronic device for auxiliary input to the input management module 912a of the local machine. Then, the input management module 912a can send the identification of the second electronic device and the auxiliary input request to the multi-device data transmission service module 913 of the local machine.
  • the multi-device data transmission service module 913 of the first electronic device may send an auxiliary input request to the multi-device data transmission service module 923 of the second electronic device according to the identifier of the second electronic device.
  • the second electronic device may display the user interface 59b of the second electronic device as shown in FIG.
  • the first electronic device sends fourth information to the second electronic device
  • step S208 is similar to the process in the foregoing step S1020, and reference may be made to the foregoing description of the step S1020, which is not repeated here.
  • the second electronic device pulls up the input method to display the fourth information
  • step S209 is similar to the process in the foregoing step S1021, and reference may be made to the foregoing description of the step S1021, and details are not repeated here.
  • the first electronic device can update the device state information to change the device state of the second electronic device from idle. Update to input, update the device state of the third electronic device from input to idle.
  • the first electronic device may continue to perform auxiliary input with the third electronic device.
  • the request for the second electronic device to reject the auxiliary input request with the first electronic device may include: timeout and no response, that is, the second electronic device does not respond within a period of time after receiving the auxiliary request from the first electronic device, and at this time the first electronic device does not respond After an electronic device sends a request for auxiliary input to the second electronic device and does not receive a response from the second electronic device within a period of time, it is considered that the second electronic device refuses to perform auxiliary input with the first electronic device. And, in response to a user refusing a request for auxiliary input with the electronic device.
  • the third electronic device notifies the first electronic device not to switch to the second electronic device for auxiliary input;
  • the first electronic device continues to perform auxiliary input with the third electronic device.
  • the input management module 932a of the third electronic device may send a response that the third electronic device determines not to switch to the second electronic device for auxiliary input to the multi-device data transmission service module 933 of the local machine.
  • the multi-device data transmission service module 933 can then send the response to the multi-device data transmission service module 913 of the first electronic device.
  • the first electronic device continues to perform auxiliary input with the third electronic device.
  • the third electronic device obtains the fifth information
  • step S2011 is similar to the process in the foregoing step S1022, and reference may be made to the foregoing description of the step S1022, which is not repeated here.
  • the third electronic device sends fifth information to the first electronic device
  • step S2012 is similar to the process in the foregoing step S1023, and reference may be made to the foregoing description of the step S1023, which is not repeated here.
  • the first electronic device displays the fifth information in the focus input box.
  • step S2013 is similar to the process in the foregoing step S1024, and reference may be made to the foregoing description of the step S1024, and details are not repeated here.
  • the information sent by the first electronic device to other electronic devices in the device group is always all the information displayed in the focus input box, and the information may include Information obtained when the machine makes an input.
  • an electronic device in a device group when an electronic device in a device group sends information to other electronic devices in the device group, such as a request, text message, response, etc., it can carry the unique identifier of the device. , for example, one or a combination of a device name, a device physical address, a mobile equipment identifier (MEID), an international mobile equipment identity (IMEI), and the like.
  • MEID mobile equipment identifier
  • IMEI international mobile equipment identity
  • the assisted device and multiple auxiliary devices form a device group, and the assisted device can select the auxiliary device with the highest device priority among the auxiliary devices whose device status is idle in the device group.
  • Auxiliary equipment, for auxiliary input As long as the device status of any auxiliary device in the device group is inputting or idle, the assisted device can be assisted in inputting.
  • the second electronic device may also be referred to as the first auxiliary device
  • the third electronic device may also be referred to as the second auxiliary device.
  • the term “when” may be interpreted to mean “if” or “after” or “in response to determining" or “in response to detecting" depending on the context.
  • the phrases “in determining" or “if detecting (the stated condition or event)” can be interpreted to mean “if determining" or “in response to determining" or “on detecting (the stated condition or event)” or “in response to the detection of (the stated condition or event)”.
  • the above-mentioned embodiments it may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • software it can be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media.
  • the usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state drives), and the like.
  • the process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium.
  • the program When the program is executed , which may include the processes of the foregoing method embodiments.
  • the aforementioned storage medium includes: ROM or random storage memory RAM, magnetic disk or optical disk and other mediums that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了辅助输入方法、电子设备以及系统。在该方法中,第一辅助设备可以与被辅助设备进行辅助输入,将本机的输入框中显示的第一信息发送给被辅助设备,当第一辅助设备不能与被辅助设备进行辅助输入时,被辅助设备可以将焦点显示框中显示的信息发送给设备群组中空闲的第二辅助设备,再与该第二辅助设备进行辅助输入。实施本申请提供的技术方案,可以提高更好的辅助被辅助设备进行辅助输入。

Description

辅助输入方法、电子设备以及系统
本申请要求于2021年03月27日提交中国专利局、申请号为202110329155.x、申请名称为“辅助输入方法、电子设备以及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端及通信技术领域,尤其涉及辅助输入方法、电子设备以及系统。
背景技术
随着联网技术的发展,大屏设备(例如智慧屏)的功能得到不断的完善与改进。越来越多的用户选择用大屏设备替代传统的电视机。市场上,大屏设备的品牌种类日益繁多,用户对于大屏设备的需求量也越来越大。因此,提升大屏设备与用户之间的交互体验感非常重要。用户可以通过一些其他的电子设备(例如遥控器)与大屏电子设备进行交互。例如,用户可以通过遥控器,在大屏电子设备的输入框中,进行信息输入。但,当需要对大屏设备输入较多的信息时,使用遥控器会导致输入效率低。
现有技术中,用户可以借助输入体验友好的电子设备(例如手机),作为辅助设备,来协助大屏设备完成输入。通过在手机中输入信息,然后显示到大屏设备中,完成对大屏设备的信息输入。
然而,该现有技术中的大屏设备只能通过一个辅助设备进行辅助输入,辅助设备可以将输入框中的显示的信息发送给发屏设备,当辅助设备开启其他的进程,无法进行辅助输入时,大屏设备仍然需要使用遥控器进行信息输入。
发明内容
本申请提供了一种辅助输入方法、电子设备以及系统,第一辅助设备可以与被辅助设备进行辅助输入,将本机的输入框中显示的第一信息发送给被辅助设备,当第一辅助设备不能与被辅助设备进行辅助输入时,被辅助设备可以将焦点显示框中显示的信息发送给设备群组中空闲的第二辅助设备,再与该第二辅助设备进行辅助输入。
第一方面,本申请提供了一种辅助方法,包括:被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息;当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
在上述实施例中,第一辅助设备已经与被辅助设备进行辅助输入了,并且已经将本机的输入框中的信息发送给了被辅助设备,当第一辅助设备因为忙碌不能与辅助设备进行辅助输入时,被辅助设备可以与第二辅助设备进行辅助输入,并且可以将此时焦点显示框中显示的第二信息发送给第二辅助设备,第二辅助设备可以在输入框中显示该第二信息,在该第二信息的基础上,对第二信息进行处理,然后可以将处理后的信息发送给被辅助设备。这样,只要设备群组中有一个空闲的辅助设备,就可以协助被辅助设备进行输入。
结合第一方面的方法,所述第二信息为所述第一信息或根据所述第一信息处理得到的信 息,具体包括:当所述被辅助电子设备没有对所述第一信息进行处理时,所述第一信息与所述第二信息相同;当所述被辅助电子设备对所述第一信息进行处理时,所述第一信息与所述第二信息不相同。
在上述实施例中,被辅助设备在接收到第一信息之后,可以对该第一信息进行处理,例如删除,增加等,改变第一信息的内容,得到第二信息。
结合第一方面的方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:所述辅助设备发送辅助输入请求给所述第一辅助设备。
结合第一方面的方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:当所述被辅助设备接收到第一辅助设备的设备状态为忙碌的信息时,所述被辅助设备在设备状态信息中更新第一辅助设备的设备状态为忙碌。
在上述实施例中,被辅助设备利用设备状态信息记录设备群组中,辅助设备的设备状态,可以方便的查找到辅助设备的状态。
结合第一方面的方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之前,所述方法还包括:所述被辅助设备更新设备状态信息中,所述第二辅助设备的设备状态为空闲。
在上述实施例中,被辅助设备利用设备状态信息记录设备群组中,辅助设备的设备状态,可以方便的更新辅助设备的状态。
结合第一方面的方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息,具体包括:所述被辅助设备确定焦点输入框,所述焦点输入框用于显示信息;所述被辅助设备接收所述第一辅助设备发送的第一信息,所述第一信息为所述被辅助设备输入框中显示的全部信息;所述被辅助设备在所述焦点输入框中显示所述第一信息。
在上述实施例中,辅助设备可以将输入框显示的信息实时的发送给被辅助设备,并且辅助设备将输入框中显示的全部信息都发送给被辅助设备。辅助设备可以将该信息显示在焦点显示框中。
结合第一方面的方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,具体包括:所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,所述第二信息为所述焦点输入框中显示的全部信息。
上述实施例中,被辅助设备可以将焦点显示框中的信息全部发送给第二辅助设备,使得第二辅助设备可以获取到被辅助设备的焦点显示框中的信息,接着对该信息进行处理,继续与该被辅助设备进行辅助输入。
结合第一方面的方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之后,所述方法还包括:所述被辅助设备接收到第一辅助设备的设备状态为空闲的信息时,所述被辅助设备在所述设备状态信息中更新第一辅助设备的设备状态为空闲;所述被辅助设备发送辅助输入切换请求给所述第二辅助设备;所述辅助输入切换请求用于询问所述第二辅助设备,是否切换到所述第一辅助设备进行辅助输入;此时,所述第一辅助设备为当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备;所述被辅助设备继续与所述第二辅助设备进行辅助输入或者选择所述第一辅助设备进行辅助输入。
在上述实施例中,当设备群组中设备优先级最高的电子设备处于空闲状态时,被辅助设备可以发送辅助输入切换请求该当前正在与其进行辅助输入的辅助设备,希望可以切换到设备优先级最高的辅助设备进行辅助输入,这样可以尽量提高辅助输入的效率。
结合第一方面的方法,所述被辅助设备继续与第二辅助设备进行辅助输入或者与第一辅 助设备进行辅助输入,具体包括:当所述被辅助设备接收到所述第二辅助设备发送的切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备选择所述第一辅助设备进行辅助输入;当所述被辅助设备接收到所述第二辅助设备发送的不切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备继续与第二辅助设备进行辅助输入。
结合第一方面的方法,所述被辅助设备选择所述第一辅助设备进行辅助输入之后,所述方法还包括:当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则所述被辅助设备继续与第二辅助设备进行辅助输入。
在上述实施例中,辅助设备可以拒绝与被辅助设备进行辅助输入,使得辅助设备的安全可以得到保障。
结合第一方面的方法,当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则所述被辅助设备继续与第二辅助设备进行辅助输入,具体包括:当所述第一辅助设备在接收到所述被辅助设备的辅助请求之后的一段时间内没有做出响应时,则所述被辅助设备继续与第二辅助设备进行辅助输入。
在上述实施例中,辅助设备超时未响应被辅助设备的辅助输入请求,则被辅助设备可以选择其他的辅助设备进行辅助设备,是辅助输入更加的智能,高效。
第二方面,本申请提供了一种被辅助设备,所述被辅助设备包括:存储器、一个或多个处理器;所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述被辅助设备执行:在焦点输入框中显示第一辅助设备发送的第一信息;确定第一辅助设备的设备状态切换到忙碌时,将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
在上述实施例中,第一辅助设备已经与被辅助设备进行辅助输入了,并且已经将本机的输入框中的信息发送给了被辅助设备,当第一辅助设备因为忙碌不能与辅助设备进行辅助输入时,被辅助设备可以与第二辅助设备进行辅助输入,并且可以将此时焦点显示框中显示的第二信息发送给第二辅助设备,第二辅助设备可以在输入框中显示该第二信息,在该第二信息的基础上,对第二信息进行处理,然后可以将处理后的信息发送给被辅助设备。这样,只要设备群组中有一个空闲的辅助设备,就可以协助被辅助设备进行输入。
结合第二方面的辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:没有对所述第一信息进行处理时,所述第一信息与所述第二信息相同;对所述第一信息进行处理时,所述第一信息与所述第二信息不相同。
结合第二方面的辅助设备,在焦点输入框中显示第一辅助设备发送的第一信息之前,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:发送辅助输入请求给所述第一辅助设备。
结合第二方面的辅助设备,在焦点输入框中显示第一辅助设备发送的第一信息之前,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:当接收到第一辅助设备的设备状态为忙碌的信息时,在设备状态信息中更新第一辅助设备的设备状态为忙碌。
结合第二方面的辅助设备,将焦点输入框中显示的第二信息发送给第二辅助设备之前, 所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:更新设备状态信息中,所述第二辅助设备的设备状态为空闲。
结合第二方面的辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:确定焦点输入框,所述焦点输入框用于显示信息;接收所述第一辅助设备发送的第一信息,所述第一信息为所述被辅助设备输入框中显示的全部信息;在所述焦点输入框中显示所述第一信息。
结合第二方面的辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:将焦点输入框中显示的第二信息发送给第二辅助设备,所述第二信息为所述焦点输入框中显示的全部信息。
结合第二方面的辅助设备,将焦点输入框中显示的第二信息发送给第二辅助设备之后,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:接收到第一辅助设备的设备状态为空闲的信息时,在所述设备状态信息中更新第一辅助设备的设备状态为空闲;发送辅助输入切换请求给所述第二辅助设备;所述辅助输入切换请求用于询问所述第二辅助设备,是否切换到所述第一辅助设备进行辅助输入;此时,所述第一辅助设备为当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备;继续与所述第二辅助设备进行辅助输入或者选择所述第一辅助设备进行辅助输入。
结合第二方面的辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:当接收到所述第二辅助设备发送的切换至第一辅助设备进行辅助输入的信息时,选择所述第一辅助设备进行辅助输入;当接收到所述第二辅助设备发送的不切换至第一辅助设备进行辅助输入的信息时,继续与第二辅助设备进行辅助输入。
结合第二方面的辅助设备,选择所述第一辅助设备进行辅助输入之后,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则继续与第二辅助设备进行辅助输入。
结合第二方面的辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:当所述第一辅助设备在接收到所述被辅助设备的辅助请求之后的一段时间内没有做出响应时,则继续与第二辅助设备进行辅助输入。
第三方面,本申请实施例提供一种辅助输入方法,包括:第一辅助设备将第一信息发送给被辅助设备;所述第一信息为所述第一辅助设备的输入框显示的全部信息;所述被辅助设备在焦点输入框中显示所述第一辅助设备发送的所述第一信息;当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
结合第三方面提供的辅助输入方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:所述辅助设备发送辅助输入请求给所述第一辅助设备。所述第一辅助设备接收所述辅助设备发送的辅助输入请求。
结合第三方面提供的辅助输入方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:所述第一辅助设备通知所述被辅助设备本机的设备状态为忙碌;当所述被辅助设备接收到第一辅助设备的设备状态为忙碌的信息时,所述被辅助设备在设备状态信息中更新第一辅助设备的设备状态为忙碌。
结合第三方面提供的辅助输入方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之前,所述方法还包括:所述第二辅助设备通知所述被辅助设备本机的设备状态为空闲;所述被辅助设备更新设备状态信息中,所述第二辅助设备的设备状态为空闲。
结合第三方面提供的辅助输入方法,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息,具体包括:所述被辅助设备确定焦点输入框,所述焦点输入框用于显示信息;所述第一辅助设备发送第一信息给被辅助设备;所述被辅助设备接收所述第一辅助设备发送的第一信息,所述第一信息为所述被辅助设备输入框中显示的全部信息;所述被辅助设备在所述焦点输入框中显示所述第一信息。
结合第三方面提供的辅助输入方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,具体包括:所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,所述第二信息为所述焦点输入框中显示的全部信息;所述第二辅助设备接收所述第二信息;所述第二辅助设备在输入框中显示所述第二信息。
结合第三方面提供的辅助输入方法,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之后,所述方法还包括:所述第一辅助设备通知所述被辅助设备本机的设备状态为空闲;所述被辅助设备接收到第一辅助设备的设备状态为空闲的信息时,所述被辅助设备在所述设备状态信息中更新第一辅助设备的设备状态为空闲;所述被辅助设备发送辅助输入切换请求给所述第二辅助设备;所述辅助输入切换请求用于询问所述第二辅助设备,是否切换到所述第一辅助设备进行辅助输入;所述第二辅助设备接收所述辅助设备切换请求;此时,所述第一辅助设备为当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备;所述被辅助设备继续与所述第二辅助设备进行辅助输入或者选择所述第一辅助设备进行辅助输入。
结合第三方面提供的辅助输入方法,所述被辅助设备继续与第二辅助设备进行辅助输入或者与第一辅助设备进行辅助输入,具体包括:所述第二辅助设备通知被辅助设备,切换至所述第一辅助设备进行辅助输入;当所述被辅助设备接收到所述第二辅助设备发送的切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备选择所述第一辅助设备进行辅助输入;所述第二辅助设备通知被辅助设备,不切换至所述第一辅助设备进行辅助输入;当所述被辅助设备接收到所述第二辅助设备发送的不切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备继续与第二辅助设备进行辅助输入。
第四方面,本申请提供了一种系统,所述系统包括:被辅助设备、第一辅助设备和第二辅助设备;所述被辅助设备、第一辅助设备和第二辅助设备包括:存储器、一个或多个处理器;所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述被辅助设备、第一辅助设备和第二辅助设备执行:第一辅助设备将第一信息发送给被辅助设备;所述第一信息为所述第一辅助设备的输入框显示的全部信息;所述被辅助设备在焦点输入框中显示所述第一辅助设备发送的所述第一信息;当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
第五方面,本申请提供了一种芯片系统,所述芯片系统应用于电子设备,所述芯片系 统包括一个或多个处理器,所述处理器用于调用计算机指令以使得所述电子设备执行如权利要求1-11中任一项所述的方法。
第六方面,本申请提供了一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行如权利要求1-11中任一项所述的方法。
第七方面,本申请提供了一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1-11中任一项所述的方法。
可以理解的是,上述第二方面提供的被辅助设备、第三方面提供的方法、第四方面提供的系统、第五提供的芯片系统、第六方面提供的计算机程序产品和第七方面提供的计算机可读存储介质均用于执行本申请实施例所提供的方法。因此,其所能达到的有益效果可参考对应的方法中的有益效果,此处不再赘述。
附图说明
图1是本申请实施例提供的设备群组的一个示意图;
图2a-图2c是本申请实施例提供的电子设备的设备状态的示意图;
图3a-图3c是本申请实施例提供的一种方案中,辅助输入方法的一个场景示意图;
图4a和图4b是本申请实施例中的辅助输入方法的一个场景示意图;
图5a-图5k是本申请实施例提供的辅助方法的一组示例性用户界面;
图6是本申请实施例提供的通信系统100的结构示意图;
图7是本申请实施例提供的第一电子设备的硬件结构示意图;
图8是本申请实施例提供的第二电子设备的硬件结构示意图;
图9是本申请实施例提供的应用场景1的一个信令交互示意图;
图10是本申请实施例提供的应用场景1的一个交互信息流示意图;
图11是本申请实施例提供的应用场景2的一个信令交互示意图。
具体实施方式
本申请以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还应当理解,本申请中使用的术语“和/或”是指并包含一个或多个所列出项目的任何或所有可能组合。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
由于本申请实施例涉及分布式协同设备之间文件保护的应用,为了便于理解,下面先对本申请实施例涉及的相关术语及概念进行介绍。
(1)设备群组:
本申请实施例中,多个电子设备首先通过网路连接可以构成分布式协同场景。然后,该多个电子设备完成输入法协同后,可以组成一个设备群组。具体的,被辅助设备可以向每一 个辅助设备发送输入法协同请求,辅助设备接收到该请求后,该辅助设备的输入法可以与该被辅助设备的输入法协同完成同一个信息输入,该信息可以包括文字信息、图像信息等,本申请实施例对此不限定。
其中,辅助设备是指可以直接由本机完成信息输入的电子设备,例如手机、平板电脑等。被辅助设备是指通过本机输入信息时不高效,但可以通过辅助设备完成信息输入的电子设备,例如智慧屏等。
设备群组中包括2个或2个以上的辅助设备,以及,1个或1个以上的被辅助设备。该设备群组中的辅助设备可以通过本申请实施例中的辅助输入方法协助被辅助设备进行输入。
在本申请实施例中,设备群组的组成方式可以有很多种:
在一些实施例中,可以设定登陆了同一个网络账号的多个电子设备构成分布式协同场景,然后,该多个电子设备完成输入法协同后,可以组成一个设备群组。
在一些实施例中,可以设定同一个局域网中的多个电子设备构成分布式协同场景,然后,该多个电子设备完成输入法协同后,可以组成一个设备群组。
在一些实施例中,可以设定具有相同特定标识的多个电子设备构成分布式协同场景,然后,该多个电子设备完成输入法协同后,可以组成一个设备群组。
在另一些实施例中,还可以采用将上述组成设备群组的方式进行组合,得到设备群组。
可以理解的是,还可以有其他的组成设备群组的方式,本身申请实施例对此不作限定。
图1为本申请实施例中的设备群组的一个示意图。
如图1所示,该设备群组中包含智慧屏、手机、平板电脑等多个电子设备。其中,智慧屏是被辅助设备,手机、平板电脑等是辅助设备。手机、平板电脑可以协助智慧屏进行输入。
(2)设备状态:
本申请实施例中,一个电子设备作为辅助设备时,该电子设备的设备状态包括:忙碌、空闲、输入中。
当电子设备的设备状态为忙碌时,不可以进行辅助输入。例如,当电子设备开启其他不可以与辅助输入同时进行的进程时,电子设备为忙碌,例如通话进程,聊天进程等。
示例性的,图2a示出了电子设备的设备状态为忙碌时的一个示例性用户界面示意图。
如图2a所示,此时,电子设备开启通话进程,不可以协助被辅助设备进行输入。
当电子设备的设备状态为空闲时,可以进行辅助输入,但是此时电子设备并没有进行辅助输入。例如,电子设备没有开启任何进程时。
示例性的,图2b示出了电子设备的设备状态为空闲时的一个示例性用户界面示意图。
如图2b所示,此时,电子设备显示主界面(Home scree),没有开启其他进程。
当电子设备的设备状态为输入中时,表示电子设备正在进行辅助输入。
示例性的,图2c示出了电子设备的设备状态为输入中时的一个示例性用户界面示意图。
如图2c所示,此时,电子设备的输入法被打开,正在进行辅助输入。
(3)设备状态信息:
本申请实施例中,设备状态信息用于表示设备群组中辅助设备的标识与设备状态的对应关系。该设备状态信息可以存储在被辅助设备的存储器中。
该辅助设备的标识用于在该设备群组中唯一标识一个辅助设备。
可选的,该辅助设备的标识可以为设备名称、设备物理地址、移动设备识别码(mobile  equipment identifier,MEID),国际移动设备识别码(international mobile equipment identity,IMEI)中的一个或其组合等,此处不作限定。
示例性的,以IMEI为辅助设备的标识为例,如下表1为本申请实施例中该设备状态信息的一个示例:
电子设备的标识 设备状态
设备1的IMEI 忙碌
设备2的IMEI 空闲
设备3的IMEI 输入中
表1
从该表1所示的设备状态信息可以确定:设备1的设备状态为忙碌;设备2的设备状态为空闲和设备3的设备状态为输入中。
在一些实施例中,当设备群组中的任一辅助设备的设备状态从其他状态更新为忙碌时,可以触发被辅助设备删除设备状态信息中该辅助设备的信息。
在一些实施例中,当设备群组中的任一辅助设备的设备状态从其他状态更新为忙碌时,可以触发被辅助设备删除设备状态信息中,所有设备状态为忙碌的辅助设备的信息。
在一些实施例中,被辅助设备可以定期获取该设备信息,删除其中设备状态为忙碌的辅助设备的信息。
在另一些实施例中,当设备群组中有任一辅助设备退出该设备群组时,可以触发被辅助设备删除设备状态信息中该辅助设备的信息。
可以理解的是,表1仅仅为设备状态信息的一个示例性示意,在实际应用中,还可以用很多种其他不同的形式来存储设备状态信息,例如数组、矩阵、数据库等等,本申请实施例对此不作限定。
在一些实施例中,被辅助设备可以设置设备群组的辅助设备的初始设备状态为忙绿。
(4)设备优先级信息:
本申请实施例中,设备优先级信息用于表示设备群组中电子设备的标识与设备优先级的对应关系。该设备优先级信息可以存储在被辅助设备的存储器中。
其中,设备优先级是指被辅助电子设备与辅助电子设备之间进行辅助输入的顺序,在本申请实施例中,被辅助设备一次只能与一个辅助设备进行辅助输入,最先可以与被辅助设备进行辅助输入的辅助设备的设备优先级最高,依次类推。
可以将第一设备优先级记为“1”,第二设备优先级记为“2”,依次类推。也可以用其他的方式表示设备优先级,本申请实施例对此不作限定。
电子设备的标识与辅助设备的标识意义相同,用于在该设备群组中唯一标识一个电子设备。
示例性的,以IMEI为辅助设备的标识为例,如下表2为本申请实施例中该设备优先级信息的一个示例:
电子设备的标识 设备优先级
设备1的IMEI 1
设备2的IMEI 2
设备3的IMEI 3
表2
从该表2所示的设备优先级信息可以确定:设备1的设备优先级最高;设备2的设备优先级次之,设备3的设备优先级最低。
在一些实施例中,一个被辅助设备中存储的设备优先级信息中可以没有本机的设备优先级的信息。在另一些实施例中,一个被辅助设备中可以包括本机的设备优先级的信息。本申请实施例对此不作限定。
可以理解的是,表2仅仅为设备优先级信息的一个示例性示意,在实际应用中,还可以用很多种其他不同的形式来存储设备优先级信息,例如数组、矩阵、数据库等等,本申请实施例对此不作限定。
图3a-图3c示例性示出了一种方案中,辅助输入方法的一个场景示意图。
其中,第一电子设备为被辅助设备,第二电子设备为辅助设备。
如图3a所示,用户界面30a为第一电子设备的一个搜索界面,该搜索界面中可以显示输入框301,该输入框301用于显示电子设备已经获取的信息。
用户界面30b为第二电子设备的一个信息输入界面,该信息输入界面中可以显示输入法的键盘302,输入提示框303以及输入框304。
假设此时用户想输入的是文字信息是“你”,响应于用户在键盘302上的操作(如点击操作),输入提示框303中可以显示跟用户的该操作对应的文字信息,例如;“你的我想有时间”。响应于用户在输入提示框303中选择文字“你”的操作(如点击操作),输入框304中可以显示“你”这一文字信息304a。
第二电子设备可以将该文字信息304a发送给第一电子设备,然后,第一电子设备用户界面30a的输入框301中,可以显示该文字信息304a。
然后,如图3b的用户界面31b所示,在第二电子设备协助第一电子设备进行辅助输入时,第二电子设备接入电话。响应于用户在来电显示框311中的接听控件311a上的操作(例如点击操作),电子设备可以开启通话进程,显示出如图3c所示的用户界面32b。
如图3c中的用户界面32b所示,此时,第二电子设备可以进行通话,不可以再协助第一电子设备进行输入。
可以理解的是,在该方案中,当第二电子设备的设备状态为忙碌时,无法协助第一电子设备进行输入。此时,第一电子设备也无法和其他的辅助设备进行辅助输入,这样,第一电子设备只能采用原有的输入方式进行输入,例如,通过遥控器进行输入。导致第一电子设备的输入效率低。
而采用本申请实施例提供的辅助输入方法,只要构成分布式协同场景的设备中,任一辅助设备的设备状态为空闲,就可以协助被辅助电子设备进行输入。
图4a和图4b示例性示出了为本申请实施例涉及的方案中,辅助输入方法的一个场景示意图。
本申请实施例中,第一电子设备为被辅助设备,第二电子设备为设备优先级最高的辅助设备,第三电子设备为第二设备优先级的辅助设备。
假设开始是第二电子设备协助第一电子设备进行输入,然后,第二电子设备开始进行通话。如图4a中的用户界面40b所示,第二电子设备因为进行通话而导致无法再协助第一电子 设备进行输入。此时,第一电子设备可以将用户界面40a中显示的输入框401中的文字信息401a发送给第二设备优先级的第三电子设备。然后,第三电子设备的用户界面40c中的输入框402中,可以显示文字信息401a。
当第二电子设备的设备状态为忙碌时,第三电子设备可以协助第一电子设备进行输入。响应于用户在图4a中所示的用户界面40c中显示的输入提示框403中的选择文字“的”的操作(例如点击操作),第三电子设备可以显示如图4b所示的用户界面41c,该用户界面41c中可以显示输入框402,该输入框402中可以显示文字信息411a,第三电子设备可以将该文字信息411a发送给第一电子设备,如图4b中的用户界面41a所示,第一电子设备的输入框401中,可以显示该文字信息411a。此时,第二电子设备如图4b中的用户界面41b所示,设备状态为忙碌。
这样,采用本申请实施例中的辅助输入方法,被辅助设备可以按照设备优先级选择辅助设备对其进行辅助输入,只要设备群组中有任一个辅助设备的设备状态为输入中或者空闲,就可以协助被辅助设备进行输入。
下面以一组示例性用户界面为例,对本申请实施例中的辅助输入方法进行说明:
图5a-图5k为本申请实施例中的辅助输入方法的一组示例性用户界面。
假设此时,第一电子设备为被辅助电子设备,第二电子设备为第一设备优先级且设备状态为空闲的辅助设备,第三电子设备为第二设备优先级且设备状态为空闲的辅助设备。
如图5a-图5e所示,第一电子设备首先与第二电子设备进行辅助输入,当第二电子设备的设备状态为忙碌时,第一电子设备可以与第三电子设备进行辅助输入。
图5a所示,第一电子设备响应于用户选择用户界面50a中的输入框501的操作后,可以将该输入框501置灰。然后,响应于用户在遥控器中的确认键502上的操作(例如按压操作、点击操作等),第一电子设备可以显示如图5b中示出的用户界面51a,在该用户界面51a中,输入框501中可以显示提示光标501a,该提示光标501a用于提示用户此时输入框501已经被确定为焦点输入框,当第一电子设备获取到信息时,则显示到该输入框501之中,且显示在该提示光标501a之后。
此时,第二电子设备的用户界面50b可以弹出提示框503,该提示框503中可以包括提示信息503a,同意控件503b,拒绝控件503c。该提示信息503a用于提示用户:“是否同意拉起本地输入,协助第一电子设备输入”。该同意控件503b用于第一电子设备同意拉起本地输入,协助第一电子设备输入。该拒绝控件503c用于第一电子设备拒绝拉起本地输入,协助第一电子设备输入。
响应于用户在该同意控件503b上的操作(如点击操作),第二电子设备可以显示出如图5b所示的用户界面51b,该用户界面51b中可以显示输入框511,以及,第二电子设备的输入法的键盘512。该键盘512可以用于向第二电子设备输入文字信息,该输入框511可以用于第二电子设备显示键盘512输入的文字信息。
如图5b所示,响应于用户在键盘512上的操作(如点击操作),第二电子设备可以显示出如图5c所示的用户界面52b,输入提示框521中可以显示跟用户的该操作对应的文字信息,例如;“你的我想有时间”。响应于用户在输入提示框521中选择文字“你”的操作(如点击操作),输入框511中可以显示“你”这一文字信息511a。
第二电子设备可以将该文字信息511a发送给第一电子设备,然后,第一电子设备的用户界面52a中的输入框501中,可以显示该文字信息511a。
此时,如图5d所示,第二电子设备接入一个电话,响应于用户在用界面53b中的来电显示框531中的接听控件531a上的操作(例如点击操作),电子设备可以开启通话进程,此时,第二电子设备的设备状态为忙碌,可以显示出如图5e所示的用户界面54b。此时,第一电子设备可以仍然显示用户界面52a。
可以理解的是,如图5a-图5d所示,当第一电子设备与第二电子设备进行辅助输入时,第三电子设备可以一直显示用户界面50c,第三电子设备的设备状态可以一直都是空闲,不能与第一电子设备进行辅助输入。
如图5e示出了第二电子设备进行通话时的一个用户界面54b。当第二电子设备开启通话进程时,设备状态从输入中切换成忙碌,第二电子设备不能再协助第一电子设备进行输入。
此时,第一电子设备可以继续显示用户界面52a。然后,第一电子设备可以与第二设备优先级的第三电子设备进行辅助输入。
如图5e所示,第三电子设备的用户界面54c可以弹出提示框541,该提示框541中可以包括提示信息541a,同意控件541b,拒绝控件541c。
响应于用户在该同意控件541b上的操作(如点击操作),第一电子设备可以将输入框501中显示的文字信息511a发送给第三电子设备。然后,第三电子设备可以显示出如图5f所示的用户界面55c,该用户界面55c中可以显示输入框551,该输入框中可以显示文字信息511a,以及,第三电子设备的输入法的键盘552。
这样,当第二电子设备的设备切换至忙碌时,第一电子设备仍然可以选择其他的辅助设备进行辅助输入,并且将当前焦点输入框中的显示的信息发送给该其他的辅助设备,使得该其他的辅助设备可以在之前的基础上继续与第一电子设备进行辅助输入。
如图5f-图5k所示,第一电子设备与第三电子设备进行辅助输入,且设备优先级最高的第二电子设备的设备状态为空闲时,第一电子设备可以切换到第二电子设备进行辅助输入,也可以继续与第三电子设备进行辅助输入。
如图5f所示,响应于用户在键盘552上的操作(如点击操作),第三电子设备可以显示出如图5g所示的用户界面56c,输入提示框561中可以显示跟用户的该操作对应的文字信息,例如;“的们的答案”。响应于用户在输入提示框561中选择文字“的”的操作(如点击操作),输入框511中可以显示“你的”这一文字信息511b。
第三电子设备可以将该文字信息511b发送给第一电子设备,然后,第一电子设备的用户界面56a中的输入框501中,可以显示该文字信息511b。
可以理解的是,如图5e-图5g所示,当第一电子设备与第三电子设备进行辅助输入时,第二电子设备可以一直显示用户界面54b,这可以表示第二电子设备的设备状态一直都是忙碌,不能与第一电子设备进行辅助输入。
响应于图5g中所示的用户界面54b中显示的挂断控件562上的操作(如点击操作),第二电子设备可以结束通话进程,显示出如图5h中所示的用户界面内57b。该用户界面57b为第二电子设备的主界面。
此时,第二电子设备的设备状态从忙碌切换到空闲,由于第三电子设备的设备优先级比第一电子设备的设备优先级低,则第一电子设备会向第三电子设备发起一个切换至第二电子设备进行辅助输入的请求。这时,第三电子设备可以显示如图5h中所示的用户界面57c。
如图5h所示,用户界面57c中可以弹出提示框571,该提示框571中可以包括提示信息571a,否控件571b,以及,是控件572c。该提示信息571a用于提示用户:“是否返回第二电 子设备输入”。该否控件571b用于第三电子设备拒绝切换至第二电子设备进行辅助输入的请求。该是控件571c用于第三电子设备同意切换至第二电子设备进行辅助输入的请求。
如果响应于用户在否控件571b上的操作(如点击操作),第三电子设备可以继续与第一电子设备进行辅助输入,该场景可以参考下述对图5i的描述。如果响应于用户在是控件571c上的操作(如点击操作),第三电子设备可以停止与第一电子设备进行辅助输入,然后第二电子设备可以继续与第一电子设备进行辅助输入,该场景可以参考下述对图5j和图5k的描述。
当第三电子设备拒绝切换至第二电子设备进行辅助输入的请求备时,如图5i所示,第三电子设备可以显示用户界面58c,继续获取文字信息,协助第一电子设备进行输入。第一电子设备可以显示用户界面56a。第二电子设备继续显示用户界面54b,设备状态仍然为空闲,不能与第一电子设备进行辅助输入。
当第三电子设备同意切换至第二电子设备进行辅助输入的请求备时,如图5j所示,第一电子设备可以显示用户界面56a。第三电子设备可以显示用户界面59c,该用户界面59c为第三电子设备的主界面,此时,第三电子设备的设备状态由输入中切换至空闲,第三电子设备不能与第一电子设备进行辅助输入。第二电子设备可以显示用户界面59b。该用户界面59b中可以弹出一个提示框503,该提示框用于提示用户是否同意拉起本地输入法,协助第一电子设备输入。响应于用户在该提示框503中的同意控件上的操作(如点击操作),第一电子设备可以将输入框501中显示的文字信息511b发送给第二电子设备。然后,第二电子设备可以显示出如图5k所示的用户界面510b。
如图5k所示,用户界面510b为第二电子设备协助第一电子设备进行输入时的一个用户界面,该用户界面510b中可以显示输入框5101,该输入框5101中可以显示第一电子设备发送的文字信息511b。第一电子设备可以继续显示用户界面56a。第三电子设备可以继续显示用户界面59c。此时,第二电子设备可以协助第一电子设备进行辅助输入。
这样,第一电子设备可以选择设备优先级最高的辅助设备进行辅助输入。这样,第一电子设备可以选择比较合适的辅助设备,提高辅助输入的效率。
下面首先介绍本申请实施提高得到示例性通信系统100.
图6是本申请实施例提供的通信系统100的结构示意图。
如图6所示,该通信系统100包括:多个电子设备,例如第一电子设备、第二电子设备、第三电子设备,第四电子设备,以及,服务器。
本申请实施例中的第一电子设备可以是搭载Android、华为鸿蒙系统(HuaweiHarmonyOS)、iOS、Microsoft或者其它操作系统的终端设备,且该第一电子设备需要通过其他的电子设备才可以完成信息输入。例如智慧屏等。第一电子设备可以作为本申请实施例中涉及的被辅助设备。
第二电子设备、第三电子设备以及第四电子设备可以是搭载Android、华为鸿蒙系统(HuaweiHarmonyOS)、iOS、Microsoft或者其它操作系统的终端设备,且可以直接由本机完成信息输入的电子设备,例如手机、平板电脑等。第二电子设备、第三电子设备以及第四电子设备可以作为本申请实施例中涉及的辅助设备。
通信系统100中的电子设备均安装有第一APP。第一APP为输入法应用。第一APP可以提供信息输入功能。该第一APP例如可以是华为“输入法”等。用户可以通过自己的身份标识登录到电子设备中的第一APP,身份标识例如可以是账号(例如名字、华为标识(identity,ID)、手机号码等)和密码、人脸图像、声纹、指纹等等。用户登录第一 APP后,可以通过第一APP可以向第一电子设备输入信息。
服务器用于为电子设备提供各项服务,例如连接服务、通信服务(数据传输等)等。
电子设备通过接入互联网,可以访问服务器,电子设备可通过3G、4G、5G等蜂窝移动通信技术、广域网(wide area network,WAN)技术、局域网(local area network,LAN)技术或无线局域网技术(wireless LAN,WLAN)技术等和服务器通信。
下面介绍本申请实施例提供的示例性第一电子设备。
图7是本申请实施例提供的第一电子设备的硬件结构示意图。
下面以第一电子设备为例对实施例进行具体说明。应该理解的是,第一电子设备可以具有比图中所示的更多的或者更少的部件,可以组合两个或多个的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
第一电子设备可以包括:处理器122、存储器123、无线通信处理模块124、电源开关125、有线LAN通信处理模块126、USB通信处理模块127和显示屏128。其中:
处理器122可用于读取和执行计算机可读指令。具体实现中,处理器122可主要包括控制器、运算器和寄存器。其中,控制器主要负责指令译码,并为指令对应的操作发出控制信号。运算器主要负责执行定点或浮点算数运算操作、移位操作以及逻辑操作等,也可以执行地址运算和转换。寄存器主要负责保存指令执行过程中临时存放的寄存器操作数和中间操作结果等。具体实现中,处理器122的硬件架构可以是专用集成电路(ASIC)架构、MIPS架构、ARM架构或者NP架构等。
在一些实施例中,处理器122可以用于解析无线通信处理模块124和/有线LAN通信处理模块126接收到的信号,如第一电子设备发送的视频通话请求、采集图像序列请求、处理视频流请求(3D降噪、编解码等)、传输视频流请求、播放视频流请求等。处理器122可以用于根据解析结果进行相应的处理操作,如根据视频通话请求驱动摄像头127执行获取图像,又如根据该显示请求或显示指令驱动显示屏128执行显示等。
在一些实施例中,处理器122还可以用于生成无线通信处理模块124和/或有线LAN通信处理模块126向外发送的信号,如开启视频通话信号、参数协商信号等。
存储器123与处理器122耦合,用于存储各种软件程序和/或多组指令。具体实现中,存储器123可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器123可以存储操作系统,例如实时多任务操作系统(real time multi-tasking operation system,uCOS)等嵌入式操作系统。存储器123还可以存储辅助输入程序,该辅助输入程序可用于与被辅助设备,辅助设备进行辅助输入。
无线通信处理模块124可以包括蓝牙(bluetooth,BT)通信处理模块124A、WLAN通信处理模块124B中的一项或多项,用于和提供即时通讯服务的服务器建立无线通信连接。
无线通信处理模块124可用于将文字信息发送至其他电子设备。例如第一电子设备可以将文字信息通过无线通信处理模块发送到第二电子设备、第三电子设备。
无线通信处理模块124还用于接收其他电子设备发送的文字信息。例如第一电子设备可以接收到第二电子设备、第三电子设备发送的文字信息。
电源开关125可用于控制电源向第一电子设备的供电。
有线LAN通信处理模块126可用于通过有线LAN和同一个LAN中的其他电子设备进行通信,还可用于通过有线LAN连接到WAN,可与WAN中的设备通信。
USB通信处理模块127可用于通过USB接口(未示出)与其他设备进行通信。
显示屏128可用于文字信息、图像等。显示屏128可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED)显示屏,有源矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED)显示屏,柔性发光二极管(flexible light-emitting diode,FLED)显示屏,量子点发光二极管(quantum dot light emitting diodes,QLED)显示屏等。
本申请实施例中,该处理器122可以调用内部存储器123中存储的计算机指令,以使得第一电子设备执行本申请实施例中的辅助输入方法。
下面介绍本申请实施例提供的示例性第二电子设备。
图8是本申请实施例提供的第二电子设备的硬件结构示意图。
下面以第二电子设备为例对实施例进行具体说明。应该理解的是,第二电子设备可以具有比图中所示的更多的或者更少的部件,可以组合两个或多个的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
应该理解的是,第三电子设备以及第四电子设备等辅助设备可以具有与第二电子设备相同的结构。
第二电子设备可以包括:处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是第二电子设备的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口, 脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
天线1和天线2用于发射和接收电磁波信号。第二电子设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在第二电子设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在第二电子设备上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行第二电子设备的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用(比如人脸识别功能,指纹识别功能、移动支付功能等)等。存储数据区可存储第二电子设备使用过程中所创建的数据(比如人脸信息模板数据,指纹信息模板等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。第二电子设备根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,第二电子设备根据压力传感器180A检测所述触摸操作强度。第二电子设备也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸 传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于第二电子设备的表面,与显示屏194所处的位置不同。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。第二电子设备可以接收按键输入,产生与第二电子设备的用户设置以及功能控制有关的键信号输入。
本申请实施例中,该处理器110可以调用内部存储器121中存储的计算机指令,以使得第二电子设备执行本申请实施例中的辅助输入方法。
下面结合上述示例性第一电子设备、第二电子设备的硬件结构示意图,对本申请实施例中的方法进行具体描述:
应用场景1:因为第二电子设备是设备群组中设备优先级最高且设备状态为空闲的辅助设备,所有第一电子设备首先与进行辅助输入。然后,该第二电子设备开启通话进程之后,不可以再协助第一电子设备进行输入时,第一电子设备将输入框中的文字信息发送给第二设备优先级且设备状态为空闲的第三电子设备,与第三电子设备进行辅助输入。
图9为本申请实施例中,应用场景1的一个信令交互示意图。
图10示出了应用场景1的一个交互信息流示意图。
如图10所示,为第一电子设备、第二电子设备,以及,第三电子设备的软件模块间的信息流。其中,第一电子设备的软件模块可以包括:输入框管理模块911、输入法框架服务模块912,多设备数据传输服务模块913。该输入法框架服务模块912中包括输入管理模块912a以及设备群组状态管理模块912b。第二电子设备可以包括输入框管理模块921、辅助输入模块922,多设备数据传输服务模块923。该辅助输入模块922中包括输入管理模块922a以及状态信息管理模块922b。第三电子设备可以包括输入框管理模块931、辅助输入模块932,多设备数据传输服务模块933。该辅助输入模块932中包括输入管理模块932a以及状态信息管理模块932b。
可以理解的是,图10示出的仅仅为第一电子设备、第二电子设备、第三电子设备中的部分软件模块,不应该对其的软件构架构成限定。
场景1的过程如图9所示,该过程包括步骤S101-步骤S1024,下面结合图10所示的交互信息流示意图,对步骤S101-步骤S1024进行具体描述:
S101.第一电子设备、第二电子设备、第三电子设备建立设备群组;
当第一电子设备与第二电子设备、第三电子设备完成输入法协同后,就建立了设备群组。
具体的,首先,第一电子设备、第二电子设备、第三电子设备首先通过网络连接构成分布式协同场景。然后,第一电子设备与第二电子设备完成输入法协同。具体的,第一电子设备的输入法框架服务模块912中的输入管理模块912a可以向本机的多设备数据传输服务模块913发送一个输入法协同请求,多设备数据传输服务模块913可以将该请求发送给第二电子设备的多设备数据传输服务模块923,该请求用于询问第二电子设备,是否将本机的输入法与第一电子设备的输入法进行协同,完成同一个信息输入。然后,第二电子设备的多设备数据传输服务模块923可以将该请求发送给本机的辅助输入模块922中的输入管理模块922a。然后第二电子设备的输入管理模块922a可以将与第一电子设备进行输入法协同的响应发送给本机的多设备数据传输服务模块923,然后该多设备数据传输服务模块923可以将该响应 发送给第一电子设备多设备数据传输服务模块913,该多设备数据传输服务模块913可以将该请求发送给第一电子设备的输入管理模块912a。这样,第一电子设备就与第二电子设备完成了输入法协同。
可以理解的是,第一电子设备也可以与第三电子设备完成输入法协同,该过程可以参考上述描述,此处不在赘述。
S102.第一电子设备设定第二电子设备、第三电子设备的设备优先级;
具体的,第一电子设备的输入管理模块912a可以设置设备群组中的电子设备的设备优先级。然后,将设置好的设备优先级发送给输入法框架模块912中的设备群组状态管理模块912b,该设备群组状态管理模块912b可以将设备优先级信息中的电子设备的优先级设置为对应的设备优先级。
在一些实施例中,用户可以直接选择设备群组中的电子设备的优先级。例如,响应于用户将第二电子设备设置为第一设备优先级的操作,第一电子设备可以将第二电子设备的设备优先级设置为第一设备优先级。
在一些实施例中,第一电子设备可以根据设备群组中的电子设备的网络信号的强弱设置设备群组中其他电子设备的设备优先级。然后,将本机的设备优先级设置为最低的优先级,例如,电子设备可以将网路信号最强的电子设备设置为第一设备优先级。
在另一些实施例中,第一电子设备可以根据设备群组中的电子设备的网络信号的强弱设置设备群组中其他电子设备,不设置本机的设备优先级。
可以理解的是,还有其他设置设备优先级的方式,本申请实施例对此不作限定。
示例性的,在一种实现方式中,若在设备优先级信息中使用MEID作为电子设备的唯一标识,将第一设备优先级记为“1”,第二设备优先级记为“2”,依次类推。则此时,设备优先级信息可以表示为:
电子设备的标识 设备优先级
第二电子设备的IMEI 1
第三电子设备的IMEI 2
表3
从该表3所示的设备优先级信息可以确定,第一电子设备设置第二电子设备的设备优先级为第一设备优先级,设置第三电子设备的设备优先级为第二设备优先级,没有设置本机的设备优先级。
S103.第一电子设备确定焦点输入框;
焦点输入框是被辅助设备用于显示信息的输入框。该信息可以包括辅助设备发送的,以及本机输入的。
响应于用户选择第一电子设备的输入框的操作(如点击操作),第一电子设备的输入框管理模块911可以设置该输入框为焦点输入框。
该过程可以参考图5a中对第一电子设备的用户界面50a的描述以及图5b中对第一电子设备的用户界面51a的描述,此处不再赘述。
S104.第二电子设备通知第一电子设备本机的设备状态为空闲;
当第二电子设备可以与第一电子设备进行辅助输入,但是没有与第一电子设备进行辅助 输入时,第二电子设备可以设置本机的设备状态为空闲,然后将该设备状态发送给第一电子设备。
具体的,第二电子设备的状态信息管理模块922b可以设置本机的设备状态为空闲。然后将该设备状态发送给本机的多设备数据传输服务模块923。
第二电子设备的多设备数据传输服务模块923可以将本机的设备状态发送给第一电子设备的多设备数据传输服务模块913。
S105.第一电子设备更新设备状态信息中第二电子设备的设备状态为空闲;
具体的,第一电子设备的多设备数据传输服务模块913可以将第二电子设备的设备状态发送给本机的设备群组状态管理模块912b,该设备群组状态管理模块912b可以将设备状态信息中第二电子设备的从初始化设备状态为忙碌更新设备状态为空闲;
此时,设备群组中的第二电子设备的设备状态为空闲,第三电子设备的设备状态可以仍然为初始化设备状态,即忙碌。
示例性的,在一种实现方式中,若在设备优先级信息中使用MEID作为电子设备的唯一标识。则此时,设备状态信息可以表示为:
电子设备的标识 设备优先级
第二电子设备的IMEI 空闲
第三电子设备的IMEI 忙碌
表4
S106.第一电子设备发送辅助输入请求给第二电子设备;
当第一电子设备没有与设备群组中的任何辅助设备进行辅助输入时,第一电子设备可以选择设备群组中,设备状态为空闲的辅助设备中,设备优先级最高的辅助设备进行辅助输入,所以,此处,第一电子设备选择第二电子设备进行辅助输入。
响应于用户选择第一电子设备的输入框的操作(如点击操作),第一电子设备可以向第二电子设备发送辅助输入请求。
具体的,第一电子设备的输入管理模块912a可以通过设备群组状态管理模块912b,获取设备优先级信息以及设备状态信息,确定第二电子设备是设备状态为空闲的辅助设备中优先级最高的辅助设备。然后,该输入管理模块912a可以将第二电子设备的标识,以及,辅助输入请求发送给本机的多设备数据传输服务模块913。
第一电子设备的多设备数据传输服务模块913可以根据第二电子设备的标识,将辅助输入请求发送给第二电子设备的多设备数据传输服务模块923。
在一些实施例中,第二电子设备接收到该辅助输入请求之后,可以显示如图5a中的第二电子设备的用户界面50b,此处可以参考前述相应的描述,不再赘述。
S107.第二电子设备拉起输入法;
具体的,第二电子设备的多设备数据传输服务模块923可以将该辅助输入请求发送给本机的输入管理模块922a,该输入管理模块922a可以拉起第二电子设备的输入法。
在一些实施例中,第二电子设备拉起本地输入法的一个用户界面可以参考前述对图5b中的第二电子设备的用户界面51b的描述,此处不再赘述。
S108.第二电子设备通知第一电子设备本机的设备状态为输入中;
可选的,当第二电子设备可以与第一电子设备进行辅助输入时,第二电子设备可以设置本机的设备状态为输入中,然后将该设备状态发送给第一电子设备。
可以理解的是,步骤S108涉及的过程与前述步骤S104中的过程相似,可以参考前述对步骤S104的描述,此处不再赘述。
S109.第一电子设备更新设备状态信息中第二电子设备的设备状态为输入中;
可以理解的是,步骤S109涉及的过程与前述步骤S105中的过程相似,可以参考前述对步骤S105的描述,此处不再赘述。
示例性的,在一种实现方式中,若在设备优先级信息中使用MEID作为电子设备的唯一标识。则此时,设备状态信息可以表示为:
电子设备的标识 设备优先级
第二电子设备的IMEI 输入中
第三电子设备的IMEI 忙碌
表5
如表5所示,此时,设备群组中的第二电子设备的设备状态为输入中,第三电子设备的设备状态可以仍然为初始化设备状态,即忙碌。
在一些实施例中,可以不执行步骤S108,当第一电子设备确定与第二电子设备进行辅助输入时,第一电子设备可以直接设置设备状态信息中第二电子设备的状态信息为输入中。
S1010.第二电子设备获取第一信息;
在一些实施例中,第一信息为第二电子设备的输入框中显示的全部信息。
响应于用户在第二电子设备的键盘中输入第一信息的操作,该第一信息可以为文字信息。第二电子设备可以获取该第一信息,然后,将该第一信息显示在本机的输入框中。
具体的,第二电子设备的输入框管理模块922a可以获取该第一信息,然后,将该第一信息显示在本机的输入框中。
在一些实施例中,该过程可以参考前述对图5b以及图5c中对第二电子设备的用户界面的描述,此处不再赘述。
S1011.第二电子设备发送第一信息给第一电子设备;
具体的,第二电子设备的输入框管理模块922a可以将该第一信息发送给本机的输入管理模块922a,然后该输入管理模块922a可以将该第一信息发送给本机的多设备数据传输服务模块923。然后该多设备数据传输服务模块923可以将该第一信息发送给第一电子设备的多设备数据传输服务模块913。
S1012.第一电子设备在焦点输入框中显示该第一信息;
具体的,第一电子设备的多设备数据传输服务模块913可以将该第一信息发生给本机的输入管理模块912a。然后,该输入管理模块912a可以将该信息发送给本机的输入框管理模块911,该输入框管理模块911可以将该信息显示在焦点输入框中。
在一些实施例中,该过程的一个示例性用户界面可以参考前述对图5c中的第一电子设备的用户界面52a的描述,此处不再赘述。
S1013.第二电子设备开启通话进程;
在一些实施例,该过程可以前述对图5d-图5f中的第二电子设备的用户界面的描述,此处不再赘述。
S1014.第二电子设备通知第一电子设备本机的设备状态为忙碌;
此时,第二电子设备不可以与第一电子设备进行辅助输入,第二电子设备可以设置本机的设备状态为忙碌,然后将该设备状态发送给第一电子设备。
可以理解的是,步骤S1014涉及的过程与前述步骤S104中的过程相似,可以参考前述对步骤S104的描述,此处不再赘述。
S1015.第一电子设备更新设备状态信息中第二电子设备的设备状态为忙碌;
可以理解的是,步骤S1015涉及的过程与前述步骤S105中的过程相似,可以参考前述对步骤S105的描述,此处不再赘述。
示例性的,在一种实现方式中,若在设备优先级信息中使用MEID作为电子设备的唯一标识。则此时,设备状态信息可以表示为:
电子设备的标识 设备优先级
第二电子设备的IMEI 忙碌
第三电子设备的IMEI 忙碌
表6
如表6所示,此时,设备群组中的第二电子设备的设备状态为忙碌,第三电子设备的设备状态可以仍然为初始化设备状态,即忙碌。
S1016.第一电子设备删除设备状态信息中第二电子设备的信息;
可选的,当第二电子设备的设备状态从输入中更新为忙碌时,可以触发第一电子设备删除设备状态信息中第二电子设备的信息。
具体的,第一电子设备的设备群组状态管理模块912b可以删除设备状态信息中第二电子设备的状态信息。
S1017.第三电子设备通知第一电子设备本机的设备状态为空闲;
当第三电子设备可以与第一电子设备进行辅助输入,但是没有与第一电子设备进行辅助输入时,第三电子设备可以设置本机的设备状态为空闲,然后将该设备状态发送给第一电子设备。
具体的,第三电子设备中的辅助输入模块932中的状态信息管理模块932b可以设置本机的设备状态为空闲。然后将该设备状态发送给本机的多设备数据传输服务模块933。
第三电子设备的多设备数据传输服务模块933可以将本机的设备状态发送给第一电子设备的多设备数据传输服务模块913。
S1018.第一电子设备更新设备状态信息中第三电子设备的设备状态为空闲;
可以理解的是,步骤S1018涉及的过程与前述步骤S105中的过程相似,可以参考前述对步骤S105的描述,此处不再赘述。
如果,第一电子设备执行了步骤S1016,则此时,设备状态信息可以表示为:
电子设备的标识 设备优先级
第三电子设备的IMEI 空闲
表7
如表7所示,此时,设备群组中的第二电子设备的信息已经被删除,第三电子设备的设备状态由忙碌更新为空闲。
S1019.第一电子设备发送辅助输入请求给第三电子设备;
具体的,第一电子设备的输入管理模块912a可以通过设备群组状态管理模块912b,获取设备优先级信息以及设备状态信息,确定第三电子设备是设备状态为空闲的辅助设备中优先级最高的辅助设备。然后,该输入管理模块912a可以将第三电子设备的标识,以及,辅助输入请求发送给本机的多设备数据传输服务模块913。
第一电子设备的多设备数据传输服务模块913可以根据第三电子设备的标识,将辅助输入请求发送给第三电子设备的多设备数据传输服务模块933。
在一些实施例中,第三电子设备接收到该辅助输入请求之后,可以显示如图5e中的第三电子设备的用户界面54c,此处可以参考前述相应的描述,不再赘述。
S1020.第一电子设备发送第二信息给第三电子设备;
此时,第二信息为焦点输入框中显示的全部信息。第二信息可以为第一信息或者根据该第一信息处理得到的信息;
具体的,第一电子设备的输入管理模块912可以将第二信息发送给本机的多设备数据传输服务模块913,第一电子设备的多设备数据传输服务模块913该第二信息发送给第三电子设备的多设备数据传输服务模块933。
可以理解的是,在一些实施例中,假设在步骤S1012之后,第一电子设备的焦点输入框中显示的全部信息仍然是第一信息,则该第二信息就是第一信息。
在另一些实施例中,假设在步骤S1012之后,第一电子设备的焦点输入框中显示的全部信息可以不再是第一信息了。具体的,当第一电子设备对第一信息进行处理之后,例如删除部分第一信息中内容的操作,则第二信息是第一信息中的一部分。例如删除全部第一信息的操作然后再新输入其他信息,则第二信息是该新输入的其他信息。此时第一信息与第二信息不相同。
S1021.第三电子设备拉起输入法,显示第二信息;
具体的,在一些实施例中,第三电子设备的多设备数据传输服务模块933可以将辅助输入请求发送给本机的输入管理模块932a,该输入管理模块932a可以拉起第二电子设备的输入法。
然后,第三电子设备的多设备数据传输服务模块933可以将第二信息发送给本机的输入管理模块932a,该输入管理模块932a可以将该第二信息发送给本机的输入框管理模块931,该输入框管理模块931可以将该第二信息显示在输入框中。
可以理解的是,该多设备数据传输服务模块933将辅助输入请求与第二信息发送给本机的输入管理模块932a的过程,没有先后顺序。
在一些实施例中,该过程的一个用户界面可以参考前述对图5f中的第三电子设备的用户 界面55c的描述,此处不再赘述。
S1022.第三电子设备获取第三信息;
第三信息为第三电子设备的输入框中显示的全部信息。
响应于用户在第三电子设备的键盘中输入信息的操作,该信息可以为文字信息。第二电子设备可以根据该信息对第二信息进行增、删等操作,得到第三信息,然后,将该第三信息显示在本机的输入框中。
具体的,第三电子设备的输入框管理模块932a可以获取该第三信息,然后,将该第三信息显示在本机的输入框中。
在一些实施例中,该过程可以参考前述对图5f以及图5g中的第三电子设备的用户界面的描述,此处再赘述。
S1023.第三电子设备发送第三信息给第一电子设备;
可以理解的是,步骤S1023涉及的过程与前述步骤S1011中的过程相似,可以参考前述对步骤S1011的描述,此处不再赘述。
S1024.第一电子设备在焦点输入框中显示第三信息;
可以理解的是,步骤S1024涉及的过程与前述步骤S1012中的过程相似,可以参考前述对步骤S1012的描述,此处不再赘述。
在一些实施例中,该过程的一个示例性用户界面可以参考前述对图5g中的第一电子设备的用户界面56a的描述,此处不再赘述。
上述步骤S105只要发生在步骤S104之后即可,步骤S104只要发生在步骤S101之后即可;步骤S1018只要发生在步骤S1017之后即可、步骤S1017只要发生在步骤S101之后即可;步骤S109只要发生在步骤S108之后即可;步骤S1015只要发生在步骤S1014之后即可;步骤S1016可以不执行,如果执行只要发生在步骤S1015之后即可;步骤S1019与步骤S1020之间没有先后顺序,可以同时执行。
应用场景2:结合应用场景1,假设此时第二电子设备结束通话进程,则第一电子设备可以切换到第一设备优先级的第二电子设备进行辅助输入,也可以继续和第二设备优先级的第三电子设备进行辅助输入。
图11为本申请实施例中,应用场景2的一个信令交互图。
该场景下,设备群组中的电子设备间的信息流可以参考图10。
场景2的过程如图10所示,该过程包括步骤S201-步骤S2013,下面结合图10所示的交互信息流示意图,对步骤S201-步骤S2013进行具体描述:
S201.第二电子结束通话进程;
在一些实施例,该过程可以前述对图5f-图5g中的第二电子设备的用户界面的描述,此处不再赘述。
S202.第二电子设备通知第一电子设备本机的设备状态为空闲;
当第二电子设备可以与第一电子设备进行辅助输入,但是没有与第一电子设备进行辅助 输入时,第二电子设备可以设置本机的设备状态为空闲,然后将该设备状态发送给第一电子设备。
可以理解的是,步骤S202涉及的过程与前述步骤S104中的过程相同,可以参考前述对步骤S104的描述,此处不再赘述。
S203.第一电子设备更新设备状态信息中第二电子设备的设备状态为空闲;
在一些实施例中,在步骤S1016中,如果第一电子设备在第二电子设备的设备状态从输入中更新为忙碌时,删除了设备状态信息中,第二电子设备的信息。则此时,第一电子设备需要先重新添加第二电子设备的设备状态,并且初始化为忙碌,然后再将第二电子设备的设备状态更新为空闲。
在另一些实施例中,没有执行步骤S1016,则第一电子设备将设备状态信息中第二电子设备的设备状态为忙碌更新为空闲。
可以理解的是,步骤S203涉及的过程可以参考前面的描述,此处不再赘述。
示例性的,在一种实现方式中,若在设备优先级信息中使用MEID作为电子设备的唯一标识。则此时,设备状态信息可以表示为:
电子设备的标识 设备优先级
第二电子设备的IMEI 空闲
第三电子设备的IMEI 输入中
表8
如表8所示,此时,设备群组中的第二电子设备的设备状态为空闲,第三电子设备的设备状态可以仍然为输入中。
S204.第一电子设备发送辅助输入切换请求给第三电子设备;
当设备群组中,有设备状态为空闲的辅助设备,且该辅助设备的设备优先级比输入中的辅助设备的设备优先级高时,第一电子设备可以向正在进行辅助输入的辅助设备发送辅助输入切换请求。该请求用于询问正在进行辅助输入的辅助设备,是否切换到当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备进行辅助输入。
由于第二电子设备的设备优先级比第三电子设备高,当第二电子设备的设备状态为空闲时,第一电子设备可以向第三电子设备,发送一个辅助输入切换请求,该请求用于询问第三电子设备,是否切换到第二电子设备进行辅助输入。
具体的,第一电子设备的输入管理模块912a可以通过设备群组状态管理模块912b,获取设备优先级信息以及设备状态信息,确定第二电子设备是设备状态为空闲的辅助设备中优先级最高的辅助设备,以及,第三电子设备的设备状态为输入中。然后,该输入管理模块912a可以将第三电子设备的标识,以及,辅助输入切换请求发送给本机的多设备数据传输服务模块913。
第一电子设备的多设备数据传输服务模块913可以根据第三电子设备的标识,将辅助输入切换请求发送给第三电子设备的多设备数据传输服务模块933。
S205.第三电子设备确定是否切换到第二电子设备;
具体的,第三电子设备的多设备数据传输服务模块933,可以将该辅助输入切换请求发送给本机的输入管理模块932a,该输入管理模块932a可以判断第三电子设备是否切换到第二 电子设备。
在一种情况下,响应于用户同意切换到第二电子设备的操作,第三电子设备可以确定切换到第二电子设备进行辅助输入。
在另一种情况下,响应于用户拒绝切换到第二电子设备的操作,第三电子设备可以确定不切换到第二电子设备进行辅助输入。在一些实施例中,该过程的一个用户界面可以参考前述对5h中的第三电子设备的用户界面57c的描述,此处暂不赘述。
如果第三电子设备确定切换到第二电子设备进行辅助输入,则执行步骤S206-步骤S209,如果第三电子设备确定不切换到第二电子设备进行辅助输入,则执行步骤S2010-步骤S2013。
S206.第三电子设备通知第一电子设备,切换至第二电子设备进行辅助输入;
具体的,第三电子设备的输入管理模块932a可以将第三电子设备确定切换到第二电子设备进行辅助输入的响应发送给本机的多设备数据传输服务模块933。然后该多设备数据传输服务模块933可以将该响应发送给第一电子设备的多设备数据传输服务模块913。
S207.第一电子设备发送辅助输入指令给第二电子设备;
第一电子设备选择与第二电子设备进行辅助输入,发送辅助输入指令给第二电子设备。
具体的,第一电子设备的多设备数据传输服务模块913可以该第三电子设备确定切换到第二电子设备进行辅助输入的响应发送给本机的输入管理模块912a。然后,该输入管理模块912a可以将第二电子设备的标识,以及,辅助输入请求发送给本机的多设备数据传输服务模块913。
第一电子设备的多设备数据传输服务模块913可以根据第二电子设备的标识,将辅助输入请求发送给第二电子设备的多设备数据传输服务模块923。
在一些实施例中,第二电子设备接收到该辅助输入请求之后,可以显示如图5j中的第二电子设备的用户界面59b,此处可以参考前述相应的描述,不再赘述。
S208.第一电子设备发送第四信息给第二电子设备;
步骤S208涉及的过程与前述步骤S1020中的过程相似,可以参考前述对步骤S1020的描述,此处不再赘述。
S209.第二电子设备拉起输入法,显示第四信息;
步骤S209涉及的过程与前述步骤S1021中的过程相似,可以参考前述对步骤S1021的描述,此处不再赘述。
在一些实施例中,该过程的一个用户界面可以参考前述对图5k中的第二电子设备的用户界面510b的描述,此处不再赘述。
可以理解的是,在一些实施例中,上述步骤S207之后,第二电子设备同意与第一电子设备进行辅助输入之后,第一电子设备可以更新设备状态信息将第二电子设备的设备状态从空闲更新为输入中,将第三电子设备的设备状态从输入中更新为空闲。
可以理解的是,在一些实施例中,上述步骤S207之后,如果第二电子设备拒绝与第一电子设备进行辅助输入的请求,则第一电子设备可以继续与第三电子设备进行辅助输入。
第二电子设备拒绝与第一电子设备进行辅助输入的请求可以包括:超时未响应,即第二 电子设备在接收到第一电子设备的辅助请求之后的一段时间内没有做出响应,此时第一电子设备在发送给第二电子设备进行辅助输入的请求后,一段时间内没有收到第二电子设备的响应,则认为第二电子设备拒绝与第一电子设备进行辅助输入。以及,响应于用户拒绝与电子设备进行辅助输入的请求。
S2010.第三电子设备通知第一电子设备,不切换至第二电子设备进行辅助输入;
第一电子设备继续与第三电子设备进行辅助输入。
具体的,第三电子设备的输入管理模块932a可以将第三电子设备确定不切换到第二电子设备进行辅助输入的响应发送给本机的多设备数据传输服务模块933。然后该多设备数据传输服务模块933可以将该响应发送给第一电子设备的多设备数据传输服务模块913。
第一电子设备继续与第三电子设备进行辅助输入。
S2011.第三电子设备获取第五信息;
步骤S2011涉及的过程与前述步骤S1022中的过程相似,可以参考前述对步骤S1022的描述,此处不再赘述。
S2012.第三电子设备发送第五信息给第一电子设备;
步骤S2012涉及的过程与前述步骤S1023中的过程相似,可以参考前述对步骤S1023的描述,此处不再赘述。
S2013.第一电子设备在焦点输入框中显示该第五信息。
步骤S2013涉及的过程与前述步骤S1024中的过程相似,可以参考前述对步骤S1024的描述,此处不再赘述。
上述步骤S207、步骤S208之间没有先后顺序,也可以同时执行。
可以理解的是,上述场景1与场景2中,第一电子设备发送给设备群组中的其他电子设备的信息始终是焦点输入框中显示的全部信息,该信息中可以包括第一电子设备通过本机进行输入时得到的信息。
可以理解的是,本申请实施例中,设备群组中的一个电子设备向该设备群组中的其他电子设备发送信息时,例如请求、文字信息、响应等,都可以携带本机的唯一标识,例如为设备名称、设备物理地址、移动设备识别码(mobile equipment identifier,MEID),国际移动设备识别码(international mobile equipment identity,IMEI)中的一个或其组合等。也可以将本机的唯一标识与该信息共同发送给其他的电子设备。只要能使其他的电子设备识别该信息来自本机即可,本申请实施例对此不做限定。
这样,采用本申请实施例中的辅助输入方法,被辅助设备与多个辅助设备组成设备群组,被辅助设备可以选择设备群组中,设备状态为空闲的辅助设备中,设备优先级最高的辅助设备,进行辅助输入。只要设备群组中有任一个辅助设备的设备状态为输入中或者空闲,就可以协助被辅助设备进行输入。
本申请实施例中,第二电子设备也可以被称为第一辅助设备,第三电子设备也可以被称 为第二辅助设备。
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
上述实施例中所用,根据上下文,术语“当…时”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地,根据上下文,短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。

Claims (27)

  1. 一种辅助输入方法,其特征在于,包括:
    被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息;
    当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;
    所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
  2. 根据权利要求1所述的方法,其特征在于,所述第二信息为所述第一信息或根据所述第一信息处理得到的信息,具体包括:
    当所述被辅助电子设备没有对所述第一信息进行处理时,所述第一信息与所述第二信息相同;
    当所述被辅助电子设备对所述第一信息进行处理时,所述第一信息与所述第二信息不相同。
  3. 根据权利要求1所述的方法,其特征在于,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:
    所述辅助设备发送辅助输入请求给所述第一辅助设备。
  4. 根据权利要求1所述的方法,其特征在于,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息之前,所述方法还包括:
    当所述被辅助设备接收到第一辅助设备的设备状态为忙碌的信息时,所述被辅助设备在设备状态信息中更新第一辅助设备的设备状态为忙碌。
  5. 根据权利要求1所述的方法,其特征在于,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之前,所述方法还包括:
    所述被辅助设备更新设备状态信息中,所述第二辅助设备的设备状态为空闲。
  6. 根据权利要求1所述的方法,其特征在于,被辅助设备在焦点输入框中显示第一辅助设备发送的第一信息,具体包括:
    所述被辅助设备确定焦点输入框,所述焦点输入框用于显示信息;
    所述被辅助设备接收所述第一辅助设备发送的第一信息,所述第一信息为所述被辅助设备输入框中显示的全部信息;
    所述被辅助设备在所述焦点输入框中显示所述第一信息。
  7. 根据权利要求6所述的方法,其特征在于,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,具体包括:
    所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备,所述第二信息为 所述焦点输入框中显示的全部信息。
  8. 根据权利要求1-7中任一项所述的方法,其特征在于,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备之后,所述方法还包括:
    所述被辅助设备接收到第一辅助设备的设备状态为空闲的信息时,所述被辅助设备在所述设备状态信息中更新第一辅助设备的设备状态为空闲;
    所述被辅助设备发送辅助输入切换请求给所述第二辅助设备;所述辅助输入切换请求用于询问所述第二辅助设备,是否切换到所述第一辅助设备进行辅助输入;此时,所述第一辅助设备为当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备;
    所述被辅助设备继续与所述第二辅助设备进行辅助输入或者选择所述第一辅助设备进行辅助输入。
  9. 根据权利要求8所述的方法,其特征在于,所述被辅助设备继续与第二辅助设备进行辅助输入或者与第一辅助设备进行辅助输入,具体包括:
    当所述被辅助设备接收到所述第二辅助设备发送的切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备选择所述第一辅助设备进行辅助输入;
    当所述被辅助设备接收到所述第二辅助设备发送的不切换至第一辅助设备进行辅助输入的信息时,所述被辅助设备继续与第二辅助设备进行辅助输入。
  10. 根据权利要求9所述的方法,其特征在于,所述被辅助设备选择所述第一辅助设备进行辅助输入之后,所述方法还包括:
    当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则所述被辅助设备继续与第二辅助设备进行辅助输入。
  11. 根据权利要求10所述的方法,其特征在于,当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则所述被辅助设备继续与第二辅助设备进行辅助输入,具体包括:
    当所述第一辅助设备在接收到所述被辅助设备的辅助请求之后的一段时间内没有做出响应时,则所述被辅助设备继续与第二辅助设备进行辅助输入。
  12. 一种被辅助设备,其特征在于,所述被辅助设备包括:存储器、一个或多个处理器;所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述被辅助设备执行:
    在焦点输入框中显示第一辅助设备发送的第一信息;
    确定第一辅助设备的设备状态切换到忙碌时,将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;
    在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
  13. 根据权利要求12所述的被辅助设备,其特征在于,所述一个或多个处理器具体用 于调用所述计算机指令以使得所述被辅助设备执行:
    没有对所述第一信息进行处理时,所述第一信息与所述第二信息相同;
    对所述第一信息进行处理时,所述第一信息与所述第二信息不相同。
  14. 根据权利要求12所述的被辅助设备,其特征在于,在焦点输入框中显示第一辅助设备发送的第一信息之前,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:
    发送辅助输入请求给所述第一辅助设备。
  15. 根据权利要求12所述的被辅助设备,其特征在于,在焦点输入框中显示第一辅助设备发送的第一信息之前,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:
    当接收到第一辅助设备的设备状态为忙碌的信息时,在设备状态信息中更新第一辅助设备的设备状态为忙碌。
  16. 根据权利要求12所述的被辅助设备,其特征在于,将焦点输入框中显示的第二信息发送给第二辅助设备之前,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:
    更新设备状态信息中,所述第二辅助设备的设备状态为空闲。
  17. 根据权利要求12所述的被辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:
    确定焦点输入框,所述焦点输入框用于显示信息;
    接收所述第一辅助设备发送的第一信息,所述第一信息为所述被辅助设备输入框中显示的全部信息;
    在所述焦点输入框中显示所述第一信息。
  18. 根据权利要求17所述的被辅助设备,其特征在于,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:
    将焦点输入框中显示的第二信息发送给第二辅助设备,所述第二信息为所述焦点输入框中显示的全部信息。
  19. 根据权利要求12-18中任一项所述的被辅助设备,其特征在于,将焦点输入框中显示的第二信息发送给第二辅助设备之后,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:
    接收到第一辅助设备的设备状态为空闲的信息时,在所述设备状态信息中更新第一辅助设备的设备状态为空闲;
    发送辅助输入切换请求给所述第二辅助设备;所述辅助输入切换请求用于询问所述第二辅助设备,是否切换到所述第一辅助设备进行辅助输入;此时,所述第一辅助设备为当前设备状态为空闲的辅助设备中设备优先级最高的辅助设备;
    继续与所述第二辅助设备进行辅助输入或者选择所述第一辅助设备进行辅助输入。
  20. 根据权利要求19所述的被辅助设备,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:
    当接收到所述第二辅助设备发送的切换至第一辅助设备进行辅助输入的信息时,选择所述第一辅助设备进行辅助输入;
    当接收到所述第二辅助设备发送的不切换至第一辅助设备进行辅助输入的信息时,继续与第二辅助设备进行辅助输入。
  21. 根据权利要求20所述的被辅助设备,其特征在于,选择所述第一辅助设备进行辅助输入之后,所述一个或多个处理器还用于调用所述计算机指令以使得所述被辅助设备执行:
    当所述第一辅助设备拒绝与所述被辅助设备进行辅助输入时,则继续与第二辅助设备进行辅助输入。
  22. 根据权利要求21所述的被辅助设备,其特征在于,所述一个或多个处理器具体用于调用所述计算机指令以使得所述被辅助设备执行:
    当所述第一辅助设备在接收到所述被辅助设备的辅助请求之后的一段时间内没有做出响应时,则继续与第二辅助设备进行辅助输入。
  23. 一种辅助输入方法,其特征在于,包括:
    第一辅助设备将第一信息发送给被辅助设备;所述第一信息为所述第一辅助设备的输入框显示的全部信息;
    所述被辅助设备在焦点输入框中显示所述第一辅助设备发送的所述第一信息;
    当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先级最高的辅助设备;
    所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
  24. 一种系统,其特征在于,所述系统包括:被辅助设备、第一辅助设备和第二辅助设备;所述被辅助设备、第一辅助设备和第二辅助设备包括:存储器、一个或多个处理器;所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述被辅助设备、第一辅助设备和第二辅助设备执行:
    第一辅助设备将第一信息发送给被辅助设备;所述第一信息为所述第一辅助设备的输入框显示的全部信息;
    所述被辅助设备在焦点输入框中显示所述第一辅助设备发送的所述第一信息;
    当所述被辅助设备确定第一辅助设备的设备状态切换到忙碌时,所述被辅助设备将焦点输入框中显示的第二信息发送给第二辅助设备;所述第二信息为所述第一信息或根据所述第一信息处理得到的信息;所述第二辅助设备为设备群组中设备状态为空闲的辅助设备中优先 级最高的辅助设备;
    所述被辅助设备在所述焦点输入框中显示所述第二辅助设备发送的第三信息,所述第三信息为所述第二信息或根据所述第二信息处理得到信息。
  25. 一种芯片系统,所述芯片系统应用于电子设备,所述芯片系统包括一个或多个处理器,所述处理器用于调用计算机指令以使得所述电子设备执行如权利要求1-11中任一项所述的方法。
  26. 一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行如权利要求1-11中任一项所述的方法。
  27. 一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1-11中任一项所述的方法。
PCT/CN2022/082534 2021-03-27 2022-03-23 辅助输入方法、电子设备以及系统 WO2022206515A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110329155.XA CN115129165A (zh) 2021-03-27 2021-03-27 辅助输入方法、电子设备以及系统
CN202110329155.X 2021-03-27

Publications (1)

Publication Number Publication Date
WO2022206515A1 true WO2022206515A1 (zh) 2022-10-06

Family

ID=83374104

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/082534 WO2022206515A1 (zh) 2021-03-27 2022-03-23 辅助输入方法、电子设备以及系统

Country Status (2)

Country Link
CN (1) CN115129165A (zh)
WO (1) WO2022206515A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103648001A (zh) * 2013-11-29 2014-03-19 乐视致新电子科技(天津)有限公司 一种切换方法及装置
CN106162364A (zh) * 2015-03-30 2016-11-23 腾讯科技(深圳)有限公司 智能电视系统输入方法及装置、终端辅助输入方法及装置
CN110798723A (zh) * 2019-11-25 2020-02-14 上海邸客网络科技有限公司 一种数字电视多人控制方法
US20200162771A1 (en) * 2018-11-20 2020-05-21 Dish Network L.L.C. Dynamically interactive digital media delivery

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103648001A (zh) * 2013-11-29 2014-03-19 乐视致新电子科技(天津)有限公司 一种切换方法及装置
CN106162364A (zh) * 2015-03-30 2016-11-23 腾讯科技(深圳)有限公司 智能电视系统输入方法及装置、终端辅助输入方法及装置
US20200162771A1 (en) * 2018-11-20 2020-05-21 Dish Network L.L.C. Dynamically interactive digital media delivery
CN110798723A (zh) * 2019-11-25 2020-02-14 上海邸客网络科技有限公司 一种数字电视多人控制方法

Also Published As

Publication number Publication date
CN115129165A (zh) 2022-09-30

Similar Documents

Publication Publication Date Title
US10069818B2 (en) Method, system, device, and terminal for network initialization of multimedia playback device
CN107332976B (zh) K歌方法、装置、设备及系统
WO2021135734A1 (zh) 应用中传输文件的方法、电子设备及系统
WO2020073536A1 (zh) 语音切换方法、电子设备及系统
CN112789934B (zh) 一种蓝牙服务的查询方法及电子设备
WO2017096909A1 (zh) 建立数据连接的方法及装置
WO2021022720A1 (zh) 基于蓝牙的数据传输方法、存储介质及终端
WO2022127661A1 (zh) 应用共享方法、电子设备和存储介质
WO2023065931A1 (zh) 一种电子设备的充电方法及电子设备
WO2024087900A1 (zh) 一种摄像头切换方法及相关电子设备
CN110944313B (zh) 一种蓝牙连接方法、装置、存储介质及终端
WO2023273321A1 (zh) 一种语音控制方法及电子设备
CN113365274A (zh) 一种网络接入方法和电子设备
WO2015078349A1 (zh) 麦克风收音状态的切换方法和装置
WO2022206515A1 (zh) 辅助输入方法、电子设备以及系统
WO2020107177A1 (zh) 一种音频资源调用的方法、装置及电子设备
JP2018527765A (ja) サービス接続を確立する方法、装置、プログラム、及び記録媒体
WO2021233398A1 (zh) 无线音频系统、无线通讯方法及设备
WO2021218544A1 (zh) 一种提供无线上网的系统、方法及电子设备
CN110582079B (zh) 一种蓝牙连接设置方法、装置、计算机可读存储介质及终端
WO2021237936A1 (zh) Ims 注册方法、存储介质及电子终端
US20230224397A1 (en) Electronic device and method for providing user interface during call
WO2023030264A1 (zh) 一种电子设备的控制方法、介质和电子设备
WO2023051229A1 (zh) 用于标识设备的方法、装置、电子设备和介质
WO2023216911A1 (zh) 设备认证的方法、电子设备和通信系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22778698

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22778698

Country of ref document: EP

Kind code of ref document: A1