WO2023109452A1

WO2023109452A1 - Control method, electronic device, and computer-readable storage medium

Info

Publication number: WO2023109452A1
Application number: PCT/CN2022/133956
Authority: WO
Inventors: 董伟鑫; 李轩恺; 丁训然
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-12-14
Filing date: 2022-11-24
Publication date: 2023-06-22
Also published as: CN114265641A

Abstract

A control method, an electronic device, and a computer-readable storage medium. The control method comprises: when a first electronic device detects a trigger instruction, determining information of an application scenario where the first electronic device is currently located; determining, according to the information of the application scenario, an application service event corresponding to the trigger instruction; and in response to the trigger instruction, executing the application service event.

Description

Control method, electronic device, and computer-readable storage medium

priority information

This application claims the priority and benefit of the patent application No. 202111531934.4 filed with the State Intellectual Property Office of China on December 14, 2021, which is hereby incorporated by reference in its entirety.

technical field

The present application relates to the field of electronic technology, and in particular to a control method, electronic equipment, and a computer-readable storage medium.

Background technique

Usually, the user needs to input a corresponding operation command to the electronic device according to his own needs, so that the electronic device can execute the corresponding application service event. For example, if the user wants to send a shopping list, he needs to input an operation instruction corresponding to sending the shopping list to the electronic device, so that the electronic device can execute the application service event (that is, send the shopping list). In this way, when the electronic device executes different application service events, the user needs to input different operation instructions to it.

Contents of the invention

Embodiments of the present application provide a control method, electronic equipment, and a computer-readable storage medium.

An embodiment of the present application provides a control method, which is applied to a first electronic device. The control method includes: when the first electronic device detects a trigger instruction, determining the application scenario information where the first electronic device is currently located; determining the application service event corresponding to the trigger instruction according to the application scenario information ; and executing the application service event in response to the trigger instruction.

The embodiments of the present application also provide an electronic device. The electronic device includes a perception framework and an application engine. The perception framework is used to determine the application scene information where the electronic device is currently located when the electronic device detects a trigger instruction. The application engine is configured to determine the application service event corresponding to the trigger instruction according to the application scenario information; and execute the application service event in response to the trigger instruction.

The embodiments of the present application also provide an electronic device. An electronic device includes one or more processors, memory and one or more programs. One or more of the programs are stored in the memory and executed by one or more of the processors, and the programs are used to execute the control method. The control method includes: when the electronic device detects a trigger instruction, determine the application scene information where the electronic device is currently located; determine the application service event corresponding to the trigger instruction according to the application scene information; and respond to The trigger instruction executes the application service event.

An embodiment of the present application provides a non-volatile computer-readable storage medium, which contains a computer program, and when the computer program is executed by one or more processors, the processors execute the following control method: in the When the first electronic device detects a trigger instruction, determine the application scenario information where the first electronic device is currently located; determine the application service event corresponding to the trigger instruction according to the application scenario information; and respond to the trigger An instruction to execute the application service event.

The control method, electronic device, and computer-readable storage medium in this application determine the application service event corresponding to the trigger instruction according to the current application scene information of the electronic device when the electronic device detects the trigger instruction, and execute the application service events. In this way, the user only needs to input a trigger command to the electronic device, and the electronic device will automatically determine the application service event that the current user actually wants according to the current application scene information, and directly execute the application service event, without the need for the user to input different application service events. Different commands are beneficial to improve the intelligence of the electronic device, and improve the efficiency and experience of the user in using the electronic device.

Additional aspects and advantages of embodiments of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and understandable from the description of the embodiments in conjunction with the following drawings, wherein:

FIG. 1 is a schematic flow diagram of a control method in some embodiments of the present application;

FIG. 2 and FIG. 3 are schematic structural diagrams of the first electronic device in some embodiments of the present application;

Fig. 4 is a schematic flow chart of a control method in some embodiments of the present application;

Fig. 5 is a schematic structural diagram of a second electronic device in some embodiments of the present application;

Fig. 6 is a schematic diagram of displaying intent information by the first electronic device in some embodiments of the present application;

7 to 10 are schematic flowcharts of the control method in some embodiments of the present application;

Fig. 11 is a schematic diagram of the page of the first electronic device before receiving shared data, after updating the application interface and after editing the application interface in some embodiments of the present application;

Fig. 12 is a schematic flowchart of a control method in some embodiments of the present application;

Fig. 13 is a schematic structural diagram of the first electronic device and the third electronic device in some embodiments of the present application

Fig. 14 is a schematic flowchart of a control method in some embodiments of the present application;

Fig. 15 is a schematic diagram of prompt information displayed by a third electronic device in some embodiments of the present application;

16 to 17 are schematic flowcharts of the control method in some embodiments of the present application;

Fig. 18 is a schematic diagram of connection between a non-volatile computer-readable storage medium and a processor in some embodiments of the present application.

Detailed ways

Embodiments of the present application are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, are only for explaining the embodiments of the present application, and should not be construed as limiting the embodiments of the present application.

A control method applied to a first electronic device, the control method comprising: when the first electronic device detects a trigger instruction, determining the application scene information where the first electronic device is currently located; according to the The application scenario information determines the application service event corresponding to the trigger instruction; in response to the trigger instruction, execute the application service event.

In some implementations, the trigger instruction includes a preset action, and the control method further includes: detecting whether the first electronic device executes the preset action through a sensor.

In some implementations, the determining the application scene information where the first electronic device is currently located includes: determining the application scene information according to collected information, the collected information includes sensor information, location of the first electronic device Information, current page information of the first electronic device, and running information of applications of the first electronic device.

In some embodiments, the executing the application service event in response to the trigger instruction includes: establishing a communication connection with the second electronic device in response to the trigger instruction; share data.

In some embodiments, the execution of the application service event in response to the trigger instruction, the control method further includes: in response to the trigger instruction, receiving a message from the second electronic device to the first electronic device The type and authority of the data requested by the device; screening out the data to be shared according to the type and the authority requested by the second electronic device; and transmitting the data to be shared to the second electronic device for updating the Describe the application interface of the second electronic device.

In some embodiments, executing the application service event in response to the trigger instruction, the control method further includes: performing a security check on the second electronic device in response to the trigger instruction; After the security verification is passed, the step of establishing a communication connection with the second electronic device is performed.

In some implementations, the execution of the application service event in response to the trigger instruction, the control method further includes: after the security check is passed, acquiring the information from the second electronic device according to the application scenario information The type and authority of the data requested by the device; sending the type and the authority of the data requested by the first electronic device to the second electronic device, so that the shared data transmitted by the second electronic device is consistent with the first The electronic device requests that the type of data and the permission match.

In some embodiments, in the case of receiving the shared data transmitted from the second electronic device, the executing the application service event in response to the trigger instruction further includes: according to the received The sharing data transmitted by the second electronic device updates the application interface of the first electronic device.

In some embodiments, the executing the application service event in response to the trigger instruction further includes: according to the input operation on the first electronic device and/or according to the transmission to the third electronic device The input operation of the first electronic device is used to edit the updated application interface of the first electronic device, and the editing includes at least one of adding data, reducing data, and modifying data.

In some embodiments, in the case of receiving the shared data transmitted from the second electronic device, the executing the application service event in response to the trigger instruction further includes: generating an event based on the shared data A prompt message, and transmit the prompt message to the third electronic device, so that the third electronic device displays the prompt message.

In some embodiments, when the application scenario information includes a shopping scenario, the control method further includes: after the execution of the application service event is completed, generating pickup information and transmitting the pickup information to a third an electronic device; and when the first electronic device and/or the third electronic device arrive at a pick-up location, generate a display operation command and transmit the display operation command to the third electronic device, so that the third electronic device The electronic device displays the pickup information.

In some implementations, the application scenario information includes a shopping scenario, and the application service event includes sharing shopping cart data.

A first electronic device includes a perception frame and a perception frame. The perception framework is used to determine the current application scenario information when a trigger instruction is detected. The application engine is configured to determine an application service event corresponding to the trigger instruction according to the application scenario information, and execute the application service event in response to the trigger instruction.

In some implementations, the trigger instruction includes a preset action, and the application engine detects whether the first electronic device executes the preset action through a sensor.

In some implementations, the application engine is further configured to determine the application scene information according to collected information, where the collected information includes sensor information, location information, and current page information of the first electronic device , at least one of the running information of the application program of the first electronic device.

In some embodiments, the application engine is further configured to establish a communication connection with the second electronic device in response to the trigger instruction; and receive sharing data transmitted from the second electronic device.

In some implementations, the application engine is further configured to: in response to the trigger instruction, receive the type and permission of the data requested by the second electronic device from the first electronic device; The type of the request and the permission filter out the data to be shared; and transmitting the data to be shared to the second electronic device for updating the application interface of the second electronic device.

In some embodiments, the application engine is further configured to: perform a security check on the second electronic device in response to the trigger instruction; and establish a communication connection with the second electronic device after the security check is passed. A step of.

In some embodiments, the application engine is further configured to: obtain the type and authority of the data requested from the second electronic device according to the application scene information after the security verification is passed; send the first electronic device requesting the type and the permission of the data to the second electronic device, so that the shared data transmitted by the second electronic device matches the type and the permission of the data requested by the first electronic device.

In some implementations, when the sharing data transmitted from the second electronic device is received, the application engine includes an interface drawing module, and the interface drawing module is configured to The sharing data transmitted by the device updates the application interface of the first electronic device.

In some implementations, the application engine is further configured to update the updated The subsequent application interface of the first electronic device is edited, and the editing includes at least one of adding data, reducing data, and modifying data.

In some implementations, the application engine is further configured to: generate a prompt message according to the shared data, and transmit the prompt message to a third electronic device, so that the third electronic device displays the prompt message .

In some embodiments, when the application scenario information includes a shopping scenario, the application engine is further configured to: after the execution of the application service event is completed, generate pickup information and transmit the pickup information to the first Three electronic devices; and when the first electronic device and/or the third electronic device arrive at the pick-up location, generate a display operation command and transmit the display operation command to the third electronic device, so that the first electronic device The three electronic devices display the pickup information.

Please refer to FIG. 1 and FIG. 2 , the embodiment of the present application provides a control method. The control method is applied to the first electronic device 10, and the control method includes:

01: When the first electronic device 10 detects a trigger instruction, determine the application scene information where the first electronic device 10 is currently located;

02: Determine the application service event corresponding to the trigger instruction according to the application scenario information; and

03: Execute the application service event in response to the trigger instruction.

Please refer to FIG. 2 , the embodiment of the present application further provides a first electronic device 10 . The first electronic device 10 includes a perception framework 11 and an application engine 12 . Wherein, the perception framework 11 can execute the method in 01, and the application engine 12 can execute the methods in 02 and 03. That is to say, the perception framework 11 is used to determine the application scene information where the first electronic device 10 is currently located when the first electronic device 10 detects the trigger instruction; the application engine 12 is used to determine the trigger instruction according to the application scene information the corresponding application service event; and executing the application service event in response to the trigger instruction.

Please refer to FIG. 3 , the embodiment of the present application further provides a first electronic device 10 . Terminal 10 includes one or more processors 13, memory 14, and one or more programs. Wherein, one or more programs are stored in the memory 14 and executed by one or more processors 13, and the programs include instructions for executing the control method of the embodiment of the present application. That is, when one or more processors 13 execute the program, the processors 13 can implement the methods in 01, 02 and 03. That is, the one or more processors 13 are configured to: when the first electronic device 10 detects the trigger instruction, determine the application scenario information where the first electronic device 10 is currently located; determine the application scenario corresponding to the trigger instruction according to the application scenario information a service event; and executing the application service event in response to the trigger instruction.

In the control method and the first electronic device 10 in this application, when the first electronic device 10 detects the trigger instruction, the application service event corresponding to the trigger instruction is determined according to the application scene information where the first electronic device 10 is currently located, And execute app service events. In this way, the user only needs to input a trigger command to the first electronic device 10, and the first electronic device 10 will automatically determine the application service event that the current user actually wants according to the current application scene information, and directly execute the application service event without the need for the user to Inputting different commands for different application service events is beneficial to improving the intelligence of the first electronic device 10 and improving the user's efficiency and experience in using the first electronic device 10 .

Wherein, the first electronic device 10 may be a mobile phone, a tablet computer, a display device, a notebook computer, a smart watch, a head-mounted display device, a game console, and the like. As shown in FIG. 3 , the embodiment of the present application is described by taking the first electronic device 10 as a mobile phone as an example. It can be understood that the specific form of the first electronic device 10 is not limited to the mobile phone.

Please refer to FIG. 4. In some embodiments, the trigger instruction includes preset actions, and the control method further includes:

04: Use the sensor to detect whether the first electronic device 10 executes a preset action.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the perception framework 11 and the processor 13 can execute the method in 04 . That is to say, both the perception framework 11 and the processor 13 can also be used to detect whether the first electronic device 10 executes a preset action through a sensor.

In some embodiments, the first electronic device 10 is provided with a sensor (not shown in the figure), and the sensor may be an attitude sensor for detecting the attitude information of the first electronic device 10 . When the gesture information indicates that the user performs a preset action on the first electronic device 10 , that is, when it is detected that the first electronic device 10 performs a preset action, it can be considered that the user inputs a trigger command to the first electronic device 10 at this time. That is to say, when the perception framework 11 (or the processor 13 ) detects through the sensor that the first electronic device 10 is performing a preset action, the first electronic device 10 receives the trigger instruction. Among them, the preset actions include but not limited to touching the first electronic device 10 with other electronic devices, shaking the first electronic device 10 and knocking the first electronic device 10, etc. The preset actions mentioned below are the same, in I won't go into details here.

When the first electronic device 10 detects a trigger instruction, that is, after the first electronic device 10 executes a preset action, the perception framework 11 (or processor 13 ) determines the application scene information where the first electronic device 10 is currently located. Specifically, in some embodiments, determining the application scene information where the first electronic device 10 is currently located includes: determining the application scene information according to collected information, where the collected information includes sensor information of the first electronic device 10, location information, first At least one of the current page information of the electronic device 10 and the running information of the application program of the first electronic device 10 .

Please refer to FIG. 2 and FIG. 3. In some embodiments, both the perception framework 11 and the processor 13 can also be used to determine the application scene information according to the collected information. The collected information includes the sensor information of the first electronic device 10, the location information, the first At least one of the current page information of the electronic device 10 and the running information of the application program of the first electronic device 10 .

Wherein, the sensor information may be the image collected by the camera of the first electronic device 10, or the posture information collected by the posture sensor, or the ambient light brightness information collected by the ambient light sensor, or the sensing information of the near field communication sensing module; the sound collected by the microphone information etc. The location information indicates the location of the first electronic device 10, such as home, company, shopping mall, or a specific indoor location. The current page information includes text, pictures, application programs, etc. displayed on the current page. The running information of the application program includes whether the current application program (APP) completes a task (for example, the task of the navigation APP can be a navigation task, and the shopping APP can be whether the current shopping cart is settled, etc.), etc., and will not be repeated here. .

After acquiring the collected information, the perception framework 11 (or the processor 13 ) can determine the application scene information where the first electronic device 10 is currently located according to the collected information. In some embodiments, the perception framework 11 set in the first electronic device 10 can directly determine the application scene information where the first electronic device 10 is currently located according to the collected information. In some embodiments, the perception framework 11 can also be set in the cloud, the first electronic device 10 uploads data to the cloud, and with the help of the powerful computing power of the cloud, uploads the collected information to the cloud for processing and determines the current location of the first electronic device 10 The application scene information of the first electronic device 10 is used to reduce the processing load of the first electronic device 10 and quickly determine the application scene information of the first electronic device 10 at present. Of course, in some embodiments, the perception framework 11 can be set on the first electronic device 10 and the cloud, for example, the collected information is uploaded to the cloud by the first electronic device 10, the data is processed by the cloud, and the result information after data processing Send it to the first electronic device 10, and the first electronic device 10 will determine the current application scene information of the first electronic device 10 based on the result information, that is, the cloud and the first electronic device 10 cooperate to process and collect information to determine the first electronic device 10 Information about the current application scenario.

For example, the current page information of the first electronic device 10 indicates that the user is browsing the application interface of the shopping cart, and the perception framework 11 (or processor 13) can determine that the current application scene information of the first electronic device 10 includes a shopping scene. For another example, the location information indicates that the user is in a shopping mall, the image in the sensor information recognizes a commodity shelf, and the perception framework 11 (or processor 13) can determine that the application scene information where the first electronic device 10 is currently located includes a shopping scene. For another example, the location information indicates that the user is inside the company, the current page information of the first electronic device 10 indicates that the user is browsing documents, and the perception framework 11 (or processor 13) can determine that the current application scene information of the first electronic device 10 includes meeting scene.

After the perception framework 11 (or processor 13) determines the application scene information where the first electronic device 10 is currently located, the perception framework 11 can send the application scene information to the application engine 12, and the application engine 12 (or processor 13) according to The application scenario information determines the application service event corresponding to the trigger instruction. It should be noted that different application scenario information has corresponding application service events.

Exemplarily, in some embodiments, the application scenario information includes a shopping scenario, and the application service event includes sharing shopping cart data. When it is determined that the application scenario of the first electronic device 10 includes a shopping scenario, it may be determined according to the application scenario information that the application service event includes sharing shopping cart data. Of course, application scenario information is not limited to shopping scenarios, and application service events are not limited to sharing shopping cart data. For the convenience of description, in the embodiment of the present application, the application scene information includes the shopping scene, and the application service event includes the shared shopping cart data as an example for description.

In some embodiments, the perception framework 11 (or the processor 13 ) may further determine the object that the user needs to share the shopping cart data according to the information of other electronic devices near the first electronic device 10 . Exemplarily, in an example, the user makes a preset action on the first electronic device 10 , that is, the gesture sensor detects that the first electronic device 10 makes a preset action. The first electronic device 10 sends a request to a nearby base station, and the base station will send to the first electronic device 10 the identifiers of other electronic devices that have also sent requests to the base station near the first electronic device 10 and within the same time period. After the first electronic device 10 receives the identification of an electronic device that also performs a predetermined action nearby within the same time period, the perception framework 11 (or processor 13) can determine the object to share shopping cart data with the first electronic device 10 is the electronic device. For example, during the same period of time, the user U1 shakes the first electronic device 10 , and at the same time the user U2 shakes the second electronic device 20 near the first electronic device 10 (as shown in FIG. 5 ). Both the first electronic device 10 and the second electronic device 20 will send a request to the base station, and the base station will send the identifier of the second electronic device 20 to the first electronic device 10 . After the first electronic device 10 receives the identification of the second electronic device 20 , the perception framework 11 (or processor 13 ) may determine that the object for sharing shopping cart data with the first electronic device 10 is the second electronic device 20 . In another example, the user makes a preset action on the first electronic device 10 , that is, the posture sensor detects that the first electronic device 10 makes a preset action. At this time, the first electronic device 10 can automatically turn on the hardware device capable of communication connection (including but not limited to one or more of the near field communication NFC module, bluetooth module, USB connection module or wireless fidelity Wi-Fi network connection module) ) to find nearby electronic devices that can be connected. After querying the surrounding electronic devices that can be connected, the perception framework 11 (or the processor 13 ) can determine that the object to share the shopping cart data with the first electronic device 10 is the electronic device. For another example, in an example, the user U1 touches the first electronic device 10 to the second electronic device 20, that is, the attitude sensor detects that the first electronic device 10 touches other second electronic devices 20, and at this time The first electronic device 10 turns on the near field communication NFC module and senses the near field communication NFC module of the second electronic device 20, and at this time the perception framework 11 (or processor 13) can determine the shopping cart data sharing with the first electronic device 10 The object is the second electronic device 20 .

Further, in some embodiments, after the application service event is determined, the determined application service event may also be displayed on the first electronic device 10 for confirmation by the user, so as to avoid wrongly predicting the user's real intention. For example, as shown in FIG. 6, assuming that the determined application service event is to share shopping cart data with the second electronic device 20, the first electronic device 10 can display a prompt message on the display screen "Do you currently need to share the shopping cart data with the second electronic device?" shopping cart data", if the user selects "Yes", it means that the current intent information is consistent with the user's real intent, and proceed to the next steps; if the user selects "No", it means that the current intent information does not match the user's real intent, then do not continue Follow the next steps. Of course, in some embodiments, after the application service event is determined on the first electronic device 10, the user can also edit and change the application service event according to his own needs.

In some embodiments, the application scenario information may also include network information of the second electronic device 20 used to establish the connection, and the second electronic device 20 is the object for which the first electronic device 10 shares the shopping cart data. Wherein, the network information includes but not limited to one or more of the pairing information of the Bluetooth connection module, the pairing information of the WIFI connection module, the pairing information of the NFC module and the pairing information of the USB connection module. Exemplarily, in some embodiments, the perception framework 11 (or the processor 13 ) may acquire network information of the second electronic device 20 . For example, in one example, at the same time, the user U1 makes a preset action on the first electronic device 10 , and the user U2 near the first electronic device 10 also makes a preset action on the second electronic device 20 . The first electronic device 10 and the second electronic device 20 send requests to nearby base stations, and the requests include respective network information. The base station will send the request sent by the second electronic device 20 to the first electronic device 10. At this time, the perception framework 11 can determine that the object of the first electronic device 10 to share data is the second electronic device 20, so that the first electronic device 10 can obtain The network information of the second electronic device 20 is obtained. Then the perception framework 11 delivers the application scenario information including the network information of the second electronic device 20 to the application engine 12 .

In some embodiments, the first electronic device 10 includes a plurality of application engines 12, and each application engine 12 corresponds to a different application program. After obtaining the application scene information, the perception framework 11 distributes the event to the corresponding application engine 12 middle. For example, if the application scenario information includes the application of the shared shopping mall A, the perception framework 11 distributes the event to the application engine 12 corresponding to the application of the shopping mall A. Such different application programs use the corresponding application engine 12 to perform subsequent operations, which is beneficial for multiple application programs to perform subsequent operations at the same time.

It should be noted that, when the first electronic device 10 includes multiple application engines 12, in some embodiments, the first electronic device 10 may only include one perception framework 11, and the perception framework 11 distributes the application scene information to the In the application engine 12 corresponding to the application program of shopping mall A, such multiple application programs can all use the same perception framework 11 to perceive the application scene information, which is beneficial to reduce the power consumption of the first electronic device 10 . Of course, in some embodiments, when the first electronic device 10 includes multiple application engines 12, the first electronic device 10 may also include multiple perception frameworks 11, and the perception frameworks 11 correspond to the application engines 12, which will not be described here. limit.

Further, in some embodiments, the control method further includes: judging whether the application scene information contains preset information. The perception framework 11 is also used to determine whether the application scene information contains preset information. The step of distributing the application scenario information to the application engine (ie, the application engine 12 ) of the first electronic device 10 is executed only when the application scenario information includes preset information. If the application scenario information does not include preset information, the application scenario information is not distributed to the application engine 12 . Wherein, the preset information may be set by default before the first electronic device 10 leaves the factory, or may be set by the user according to his own needs. For example, the preset information includes the application program of mall A. Assuming that it is determined that the application scene information of the first electronic device 10 currently includes the application program of mall A, that is, the application scene information contains preset information, the perception framework 11 distributes the application scene information to the application engine 12; If the application scenario information of the electronic device 10 currently includes the application program of the shopping mall B, that is, the event does not include preset information, the perception framework 11 will not distribute the application scenario information to the application engine 12 . In this way, only performing subsequent processing on the application scenario information including the preset information is beneficial to further reducing the power consumption of the first electronic device 10 compared to performing subsequent processing on all application scenario information.

Referring to FIG. 7, in some embodiments, in response to the trigger instruction, executing an application service event includes:

031: Establish a communication connection with the second electronic device 20 in response to the trigger instruction; and

032: Receive the shared data transmitted from the second electronic device 20 .

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 can execute the methods in 031 and 032 . That is to say, both the application engine 12 and the processor 13 are further configured to: establish a communication connection with the second electronic device 20 in response to a trigger instruction; and receive shared data transmitted from the second electronic device 20 .

The application engine 12 (or the processor 30 ) establishes a communication connection between the first electronic device 10 and the second electronic device 20 in response to the trigger instruction. For example, in some embodiments, the application engine 12 (or the processor 30) can establish the network information of the first electronic device 10 and the second electronic device 20 according to the network information of the first electronic device 10 and the network information of the second electronic device 20. communication link between.

Take the application engine 12 establishing a communication connection between the first electronic device 10 and the second electronic device 20 according to the network information of the first electronic device 10 and the network information of the second electronic device 20 as an example. Specifically, please refer to FIG. 2 , in some embodiments, the application engine 12 includes an execution engine 121 and a connection management module 122, the execution engine 121 obtains the network information of the second electronic device 20, and the execution engine 121 obtains the network information of the first electronic device 10. Wherein, the acquired network information of the first electronic device 10 needs to correspond to the network information of the second electronic device 20 . For example, assuming that the network information of the second electronic device 20 is the Bluetooth module pairing information of the second electronic device 20 , the network information of the first electronic device 10 should also be the Bluetooth module pairing information of the first electronic device 10 . Subsequently, the connection management module 122 establishes a communication connection between the first electronic device 10 and the second electronic device 20 through hardware corresponding to the network information according to the network information of the first electronic device 10 and the network information of the second electronic device 20 . For example, assuming that the network information of the second electronic device 20 is the pairing information of the Bluetooth module of the second electronic device 20, the connection management module 122, according to the pairing information of the Bluetooth module of the first electronic device 10 and the pairing information of the Bluetooth module of the second electronic device 20 , establishing a communication connection between the first electronic device 10 and the second electronic device 20 through the Bluetooth connection module. Certainly, in some embodiments, the network information of the second electronic device 20 and the network information of the first electronic device 10 may also be acquired by the connection management module 122 , which is not limited here.

After the communication connection between the first electronic device 10 and the second electronic device 20 is established, the application engine 12 (or processor 30 ) of the first electronic device 10 can also receive the sharing data transmitted from the second electronic device 20 . Since the sharing of data across devices is usually done by scanning the same QR code or sharing it with the other party in the way of forwarding in the instant messaging application. For example, when shopping, different family members add different items to the shopping list, and they need to be forwarded and shared one by one to ensure that the items of all family members are in the same shopping cart for payment. This kind of data sharing method is relatively complicated, and it is operated in an unnatural interactive manner, so the sharing efficiency is low and the user experience is poor. However, in the embodiment of the present application, the user only needs to input a trigger instruction to the first electronic device 10, that is, when the first electronic device 10 detects the trigger instruction, and determine the application scene where the first electronic device 10 is currently located When the information includes a shopping scene, the first electronic device 10 can automatically establish a communication connection with the second electronic device 10 to receive sharing data transmitted from the second electronic device 20 . In this way, the effective sharing of application data across electronic devices can be realized, which greatly improves the efficiency of sharing compared to sharing to the other party by scanning the same two-dimensional code or by forwarding in an instant messaging application. In addition, in the embodiment of the present application, data transmission across electronic devices can be realized without transferring data through a server or cloud, which is beneficial to reduce the risk of data leakage and improve security.

In particular, referring to FIG. 8, in some embodiments, executing an application service event in response to a trigger instruction further includes:

033: Perform security verification on the second electronic device 20 in response to the trigger instruction;

After the security verification is passed, a step of establishing a communication connection with the second electronic device 20 is performed.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 are also used to execute the method in 033 . That is to say, both the application engine 12 and the processor 13 are further configured to perform security verification on the second electronic device 20 in response to the trigger instruction. After the security verification is passed, a step of establishing a communication connection with the second electronic device 20 is performed.

For example, in some embodiments, it may also be identified according to the network information of the second electronic device 20 whether the second electronic device 20 is a legal device allowed to connect. If it is recognized that the second electronic device 20 is a legal device that is allowed to be connected, then the second electronic device 20 passes the security check; otherwise, if it is recognized that the second electronic device 20 is not a legal device that is allowed to be connected, then the second Second, the electronic device 20 does not pass the security check. Only after the safety verification is passed, the step of establishing a communication connection between the first electronic device 10 and the second electronic device 20 is performed, so that the first electronic device 10 can receive the shared data transmitted by the second electronic device 20, This can further enhance the security of data sharing.

Referring to FIG. 9, in some embodiments, executing an application service event in response to a trigger instruction further includes:

034: After passing the security check, obtain the type and authority of the data requested from the second electronic device 20 according to the application scenario information; and

035: Send the type and permission of the data requested by the first electronic device 10 to the second electronic device 20, so that the shared data transmitted by the second electronic device 20 matches the type and permission of the data requested by the first electronic device 10.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 are also used to execute the methods in 034 and 035 . That is to say, both the application engine 12 and the processor 13 are also used to obtain the type and authority of the data requested from the second electronic device 20 according to the application scene information after the security verification is passed; and send the request data to the first electronic device 10 The type and permission of the shared data transmitted by the second electronic device 20 match the type and permission of the data requested by the first electronic device 10 to the second electronic device 20 .

In some embodiments, the application engine 12 (or the processor 13 ) may acquire the type and permission of data that needs to be requested from the second electronic device 20 according to the application scenario information. Wherein, the data type includes at least one of application business data, application status data, and system status data; data permissions include shareable, readable and editable. For example, in some embodiments, the types and permissions of requested data corresponding to different application scenario information are preset. After obtaining the application scenario information, the application engine 12 (or processor 13 ) may request the type and permission of data from the second electronic device 20 according to the application scenario information and corresponding needs.

After obtaining the type and authority of the data that needs to be requested from the second electronic device 20, send the type and authority of the data requested by the first electronic device 10 to the second electronic device 20, so that the first electronic device 10 can receive the data from the second electronic device 20. The shared data of the electronic device 20 can match the type and authority of the data requested by the first electronic device 10 .

Please refer to FIG. 10 , in some embodiments, in the case of receiving the shared data transmitted from the second electronic device 20, in response to the trigger instruction, executing the application service event further includes:

036: Update the application interface of the first electronic device 10 according to the received sharing data transmitted by the second electronic device 20 .

Please refer to FIG. 2 and FIG. 3 , in some embodiments, the application engine 12 further includes an interface drawing module 123 . Both the interface drawing module 123 and the processor 13 are also used to execute the method in 036 . That is to say, both the interface drawing module 123 and the processor 13 are further configured to update the application interface of the first electronic device 10 according to the received sharing data transmitted by the second electronic device 20 .

For example, after receiving the shared data transmitted from the second electronic device 20, the first electronic device 10 synchronously updates its own data according to the shared data to obtain updated data. Subsequently, the interface drawing module 123 updates the application interface of the first electronic device 10 according to the updated data, so that the user of the first device 10 can see the data information shared by the user of the second electronic device 20 more intuitively. For example, as shown in FIG. 11 , the left side of FIG. 11 is the application interface before the first electronic device 10 receives the sharing data transmitted from the second electronic device 20 , where there are only hats in the shopping cart, and the number of hats is 1. The shared data transmitted by the second electronic device 20 is to add a hat and a bottle of Coke. After receiving the shared data transmitted by the second electronic device 20, the interface drawing module 123 Share the data and update the application interface of the first electronic device 10 . The figure in the middle of FIG. 11 is the updated application interface of the first electronic device 10 , where there are hats and cola in the shopping cart, the quantity of hats is 2, and the quantity of cola is 1.

It should be noted that, as shown in FIG. 2 , in some embodiments, the application engine 12 may further include a data management module 124 for storing data. After synchronously updating its own data according to the shared data and obtaining the updated data, the updated data is stored in the data management module 124 . The data management module 124 initiates an interface update request to the interface drawing module 123 , and then the interface drawing module 123 updates the application interface of the first electronic device 10 .

Referring to FIG. 12 and FIG. 13, in some embodiments, executing an application service event in response to a trigger instruction further includes:

037: Edit the updated application interface of the first electronic device 10 according to the input operation on the first electronic device 10 and/or according to the input operation transmitted from the third electronic device 30 to the first electronic device 10, the editing includes adding At least one of data, reducing data, and modifying data.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 are also used to execute the method in step 037 . That is to say, both the application engine 12 and the processor 13 are also configured to update the updated The application interface of the first electronic device 10 performs editing, and the editing includes at least one of adding data, reducing data, and modifying data.

Wherein, the third electronic device 30 is a wearable device communicatively connected with the first electronic device 10 , for example, the third electronic device 30 may be a smart watch, smart glasses, smart bracelet, etc., which is not limited here. For convenience of description, in the embodiment of the present application, the third electronic device 30 is described as a smart watch.

For example, after the application interface is updated according to the data shared by the second electronic device 20, the updated application interface of the first electronic device 10 can also be edited according to the input operation on the first electronic device 10 at this time. It includes at least one of increasing data, reducing data, and modifying data. Wherein, the input operation on the first electronic device 10 includes but not limited to at least one of touch input and voice input. For example, as in the embodiment described in FIG. 11, since the sharing data transmitted by the second electronic device 20 is to add a hat and a bottle of Coke, the updated application interface is as shown in the middle figure of FIG. There are hats and Coke in the car, the number of hats is 2, and the number of Coke is 1. Assuming that the user of the first electronic device 10 does not want to buy Coke, the user of the first electronic device 10 only needs to delete the Coke through the input of the first electronic device 10 to update the application data again, as shown on the right side of Figure 11 As shown, the right side of FIG. 11 shows the updated application interface of the first electronic device 10 , where there are only hats in the shopping cart, and the number of hats is 2. Of course, please refer to FIG. 13 , in some embodiments, the user can also input an operation to the third electronic device 30, and then the third electronic device 30 transmits the input operation to the first electronic device 10, and the application engine 12 (or processor 13) Edit the updated application interface of the first electronic device 10 according to the input operation received from the third electronic device 30 . Since the first electronic device 10 is a mobile phone and the third electronic device 30 is a smart watch, it is possible to edit the updated first electronic device 10 only by inputting an operation on the smart watch when the user is inconvenient to use the mobile phone. application interface.

When the third electronic device 30 communicates with the first electronic device 10 , the first electronic device 10 can also transmit information to the third electronic device 30 . Specifically, referring to FIG. 14 , in the case that the first electronic device 10 receives the shared data transmitted from the second electronic device 20, in response to a trigger instruction, executing an application service event further includes:

038: Generate a prompt message according to the shared data, and transmit the prompt message to the third electronic device 30, so that the third electronic device 30 displays the prompt message.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 are further configured to execute the method in step 038 . That is to say, both the application engine 12 and the processor 13 are also configured to generate a prompt message according to the shared data, and transmit the prompt message to the third electronic device 30, so that the third electronic device 30 displays the prompt message.

For example, in some embodiments, when the first electronic device 10 receives the sharing data transmitted from the second electronic device 20, the application engine 12 (or processor 13) generates prompt information according to the received sharing data. Wherein, the prompt message is used to remind the user what data is shared by the second electronic device 20 . For example, in the embodiment shown in FIG. 15 , where the sharing data transmitted by the second electronic device 20 is to add a hat and a bottle of Coke, the prompt information may be "Add a hat and a bottle of Coke". After generating the prompt information, the first electronic device 10 transmits the prompt information to the third electronic device 30 communicatively connected thereto, so that the third electronic device 30 displays the prompt information. That is, after receiving the prompt information, the third electronic device 30 displays the prompt information on its display screen. Since the first electronic device 10 is a mobile phone and the third electronic device 30 is a smart watch, it is possible for the user to know what data the second electronic device 20 shares when it is inconvenient for the user to use the mobile phone.

Please refer to FIG. 16. In some embodiments, when the application scenario information includes a shopping scenario, the control method further includes:

05: After the execution of the application service event is completed, generate pickup information and transmit the pickup information to the third electronic device 30; and

06: When the first electronic device 10 and/or the third electronic device 30 arrive at the pick-up location, generate a display operation command and transmit the display operation command to the third electronic device 30, so that the third electronic device 30 displays the pick-up information .

Please refer to FIG. 2 and FIG. 3 , in some embodiments, both the application engine 12 and the processor 13 are also used to execute the methods in

steps

05 and 06 . That is to say, both the application engine 12 and the processor 13 are also configured to generate pickup information and transmit the pickup information to the third electronic device 30 after the execution of the application service event; and in the first electronic device 10 and/or Or when the third electronic device 30 arrives at the pick-up location, generate a display operation command and transmit the display operation command to the third electronic device 30, so that the third electronic device 30 displays the pick-up information.

It should be noted that, in some embodiments, when the application scenario information includes a shopping scenario, after the user finishes paying for items in the shopping cart, it can be considered that the execution of the application service event is completed. At this time, the application engine 12 (or the processor 13 ) generates the pick-up information and transmits the pick-up information to the third electronic device 30 . After the third electronic device 30 receives the pick-up message, it can immediately display the pick-up information on its display screen, or store it in its memory first, and display the pick-up information on its display screen according to the user's input operation. No limit. Since the first electronic device 10 is a mobile phone and the third electronic device 30 is a smart watch, the pick-up information can be obtained through the smart watch even when the user does not use the mobile phone.

When the first electronic device 10 and/or the third electronic device 30 arrive at the pick-up location, the application engine 12 (or processor 13) generates a display operation command and transmits the display operation command to the third electronic device 30, so that the third electronic device 30 The electronic device 30 displays the pick-up information. That is, after the third electronic device 30 receives the display operation command, the third electronic device 30 displays the pick-up information on its display screen. In this way, when the first electronic device 10 and/or the third electronic device 30 arrive at the pick-up address, the pick-up information can be automatically displayed on the third electronic device 30 without user operation, which is convenient for the user to display the pick-up information for pick-up .

Referring to FIG. 17, in some embodiments, in response to the trigger instruction, executing an application service event further includes:

0391: In response to the trigger instruction, receive the type and permission of the data requested by the second electronic device 20 from the first electronic device 10;

0392: Filter out the data to be shared according to the type and permission requested by the second electronic device 20; and

0393: Transmit the data to be shared to the second electronic device 20, so as to update the application interface of the second electronic device 20.

Please refer to FIG. 2 and FIG. 3 , in some embodiments, the application engine 12 and the processor 13 are also used to execute the methods in 0391 , 0392 and 0393 . That is to say, both the application engine 12 and the processor 13 are further configured to: receive the type and authority of the data requested by the second electronic device 20 from the first electronic device 10 in response to the trigger instruction; The data to be shared is filtered out by type and authority; and the data to be shared is transmitted to the second electronic device 20 for updating the application interface of the second electronic device 20 .

Exemplarily, after establishing the communication connection between the first electronic device 10 and the second electronic device 20, the connection management module 121 (or the processor 13) of the application engine 12 can respond to the trigger instruction and receive the communication from the second electronic device 20 to the first electronic device. The device 10 requests the type and permissions of the data. After receiving the type and authority of data requested by the second electronic device 20 from the first electronic device 10, the execution engine 121 (or processor 13) of the application engine 12 transfers data from the first electronic device 12 according to the type and authority requested by the second electronic device 20. 10 to filter out the data to be shared.

In particular, in some embodiments, the application engine 12 includes a data management module 124, and the data management module 124 stores data. After receiving the type and permission of the data requested by the second electronic device 20 from the first electronic device 10, the application The execution engine 121 (or the processor 13 ) of the engine 12 filters the data to be shared from the first data management module 124 according to the type and permission requested by the second electronic device 20 . Specifically, in some embodiments, the data management module 124 stores different types of data, and each type of data has identification information for representing its authority. After receiving the type and authority of the data requested by the second electronic device 20 from the first electronic device 10, the execution application engine 121 obtains the corresponding The data and the identification information of the corresponding data, and then obtain the data to be shared according to the permission of the requested data and the identification information of the corresponding data.

For example, in some embodiments, if the permission of the requested data includes the first requested permission, and the identification information of the corresponding data includes the first permission, the obtained data is taken as the data to be shared. If the permission of the requested data includes the first request permission, but the identification information of the corresponding data includes the second permission, the obtained data cannot be used as the data to be shared. Wherein, the first request permission is used to indicate that the data is requested to be shared, the first permission is used to indicate that the data is shareable data, and the second permission is used to indicate that the data is non-shareable data. For example, assume that the type of requested data is type A, and the requested permission is the first requested permission, that is, it is requested to share data of type A. The execution application engine 121 obtains the data of type A and its corresponding identification information in the data management module 124. If the identification information of the data of type A in the data management module 124 includes the first permission, it means that the data of type A can be shared. At this time, the data of type A is used as the data to be shared; if the identification information of the data of type A in the data management module 124 includes the second permission, it means that the data of type A cannot be shared, and the data of type A cannot be transmitted at this time. In this way, not all the data requested by the second electronic device 20 can be transmitted by the first electronic device 10 , which can further improve the security of the first electronic device 10 .

After obtaining the data to be shared, the connection management module 122 (or the processor 13 ) of the application engine 12 transmits the data to be shared to the second electronic device 20 for updating the application interface of the second electronic device 20 .

Referring to FIG. 18 , the embodiment of the present application also provides a non-volatile computer-readable storage medium 200 containing a computer program 201 . When the computer program 201 is executed by one or more processors 13, the processors 13 are made to execute 01, 02, 03, 04, 031, 032, 033, 034, 035, 036, 037, 038, 05, 06, 0391, Control methods in 0392 and 0393.

For example, referring to FIG. 1, when the computer program 201 is executed by one or more processors 13, the processors 13 are made to perform the following methods:

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. The specific features, structures, materials or features described in the manner or example are included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

Although the implementation of the present application has been shown and described above, it can be understood that the above-mentioned implementation is exemplary and should not be construed as limiting the application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims

A control method applied to a first electronic device, wherein the control method includes:

When the first electronic device detects a trigger instruction, determine the application scenario information where the first electronic device is currently located;

determining an application service event corresponding to the trigger instruction according to the application scenario information;

In response to the trigger instruction, execute the application service event.
The control method according to claim 1, wherein the trigger instruction includes a preset action, and the control method further includes:

A sensor is used to detect whether the first electronic device executes the preset action.
The control method according to claim 1, wherein the determining the application scene information where the first electronic device is currently located comprises:

Determine the application scene information according to the collected information, the collected information includes sensor information, location information, and current page information of the first electronic device, and the running information of the application program of the first electronic device at least one.
The control method according to claim 1, wherein the executing the application service event in response to the trigger instruction comprises:

Establishing a communication connection with the second electronic device in response to the trigger instruction; and

Receive the shared data transmitted from the second electronic device.
The control method according to claim 4, wherein the executing the application service event in response to the trigger instruction further comprises:

Responding to the trigger instruction, receiving the type and permission of the data requested by the second electronic device from the first electronic device;

filtering out the data to be shared according to the type and the permission requested by the second electronic device; and

and transmitting the data to be shared to the second electronic device for updating an application interface of the second electronic device.
The control method according to claim 4, wherein the executing the application service event in response to the trigger instruction further comprises:

performing a security check on the second electronic device in response to the trigger instruction;

After the security verification is passed, a step of establishing a communication connection with the second electronic device is performed.
The control method according to claim 6, wherein the executing the application service event in response to the trigger instruction further comprises:

After the security check is passed, obtain the type and authority of the data requested from the second electronic device according to the application scenario information;

sending the type of data requested by the first electronic device and the permission to the second electronic device, so that the shared data transmitted by the second electronic device is consistent with the type of data requested by the first electronic device and the described permissions match.
The control method according to claim 1, wherein, in the case of receiving the shared data transmitted from the second electronic device, the execution of the application service event in response to the trigger instruction further comprises:

updating the application interface of the first electronic device according to the received sharing data transmitted by the second electronic device.
The control method according to claim 8, wherein the executing the application service event in response to the trigger instruction further comprises:

Edit the updated application interface of the first electronic device according to the input operation to the first electronic device and/or according to the input operation transmitted to the first electronic device by the third electronic device, the editing It includes at least one of increasing data, reducing data, and modifying data.
The control method according to claim 1, wherein in the case of receiving the shared data transmitted from the second electronic device, executing the application service event in response to the trigger instruction further comprises:

A prompt message is generated according to the shared data, and the prompt message is transmitted to a third electronic device, so that the third electronic device displays the prompt message.
The control method according to claim 1, wherein, when the application scene information includes a shopping scene, the control method further includes:

After the execution of the application service event is completed, generating pickup information and transmitting the pickup information to a third electronic device; and when the first electronic device and/or the third electronic device arrive at a pickup location , generating a display operation command and transmitting the display operation command to a third electronic device, so that the third electronic device displays the pick-up information.
The control method according to any one of claims 1 to 11, wherein the application scenario information includes a shopping scenario, and the application service event includes sharing shopping cart data.
A first electronic device, comprising:

A perception framework, used to determine the current application scenario information when a trigger instruction is detected; and

The application engine is configured to determine the application service event corresponding to the trigger instruction according to the application scenario information, and execute the application service event in response to the trigger instruction.
The first electronic device according to claim 13, wherein the trigger instruction includes a preset action, and the application engine detects whether the first electronic device executes the preset action through a sensor.
The first electronic device according to claim 13, wherein the application engine is further configured to determine the application scene information according to collected information, and the collected information includes sensor information, location information, and the second electronic device information of the first electronic device. At least one of the current page information of an electronic device and the running information of the application program of the first electronic device.
The first electronic device according to claim 13, wherein the application engine is further configured to establish a communication connection with the second electronic device in response to the trigger instruction; and receive sharing data transmitted from the second electronic device.
The first electronic device according to claim 16, wherein the application engine is further configured to: in response to the trigger instruction, receive the type and permission of the data requested by the second electronic device from the first electronic device;

filtering out the data to be shared according to the type and the permission requested by the second electronic device; and

and transmitting the data to be shared to the second electronic device for updating an application interface of the second electronic device.
The first electronic device according to claim 16, wherein the application engine is further used for:

performing a security check on the second electronic device in response to the trigger instruction;

After the security verification is passed, a step of establishing a communication connection with the second electronic device is performed.
The first electronic device according to claim 18, wherein the application engine is further used for:

After the security check is passed, obtain the type and authority of the data requested from the second electronic device according to the application scenario information;

sending the type of data requested by the first electronic device and the permission to the second electronic device, so that the shared data transmitted by the second electronic device is consistent with the type of data requested by the first electronic device and the described permissions match.
The first electronic device according to claim 13, wherein, in the case of receiving the shared data transmitted from the second electronic device, the application engine includes an interface drawing module, and the interface drawing module is used for:

updating the application interface of the first electronic device according to the received sharing data transmitted by the second electronic device.
The first electronic device according to claim 20, wherein the application engine is further used for:

Edit the updated application interface of the first electronic device according to the input operation to the first electronic device and/or according to the input operation transmitted to the first electronic device by the third electronic device, the editing It includes at least one of increasing data, reducing data, and modifying data.
The first electronic device according to claim 13, wherein, in the case of receiving the shared data transmitted from the second electronic device, the application engine is further configured to:

A prompt message is generated according to the shared data, and the prompt message is transmitted to a third electronic device, so that the third electronic device displays the prompt message.
The first electronic device according to claim 13, wherein, when the application scenario information includes a shopping scenario, the application engine is further configured to:

After the execution of the application service event is completed, generating pickup information and transmitting the pickup information to the third electronic device; and

When the first electronic device and/or the third electronic device arrive at the pick-up location, generate a display operation command and transmit the display operation command to the third electronic device, so that the third electronic device displays the the pickup information.
The first electronic device according to any one of claims 13 to 23, wherein the application scenario information includes a shopping scenario, and the application service event includes sharing shopping cart data.
An electronic device, comprising:

one or more processors, memory; and

One or more programs, wherein one or more of said programs are stored in said memory and executed by one or more of said processors, said programs comprising means for performing any one of claims 1 to 12 the control method described above.
A non-volatile computer-readable storage medium containing a computer program, when the computer program is executed by a processor, the processor is made to execute the control method described in any one of claims 1-12.