CN117177216A

CN117177216A - Information interaction method and device and electronic equipment

Info

Publication number: CN117177216A
Application number: CN202210580518.1A
Authority: CN
Inventors: 邓旭明; 李世明
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-05-25
Filing date: 2022-05-25
Publication date: 2023-12-05

Abstract

The embodiment of the application provides a method, a device and electronic equipment for information interaction, wherein the method comprises the following steps: when the first device detects that the motion sensing data of the first device changes, determining first data according to the change of the motion sensing data; and the first device receives second data sent by the second device through the low-power Bluetooth BLE; the first device then determines whether the first data and the second data match; when it is determined that the first data and the second data match, the first device performs information interaction with the second device, wherein the first data comprises edges and/or directions of the collision and/or time of the collision for indicating that the first device collides, and the second data comprises edges and/or directions of the collision and/or time of the collision for the second device. The method can accurately identify the interaction intention among the devices, simplify the operation steps of the user, and better meet the requirements of the user on the quick interaction among the devices.

Description

Information interaction method and device and electronic equipment

Technical Field

The embodiment of the application relates to the field of equipment interaction, in particular to a method, a device and electronic equipment for information interaction.

Background

The recognition of the intent of interaction between devices is a very important feature in human-machine interaction. Traditional equipment interaction is mainly based on networking type interaction, and equipment for interaction needs a networking connection process; moreover, interaction between the devices is initiated and selected manually by a user, the selection steps are complicated, the user is required to perform multiple clicking operations on the terminal, and the requirement of the user on the convenience of use is difficult to meet.

Accordingly, there is a need to provide an interaction scheme between devices, so that the interaction between the devices is more convenient.

Disclosure of Invention

The application provides an information interaction method, an information interaction device and electronic equipment, which can accurately identify the interaction intention among the equipment, simplify the operation steps of a user and better meet the requirements of the user on quick interaction among the equipment.

In a first aspect, a method for information interaction is provided, the method comprising: after the first device detects that the motion sensing data of the first device changes, determining first data according to the detected change of the motion sensing data of the first device; the first device then receives second data sent by the second device over bluetooth low energy (bluetooth low energy, BLE); then the first device determines whether the first data and the second data match; when the first device determines that the first data and the second data match, the first device interacts with the second device.

The first device detects that the motion sensing data of the first device changes, and may be replaced by: the first device determines that the motion-sensing data of the first device has changed, wherein the motion-sensing data may alternatively be detected by a third-party device and transmitted to the first device.

It should be understood that: the first device determines whether the first data and the second data match, essentially the first device further determines by this step whether the motion of the first device matches the motion of the second device.

Alternatively, the movement of the first device may be a collision gesture of the first device with the second device, or may be a movement speed of the first device, or may be other movement of the first device, which is not limited in this application.

Similarly, the movement of the second device may be a collision gesture of the second device with the first device, a movement speed of the second device, or other movement of the second device, which is not limited by the present application.

Optionally, the first device performs information interaction with the second device, including: the first device sends first interaction information to the second device.

Optionally, the first data includes one or more of data for indicating an edge where the first device collides, data for indicating a direction where the first device collides, and data for indicating a time where the first device collides, and further, the first data may include other data, which is not limited in this respect.

Optionally, the second data includes one or more of data indicating an edge where the second device collides, data indicating a direction where the second device collides, and data indicating a time when the second device collides, and further, the second data may include other data, which is not limited in the present application.

The motion sensing data of the first device changes as a result of a collision between the first device and the second device.

Optionally, the motion sensing data comprises acceleration.

And the first device determines whether the first data and the second data are matched, which can be understood as that the first device determines whether the collision meets the preset condition (such as a preset collision gesture), and when the collision meets the preset condition, the first device performs information interaction with the second device. And whether the collision satisfies a preset condition is determined by the first device by judging whether the first data and the second data match.

It should be understood that: the order in which the first device receives the second data and determines the first data is not limited by the present application.

In the embodiment of the application, the devices can realize interaction in a mutual collision mode, when the collision among the devices meets the preset conditions (such as preset collision gesture), the application interaction among the devices is automatically carried out, the manual operation of the user for many times is not needed, and the use experience of the user can be improved; in addition, the method carries out the receiving and transmitting of collision information through the low-power-consumption Bluetooth BLE module, does not depend on the NFC function of the equipment, avoids the increase of equipment power consumption caused by the normal open of the NFC function of the equipment, and in addition, the safety of interaction between the equipment is higher due to the preset collision condition.

With reference to the first aspect, in one possible implementation manner, the first device sends first data to the second device through BLE, where the first data is used by the second device to match the first data with the second data; and, the first equipment carries out information interaction with the second equipment, includes: the first device receives second interaction information sent by the second device after the first data and the second data are determined to be matched.

Optionally, the first device broadcasts the first data through BLE located inside the first device, so that the second device can timely recognize the interaction intention of the first device.

It should be understood that: the second device may be referred to herein generally as a device other than the first device within the same network.

Alternatively, the first data may be sent through a packet, may be sent directly, or may be sent by encryption and/or compression and/or encoding, which is not limited in the present application.

In the embodiment of the application, after the first device determines the first data (the collision information of the first device), the first data is broadcasted through BLE, so that the second device can receive the collision information of the first device and timely recognize the interaction intention of the first device.

With reference to the first aspect, in one possible implementation manner, the determining, by the first device, whether the first data and the second data match includes: in the case where the first data and the second data satisfy any one or more of the following condition a, condition B, and condition C, the first device determines that the first data and the second data match: A. the side where the first device collides is the same as or opposite to the side where the second device collides; B. the direction of the first device collision is opposite to the direction of the second device collision; C. the time when the first device collides is the same as the time when the second device collides.

Specifically, in one implementation, if the side of the first device that collides and the side of the second device that collides are the same or opposite, the first device determines that the first data and the second data match.

In yet another implementation, the first device determines that the first data and the second data match if the direction of the first device collision and the direction of the second device collision are opposite.

In yet another implementation, if the time at which the first device collides and the time at which the second device collides are the same, the first device determines that the first data and the second data match.

Illustratively, if the first device collides by 9 am at 1 month 5 a.m. of beijing 2021 and the second device collides by 9 am at 5 month 1 a.m. of beijing 2021, the first device determines that the first data and the second data match.

In yet another implementation, if the side of the first device that collides and the side of the second device that collides are the same or opposite, and the direction of the first device that collides and the second device that collides are exactly opposite, the first device determines that the first data and the second data are successfully paired, i.e., the first data and the second data match.

In yet another implementation, if the side of the first device that collides and the side of the second device that collides are the same or opposite, and the time of the first device and the second device that collides are the same, the first device determines that the first data and the second data match.

In yet another implementation, if the first device and the second device collide in opposite directions and the time of the first device and the second device collide is the same, the first device determines that the first data and the second data match.

In yet another implementation, if the side of the first device that collides and the side of the second device that collides are the same or opposite, the directions of the collisions are opposite, and the time of the collisions are the same, the first device determines that the first data and the second data are successfully paired, i.e., the first data and the second data are matched.

In the embodiment of the application, the preset collision gesture between the devices can be limited to be one or more of the same or opposite sides of the collision, opposite directions of the collision and same time of the collision, and the interaction intention can be determined between the two devices only when the actual collision gesture meets the conditions, so that the information interaction is performed. In this way, the recognition of the interaction intention among the devices can be more accurate.

In addition, if the sides of the first device and the second device, which collide with each other, are the same or opposite, the collision directions are opposite, and the collision time is the same, the erroneous recognition of the interaction intention between the devices caused by the false touch operation of the user can be better eliminated, so that the accuracy of the interaction intention recognition between the devices is further improved.

With reference to the first aspect, in one possible implementation manner, the first device and the second device are devices with different identities.

The devices with different identities may be, for example, devices that do not log in to the same account and that do not bind to the same account. Optionally, the account may be an account of an account system provided by the manufacturer of the electronic device (for example, the Hua account, apple ID), or an account of an account system provided by a third party application.

In the embodiment of the application, the mutual interaction equipment can be two or more equipment with different identities, and compared with the prior art which can only realize the interaction with the equipment with the same identity, the method and the device can overcome the identity limitation of the interaction equipment, so that the application range is wider, and the use experience of a user is further improved.

In a second aspect, there is provided a method of information interaction, the method comprising: after the second device detects that the motion sensing data of the second device changes, determining second data according to the detected change of the motion sensing data of the second device; the second device then receives first data sent by the first device over bluetooth low energy (bluetooth low energy, BLE); then the second device determines whether the first data and the second data match; when the second device determines that the first data and the second data match, the second device performs information interaction with the first device.

Optionally, the second device performs information interaction with the first device, including: the second device sends second interaction information to the first device.

Optionally, the first data includes one or more of data for indicating an edge where the first device collides, data for indicating a direction where the first device collides, and data for indicating a time when the first device collides, and further, the first data may include other data, which is not limited in this application.

Optionally, the second data includes one or more of data for indicating an edge where the second device collides, data for indicating a direction where the first device collides, and data for indicating a time where the second device collides, and further, the second data may include other data, which is not limited in this application.

Wherein the change in the motion sensing data of the second device is caused by a collision of the second device with the second device.

Optionally, the motion sensing data comprises acceleration.

And the second device determines whether the first data and the second data are matched, which can be understood that the second device judges whether the collision meets the preset condition (such as a preset collision gesture), and when the collision meets the preset condition, the second device performs information interaction with the first device. And whether the collision satisfies a preset condition is determined by the second device by judging whether the first data and the second data match.

It should be understood that: the order in which the first data is received and the second data is determined by the second device is not limited by the present application.

In the embodiment of the application, the devices can realize interaction in a mutual collision mode, when the collision among the devices meets the preset conditions (such as preset collision gesture), the application interaction among the devices is automatically carried out, the manual operation of the user for many times is not needed, and the use experience of the user can be improved; in addition, the method carries out the receiving and transmitting of collision information through the low-power-consumption Bluetooth BLE module, does not depend on the NFC function of the equipment, and avoids the increase of equipment power consumption caused by the normal open of the NFC function of the equipment.

With reference to the second aspect, in one possible implementation manner, the second device sends second data to the first device through BLE, where the second data is used by the first device to match the first data with the second data; and, the second equipment carries out information interaction with the first equipment, includes: the second device receives first interaction information sent by the first device after the first data and the second data are determined to be matched.

Optionally, the second device broadcasts the second data through BLE located inside the second device, so that the first device can timely recognize the interaction intention of the second device.

It should be understood that: the first device may refer broadly herein to other devices within the same network than the second device.

Alternatively, the second data may be sent through a packet, may be sent directly, or may be sent by encryption and/or compression and/or encoding, which is not limited in the present application.

In the embodiment of the application, after the second device determines the second data (the collision information of the second device), the second data is broadcasted through BLE, so that the first device can receive the collision information of the second device and timely recognize the interaction intention of the second device.

With reference to the second aspect, in one possible implementation manner, the determining, by the second device, whether the first data and the second data match includes: in the case where the first data and the second data satisfy any one or more of the following condition a, condition B, and condition C, the second device determines that the first data and the second data match: A. the side where the second device collides is the same as or opposite to the side where the first device collides; B. the direction of the collision of the second device is opposite to the direction of the collision of the first device; C. the time at which the second device collides is the same as the time at which the first device collides.

Specifically, in one implementation, if the side of the second device that collides is the same as or opposite to the side of the first device that collides, the second device determines that the first data and the second data match.

In yet another implementation, the second device determines that the first data and the second data match if the direction of the second device collision is opposite to the direction of the first device collision.

In yet another implementation, if the time at which the second device collides is the same as the time at which the first device collides, the second device determines that the first data and the second data match.

Illustratively, if the time of the second device colliding is 9 am integer at 1 month 5 a 1 st of beijing time 2021 and the time of the first device colliding is 9 am integer at 5 a 1 st of beijing time 2021, the second device determines that the first data and the second data match.

In yet another implementation, if the side of the second device that collides is the same or opposite to the side of the first device that collides, and the direction of the second device that collides is exactly opposite to the direction of the first device that collides, the second device determines that the first data and the second data are successfully paired, i.e., the first data and the second data match.

In yet another implementation, if the side of the second device that collides is the same or opposite to the side of the first device that collides, and the time of the second device that collides is the same as the time of the first device that collides, the second device determines that the first data and the second data match.

In yet another implementation, if the direction of the collision between the second device and the first device is opposite, and the time of the collision between the second device and the first device is the same, the second device determines that the first data and the second data match.

In yet another implementation, if the side of the second device that collides with the side of the first device that collides with the side of the second device is the same or opposite, the direction of the collision is opposite, and the time of the collision is the same, the second device determines that the first data and the second data are successfully paired, i.e., the first data and the second data are matched.

With reference to the second aspect, in one possible implementation manner, the first device and the second device are devices with different identities.

In a third aspect, there is provided an apparatus for information interaction, the apparatus comprising: a motion sensor for detecting a change in motion sensing data of the first device; a processing unit for determining first data from a change in motion sensing data of the first device; the low-power consumption Bluetooth BLE module is used for receiving second data sent by the second equipment through BLE; the processing unit is further configured to determine whether the first data and the second data match; the BLE module is further configured to interact with the second device when the processing unit determines that the first data and the second data match.

Optionally, the BLE module is specifically configured to: and sending the first interaction information to the second device.

Optionally, the first data includes one or more of data for indicating an edge where the first device collides, data for indicating a direction where the first device collides, and data for indicating a time where the first device collides, and further, the first data may include other data, which is not limited in this application.

It should be understood that: the second device in the present application may refer to all devices except the first device in the network where the first device is located.

Optionally, the motion sensing data comprises acceleration.

And, the processing unit determines whether the first data and the second data match, which may be understood that the processing unit determines whether the collision meets a preset condition (for example, a preset collision gesture), and when it is determined that the collision meets the preset condition, the BLE module of the first device performs information interaction with the second device. And whether the collision satisfies a preset condition is determined by the processing unit by determining whether the first data and the second data match. Alternatively, the motion sensor may be an Acceleration (ACC) sensor and/or a gyro sensor, and may be other sensors capable of detecting changes in motion sensing data, which is not limited by the present application.

In the embodiment of the application, the devices can realize interaction in a mutual collision mode, when the collision among the devices meets the preset conditions (such as preset collision gesture), the application interaction among the devices is automatically carried out, the manual operation of the user for many times is not needed, and the use experience of the user can be improved; in addition, the device carries out the receiving and transmitting of collision information through the low-power-consumption Bluetooth BLE module, does not depend on the NFC function of the equipment, and avoids the increase of equipment power consumption caused by the normal open NFC function of the equipment.

With reference to the third aspect, in one possible implementation manner, the BLE module is further configured to: transmitting the first data to a second device, wherein the first data is used for matching the first data and the second data by the second device; and, the processing unit is also specifically configured to: and receiving second interaction information sent by the second device after the first data and the second data are determined to be matched.

Optionally, the BLE module of the first device broadcasts the first data, so that the second device can timely identify the interaction intention of the first device.

In the embodiment of the application, after determining the first data (the collision information of the first device), the BLE module broadcasts the first data, so that the second device can receive the collision information of the first device and timely recognize the interaction intention of the first device.

With reference to the third aspect, in one possible implementation manner, the processing unit is specifically configured to: determining that the first data and the second data match if the first data and the second data meet any one or more of the following conditions a, B and C: A. the side where the first device collides is the same as or opposite to the side where the second device collides; B. the direction of the first device collision is opposite to the direction of the second device collision; C. the time when the first device collides is the same as the time when the second device collides.

Specifically, in one implementation, the processing unit is specifically configured to: and determining that the first data and the second data are matched when the side where the first device collides and the side where the second device collides are the same or opposite.

In yet another implementation, the processing unit is specifically configured to: when the direction of the first device collision is opposite to the direction of the second device collision, the first data and the second data are determined to match.

In yet another implementation, the processing unit is specifically configured to: and when the time of collision of the first device and the time of collision of the second device are the same, determining that the first data and the second data are matched.

Illustratively, if the time of the first device colliding is 9 am integer at 1 month 5 a 1 st of beijing time 2021 and the time of the second device colliding is 9 am integer at 5 a 1 st of beijing time 2021, the processing unit determines that the first data and the second data match.

In yet another implementation, the processing unit is specifically configured to: and when the side where the first device collides and the side where the second device collides are the same or opposite, and the directions of the first device and the second device collide are opposite, determining that the first data and the second data are successfully paired, i.e. the first data and the second data are matched.

In yet another implementation, the processing unit is specifically configured to: and determining that the first data and the second data are matched when the side where the first device collides and the side where the second device collides are the same or opposite, and the time where the first device collides and the second device collide are the same.

In yet another implementation, the processing unit is specifically configured to: and when the collision directions of the first device and the second device are opposite and the collision time of the first device and the second device is the same, determining that the first data and the second data are matched.

In yet another implementation, the processing unit is specifically configured to: and when the side where the first device collides and the side where the second device collides are the same or opposite, and the directions of the collisions are opposite, and the time of the collisions is the same, determining that the first data and the second data are matched.

With reference to the third aspect, in one possible implementation manner, the first device and the second device are devices with different identities.

In a fourth aspect, there is provided an apparatus for information interaction, the apparatus comprising: a motion sensor for detecting a change in motion sensing data of the second device; a processing unit for determining second data from the change in motion sensing data of the second device; the low-power consumption Bluetooth BLE module is used for receiving first data sent by the first equipment through BLE; the processing unit is further configured to determine whether the first data and the second data match; the BLE module is further configured to interact with the first device when the processing unit determines that the first data and the second data match.

Optionally, the BLE module is specifically configured to: and sending the second interaction information to the first device.

Optionally, the first data includes one or more of data for indicating an edge where the first device collides, data for indicating a direction where the first device collides, and data for indicating a time where the first device collides, and in addition, the first data may include other data, which is not limited in this application.

Optionally, the second data includes one or more of data for indicating an edge where the second device collides, data for indicating a direction where the second device collides, and data for indicating a time where the second device collides, and in addition, the second data may include other data, which is not limited in this application.

Wherein the change in the motion sensing data of the second device is caused by a collision of the second device with the first device.

Optionally, the motion sensing data comprises acceleration.

And the processing unit determines whether the first data and the second data are matched, which can be understood that the processing unit judges whether the collision meets the preset condition (such as a preset collision gesture), and when the collision meets the preset condition, the BLE module of the second device performs information interaction with the first device. And whether the collision satisfies a preset condition is determined by the processing unit by determining whether the first data and the second data match.

Alternatively, the motion sensor may be an ACC sensor and/or a gyro sensor, or may be another sensor capable of detecting a change in motion sensing data, which is not limited in the present application.

With reference to the fourth aspect, in one possible implementation manner, the BLE module is further configured to: transmitting the second data to the first device, wherein the second data is used for matching the first data and the second data by the first device; and, the processing unit is also specifically configured to: and receiving first interaction information sent by the first device after the first data and the second data are determined to be matched.

Optionally, the BLE module of the second device broadcasts the second data, so that the first device can timely recognize the interaction intention of the second device.

In the embodiment of the application, after determining the second data (the collision information of the second device), the BLE module broadcasts the second data, so that the first device can receive the collision information of the second device and timely recognize the interaction intention of the second device.

With reference to the fourth aspect, in one possible implementation manner, the processing unit is specifically configured to: determining that the first data and the second data match if the first data and the second data meet any one or more of the following conditions a, B and C: A. the side where the second device collides is the same as or opposite to the side where the first device collides; B. the direction of the collision of the second device is opposite to the direction of the collision of the first device; C. the time at which the second device collides is the same as the time at which the first device collides.

Specifically, in one implementation, the processing unit is specifically configured to: and determining that the first data and the second data are matched when the side where the second device collides and the side where the first device collides are the same or opposite.

In yet another implementation, the processing unit is specifically configured to: when the direction of the collision of the second device is opposite to the direction of the collision of the first device, the first data and the second data are determined to match.

In yet another implementation, the processing unit is specifically configured to: and when the time of the collision of the second device is the same as the time of the collision of the first device, determining that the first data and the second data are matched.

Illustratively, if the time of the second device colliding is 9 am integer at 1 month 5 a 1 st of beijing time 2021 and the time of the first device colliding is 9 am integer at 5 a 1 st of beijing time 2021, the processing unit determines that the first data and the second data match.

In yet another implementation, the processing unit is specifically configured to: and when the side where the second device collides and the side where the first device collides are the same or opposite, and the directions of the second device and the first device collide are opposite, determining that the first data and the second data are successfully paired, i.e. the first data and the second data are matched.

In yet another implementation, the processing unit is specifically configured to: and determining that the first data and the second data are matched when the side where the second device collides and the side where the first device collides are the same or opposite, and the time where the second device collides and the first device are the same.

In yet another implementation, the processing unit is specifically configured to: and determining that the first data and the second data are matched when the collision directions of the second device and the first device are opposite and the collision time of the second device and the first device is the same.

In yet another implementation, the processing unit is specifically configured to: and when the side where the second device collides and the side where the first device collides are the same or opposite, and the directions of the collisions are opposite, and the time of the collisions is the same, determining that the first data and the second data are matched.

With reference to the fourth aspect, in one possible implementation manner, the first device and the second device are devices with different identities.

In a fifth aspect, an electronic device is provided, the electronic device comprising a memory for storing computer program code and a processor for executing the computer program code stored in the memory to implement the method of the first aspect or any one of the possible implementations of the first aspect or to implement the method of the second aspect or any one of the possible implementations of the second aspect.

In a sixth aspect, a system for information interaction is provided, the system comprising at least two electronic devices provided in the third aspect, or the interaction system comprising an apparatus in any one of the possible implementations of the third aspect or the third aspect and an apparatus in any one of the possible implementations of the fourth aspect or the fourth aspect.

A seventh aspect provides a chip having instructions stored therein which, when run on a device, cause the chip to perform the method of or the method of any of the possible implementations of the first aspect or the second aspect.

An eighth aspect provides a computer readable storage medium having stored therein a computer program or instructions which, when executed, implement the method of the first aspect or any one of the possible implementations of the first aspect or the method of the second aspect or any one of the possible implementations of the second aspect.

Drawings

Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 2 is a block diagram of a software architecture of an electronic device according to an embodiment of the present application;

FIG. 3 is a diagram of conventional interactions between devices provided by an embodiment of the present application;

FIG. 4 is a schematic flow chart of a control method of device interaction in the prior art provided by an embodiment of the present application;

FIG. 5 is a schematic flow chart of another method of controlling device interaction in the prior art provided by an embodiment of the present application;

FIG. 6 is a diagram showing an interface for implementing an interaction process between devices according to an embodiment of the present application;

fig. 7 is a schematic diagram of a natural coordinate system of a mobile phone according to an embodiment of the present application;

FIG. 8 is an information interaction diagram of interaction between a first device and a second device according to an embodiment of the present application;

FIG. 9 is a schematic diagram of an application registration interaction interface and interaction implemented through the interaction interface provided by an embodiment of the present application;

FIG. 10 is a schematic flow chart of a first device implementation interaction provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of functional modules of an interactive system according to an embodiment of the present application;

fig. 12 is a schematic diagram of functional modules of another interactive system according to an embodiment of the present application.

Detailed Description

The technical scheme of the application will be described below with reference to the accompanying drawings. It will be apparent that the described embodiments are only some, but not all, embodiments of the application.

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plural" or "plurality" means two or more than two.

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

The method provided by the embodiment of the application can be applied to electronic equipment such as mobile phones, tablet computers, wearable equipment, vehicle-mounted equipment, augmented reality (augmented reality, AR)/Virtual Reality (VR) equipment, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal digital assistant, PDA) and the like, and the embodiment of the application does not limit the specific type of the electronic equipment.

By way of example, fig. 1 shows a schematic diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 communicates with the touch sensor 180K through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an App (such as a sound playing function, an image playing function, etc.) and the like required for at least one function of the operating system. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The electronic device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 100 employs an embedded SIM (eSIM) card, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

It should be understood that the phone cards in embodiments of the present application include, but are not limited to, SIM cards, eSIM cards, universal subscriber identity cards (universal subscriber identity module, USIM), universal integrated phone cards (universal integrated circuit card, UICC), and the like.

The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Fig. 2 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively. The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

It should be understood that the technical scheme in the embodiment of the application can be used in Android, IOS, hong Meng and other systems.

The technical scheme of the embodiment of the application can be applied to interaction scenes among electronic devices, in particular to interaction scenes among electronic devices with different identities, and can also be applied to interaction scenes among electronic devices without NFC functions.

The electronic device in the embodiment of the application may be a television, a desktop computer, a notebook computer, a portable electronic device, such as a mobile phone, a tablet computer, a camera, a video recorder, or other electronic devices with a screen display function, electronic devices in a 5G network, or electronic devices in a public land mobile network (public land mobile network, PLMN) that evolves in the future, which is not limited in this application.

Currently, recognition of interaction intention between devices is a very important ring in man-machine interaction. Traditional equipment interaction is mainly based on networking, and equipment for interaction needs a networking connection process; and is manually initiated and selected by the user. The selecting step mainly comprises the following steps: initiating a task, entering a list of devices, and selecting a target device.

By way of example, taking the form of interaction between devices as a picture transmission, fig. 3 shows a schematic diagram of conventional interaction between devices according to an embodiment of the present application. As shown in fig. 3, the album application of the current device is running, and the interface displays the picture a in the album, when the user wants to transmit the picture a to another device, the user needs to click on the "send" control on the interface shown in (a) in fig. 3, then the interface display is shown in (b) in fig. 3, and when the interface is manually selected to transmit the picture in "bluetooth", the user jumps to the selectable device list (shown in (c) in fig. 3), and after the user manually selects the device needing to interact with the current device (i.e. the receiving end of the picture a) in the device list as the device 3, the current device starts to send the picture a to the device 3.

Therefore, the conventional interaction method between devices requires the user to perform multiple clicking operations on the terminal, so as to influence the experience of the user.

In view of the above problems, there are currently two main solutions, and fig. 4 shows a schematic flow chart of a control method 400 of device interaction in the prior art provided by the present application. The method 400 is a triggered interaction in response to near field communication (near field communication, NFC), the method 400 comprising:

step S401: and acquiring NFC equipment state information in response to the triggering of the NFC.

Wherein the NFC device state information includes master device state information and slave device state information.

Step S402: providing an interaction function corresponding to the acquired NFC equipment state information according to a preset mapping relation, and executing the interaction function in response to a triggering condition so as to realize information interaction between the master equipment and the slave equipment.

In this method 400, the electronic device must be interactively triggered by the approach communication NFC. The NFC device is only suitable for interaction between electronic devices with NFC functions, and the NFC functions of the devices are kept in a normally-open state, so that larger power consumption can be generated.

Fig. 5 shows a schematic flow chart of another device interaction control method 500 in the prior art provided by the present application. The method 500 is a method of cross-device interaction, the method 500 comprising:

Step S501: the first device determines that the user identity of the first device is the same as the user identity of the second device (i.e., the first device and the second device are electronic devices of the same identity).

The electronic devices with the same identity may be, for example, electronic devices logged in with the same account, or electronic devices bound with the same account. Optionally, the account may be an account of an account system provided by the manufacturer of the electronic device (for example, the Hua account, apple ID), or an account of an account system provided by a third party application.

Step S502: the first device obtains a target user of a task being performed by the second device.

Step S503: the first device determines that a target contact of an application currently used by the first device is a target user of a task being executed by the second device according to the target user.

Step S504: the first device sends information to the target user.

In this method 500, the two devices that interact must be two devices that are identical in identity. The convenient interaction between two devices with different identities cannot be satisfied.

Therefore, in the current scheme, the electronic devices interact based on networking, and the interaction device needs to have a networking connection process; the interaction between electronic devices is limited by the identity of the devices or the functions of the devices, and the like, and the existing scheme is mainly optimized by simplifying the selection flow of the devices, so that the interaction requirement of users on different identity devices cannot be met.

Based on the method, the device and the electronic equipment, the method can accurately identify the interaction intention among the equipment, realize the interaction among the equipment with the same or different identities, and realize the interaction triggering of the non-NFC equipment, thereby avoiding the increase of power consumption caused by the normal open of the NFC function of the equipment and further meeting the requirement of a user on the quick interaction among the equipment.

The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" means one, two or more than two. The term "and/or" is used to describe an association relationship of associated objects, meaning that there may be three relationships; for example, a and/or B may represent: a alone, a and B together, and B alone, wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "one embodiment," "some embodiments," "another embodiment," "other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more, but not all, embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

By taking the interaction form between devices as an example, fig. 6 shows an interface display diagram of an interaction process between devices according to an embodiment of the present application. As shown in fig. 6, an album application of the first device is running, and an interface of the first device displays a picture a in the album, when a user wants to transmit the picture a to the second device, the first device and the second device are only required to collide with each other in a preset gesture, so that interaction between the first device and the second device can be realized, and at this time, the second device receives the picture a sent by the first device, where the first device and the second device are electronic devices.

It should be understood that: in the embodiment of the application, application interaction is realized among devices, and a corresponding application pre-registration interaction interface is needed, wherein the interaction interface is an implementation mode provided for application interaction among devices in the embodiment of the application, and application registration of the interaction interface can be understood as application permission to realize interaction with applications on other devices through an interaction mode (collision) provided by the embodiment of the application.

It should also be appreciated that: in the embodiment of the present application, the interaction application between devices is described by taking an album as an example, but this does not limit the interaction form between devices, and the interaction application between devices may be one or more of a video application, a chat application, a browser application, and a learning application, or may be other applications registered with the interaction interface.

Alternatively, the first device and the second device may collide with a preset gesture, which may be preset by a user, for example, may collide with corresponding sides (any one or more of sides a1 and a2, b1 and b2, c1 and c2, and d1 and d2 shown in fig. 6) of the first device and the second device, may collide with corresponding sides of the first device and the second device, may collide with preset corresponding sides or sides, or may collide in other manners, which is not limited in the present application.

Alternatively, the collision between the first device and the second device may be that the first device and the second device move towards each other; or the first device moves to the second device, and the second device does not move; the second device may also move toward the first device, and the first device may not move, or may move in other manners, which is not limited by the present application.

Alternatively, the first device and the second device may be devices with the same identity, or may be devices with different identities, which is not limited in the present application.

The explanation about the devices with the same identity is described in detail in the embodiment shown in fig. 5, and is not described herein for brevity; in addition, the devices with different identities may be devices that are not registered with the same account, and are not bound to the same account, for example. The explanation about the account number is also described in detail in the embodiment shown in fig. 5, and is not repeated here for brevity.

According to the embodiment of the application, the application interaction among the devices can be realized in a collision mode, when the collision among the devices meets the preset conditions (such as preset collision gesture), the application interaction among the devices is automatically carried out, the manual operation of a user for many times is not needed, and the use experience of the user can be improved; the method does not depend on the NFC function of the equipment, and the increase of the power consumption of the equipment caused by the normal open of the NFC function of the equipment is avoided.

In order to more clearly describe the embodiments of the present application in the following, a natural coordinate system of a mobile phone will be explained in detail by taking a mobile phone as an example of both the first device and the second device in conjunction with fig. 7. As shown in fig. 7, the front of the mobile phone is vertically placed, and the x-axis is horizontally directed to the right along the plane of the mobile phone screen based on the screen of the mobile phone, that is, the positive direction of the x-axis is horizontally directed to the right along the plane of the mobile phone screen, and the negative direction of the x-axis is horizontally directed to the left along the plane of the mobile phone screen; the y-axis is vertically upward along the plane of the mobile phone screen, that is, the positive direction of the y-axis is horizontally and vertically upward along the plane of the mobile phone screen, and the negative direction of the y-axis is horizontally and vertically downward along the plane of the mobile phone screen; the z-axis is directed out of the front of the screen perpendicular to the plane of the mobile phone screen, that is, the positive direction of the z-axis is directed out of the front of the screen perpendicular to the plane of the mobile phone screen, and the negative direction of the z-axis is directed out of the back of the screen perpendicular to the plane of the mobile phone screen. In the placing posture of the mobile phone, the upper side of the first device is marked as a1, the left side is marked as b1, the right side is marked as c1, and the lower side is marked as d1; similarly, the second device is denoted a2 on the top, b2 on the left, c2 on the right, and d2 on the bottom.

Next, an exemplary information interaction diagram corresponding to an interaction method 800 of the first device and the second device provided in the embodiment of the present application is shown in fig. 8. As shown in fig. 8, the method 800 includes:

step S801: the first device detects a change in motion sensing data of the first device.

When the first device and the second device send a tap, the first device detects that the motion sensing data of the first device changes.

In particular, the first device may comprise a motion sensor by means of which the first device detects a change in motion sensing data of the first device

Optionally, the motion sensing data comprises acceleration.

Alternatively, the motion sensor may be an Acceleration (ACC) sensor, and may be other sensors capable of detecting changes in motion sensing data, which is not limited in the present application.

Optionally, the first device may further include a gyro sensor, and the first device detects a change in motion sensing data of the first device through the ACC sensor and the gyro sensor; in addition, the first device may detect changes in the motion sensing data via one or more other sensors, as the application is not limited in this regard.

Step S802: the first device transmits first data to the second device.

The first device determines first data of the first device according to the change of the motion sensing data, and then sends the first data to the second device.

Wherein the first data includes data for indicating an edge of the first device that collides and/or data for indicating a direction in which the first device collides, may further include data for indicating a time of the first device that collides and/or data for indicating an identification of the first device, and may further include other data, which is not limited in this regard.

Wherein the first device includes a bluetooth low energy (bluetooth low energy, BLE) module that remains in a normally open state through which the first device broadcasts the first data.

Step S803: the second device detects a change in motion sensing data of the second device.

When the first device and the second device send a tap, the second device detects that the motion sensing data of the second device changes.

In particular, the second device may comprise a motion sensor by means of which the second device detects a change in motion sensing data of the second device.

Optionally, the motion sensing data comprises acceleration.

Alternatively, the motion sensor may be an ACC sensor, or may be another sensor capable of detecting a change in motion sensing data, which is not limited in the present application.

Optionally, the second device may further include a gyro sensor, the second device detecting a change in motion sensing data of the second device through the ACC sensor and the gyro sensor; in addition, the second device may detect changes in the motion sensing data via one or more other sensors, as the application is not limited in this regard.

Step S804: the second device transmits second data to the first device.

The second device determines second data of the second device according to the change of the motion sensing data, and then sends the second data to the first device.

Wherein the second data includes data for indicating an edge of the second device that collides and/or data for indicating a direction in which the second device collides, may further include data for indicating a time of the second device that collides and/or data for indicating an identification of the second device, and may further include other data, which is not limited in this regard.

Wherein the second device comprises a BLE module that remains in a normally open state, through which the second device broadcasts the second data.

Step S805: the first device determines whether the first data and the second data are matched (namely whether the collision meets a preset condition), and if the first data and the second data are not matched, no interaction intention with the second device is determined; if so, it is determined that there is an intention to interact with the second device, and the process continues to step S807.

Wherein the first device determines whether the first data and the second data match, which may be the case if the first data and the second data match any one or more of the following conditions:

the side where the first device collides is the same as or opposite to the side where the second device collides;

the direction of the first device collision is opposite to the direction of the second device collision;

the time when the first device collides is the same as the time when the second device collides.

Taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as a basis, the side where the first device collides with the side where the second device collides with the side is the same, which may mean that the side where the first device collides with the side is a1, and the side where the second device collides with the side is a2; it may also mean that the side where the first device collides is b1, and the side where the second device collides is b2; it may also mean that the side where the first device collides is c1, and the side where the second device collides is c2; it may also mean that the side where the first device collides is d1, and the side where the second device collides is d2.

Taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as a basis, and making a side where the first device collides opposite to a side where the second device collides, where the side where the first device collides is a1 and the side where the second device collides is a2; it may also mean that the side where the first device collides is b1, and the side where the second device collides is c2; it may also mean that the side where the first device collides is c1, and the side where the second device collides is b2; it may also mean that the side where the first device collides is d1, and the side where the second device collides is d2.

In addition, the two opposite sides may also refer to any side length of the first device and any side length of the second device, which are preset by the user according to actual situations (for example, self habits, etc.), respectively.

Taking the first device and the second device as an example of a mobile phone, based on a natural coordinate system (shown in fig. 7) of the mobile phone, there are four possible situations of collision directions of the first device and/or the second device, which are respectively: an x-axis positive direction, an x-axis negative direction, a y-axis positive direction, and a y-axis negative direction. The collision direction of the first device and the collision direction of the second device are opposite, which means that the collision direction of the first device is the positive x-axis direction and the collision direction of the second device is the negative x-axis direction; the collision direction of the first device is the negative x-axis direction, and the collision direction of the second device is the positive x-axis direction; the collision direction of the first device is the positive y-axis direction, and the collision direction of the second device is the negative y-axis direction; it may also mean that the direction of the collision of the first device is the negative y-axis direction and the direction of the collision of the second device is the positive y-axis direction.

Taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as an example, determining that the first data and the second data are matched by the first device, wherein the side where the first device collides is a1, the direction where the first device collides is the positive x-axis direction, the side where the second device collides is a2, and the direction where the second device collides is the negative x-axis direction.

Taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as an example, a side where the first device collides is b1, a direction where the first device collides is an x-axis positive direction, a side where the second device collides is a2, and a direction where the second device collides is an x-axis negative direction, the first device determines that the first data and the second data are matched.

Illustratively, taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as a base, taking a side of the first device, where the first device collides with a1, and the time of the collision is 9 am integer in 1 month 5 a year of beijing time 2021, taking a2 side of the second device, and the time of the collision is 9 am integer in 1 month 5 a day of beijing time 2021, the first device determines that the first data and the second data are matched.

Illustratively, taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as a base, taking a side where the first device collides as b1, and taking the time of the collision as 9 am integer in 1 month 5 a year of Beijing time 2021, taking a side where the second device collides as a2, and taking the time of the collision as 9 am integer in 5 month 5 a year of 1 year of Beijing time 2021, the first device determines that the first data and the second data are matched.

Taking a first device and a second device as an example, taking a natural coordinate system (shown in fig. 7) of the mobile phone as a base, the first device collides with the first device in an x-axis positive direction, the time of the collision is 9 am on 1 month 5 a day of beijing time 2021, the second device collides with the second device in an x-axis negative direction, and the time of the collision is 9 am on 1 month 5 a day of beijing time 2021, so that the first device determines that the first data and the second data are matched.

Taking a first device and a second device as an example, taking a natural coordinate system of the mobile phone as a base (shown in fig. 7), wherein the side where the first device collides is a1, the direction of the collision is the positive direction of the x axis, and the time of the collision is 9 am of the Beijing time 2021, 1, 5 and 5; the side of the second device where the collision occurs is a2, the direction of the collision is the negative x-axis direction, and the time of the collision is 9 am integer at 5 a1 month of beijing time 2021, then the first device determines that the first data and the second data match.

Taking a first device and a second device as an example, taking a natural coordinate system of the mobile phone as a base (shown in fig. 7), wherein the side where the first device collides is a1, and the collision direction is the positive direction of the x axis; the side of the collision of the second device is a2, the direction of the collision is the negative direction of the x axis, and the second device sends the collision information to the first device through the second data; after the first device receives the collision information sent by the second device, if it is further determined that the time of collision between the first device and the second device is 9 am integer of Beijing time 2021, 1 month and 5 day, then the first device determines that the first data and the second data are matched.

Taking a first device and a second device as an example, taking a natural coordinate system of the mobile phone as a base (shown in fig. 7), wherein the side where the first device collides is b1, the direction of the collision is the positive direction of the x axis, and the time of the collision is 9 am of the Beijing time 2021, 1, 5 and 5; the side of the second device where the collision occurs is a2, the direction of the collision is the negative x-axis direction, and the time of the collision is 9 am integer at 5 a1 month of beijing time 2021, then the first device determines that the first data and the second data match.

Taking a first device and a second device as an example, taking a natural coordinate system of the mobile phone as a base (shown in fig. 7), wherein the side where the first device collides is b1, and the collision direction is the positive x-axis direction; the side of the collision of the second device is a2, the direction of the collision is the negative direction of the x axis, and the second device sends the collision information to the first device through the second data; after the first device receives the collision information sent by the second device, if it is further determined that the time of collision between the first device and the second device is 9 am integer of Beijing time 2021, 1 month and 5 day, then the first device determines that the first data and the second data are matched.

Step S806: the second device determines whether the first data and the second data are matched (namely whether the collision meets a preset condition), and if the first data and the second data are not matched, no interaction intention with the first device is determined; if so, it is determined that there is an intention to interact with the first device, and the process continues to step S807.

Wherein, similar to step S805, the second device determines whether the first data and the second data match, and may determine that the first data and the second data match if the first data and the second data meet any one or more of the following conditions:

the side where the second device collides is the same as or opposite to the side where the first device collides;

the direction of the collision of the second device is opposite to the direction of the collision of the first device;

the time at which the second device collides is the same as the time at which the first device collides.

Specifically, in one implementation, if the side of the second device that collides is the same as or opposite to the side of the first device that collides, the second device determines that the first data and the second data match. The same or opposite explanation about the side where the second device collides and the side where the first device collides are similar to the same or opposite explanation about the side where the first device collides and the side where the second device collides in step S805, and are not repeated here for brevity.

In yet another implementation, the second device determines that the first data and the second data match if the direction of the second device collision is opposite to the direction of the first device collision. The explanation about the direction of the second device collision and the direction of the first device collision are similar to those of the first device collision and the direction of the second device collision in step S805, and are not repeated here for brevity.

In yet another implementation, if the time at which the second device collides is the same as the time at which the first device collides, the second device determines that the first data and the second data match. The explanation about the same time when the second device collides and the same time when the first device collides are similar to the explanation about the same time when the first device collides and the same time when the second device collides in step S805, and are not repeated here for brevity.

Step S807: and the first device and the second device conduct information interaction.

When the first device and the second device determine that the first device and the second device have interaction intention, the first device and the second device start to interact information.

The information interaction between the first device and the second device may be information interaction, may be information circulation, or may be interaction in other forms, where a specific interaction form depends on applications registered with interaction interfaces on the first device and the second device (for example, an application currently running is an album, and the album application registers the interaction interfaces, then the interaction between devices is picture transmission, an application currently running is video, and the video application registers the interaction interfaces, then the interaction between devices is video transmission or screen display), which is not limited in the application.

Note that: the explanation of the above-mentioned interaction interface is already explained in detail in the embodiment shown in fig. 6, and is not repeated here for brevity.

It should be understood that: the order of execution of the step S801 and the step S803 is not limited, and the step S801 and the step S803 may be performed simultaneously or may not be performed simultaneously; in addition, the order of execution of the steps S802 and S804 is not limited, and the steps S802 and S804 may be performed simultaneously or may not be performed simultaneously; similarly, the order of execution of the steps S805 and S806 is not limited in the embodiment of the present application, and the steps S805 and S806 may be performed simultaneously or may not be performed simultaneously.

It should be understood that: the interaction method 800 provided by the embodiment of the application provides an interaction interface for interaction between applications of the device, and the interaction method 800 provided by the embodiment of the application can be applied only after the application of the device registers the interaction interface.

In addition, in the interaction method provided by the embodiment of the application, the collision gesture (gesture) is preset, the interaction intention is determined between the two devices only when the actual collision gesture meets the preset condition, and if the preset collision gesture is set to be the same or opposite to the side where the first device and the second device collide, and the collision directions are opposite, and the collision time is the same, the false recognition of the interaction intention between the devices caused by the false touch operation of the user can be better eliminated, and the recognition of the interaction intention between the devices is more accurate.

Exemplary, on the basis of the embodiment shown in fig. 8, fig. 9 shows a schematic diagram of an application registration interaction interface provided by the embodiment of the present application, and interaction implemented through the interaction interface.

As shown in fig. 9, the application programs of the first device and the second device subscribe to the respective integrated sensor information processing platforms (multimodal sensor date platform, MSDP) for a collision event (step S901), and when the MSDP detects the collision event, the application programs are sent a collision result (step S902); the first device and the second device exchange collision results by BLE broadcast (step S903), and the collision results transmitted by the first device include the first data, and the collision results transmitted by the second device include the second data.

Optionally, the first device and the second device send the collision result through BLE broadcast, which may be directly sending related messages, or may send the collision result after being encrypted and/or compressed and/or encoded.

Wherein the application subscription collision event of the first device and the second device may be regarded as an application registration interaction interface of the first device and the second device.

In the embodiment of the application, after the application of the application program layer of the equipment registers the interaction interface (subscribes to the collision event), the convenient interaction with other equipment can be realized by collision in a preset gesture.

On the basis of the embodiment shown in fig. 8, fig. 10 shows a schematic flowchart of a method 1000 for implementing interaction by a first device according to an embodiment of the present application. The method 1000 is applied to an electronic device, as shown in fig. 10, the method 1000 includes:

step S1001: the first device detects a change in motion sensing data of the first device.

In particular, the first device may comprise a motion sensor by means of which the first device detects a change in motion sensing data of the first device.

Optionally, the motion sensing data comprises acceleration.

Optionally, the first device may further include a gyro sensor, and the first device detects a change in motion sensing data of the first device through the motion sensor and the gyro sensor; in addition, the first device may detect changes in the motion sensing data via one or more other sensors, as the application is not limited in this regard.

Step S1002: the first device determines first data.

The first device is capable of determining first data for the first device based on the detected change in motion sensing data.

Wherein the first data includes data for indicating an edge of the first device that collides with the second device and/or data for indicating a direction in which the first device collides with the second device, may further include data for indicating a time of the first device that collides with the second device and/or data for indicating an identification of the first device, and may further include other data, which the present application is not limited to.

Step S1003: the first device receives the second data.

Accordingly, at the second device side, after the second device and the first device send a tap, the second device detects that the motion sensing data of the second device changes.

Optionally, the motion sensing data includes acceleration.

Optionally, the second device may further include a gyro sensor, the second device detecting a change in motion sensing data of the second device through the motion sensor and the gyro sensor; in addition, the second device may detect changes in the motion sensing data via one or more other sensors, as the application is not limited in this regard.

By means of a corresponding algorithm, the second device is able to determine the second data of the second device from the changes in the motion sensing data detected by the second device.

Wherein the second data includes data for indicating an edge of the second device that collides with the first device and/or for indicating a direction in which the second device collides with the first device, may further include data for indicating a time of the second device that collides with the first device and/or data for indicating an identification of the second device, and may further include other data, which the present application is not limited to.

Step S1004: the first device determines whether the first data and the second data were successfully paired. If not, executing step S1005; if yes, step S1006 is performed.

The specific pairing method is already described in detail in step S805, and is not described herein for brevity.

Step S1005: the first device determines that there is no intent to interact with the second device.

When the first data is not matched with the second data, the first device determines that the first device has no interaction intention with the second device.

The mismatch is already described in detail in step S805, and is not described herein for brevity.

Step S1006: the first device determines that there is an intent to interact with the second device.

When the first data is matched with the second data, the first device determines that the first device has interaction intention with the second device.

The matching situation is already described in detail in step S805, and is not described herein for brevity.

Step S1007: and the first device performs information interaction with the second device.

The first device performs information interaction with the second device, which may include the first device sending first interaction information to the second device, and may further include the first device receiving second interaction information sent by the second device when the first data and the second data are determined to match.

When the first equipment determines that the interaction intention exists with the second equipment, the first equipment sends interaction information to the second equipment, and interaction with the second equipment is further achieved.

The information interaction between the first device and the second device may be information interaction, or may be information circulation, or may be other interaction, where a specific interaction form depends on applications of the first device and the second device registered with an interaction interface, which is not limited in the present application.

In addition, in the interaction method provided by the embodiment of the application, the collision gesture is preset, the interaction intention is determined only when the collision gesture meets the preset condition, and if the preset collision gesture is set to be the same or opposite to the side where the first device and the second device collide, and the collision directions are opposite, and the collision time is the same, the false recognition of the interaction intention among the devices caused by the false touch operation of the user can be better eliminated, so that the recognition of the interaction intention among the devices is more accurate.

Fig. 11 is a schematic functional block diagram of an interactive system 1100 according to an embodiment of the present application. As shown in fig. 11, the interactive system 1100 includes a first device including an ACC sensor 1110 and bluetooth low energy (bluetooth low energy, BLE) 1120 and a second device having the same functional block configuration as the first device including an ACC sensor 1130 and a BLE sensor 1140. Specific:

ACC sensor 1110 for detecting motion sensing data of the first device.

The ACC sensor 1110 is specifically configured to detect a change in motion-sensing data of the first device.

Alternatively, the ACC sensor 1110 may be replaced with any motion sensor having a function of detecting motion sensing data, which is not limited in the present application.

Optionally, the motion sensing data comprises acceleration.

BLE module 1120 is configured to broadcast first data of the first device.

Optionally, the first device further comprises a processing unit for determining the above first data according to the acceleration or the change of acceleration of the first device detected by the ACC sensor 1110.

The ACC sensor 1130 has the same function and structure as the ACC sensor 1110 for detecting motion sensing data of the second device.

Optionally, the ACC sensor 1130 is specifically configured to detect a change in motion sensing data of the second device.

Alternatively, the ACC sensor 1130 may be replaced with any motion sensor having a function of detecting motion sensing data, which is not limited in the present application.

BLE module 1140 has the same functionality and structure as BLE1120 for broadcasting second data for the second device.

Optionally, the second device further comprises a processing unit for determining the second data according to the change of the motion sensing data of the second device detected by the ACC sensor 1130.

Optionally, the BLE module 1120 is further configured to receive second data sent by the second device; BLE module 1140 is also configured to receive first data transmitted by the first device.

Optionally, the processing units of the first device and the second device are further configured to determine whether the first data and the second data match. The specific judging condition of whether to match is described in detail in the embodiment shown in fig. 8, and is not described here again for brevity.

Optionally, the BLE module 1120 is further configured to send interaction information to the second device when the first data and the second data match.

Optionally, BLE module 1140 is further configured to send interaction information to the first device when the first data and the second data match.

In addition, in the interaction method provided by the embodiment of the application, the collision gesture is preset, the interaction intention among the devices is determined only when the collision gesture meets the preset condition, and if the preset collision gesture is set to be the same or opposite to the side where the first device and the second device collide, and the collision directions are opposite, and the collision time is the same, the false recognition of the interaction intention caused by the false touch operation of the user can be better eliminated, so that the recognition of the interaction intention among the devices is more accurate.

Fig. 12 shows a functional block diagram of an interactive system 1200 according to an embodiment of the present application. As shown in fig. 12, the interactive system 1200 includes a first device including a gyro sensor 1210, an ACC sensor 1220, and a BLE module 1230, and a second device having the same functional module constitution as the first device including a gyro sensor 1240, an ACC sensor 1250, and a BLE module 1260. Specific:

both the gyro sensor 1210 and the ACC sensor 1220 are used to detect motion sensing data of the first device.

Optionally, both the gyro sensor 1210 and the ACC sensor 1220 are specifically used to detect a change in motion sensing data of the first device.

Alternatively, both the gyro sensor 1210 and the ACC sensor 1220 may be replaced with any motion sensor having a function of detecting motion sensing data, which is not limited in the present application.

Optionally, the motion sensing data comprises acceleration.

BLE module 1230 is configured to broadcast first data for a first device.

Wherein the first data includes data for indicating an edge of the first device that collides and/or data for indicating a direction in which the first device collides, may further include data for indicating a time of the first device that collides and/or data for indicating an identification of the first device, and may further include other information, which is not limited in this regard.

Optionally, the first device further comprises a processing unit for determining the first data according to the changes of the motion sensing data of the first device detected by the gyro sensor 1210 and the ACC sensor 1220.

The gyro sensor 1240 and the ACC sensor 1250 have the same function and structure as the gyro sensor 1210 and the ACC sensor 1220, respectively, and are used to detect motion sensing data of the second device.

Optionally, the motion sensing data comprises acceleration.

Optionally, both the gyro sensor 1240 and the ACC sensor 1250 are specifically used to detect changes in the motion sensing data of the second device.

Alternatively, both the gyro sensor 1240 and the ACC sensor 1250 may be replaced with any motion sensor having a function of detecting motion sensing data, which is not limited by the present application. Optionally, the second device further comprises a processing unit for calculating the above-mentioned second data from the changes of the motion sensing data of the second device detected by the gyro sensor 1240 and the ACC sensor 1250.

BLE module 1260 has the same functionality and structure as BLE module 1230 for broadcasting the second data of the second device.

Optionally, BLE module 1230 is further configured to receive second data sent by the second device; BLE module 1260 is also configured to receive first data transmitted by the first device.

Optionally, BLE module 1230 is further configured to send interaction information to the second device when the first data and the second data match.

Optionally, BLE module 1260 is further configured to send interaction information to the first device when the first data and the second data match.

In the embodiment of the application, a plurality of motion sensors (such as a gyroscope sensor and an ACC sensor) are adopted to detect the change of the motion sensing data of the equipment, and then the collision information of the equipment is calculated according to the change of the motion sensing data, so that the calculated collision information is more accurate, and the interaction intention among the equipment can be more accurately identified.

One or more of the modules or units described herein may be implemented in software, hardware, or a combination of both. When any of the above modules or units are implemented in software, the software exists in the form of computer program instructions and is stored in a memory, a processor can be used to execute the program instructions and implement the above method flows. The processor may include, but is not limited to, at least one of: a central processing unit (central processing unit, CPU), microprocessor, digital Signal Processor (DSP), microcontroller (microcontroller unit, MCU), or artificial intelligence processor, each of which may include one or more cores for executing software instructions to perform operations or processes. The processor may be built into a SoC (system on a chip) or an application specific integrated circuit (application specificintegrated circuit, ASIC) or may be a separate semiconductor chip. The processor may further include necessary hardware accelerators, such as field programmable gate arrays (field programmable gate array, FPGAs), PLDs (programmable logic devices), or logic circuits implementing dedicated logic operations, in addition to the cores for executing software instructions for operation or processing.

When the modules or units described herein are implemented in hardware, the hardware may be any one or any combination of a CPU, microprocessor, DSP, MCU, artificial intelligence processor, ASIC, soC, FPGA, PLD, application specific digital circuitry, hardware accelerator, or non-integrated discrete device that may run the necessary software or that is independent of the software to perform the above method flows.

When the modules or units described herein are implemented in software, they may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of information interaction, the method comprising:

the method comprises the steps that a first device detects that motion sensing data of the first device changes;

the first device determines first data according to the change of the motion sensing data of the first device;

the first equipment receives second data sent by second equipment through Bluetooth Low Energy (BLE);

the first device determining whether the first data and the second data match;

and when the first device determines that the first data and the second data are matched, the first device performs information interaction with the second device.

2. The method of claim 1, wherein the first device interacts with the second device by information comprising:

the first device sends first interaction information to the second device.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

the first device sends the first data to the second device through BLE, wherein the first data is used for matching the first data and the second data by the second device;

the first device performs information interaction with the second device, including:

and the first equipment receives second interaction information sent by the second equipment after the first data and the second data are determined to be matched.

4. A method according to any one of claims 1 to 3, wherein the first data comprises one or more of data indicating an edge of the first device that has collided, data indicating a direction of the first device that has collided, and data indicating a time of the first device that has collided.

5. The method of claim 4, wherein the second data comprises one or more of data indicating an edge of the second device that impacted, data indicating a direction of the second device that impacted, and data indicating a time of the second device that impacted.

6. The method of claim 5, wherein the first device determining whether the first data and the second data match comprises:

the first device determines that the first data and the second data match if the first data and the second data meet any one or more of the following conditions a, B, and C:

condition a: the side where the first device collides is the same as or opposite to the side where the second device collides;

condition B: the direction of the first device collision is opposite to the direction of the second device collision;

condition C: the time of the first device colliding is the same as the time of the second device colliding.

7. The method of any of claims 1-6, wherein the first device and the second device are devices of different identities.

8. The method of any one of claims 1 to 6, wherein the motion sensing data comprises acceleration.

9. An apparatus for information interaction, the apparatus comprising:

a motion sensor for detecting a change in motion sensing data of the first device;

A processing unit for determining first data from a change in motion sensing data of the first device;

the low-power consumption Bluetooth BLE module is used for receiving second data sent by the second equipment through the low-power consumption Bluetooth BLE;

the processing unit is further configured to determine whether the first data and the second data match;

the BLE module is further configured to perform information interaction with the second device when the processing unit determines that the first data and the second data match.

10. The apparatus of claim 9, wherein the BLE module is specifically configured to:

and sending the first interaction information to the second equipment.

11. The apparatus of claim 9 or 10, wherein the BLE module is further configured to:

transmitting the first data to the second device, wherein the first data is used for matching the first data and the second data by the second device;

the processing unit is also specifically configured to:

and receiving second interaction information sent by the second equipment after the first data and the second data are determined to be matched.

12. The apparatus of any of claims 9 to 11, wherein the first data comprises one or more of data indicating an edge of the first device that impacted, data indicating a direction of the first device that impacted, and data indicating a time at which the first device impacted.

13. The apparatus of claim 12, wherein the second data comprises one or more of data indicating an edge of the second device that impacted, data indicating a direction of the second device that impacted, and data indicating a time of the second device that impacted.

14. The apparatus according to claim 13, wherein the processing unit is specifically configured to:

determining that the first data and the second data match if the first data and the second data meet any one or more of the following conditions a, B, and C:

15. The apparatus of any one of claims 9 to 14, wherein the first device and the second device are devices of different identities.

16. The apparatus of any one of claims 9 to 15, wherein the motion sensing data comprises acceleration.

17. The device according to any one of claims 9 to 16, wherein the motion sensor comprises an acceleration ACC sensor and/or a gyro sensor.

18. An electronic device, comprising:

one or more processors;

one or more memories;

and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs comprising instructions, which when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-8.

19. A system of information interaction, characterized in that the system comprises at least two electronic devices as claimed in claim 18.

20. A computer readable storage medium, characterized in that the storage medium has stored therein a program or instructions which, when executed, implement the method of any one of claims 1 to 8.