WO2023103699A1

WO2023103699A1 - Interaction method and apparatus, and electronic device and storage medium

Info

Publication number: WO2023103699A1
Application number: PCT/CN2022/130876
Authority: WO
Inventors: 罗升阳
Original assignee: 杭州逗酷软件科技有限公司
Priority date: 2021-12-10
Filing date: 2022-11-09
Publication date: 2023-06-15
Also published as: CN114285930A; CN114285930B

Abstract

The present application relates to the technical field of electronic devices. Disclosed are an interaction method and apparatus, and an electronic device and a storage medium. The method is applied to an electronic device, and the method comprises: in response to received interaction information that satisfies a preset condition, enabling a context awareness function of an electronic device; identifying the current context in which the electronic device is located, and then determining a user intent on the basis of the current context; and pushing content on the basis of the user intent. By means of the present application, a context awareness function of an electronic device is enabled by means of interaction information, such that the requirement of the electronic device for resources is reduced, and the power consumption of the electronic device is also reduced.

Description

Interaction method, device, electronic device and storage medium

Cross References to Related Applications

This application claims priority to Chinese application No. CN202111507921.3 filed on December 10, 2021, which is hereby incorporated by reference in its entirety for all purposes.

technical field

The present application relates to the technical field of electronic equipment, and more specifically, to an interaction method, device, electronic equipment, and storage medium.

Background technique

With the development of science and technology, the use of electronic equipment is becoming more and more extensive, with more and more functions, and has become one of the must-haves in people's daily life. Currently, electronic devices generally push content to users.

Contents of the invention

In view of the above problems, the present application proposes an interaction method, device, electronic equipment and storage medium to solve the above problems.

In the first aspect, the embodiment of the present application provides an interaction method, which is applied to an electronic device, and the method includes: in response to the received interaction information meeting the preset condition, starting the context awareness function of the electronic device; identifying the The current situation of the electronic device is located, and the user intention is determined based on the current situation; based on the user intention, content push is performed.

In the second aspect, the embodiment of the present application provides an interaction device, which is applied to electronic equipment, and the device includes: a function activation module, configured to activate the electronic equipment in response to the received interaction information satisfying the preset condition. Context awareness function; a user intention recognition module, configured to identify the current context of the electronic device, and determine the user intention based on the current context; a content push module, configured to push content based on the user intention.

In a third aspect, the embodiment of the present application provides an electronic device, including a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the The processor executes the above method.

In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, where program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the above method.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 2 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 3 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 4 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 5 shows a schematic flowchart of step S450 of the interaction method identified in FIG. 4 of the present application;

FIG. 6 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 7 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 8 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 9 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

FIG. 10 shows a schematic flowchart of an interaction method provided by an embodiment of the present application;

Fig. 11 shows a module block diagram of an interaction device provided by an embodiment of the present application;

FIG. 12 shows a block diagram of an electronic device for performing an interaction method according to an embodiment of the present application in an embodiment of the present application;

Fig. 13 shows a storage unit for storing or carrying program codes for realizing the interaction method according to the embodiment of the present application according to the embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

Among them, electronic devices generally push content to users. For example, electronic devices can be equipped with a context awareness function. When the context awareness function is turned off, the electronic device will not push content to the user. When the context awareness function is turned on , the electronic device will push content to the user. At present, the situation awareness functions of electronic devices are always on. Therefore, electronic devices will push content to users from time to time. The user experience is not good.

In view of the above problems, the inventor discovered after long-term research, and proposed the interaction method, device, electronic equipment and storage medium provided by the embodiment of the present application, and activates the situation awareness function of the electronic equipment through interactive information, so as to reduce the resource requirements of the electronic equipment And reduce the power consumption of electronic equipment. Wherein, the specific interaction method is described in detail in the subsequent embodiments.

Please refer to FIG. 1 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is used for starting the situation awareness function of the electronic device through the interaction information, so as to reduce the resource requirement of the electronic device and reduce the power consumption of the electronic device. In a specific embodiment, the interaction method is applied to the interaction device 200 shown in FIG. 11 and the electronic device 100 ( FIG. 12 ) configured with the interaction device 200 . The following will take an electronic device as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the electronic device applied in this embodiment may include a smart phone, a tablet computer, a wearable electronic device, etc., which is not limited here. The process shown in Figure 1 will be described in detail below, and the interaction method may specifically include the following steps:

Step S110: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

In this embodiment, the electronic device may detect the interaction information input by the user. As a method, the electronic device can detect the interaction information input by the user in real time, detect the interaction information input by the user at a preset time interval, detect the interaction information input by the user at a preset time point, and can detect the interaction information input by the user according to The environmental factors trigger the detection of the interaction information input by the user, or the detection of the interaction information input by the user according to other preset rules, etc., which are not limited here.

Wherein, the detection of the interaction information input by the user is triggered according to the environmental factors as an example. When the detected ambient temperature reaches the preset temperature, it can detect the interactive information input by the user; when it detects that the ambient humidity reaches the preset humidity, it can detect the interactive information input by the user; when it detects that the environmental location is within the preset range When inside, the interaction information input by the user may also be detected, etc., which is not limited here.

In some implementation manners, the input interaction information detected by the electronic device may include: voice interaction information, text interaction information, touch interaction information, etc., which is not limited herein.

Among them, context awareness refers to the acquisition of relevant information of the user's environment by electronic devices when designing sensors and related technologies, and performing corresponding actions. In this embodiment, situational awareness can detect data through sensors of electronic devices, perform feature statistics through machine learning, perceive basic situations, such as environment, time, activity, traffic, location, nearby equipment, etc., and then use inference Engine reasoning obtains advanced contexts, for example, ordering meals in advanced contexts through time/location inferences in basic contexts; Situational sightseeing attractions; advanced situational projections obtained through inference of devices near the basic situation, etc., are not limited here.

In some embodiments, the context awareness function includes: position awareness function, vehicle awareness function, activity state awareness function, device state awareness function, device attitude awareness function, nearby device awareness function, environmental state awareness function, time awareness function, etc., It is not limited here.

As an implementable manner, the position awareness function can locate the position of the electronic device through the technology of the global positioning system (GPS), and can locate the position of the electronic device through the technology of the Beidou positioning system, etc., which is not limited here.

As an implementable method, the vehicle perception function can calculate the change speed of the electronic device on the x-axis and y-axis through the acceleration sensor of the electronic device, and combine machine learning and other technologies to determine whether the electronic device is in a driving state. When in the driving state, the types of vehicles are distinguished through voice recognition, for example, cars, buses, trains, airplanes, etc., where different vehicles correspond to different environmental noises.

As an implementable way, the activity state perception function can calculate the change speed of the electronic device on the x-axis and y-axis through the acceleration sensor of the electronic device, and combine machine learning and other technologies to determine whether the user corresponding to the electronic device is in a static state, whether Whether it is in a walking state, whether it is in a running state, etc., is not limited here.

As an implementable manner, the device state function may acquire the state of the electronic device through the operating system of the electronic device. For example, whether the electronic device is connected to an audio playback device, whether the wireless module of the electronic device is connected, whether the screen of the electronic device is turned on, etc., are not limited here.

As an implementable method, the device posture perception function can use the acceleration sensor, gyroscope, magnetometer and other sensors of the electronic device, combined with machine learning and other technologies, to evaluate whether the electronic device is facing up or down, whether it is placed on the table or placed on it. In pockets, backpacks, etc., it is not limited here.

As an implementable manner, the nearby device sensing function can identify nearby devices through broadcasts such as Bluetooth and WiFi sent by nearby devices. Wherein, the nearby devices may include, for example, smart phones, smart TVs, smart watches, smart earphones, smart cars, etc., which are not limited herein.

As an implementable manner, the environmental state sensing function may identify the current environmental state of the electronic device through sensors such as a barometer, a thermometer, and ambient light of the electronic device.

As an implementable way, the time awareness function can determine whether it is a working day or a weekend, morning, afternoon, evening or late night, etc. by obtaining the current system time of the electronic device, calculating date, week and other information. Then, through the country or region to which it belongs, determine whether it is a holiday or not.

In some implementation manners, the electronic device may preset and store a preset condition, and the preset condition is used as a basis for judging the interaction information detected by the electronic device. Therefore, in this embodiment, when the electronic device detects the input interaction information, it may compare the input interaction information with a preset condition to determine whether the interaction information satisfies the preset condition.

As a manner, when the judgment result indicates that the interaction information satisfies the preset condition, the situation awareness function of the electronic device may be activated. Wherein, the electronic device can push content to the user when the context awareness function is turned on. As yet another manner, when the judgment result indicates that the interaction information does not meet the preset condition, the situation awareness function of the electronic device may be kept in an off state. Wherein, the electronic device may not push content to the user when the context awareness function is turned off.

In some implementation manners, the preset condition may include preset voice information, preset touch information, preset text information, etc., which are not limited here.

Step S120: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

In this embodiment, after the context awareness function of the electronic device is started, it can detect the current situation of the electronic device, and after detecting the current situation of the electronic device, it can identify the current situation and obtain The user intent corresponding to the electronic device.

In some implementations, detecting the current context of the electronic device may be detecting the basic context of the electronic device, for example, detecting the current environment, current time, current activity, current vehicle, current location and/or or currently nearby devices. Wherein, after the basic context of the electronic device is detected, the advanced context can be inferred by the rule engine based on the basic context, and the user intention corresponding to the electronic device can be determined based on the high-level context obtained through reasoning.

For example, when it is detected that the current situation of the electronic device is a commuting scene, when the system passing time (7:00-9:00 am, 5:00-7:00 pm), location (in the subway station), and activity state of the electronic device (walking), etc., it can be inferred that the user has the intention of taking the subway.

Step S130: Push content based on the user intention.

In some implementation manners, after obtaining the user's intention, the electronic device may push content based on the user's intention. For example, after it is determined that the user intends to take the subway, the subway code can be pushed to the user.

Based on this, this embodiment can rely on the sensor of a single electronic device to complete the situation awareness of a single electronic device. Therefore, it can be applied to the scenarios of a single electronic device and multiple electronic devices, and can also be applied to indoor and outdoor scenarios. In this embodiment, a simple and natural multi-modal active expression technology can be used to avoid continuous context awareness in the system background of the electronic device and consume resources of the electronic device.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information satisfying the preset condition, identifies the current context of the electronic device, determines the user intention based on the current context, and based on the user The intent is to push content, so as to activate the situation awareness function of the electronic device through interactive information, so as to reduce the resource requirement of the electronic device and reduce the power consumption of the electronic device.

Please refer to FIG. 2 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the flow shown in Figure 2 will be described in detail below, and the interaction method may specifically include the following steps:

Step S210: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S220: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Wherein, for the specific description of step S210-step S220, please refer to step S110-step S120, which will not be repeated here.

Step S230: Based on the user intention, output prompt information, wherein the prompt information is used to prompt selection of whether to execute content push.

In this embodiment, after obtaining the user's intention, the electronic device may output prompt information for prompting whether to perform content push based on the user's intention, so that the user can select content push according to the prompt information. Wherein, based on the prompt information, it is possible to avoid false recognition of user intentions and improve the accuracy of user intention recognition. In addition, based on the prompt information, it is possible to make up for the lack of basic situation awareness and improve the accuracy of user intention recognition.

In some implementation manners, after the electronic device obtains the user's intention, it may determine the degree of certainty of the electronic device for the user's intention. Wherein, when the degree of certainty is lower than the predetermined degree of certainty, indicating that the intention is highly likely to be inaccurate, prompt information may be output to avoid errors in pushed content. Wherein, when the degree of certainty is higher than the preset accuracy, indicating that the user's intention is highly likely to be accurate, it is possible to directly push content according to the user's intention without outputting prompt information, so as to improve the user's experience.

In some implementations, the prompt information may include voice prompt information, text prompt information, color prompt information, vibration prompt information, etc., which is not limited herein.

Step S240: Push the content when the input confirmation information is received.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when the confirmation information input based on the prompt information is detected, it means that the user approves the user intention, that is, the electronic device agrees to push the content based on the user intention, and then the content push can be performed. Wherein, when the denial information input based on the prompt information is detected, it means that the user does not approve the user intention, that is, the electronic device does not agree to push the content based on the user intention, and the content push may not be performed.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information satisfying the preset condition, identifies the current context of the electronic device, determines the user intention based on the current context, and based on the user Intent, to output prompt information for prompting to choose whether to perform content push, and when the input confirmation information is received, content push will be performed. Compared with the interaction method shown in FIG. 1 , this embodiment also outputs prompt information when the user's intention cannot be completely determined, and determines whether to execute content push according to the user's choice, so as to improve the accuracy of content push.

Please refer to FIG. 3 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the flow shown in Figure 3 will be described in detail below, and the interaction method may specifically include the following steps:

Step S310: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S320: Identify the current context of the electronic device, and determine the user's intention based on the current context.

Wherein, for the specific description of step S310-step S320, please refer to step S110-step S120, which will not be repeated here.

Step S330: Based on the user intention, output prompt information, wherein the prompt information is used to prompt to choose whether to perform content push.

Wherein, for the specific description of step S330, please refer to step S230, which will not be repeated here.

Step S340: When an input voice command is received, recognize the voice command based on voice recognition technology, and obtain voice information included in the voice command.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when a voice command input based on the prompt information is detected, the voice command may be recognized based on voice recognition technology, so as to obtain the voice information included in the voice command.

In some embodiments, an electronic device may include a sound pickup device (eg, a microphone). The sound pickup device of the electronic device may be in a normally-on state, or may be controlled to be turned on after outputting a prompt message, which is not limited here.

Step S350: When the voice information includes preset voice information, push the content.

In some implementations, the electronic device may be preset and stored with preset voice information, and the preset voice information is used as a basis for judging the voice information contained in the voice instruction received by the electronic device. Therefore, in this embodiment, after the voice information is obtained, the voice information may be compared with the preset voice information to determine whether the voice information includes the preset voice information. Wherein, when it is determined that the voice information includes preset voice information, it means that the user approves the user intention, that is, agrees that the electronic device pushes content based on the user intention, and then the content push can be performed. Wherein, when it is determined that the voice information does not include the preset voice information, it means that the user does not approve the user intention, that is, the electronic device does not agree to push content based on the user intention, and the content push may not be performed.

In some implementation manners, the preset voice information may include "yes", "agree", "execute", "push", etc., which are not limited herein.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information satisfying the preset condition, identifies the current context of the electronic device, determines the user intention based on the current context, and based on the user Intent, to output prompt information for prompting to choose whether to execute content push. When an input voice command is received, the voice command is recognized based on voice recognition technology, and the voice information contained in the voice command is obtained. When the voice information includes preset voice When the information is sent, the content is pushed. Compared with the interaction method shown in FIG. 1 , this embodiment also outputs prompt information when the user's intention cannot be completely determined, and determines whether to execute content push according to the user's voice command, so as to improve the accuracy of content push.

Please refer to FIG. 4 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the flow shown in Figure 4 will be described in detail below, and the interaction method may specifically include the following steps:

Step S410: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S420: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Wherein, for the specific description of step S410-step S420, please refer to step S110-step S120, which will not be repeated here.

Step S430: Based on the user intention, output prompt information, wherein the prompt information is used to prompt to choose whether to perform content push.

Wherein, for the specific description of step S430, please refer to step S230, which will not be repeated here.

Step S440: When a first tap operation acting on the electronic device is detected, detect a tap position corresponding to the first tap operation.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when a tap operation (first tap operation) input based on the prompt information is detected, a tap position corresponding to the first tap operation may be detected.

In some implementations, an electronic device may include a touch sensor. Then, after the electronic device outputs the prompt information, it can detect the touch operation acting on the electronic device through the touch sensor, wherein, when the first tapping operation acting on the electronic device is detected, the first tapping operation can be detected Operate the corresponding tapping position.

In some implementations, the electronic device may include a pressure sensor. Then, after the electronic device outputs the prompt information, it can detect the touch operation acting on the electronic device through the pressure sensor, wherein, when the first tapping operation acting on the electronic device is detected, the first tapping operation can be detected Operate the corresponding tapping position.

Please refer to FIG. 5 , which shows a schematic flowchart of step S440 of the interaction method identified in FIG. 4 of the present application. The process shown in Figure 5 will be described in detail below, and the method may specifically include the following steps:

Step S441: When a first tap operation acting on the electronic device is detected, acquire a tap sound corresponding to the first tap operation.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when a tap operation (first tap operation) input based on the prompt information is detected, a tap sound corresponding to the first tap operation may be detected.

In some implementations, the electronic device can perform feature statistics on the sounds generated when tapping different positions of the electronic device by means of machine learning, so as to identify different positions of the electronic device tapped by the user through different tapping sounds. For example, the electronic device can perform feature statistics on the different sounds generated when the front and back of the electronic device are knocked by machine learning, so as to identify the user's knock on the front or back of the electronic device through different knocking sounds.

Step S442: Based on the tapping sound, determine a tapping position corresponding to the first tapping operation.

In some implementations, after detecting the tapping sound corresponding to the first tapping operation, the electronic device may determine the tapping position corresponding to the first tapping operation based on the tapping sound. Wherein, after the electronic device detects the tapping sound corresponding to the first tapping operation, it can compare the tapping sound with pre-stored tapping sounds of different positions, and determine that the tapping sound is consistent with a pre-stored When the tapping sounds of the positions match, it can be determined that the tapping position corresponding to the first tapping operation is the certain position.

Step S450: Push the content when the tap position satisfies the preset tap position.

In some implementations, the electronic device may be preset and stored with a preset tap position, and the preset tap position is used as the tap position corresponding to the first tap operation received by the electronic device and acting on the electronic device. Judgments based. Therefore, in this embodiment, after the tapping position is obtained, the tapping position may be compared with the preset tapping position to determine whether the tapping position satisfies the preset tapping position. Wherein, when it is determined that the tap position satisfies the preset tap position, it means that the user approves the user intention, that is, agrees that the electronic device pushes content based on the user intention, and then the content push can be performed. Wherein, when it is determined that the tap position does not satisfy the preset tap position, it means that the user does not approve the user intention, that is, the electronic device does not agree to push content based on the user intention, and the content push may not be performed.

In some implementations, the preset tapping position may include the front of the electronic device, may include the back of the electronic device, may include the side of the electronic device, etc., which is not limited herein.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information meeting the preset conditions, identifies the current context of the electronic device, determines the user intention based on the current context, and determines the user intention based on the user intention. Output prompt information, wherein the prompt information is used to prompt to select whether to perform content push, when the first tap operation acting on the electronic device is detected, the tap position corresponding to the first tap operation is detected, when the tap position When the preset tapping position is satisfied, the content is pushed. Compared with the interaction method shown in FIG. 1 , this embodiment also outputs prompt information when the user's intention cannot be completely determined, and determines whether to execute content push according to the tap position corresponding to the tap operation, so as to improve the accuracy of content push.

Please refer to FIG. 6 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the following will describe the process shown in Figure 6 in detail, and the interaction method may specifically include the following steps:

Step S510: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S520: Identify the current context of the electronic device, and determine the user's intention based on the current context.

Wherein, for the specific description of step S510-step S520, please refer to step S110-step S120, which will not be repeated here.

Step S530: Based on the user intention, output prompt information, wherein the prompt information is used to prompt to choose whether to perform content push.

Wherein, for the specific description of step S530, please refer to step S230, which will not be repeated here.

Step S540: When a second tap operation acting on the electronic device is detected, detect the number of consecutive taps corresponding to the second tap operation.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when a tap operation (second tap operation) input based on the prompt information is detected, the number of consecutive taps corresponding to the second tap operation may be detected.

In some implementations, an electronic device may include a touch sensor. Then, after the electronic device outputs the prompt information, it can detect the touch operation acting on the electronic device through the touch sensor, wherein, when the second tapping operation acting on the electronic device is detected, the second tapping operation can be detected The number of consecutive taps corresponding to the operation.

In some implementations, the electronic device may include a pressure sensor. Then, after the electronic device outputs the prompt information, it can detect the touch operation acting on the electronic device through the pressure sensor, wherein, when the second tapping operation acting on the electronic device is detected, the first tapping operation can be detected The number of consecutive taps corresponding to the operation.

As an implementable manner, the number of consecutive taps may refer to the total number of taps within a certain preset time period.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when a tap operation (second tap operation) input based on the prompt information is detected, a tap sound corresponding to the second tap operation may be detected.

In some implementations, the electronic device can perform feature statistics on the sound of continuous tapping on the electronic device for different times through machine learning, so as to identify the different times of the electronic device being tapped by the user through different tapping sounds. For example, the electronic device can use machine learning to perform feature statistics on the different sounds generated when the electronic device is tapped once, twice, or three times in a row, so as to identify the consecutive times the user taps the electronic device through different tapping sounds.

In some implementations, after the electronic device detects the tapping sound corresponding to the second tapping operation, it may determine the number of consecutive tappings corresponding to the second tapping operation based on the tapping sound. Wherein, after the electronic device detects the tapping sound corresponding to the second tapping operation, it can compare the tapping sound with pre-stored tapping sounds with different consecutive tapping times, and determine the difference between the tapping sound and the pre-stored tapping sound. When the tap sound of a certain number of consecutive taps matches, it can be determined that the number of consecutive taps corresponding to the second tap operation is the certain number of consecutive taps.

Step S550: Push the content when the number of consecutive taps meets the preset number of taps.

In some implementations, the electronic device may be preset and stored with a preset number of taps, and the preset number of taps is used as the number of connection taps corresponding to the second tap operation received by the electronic device and acting on the electronic device. basis for judgment. Therefore, in this embodiment, after the number of consecutive taps is obtained, the number of consecutive taps can be compared with the preset number of taps to determine whether the number of consecutive taps meets the preset number of taps. Wherein, when it is determined that the number of consecutive taps satisfies the preset number of taps, it means that the user approves the user intention, that is, agrees that the electronic device pushes content based on the user intention, and then the content push can be performed. Wherein, when it is determined that the number of consecutive taps does not meet the preset number of taps, it means that the user does not approve the user intention, that is, the electronic device does not agree to push content based on the user intention, and the content push may not be performed.

In some implementations, the preset number of taps may include one, two, three times, etc., which is not limited here.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information meeting the preset conditions, identifies the current context of the electronic device, determines the user intention based on the current context, and determines the user intention based on the user intention. Output prompt information, wherein the prompt information is used to prompt to select whether to perform content push, when a second tap operation acting on the electronic device is detected, the number of consecutive taps corresponding to the second tap operation is detected, and the continuous tap When the number of taps meets the preset number of taps, the content is pushed. Compared with the interaction method shown in Figure 1, this embodiment also outputs prompt information when the user's intention cannot be completely determined, and determines whether to perform content push according to the number of consecutive taps corresponding to the tap operation, so as to improve the accuracy of content push .

Please refer to FIG. 7 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the flow shown in FIG. 7 will be described in detail below. The interaction method may specifically include the following steps:

Step S610: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S620: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Wherein, for the specific description of step S610-step S620, please refer to step S110-step S120, which will not be repeated here.

Step S630: Based on the user intention, output prompt information, wherein the prompt information is used to prompt selection of whether to execute content push.

Wherein, for the specific description of step S630, please refer to step S230, which will not be repeated here.

Step S640: When an image is captured by the camera, the image is recognized based on an image recognition technology, and image information corresponding to the image is obtained.

In this embodiment, the electronic device may include a camera.

In some implementation manners, after outputting the prompt information, the electronic device may monitor whether information input based on the prompt information is received. Wherein, when the image collected by the camera of the electronic device is monitored, the image may be recognized based on an image recognition technology, so as to obtain the image information corresponding to the image.

Step S650: Push the content when the image information includes preset image information.

In some implementations, the electronic device may be preset and stored with preset image information, and the preset image information is used as a basis for judging the image information corresponding to the image collected by the electronic device. Therefore, in this embodiment, after the image information is obtained, the image information may be compared with the preset image information to determine whether the image information includes the preset image information. Wherein, when the image information includes the preset image information, it means that the user approves the user intention, that is, agrees that the electronic device pushes the content based on the user intention, and then the content push can be performed. Wherein, when the image information includes non-preset image information, it means that the user does not approve the user intention, that is, the electronic device does not agree to push content based on the user intention, and the content push may not be performed.

In some implementations, the preset image information may include "nod image information", "like image information", etc., which are not limited here.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information meeting the preset conditions, identifies the current context of the electronic device, determines the user intention based on the current context, and determines the user intention based on the user intention. Output prompt information, wherein the prompt information is used to prompt to choose whether to perform content push. When the image is collected by the camera, the image is recognized based on the voice recognition technology to obtain the image information corresponding to the image. When the image information includes the preset When image information is displayed, content push is performed. Compared with the interaction method shown in FIG. 1 , this embodiment also outputs prompt information when the user's intention cannot be completely determined, and determines whether to execute content push according to the image information collected by the camera, so as to improve the accuracy of content push.

Please refer to FIG. 8 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. This method is applied to the above-mentioned electronic equipment, and the following will elaborate on the flow shown in Figure 8 in detail, and the interaction method may specifically include the following steps:

Step S710: Obtain the acceleration change of the electronic device based on the shaking operation.

In some implementations, the electronic device can detect a shaking operation acting on the electronic device. As an implementable manner, the electronic device may detect a shaking operation acting on the electronic device through an acceleration sensor.

In some implementations, when the electronic device detects an input shaking operation, it may acquire an acceleration change of the electronic device based on the shaking operation. Wherein, the electronic device can obtain the acceleration change of the electronic device on the x-axis, y-axis and z-axis through the acceleration sensor, and determine the acceleration change of the electronic device on the x-axis, y-axis and z-axis as the acceleration of the electronic device based on the shaking operation Variety.

Step S720: When the acceleration change satisfies a preset acceleration change, determine that the interaction information satisfies the preset condition, and start a situation awareness function of the electronic device.

In some implementations, the electronic device may be preset and stored with a preset acceleration change, and the preset acceleration change is used as a basis for judging the acceleration change of the electronic device. Therefore, in this embodiment, when the acceleration change of the electronic device is obtained, the acceleration change may be compared with a preset acceleration change to determine whether the acceleration change satisfies the preset acceleration change.

As a manner, when the judging result indicates that the acceleration change satisfies the preset acceleration change, the situation awareness function of the electronic device may be activated. Wherein, the electronic device can push content to the user when the context awareness function is turned on. As yet another manner, when the judging result indicates that the acceleration change does not meet the preset acceleration change, the situation awareness function of the electronic device may be kept in an off state. Wherein, the electronic device may not push content to the user when the context awareness function is turned off.

Step S730: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Step S740: Push content based on the user intention.

Wherein, for the specific description of step S730-step S740, please refer to step S120-step S130, which will not be repeated here.

The interaction method provided by an embodiment of the present application acquires the acceleration change of the electronic device based on the shaking operation. When the acceleration change meets the preset acceleration change, it is determined that the interaction information meets the preset condition, and the context awareness function of the electronic device is activated to identify the electronic device. Based on the current situation, the user's intention is determined based on the current situation, and the content is pushed based on the user's intention. Compared with the interaction method shown in FIG. 1 , this embodiment also activates the situation awareness function of the electronic device when the acceleration change based on the shaking operation of the electronic device satisfies the preset acceleration change, so as to improve the autonomy of function activation and reduce the electronic device power consumption.

Please refer to FIG. 9 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. The method is applied to the above-mentioned electronic equipment, and the following will describe the process shown in Figure 9 in detail, and the interaction method may specifically include the following steps:

Step S810: When the third tap operation satisfies a preset tap operation, determine that the interaction information satisfies the preset condition, and activate a context awareness function of the electronic device.

In some implementations, the electronic device can detect a tap operation on the electronic device. As an implementable manner, the electronic device may detect a tap operation (third tap operation) acting on the electronic device through a touch sensor, a pressure sensor, or the like.

In some implementations, the electronic device may be preset and stored with a preset tap operation, and the preset tap operation is used as a basis for judging a third tap operation of the electronic device. Therefore, in this embodiment, when the third tapping operation acting on the electronic device is obtained, the third tapping operation can be compared with the preset tapping operation to determine whether the third tapping operation satisfies the Preset tap action.

As a manner, when the judging result indicates that the third tapping operation satisfies the preset tapping operation, the situation awareness function of the electronic device may be activated. Wherein, the electronic device can push content to the user when the context awareness function is turned on. As yet another manner, when the judgment result indicates that the third tap operation does not satisfy the preset tap operation, the situation awareness function of the electronic device may be kept in an off state. Wherein, the electronic device may not push content to the user when the context awareness function is turned off.

In some implementations, the preset tapping operation may include: tapping a certain position of the electronic device for a predetermined number of times.

Step S820: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Step S830: Push content based on the user intention.

Wherein, for the specific description of step S820-step S830, please refer to step S120-step S130, which will not be repeated here.

In the interaction method provided by an embodiment of the present application, when the third tap operation satisfies the preset tap operation, it is determined that the interaction information satisfies the preset condition, and the context awareness function of the electronic device is activated to identify the current context of the electronic device, Determine user intent based on the current situation, and push content based on user intent. Compared with the interaction method shown in FIG. 1 , this embodiment also activates the context-aware function of the electronic device when detecting the third tap operation that satisfies the preset tap operation, so as to improve the autonomy of function startup and reduce electronic The power consumption of the device.

Please refer to FIG. 10 , which shows a schematic flowchart of an interaction method provided by an embodiment of the present application. This method is applied to the above-mentioned electronic equipment, and the flow shown in Figure 10 will be described in detail below, and the interaction method may specifically include the following steps:

Step S910: In response to the received interaction information meeting the preset condition, activate the context awareness function of the electronic device.

Step S920: Identify the current situation of the electronic device, and determine the user's intention based on the current situation.

Wherein, for the specific description of step S910-step S920, please refer to step S110-step S120, which will not be repeated here.

Step S930: Obtain a user portrait of a user corresponding to the electronic device.

In this embodiment, a user portrait of a user corresponding to the electronic device may be acquired. As a method, user portraits can be constructed based on the user's habits of using electronic devices, such as frequently used applications, including the user's exercise habits, entertainment habits, consumption habits, commuting habits, sleeping habits, etc. For example, commuting habits during commuting time and the like are not limited here.

In some implementations, the build cycle can be preset. For example, different time periods of each day may be preset as a build cycle, one day may be preset as a build cycle, and one week may be set as a build cycle, etc., which are not limited here. Among them, when the pre-set construction period is a different time period every day, you can set 8:00~12:00 every day as a construction period, 12:00～16:00 as a construction period, and 12:00～12:00 20:00 is set as a build cycle, 20:00~24:00 is set as a build cycle, and 24:00~8:00 is set as a build cycle.

In some implementation manners, the current time may be acquired, the construction period in which the current time is located is determined as the current construction period, and user data of the user corresponding to the electronic device is collected. For example, if the preset build period is a different time period every day, and the current time is 9:00, you can use 8:00-12:00 as the current build period, and the build period between 8:00-12:00 Collect the user data of the user corresponding to the electronic device.

In some implementation manners, user data of users corresponding to electronic devices in different applications, different services, different systems, etc. may be collected during the current construction cycle. Taking applications as an example, it is possible to collect user data of users corresponding to electronic devices in chat applications, collect user data of users corresponding to electronic devices in game applications, and collect user data of users corresponding to electronic devices in video applications. The user data in the search application, the collection of user data of the user corresponding to the electronic device in the search application program, etc., are not limited here.

In some implementations, the collected user data of the user corresponding to the electronic device may include: the user's age, the user's gender, the user's occupation, the user's income, the user's hobbies, the applications downloaded by the user, and the user's relationship with the application. Scoring, etc., are not limited here.

In this embodiment, after the user data of the user corresponding to the electronic device is collected, the user data of the user corresponding to the electronic device may be aggregated to obtain a user portrait of the user corresponding to the electronic device in the current construction cycle. In some embodiments, after the user data of the user is collected from different applications, services, systems, etc., the user data collected from different applications, services, systems, etc. can be aggregated to obtain the corresponding The user profile of the user in the current build cycle.

In some implementations, after collecting the user data of the user corresponding to the electronic device from different applications, services, systems, etc., it is possible to analyze and construct the user's basic portrait, business portrait, behavior portrait and other global dimensions based on rules and algorithms The user profile of the user is aggregated to obtain the user profile of the user in the current construction cycle. Among them, the user's basic portrait can be constructed based on the user's age, gender, income, etc. collected from different applications, businesses, systems, etc., and the user's business portrait can be constructed based on user preferences collected from different applications, businesses, systems, etc. , build a user's behavior profile based on the downloaded and installed applications collected from different applications, services, systems, etc., which are not limited here.

Step S940: Push the content based on the user intention and the user portrait.

In this embodiment, after the user intention and user portrait are obtained, content push can be performed based on the user intention and user portrait. Among them, this embodiment combines user portraits to identify different user intentions in the same situation, and realize personalized situation awareness.

The interaction method provided by an embodiment of the present application activates the context awareness function of the electronic device in response to the received interaction information satisfying the preset condition, identifies the current context of the electronic device, determines the user's intention based on the current context, and obtains the information of the electronic device. The user portrait of the corresponding user, based on the user intention and user portrait, pushes the content. Compared with the interaction method shown in FIG. 1 , this embodiment also acquires the user portrait of the user corresponding to the electronic device, and pushes content based on user intent and user portrait, thereby improving the accuracy of content push.

Please refer to FIG. 11 . FIG. 11 shows a module block diagram of an interaction device provided by an embodiment of the present application. The interaction device 200 is applied to the above-mentioned electronic equipment, and will be described below with respect to the block diagram shown in FIG.

The function starting module 220 is configured to start the situation awareness function of the electronic device in response to the received interaction information satisfying the preset condition.

Further, the interaction information includes a shaking operation, and the function activation module 210 includes: an acceleration change acquisition submodule and a first function activation submodule, wherein:

The acceleration change acquisition submodule is configured to acquire the acceleration change of the electronic device based on the shaking operation.

The first function activating submodule is configured to determine that the interaction information satisfies the preset condition when the acceleration change satisfies a preset acceleration change, and start the situation awareness function of the electronic device.

Further, the interaction information includes a third tap operation, and the function activation module 210 includes: a second function promoter module, wherein:

The second function activation sub-module is configured to determine that the interaction information satisfies the preset condition when the third tap operation satisfies the preset tap operation, and activate the situation awareness function of the electronic device.

The user intention identification module 220 is configured to identify the current situation of the electronic device, and determine the user intention based on the current situation.

The content pushing module 230 is configured to push content based on the user intention.

Further, the content push module 230 includes: a prompt information output submodule and a first content push submodule, wherein:

The prompt information output submodule is configured to output prompt information based on the user intention, wherein the prompt information is used to prompt selection of whether to execute content push.

The first content pushing submodule is configured to push the content when the input confirmation information is received.

Further, the first content pushing submodule includes: a voice information obtaining unit and a first content pushing unit, wherein:

The voice information obtaining unit is configured to, when receiving an input voice command, recognize the voice command based on a voice recognition technology, and obtain voice information included in the voice command.

The first content pushing unit is configured to push the content when the voice information includes preset voice information.

Further, the first content push submodule includes: a tap position detection unit and a second content push unit, wherein:

The tap position detection unit is configured to detect a tap position corresponding to the first tap operation when a first tap operation acting on the electronic device is detected.

Further, the tapping position detection unit includes: a tapping sound acquisition subunit and a tapping position determination subunit, wherein:

The knocking sound acquisition subunit is configured to acquire a knocking sound corresponding to the first knocking operation when a first knocking operation acting on the electronic device is detected.

The tapping position determination subunit is configured to determine the tapping position corresponding to the first tapping operation based on the tapping sound.

The second content push unit is configured to push the content when the tap position satisfies a preset tap position.

Further, the first content pushing submodule includes: connecting the number of times of tapping unit and the third content pushing unit, wherein:

The continuous tapping times unit is configured to, when a second tapping operation acting on the electronic device is detected, detect the consecutive tapping times corresponding to the second tapping operation.

The third content pushing unit is configured to push the content when the number of consecutive taps meets a preset number of taps.

Further, the first content pushing submodule includes: an image information obtaining unit and a fourth content pushing unit, wherein:

The image information obtaining unit is configured to, when an image is collected by the camera, recognize the image based on an image recognition technology, and obtain image information corresponding to the image.

The fourth content pushing unit is configured to push the content when the image information includes preset image information.

Further, the content push module 230 includes: a user portrait acquisition sub-module and a second content push sub-module, wherein:

The user portrait acquiring submodule is configured to acquire the user portrait of the user corresponding to the electronic device.

The second content pushing submodule is configured to push the content based on the user intention and the user portrait.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the devices and modules described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other forms of coupling.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.

Please refer to FIG. 12 , which shows a structural block diagram of an electronic device 100 provided by an embodiment of the present application. The electronic device 100 may be an electronic device capable of running application programs, such as a smart phone, a tablet computer, and an e-book. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more application programs, wherein one or more application programs may be stored in the memory 120 and configured to be executed by a or a plurality of processors 110, and one or more programs are configured to execute the methods described in the foregoing method embodiments.

Wherein, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes or executes instructions, programs, code sets or instruction sets stored in the memory 120, and calls data stored in the memory 120 to execute Various functions of the electronic device 100 and processing data. Optionally, the processor 110 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content to be displayed; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 110, but may be realized by a communication chip alone.

The memory 120 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system and instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area can also store data created during use of the electronic device 100 (such as phonebook, audio and video data, chat record data) and the like.

Please refer to FIG. 13 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. Program codes are stored in the computer-readable medium 300, and the program codes can be invoked by a processor to execute the methods described in the foregoing method embodiments.

The computer readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The computer-readable storage medium 300 has a storage space for program code 310 for executing any method steps in the above methods. These program codes can be read from or written into one or more computer program products. Program code 310 may, for example, be compressed in a suitable form.

To sum up, the interaction method, device, electronic device, and storage medium provided by the embodiments of the present application activate the context awareness function of the electronic device in response to the received interaction information that satisfies the preset condition, and identify the current situation where the electronic device is located. Context, based on the current context to determine the user's intention, based on the user's intention, to push the content, so as to activate the situation awareness function of the electronic device through interactive information, so as to reduce the resource demand and power consumption of the electronic device.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions away from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims

An interaction method, characterized in that it is applied to an electronic device, the method comprising:

activating the context awareness function of the electronic device in response to the received interaction information meeting the preset condition;

identifying a current context in which the electronic device is located, and determining user intent based on the current context;

Content pushing is performed based on the user intention.
The method according to claim 1, wherein the pushing content based on the user intention includes:

Outputting prompt information based on the user intention, wherein the prompt information is used to prompt to select whether to perform content push;

When the input confirmation information is received, the content push is performed.
The method according to claim 2, wherein when the input confirmation information is received, pushing the content includes:

When an input voice command is received, the voice command is recognized based on voice recognition technology, and the voice information contained in the voice command is obtained;

When the voice information includes preset voice information, the content push is performed.
The method according to claim 2, wherein when the input confirmation information is received, pushing the content includes:

When detecting a first tapping operation acting on the electronic device, detecting a tapping position corresponding to the first tapping operation;

When the tap position satisfies the preset tap position, the content push is performed.
The method according to claim 4, wherein when the first tapping operation acting on the electronic device is detected, detecting the tapping position corresponding to the first tapping operation comprises:

When a first tapping operation acting on the electronic device is detected, acquiring a tapping sound corresponding to the first tapping operation;

Based on the tapping sound, a tapping position corresponding to the first tapping operation is determined.
The method according to claim 2, wherein when the input confirmation information is received, pushing the content includes:

When detecting a second tap operation acting on the electronic device, detecting the number of consecutive taps corresponding to the second tap operation;

When the number of consecutive taps meets the preset number of taps, the content is pushed.
The method according to claim 2, wherein the electronic device includes a camera, and when the input confirmation information is received, pushing the content includes:

When an image is collected by the camera, the image is recognized based on an image recognition technology, and image information corresponding to the image is obtained;

When the image information includes preset image information, the content push is performed.
The method according to any one of claims 2-7, wherein the outputting prompt information based on the user intention includes:

Acquiring the degree of certainty of the electronic device with respect to the user's intention;

When the degree of certainty is lower than a preset degree of certainty, the prompt information is input.
The method according to claim 8, characterized in that the method further comprises:

When the degree of certainty is higher than the preset degree of certainty, push the content.
The method according to any one of claims 2-7, wherein the prompt information includes one or a combination of voice prompt information, text prompt information, color prompt information, and vibration prompt information.
The method according to any one of claims 1-7, wherein the interaction information includes a shaking operation, and the context awareness function of the electronic device is activated in response to the received interaction information satisfying a preset condition ,include:

Acquiring acceleration changes of the electronic device based on the shaking operation;

When the acceleration change satisfies a preset acceleration change, it is determined that the interaction information satisfies the preset condition, and a situation awareness function of the electronic device is started.
The method according to any one of claims 1-7, wherein the interaction information includes a third tap operation, and in response to the received interaction information satisfying the preset condition, starting the Situational awareness capabilities, including:

When the third tap operation satisfies the preset tap operation, it is determined that the interaction information satisfies the preset condition, and the context awareness function of the electronic device is activated.
The method according to any one of claims 1-7, wherein the pushing content based on the user intention includes:

Obtaining a user portrait of a user corresponding to the electronic device;

The content push is performed based on the user intention and the user portrait.
The method according to any one of claims 1-7, characterized in that before starting the situation awareness function of the electronic device in response to the received interaction information meeting the preset condition, further comprising:

When it is detected that the ambient temperature of the environment where the electronic device is located reaches a preset temperature, the input interaction information is detected; or

When it is detected that the ambient humidity of the environment where the electronic device is located reaches a preset humidity, the input interaction information is detected; or

When it is detected that the environmental location of the environment where the electronic device is located is within a preset range, the input interaction information is detected.
The method according to any one of claims 1-7, wherein the interaction information includes one or a combination of voice interaction information, text interaction information, and touch interaction information.
The method according to any one of claims 1-7, wherein the situation awareness function includes a position awareness function, a vehicle awareness function, an activity state awareness function, a device state awareness function, a device attitude awareness function, a nearby device One or a combination of perception functions, environmental state perception functions, and time perception functions.
An interactive device is characterized in that it is applied to electronic equipment, and the device includes:

A function starting module, configured to start the situation awareness function of the electronic device in response to the received interaction information satisfying the preset condition;

A user intention identification module, configured to identify the current context in which the electronic device is located, and determine the user intention based on the current context;

A content push module, configured to push content based on the user intention.
The device according to claim 17, wherein the content pushing module comprises:

A prompt information output submodule, configured to output prompt information based on the user intention, wherein the prompt information is used to prompt to choose whether to perform content push;

The first content push sub-module is configured to push the content when the input confirmation information is received.
An electronic device, characterized in that it includes a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor performs The method described in any one of claims 1-16.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores program codes, and the program codes can be invoked by a processor to execute the method according to any one of claims 1-16 .