WO2022222576A1

WO2022222576A1 - Scenario recognition method and electronic device

Info

Publication number: WO2022222576A1
Application number: PCT/CN2022/075559
Authority: WO
Inventors: 丁勇
Original assignee: 荣耀终端有限公司
Priority date: 2021-04-23
Filing date: 2022-02-08
Publication date: 2022-10-27
Also published as: CN115668989B; CN115668989A

Abstract

Embodiments of the present application provide a scenario recognition method and an electronic device, the method comprising: when detected that an electronic device is located in a first position, a position label corresponding to the first position is acquired, the position label representing environmental information acquired by the electronic device in a current place; and the electronic device compares the position label with preset position information of the first position to acquire a comparison result. If the comparison result indicates that the position label conforms to the preset position information, the electronic device may be triggered to automatically execute a first action corresponding to the first position while not receiving any user operations, the first action comprising the electronic device running a first application and displaying a first interface, and the first interface may comprise a two-dimensional code. Said method may simplify the operation of an electronic device, so as to improve user experience.

Description

A scene recognition method and electronic device

This application claims the priority of the Chinese patent application filed on April 23, 2021, with the application number 202110444566.3 and the invention titled "A method for constructing a multi-layer fence, cloud server and first terminal device", and The priority of the Chinese patent application with the application number 202110892061.3 and the invention title "A Scene Recognition Method and Electronic Device" submitted to the State Intellectual Property Office on August 4, 2021, the entire contents of which are incorporated in this application by reference.

technical field

The embodiments of the present application relate to the technical field of electronic communication, and in particular, to a scene recognition method and an electronic device.

Background technique

With the development of electronic technology, electronic products are becoming more and more intelligent, and electronic devices can be used in all aspects of life. Taking mobile phones as an example, when people go out to take public transportation, such as subways, buses, etc., they can use their mobile phones to pay for transportation expenses; people can also apply for various electronic membership cards in stores and set the membership cards on their mobile phones. For mobile phones with Near Field Communication (NFC) functions, an electronic access card can also be set in the mobile phone, so that people can easily enter and exit certain areas. For example, the electronic access control card of the community can be set on the mobile phone, which can facilitate people to enter and leave the community access control.

Among them, take the use of mobile phones to pay for subway fares as an example. When passengers enter the subway station to take the subway, they need to go through the subway gates to take the subway, and they need to swipe the boarding code on their mobile phones when entering and leaving the subway station. Use mobile phone to swipe Alipay

Take the bus code as an example, the mobile phone runs Alipay

application, the user clicks Alipay

Click "Travel" in the interface, and further click "Subway", the mobile phone will display the subway boarding code. In this way, the user can pass the subway gate by swiping the subway boarding code displayed on the mobile phone.

Use mobile phone to swipe WeChat

Take the bus code as an example, the mobile phone runs WeChat

application, the user clicks on WeChat

Click "Me" on the interface, and then click "Card Packet", click "Transportation Card" in the corresponding interface of "Card Packet" displayed on the mobile phone, and click "Passenger Code". After these series of operations, the mobile phone displays the subway boarding code.

In the above example, the mobile phone needs to go through a multi-step operation before the mobile phone can display the interface required by the user (ie, the subway boarding code). That is to say, this method is relatively cumbersome to operate.

SUMMARY OF THE INVENTION

The present application provides a scene recognition method and an electronic device, so as to simplify the operation of the electronic device and improve user experience.

In order to realize the above-mentioned technical purpose, the application adopts the following technical solutions:

In a first aspect, the present application provides a scene recognition method, the method may include: detecting that the electronic device enters the first area, and after detecting that the electronic device enters the first area, detecting that the electronic device is located in the first area in the first area When the location is a location label corresponding to the first location, the location label represents the environmental information acquired by the electronic device in the current location, and the first location is in the first area. The electronic device compares the location label with the location information corresponding to the preset location to obtain a comparison result. It should be noted that the preset position information represents the environmental information of the electronic device in the preset scene of the first position, and the preset position is within the first area. That is to say, before the electronic device obtains the position label, the electronic device has obtained the preset position information, and the electronic device compares the position label of the first position with the position information corresponding to the preset position, and can determine that the electronic device Whether the current first position is the preset position.

If the comparison result indicates that the position label matches the position information corresponding to the preset position, that is, the current first position of the electronic device is the preset position. If no user operation is received, the electronic device can be triggered to automatically perform the first action corresponding to the first position. The first action includes the electronic device running the first application and displaying the first interface. The first interface may include two dimensional code. The first application may implement multiple functions, and when the electronic device runs the first application and the first application implements a corresponding function, a corresponding display interface is displayed. For example, the first application may be an electronic payment application, and the first application is Alipay

For example, Alipay

With electronic payment, electronic payment and other functions, when the electronic device runs Alipay

Application, when realizing electronic payment and electronic payment, the display interface of electronic equipment is different. That is, after the electronic device runs the first application, the electronic device may display interfaces with different functions, and the first interface here corresponds to the display interface of the first application responding to the first action.

On the other hand, if the comparison result indicates that the position label does not match the position information corresponding to the preset position, it means that the current first position of the electronic device is not the preset position, and the electronic device may not perform the first action, that is, the electronic device does not perform the first action. any response.

There is a preset logical relationship between the first action and the first position. That is to say, the position label of the electronic device at the first position is consistent with the preset position information, and the electronic device can automatically perform the first action. The preset logical relationship may be that a strong association rule between the first position and the first action is preset in the electronic device, so that the electronic device can automatically execute the first action at the first position.

It can be understood that, if the electronic device is in the first position, the environment information in the current position is acquired to generate the position label. If the position label matches the preset position information, it means that the current scene matches the preset scene. Since the electronic device includes a preset logical relationship between the first position and the first action, and the current scene matches the preset scene, the electronic device can execute the first action without receiving any user operation. In order to simplify the operation of the electronic device, thereby improving the user experience.

Wherein, the location label includes: all the first site addresses collected by the electronic device and the signal strength of each first site address, the electronic device obtains the first cell identifier and the signal strength of each first cell identifier, and the electronic device obtains the first cell identifier and the signal strength of each first cell identifier. At least one of the first satellite signal obtained by the device and the first light intensity collected by the electronic device. The above-mentioned preset location information includes: all the second site addresses collected by the electronic device and the signal strength of each second site address, the second cell identifier acquired by the electronic device, and the signal of each second cell identifier Intensity, at least one of the second satellite signal obtained by the electronic device and the second light intensity collected by the electronic device.

In a possible design of the first aspect, the method may further include: after detecting that the electronic device enters the first area, detecting that the electronic device is located at the first position in the first area before the position label corresponding to the first position , the electronic device may further perform operations including: after detecting that the electronic device enters the first area, determining that the electronic device is in a preset position in the first area. Obtaining the confidence level of the electronic device executing the first event, the confidence level representing the execution degree of the user operation triggering the execution of the first event, wherein the first event and the first position have a preset logical relationship, and the first event has a relationship with the first action, The electronic device executes the first application when the first event is executed.

Further, when the confidence level indicates that the execution of the first event is completed, the electronic device may obtain the execution result of the first event, and verify the execution result to obtain the verification result. If the verification result indicates that the first event is successfully executed, the position label corresponding to the preset position of the electronic device is obtained, and the position label is transmitted to the cloud server, so that the cloud server can generate the position information corresponding to the preset position according to the position label. The location tag represents the environmental information acquired by the electronic device in the current location.

It should be noted that the first event is that in response to a user operation, the electronic device runs the first application to implement the corresponding function. The first action is an action performed automatically by the electronic device after determining that the location tag matches the preset location information. The first action is automatically performed by the electronic device, and the first event is an action performed by the electronic device in response to a user operation. For example, the first action is that the electronic device realizes the function of displaying the boarding code, the electronic device determines that the location label matches the preset location information, automatically runs the first application, and displays the first interface, that is, the electronic device displays the boarding code 2 QR code interface. When the electronic device is in the first position, the electronic device receives a user operation, runs the first application in response to the user operating the electronic device, and displays the first interface. In addition, the confidence level of the first event represents the execution degree of the first event, that is, the electronic device starts to run the first application and displays the first interface, then the confidence level of the first event indicates that the execution of the first event starts; Under the operation of , it is close to the scanning port of the subway gate, so that the user passes through the subway gate, and the confidence level of the first event indicates that the execution of the first event is completed.

In another possible design manner of the first aspect, the method may further include: after detecting that the electronic device enters the first area, detecting that the electronic device is located at the first position in the first area before the position label corresponding to the first position , the electronic device may further perform operations including: after detecting that the electronic device enters the first area, determining that the electronic device is in a preset position in the first area. Obtaining the confidence level of the electronic device executing the first event, the confidence level representing the execution degree of the user operation triggering the execution of the first event, wherein the first event and the first position have a preset logical relationship, and the first event has a relationship with the first action, The electronic device executes the first application when the first event is executed.

Further, when the confidence level indicates that the execution of the first event is completed, the electronic device may obtain the execution result of the first event, and verify the execution result to obtain the verification result. If the verification result indicates that the first event is successfully executed, a position label corresponding to the preset position of the electronic device is obtained, and the electronic device can generate position information corresponding to the preset position according to the position label. The location tag represents the environmental information acquired by the electronic device in the current location.

It can be understood that the electronic device collects and obtains the environmental information of the current place where the electronic device executes the first event under the operation of the user according to the first event. On the one hand, the electronic device can transmit the obtained environmental information to the cloud server, so that the cloud server generates preset environmental information. On the other hand, the electronic device can generate preset environmental information according to the environmental information by itself.

In another possible design method of the first aspect, the electronic device may also obtain the position information corresponding to the preset position of the electronic device before comparing the position label with the position information corresponding to the preset position and obtaining the comparison result.

Wherein, when the electronic device is in a preset position, the position information can be obtained first. In this way, the electronic device can compare whether the position label is consistent with the preset position information according to the currently obtained position label, so as to determine whether the electronic device is located at the preset position in the first area, so as to decide whether to automatically execute the first action. .

In another possible design manner of the first aspect, the above-mentioned when the confidence level indicates that the execution of the first event ends, specifically includes: after the electronic device obtains the confidence level, if the confidence level is determined to be greater than the first preset threshold and less than or equal to With the second preset threshold, it can be determined that the electronic device starts to execute the first event; if the confidence level is greater than the second preset threshold, it is determined that the electronic device has completed executing the first event. Wherein, the first preset threshold is smaller than the second preset threshold.

It can be understood that when the electronic device executes the first event in response to the user operation, the electronic device can acquire the confidence level of the first event in real time, so that the electronic device can determine the execution state of the first event according to the confidence level. The confidence level may represent that the first event starts to be executed, the execution is completed, or the execution fails.

In another possible design manner of the first aspect, the above execution result includes the current display interface of the electronic device.

It can be understood that when the electronic device executes the first event, a corresponding interface can be displayed based on the user operation. Therefore, the electronic device can determine the execution result of the first event by acquiring the current display interface. In other words, the electronic device may acquire the current display interface in real time, and the electronic device may determine the confidence level of the first event according to the display interface.

In another possible design manner of the first aspect, if the location label includes: all the first site addresses collected by the electronic device, the signal strength of each first site address, and the first cell identifier obtained by the electronic device. , and the signal strength of the first cell identifier.

Then the electronic device compares the location label with the preset location information of the first location, and obtains the comparison result, which specifically includes: generating a first item set including the identifier of the first site and the first cell based on the location label; based on the preset location information A second item set of the identifiers of the second site and the second cell is generated; according to the first item set and the second item set, a comparison result between the position label and the preset position information is obtained by calculation.

Wherein, the electronic device can calculate and obtain the comparison result of the position label and the preset position information according to the preset operation relationship.

In another possible design method of the first aspect, if the first action involves scanning the QR code displayed by the electronic device to take the subway through the subway gate, the QR code is the subway boarding code or a health-related 2-dimensional code. QR code (such as a QR code indicating whether you have been vaccinated or a QR code indicating health test results). If the first action involves scanning a two-dimensional code displayed by the electronic device to take a bus, the two-dimensional code may be a bus ride code.

In another possible design manner of the first aspect, before obtaining the confidence of the electronic device executing the first event, the method may further include: the electronic device starts executing the first event in response to a user operation.

In another possible design manner of the first aspect, when the electronic device executes the first event in response to the user operation, it specifically includes: the electronic device receives a first operation input by the user, and the first operation is used to instruct the electronic device to run the first application . In response to the first operation, the electronic device runs the first application and displays a first interface, wherein the first interface includes a two-dimensional code, and the two-dimensional code is a subway boarding code. The electronic device receives the user's flipping operation, and in response to the flipping operation, the display screen of the electronic device faces the code swiping port of the subway gate.

Among them, the above-mentioned first event is taken as an example of swiping code at a subway station, and the first event is described in detail.

In another possible design manner of the first aspect, obtaining the confidence of the electronic device executing the first event specifically includes: in response to the first operation, the electronic device runs the first application and displays the first interface, and then the electronic device obtains first interface. Further, the electronic device recognizes the first interface to obtain a first recognition result, and the electronic device can determine the confidence level of the first event according to the first recognition result. Moreover, the electronic device may continue to acquire the current display interface of the electronic device once every first preset time period, and determine the confidence level of the first event according to the current display interface.

In another possible design method of the first aspect, the above-mentioned obtaining the confidence level of the electronic device executing the first event specifically includes: after the electronic device receives the user's grip and flip operation, after a second preset time period, the electronic device obtains the current UI. And the current display interface is identified to obtain a second identification result, and the electronic device determines the confidence level of the first family according to the second identification result.

In a second aspect, the present application further provides an electronic device, including: a detection module, a comparison module and an execution module.

The detection module is used to detect that the electronic device enters the first area, and after detecting that the electronic device enters the first area, to detect the position label corresponding to the first position when the electronic device is located at the first position in the first area, and the position label represents the electronic device. The environmental information obtained by the device in the current location, and the first location is within the first area. The comparison module is used to compare the position label with the position information corresponding to the preset position to obtain a comparison result. It should be noted that the preset position information represents the environmental information of the electronic device in the preset scene of the first position, and the preset position is within the first area. It should be noted that the preset location information represents the environmental information of the electronic device in the preset scene of the first location. The execution module is used to trigger the electronic device to automatically execute the first action corresponding to the first position without receiving any user operation if the comparison result indicates that the position label is consistent with the preset position information, and the first action includes The electronic device runs the first application and displays a first interface, where the first interface may include a two-dimensional code.

In a possible design manner of the second aspect, the electronic device may further include: a determination module and a response module.

The determining module is configured to, after detecting that the electronic device enters the first area, determine that the electronic device is in a preset position in the first area. The response module is used to obtain the confidence level of the electronic device executing the first event, and the confidence level represents the execution level of the user operation triggering the execution of the first event, wherein the first event and the first position have a preset logical relationship, and the first event and the first event have a preset logical relationship. An action is related, and the electronic device runs the first application when the first event is executed.

The confidence level represents the execution degree of the user operation triggering the execution of the first event, wherein the first event has a preset logical relationship with the first position, the first event has a relationship with the first action, and the electronic device executes the first event when the electronic device executes the first event. an application. When the electronic device determines to start executing the first event according to the confidence of the first event, the electronic device can obtain the execution result of the first event, and verify the execution result to obtain the verification result. If the verification result indicates that the first event is successfully executed, a location label corresponding to the first location is obtained, and the location label is transmitted to the cloud server, so that the cloud server can generate preset location information according to the location label. The location tag represents the environmental information acquired by the electronic device in the current location.

In another possible design manner of the second aspect, the electronic device may further include: a determination module and a response module.

The determining module is configured to, after detecting that the electronic device enters the first area, determine that the electronic device is in a preset position in the first area. The response module is used to obtain the confidence level of the electronic device executing the first event, and the confidence level represents the execution level of the user operation triggering the execution of the first event, wherein the first event and the first position have a preset logical relationship, and the first event and the first event have a preset logical relationship. An action is related, and the electronic device runs the first application when the first event is executed. When the electronic device determines to start executing the first event according to the confidence of the first event, the electronic device can obtain the execution result of the first event, and verify the execution result to obtain the verification result. If the verification result indicates that the first event is successfully executed, a location label corresponding to the first location is obtained, and the electronic device can generate preset location information according to the location label. The location tag represents the environmental information acquired by the electronic device in the current location.

In another possible design method of the second aspect, the electronic device is located at the first position, and the position label corresponding to the first position is obtained. The position label represents the environmental information obtained by the electronic device in the current place, and the electronic device can also obtain electronic equipment. The preset location information of the device at the first location.

In another possible design manner of the second aspect, after the electronic device obtains the confidence level, if it is determined that the confidence level is greater than the first preset threshold and less than or equal to the second preset threshold, it may be determined that the electronic device starts to execute the first an event; if the confidence level is greater than the second preset threshold, it is determined that the electronic device has completed the execution of the first event. Wherein, the first preset threshold is smaller than the second preset threshold.

In another possible design manner of the second aspect, the above execution result includes the current display interface of the electronic device.

In another possible design manner of the second aspect, if the location label includes: all the first site addresses collected by the electronic device, the signal strength of each first site address, and the first cell identifier obtained by the electronic device , and the signal strength of the first cell identifier.

In another possible design manner of the second aspect, if the first action is that the electronic device has a subway gate, the two-dimensional code is the subway boarding code. If the first action is that the electronic device has a passing bus vehicle, the two-dimensional code may be a bus ride code.

In another possible design manner of the second aspect, before obtaining the confidence of the electronic device executing the first event, the method may further include: the electronic device starts executing the first event in response to a user operation.

In another possible design manner of the second aspect, the electronic device is specifically configured to: the electronic device receives a first operation input by a user, and the first operation is used to instruct the electronic device to run the first application. In response to the first operation, the electronic device runs the first application and displays a first interface, wherein the first interface includes a two-dimensional code, and the two-dimensional code is a subway boarding code. The electronic device receives the user's flipping operation, and in response to the flipping operation, the display screen of the electronic device faces the code swiping port of the subway gate.

In another possible design manner of the second aspect, the electronic device is specifically configured to: in response to the first operation, the electronic device runs the first application, and after displaying the first interface, the electronic device acquires the first interface. Further, the electronic device recognizes the first interface to obtain a first recognition result, and the electronic device can determine the confidence level of the first event according to the first recognition result. Moreover, the electronic device may continue to acquire the current display interface of the electronic device once every first preset time period, and determine the confidence level of the first event according to the current display interface.

In another possible design manner of the second aspect, the electronic device is specifically configured to: after the electronic device receives the user's grip and flip operation, the electronic device obtains the current display interface after a second preset time period. And the current display interface is identified to obtain a second identification result, and the electronic device determines the confidence level of the first event according to the second identification result.

In a third aspect, the present application also provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs The program includes instructions that, when executed by the electronic device, cause the electronic device to execute the method in the first aspect and any possible design manners thereof.

In a fourth aspect, the present application also provides a computer-readable storage medium, which is characterized by comprising computer instructions, when the computer instructions are run on a computer, the computer is made to execute the first aspect and any possible design methods thereof. method.

In a fifth aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on a computer, enables the computer to execute the method for executing the electronic device in the first aspect and any possible design thereof.

In a sixth aspect, an embodiment of the present application provides a chip system, and the chip system is applied to an electronic device. The chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the interface circuit is used for receiving signals from the memory of the electronic device and sending signals to the processor, and the signals are included in the memory Stored computer instructions; when the processor executes the computer instructions, it causes the electronic device to perform the method in the first aspect and any possible designs thereof.

It can be understood that the electronic device of the second aspect, the electronic device of the third aspect, the computer-readable storage medium of the fourth aspect, the computer program product of the fifth aspect, and the chip system of the sixth aspect can be For the beneficial effects achieved, reference may be made to the beneficial effects in the first aspect and any possible design manners thereof, which will not be repeated here.

Description of drawings

1 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application;

2 is a flowchart of a scene recognition method provided by an embodiment of the present application;

3A is a schematic flowchart of a cloud server data mining process provided by an embodiment of the present application;

3B is a schematic flowchart of a cloud server deleting a fingerprint feature according to an embodiment of the present application;

4 is a flowchart of another scene recognition method provided by an embodiment of the present application;

5 is a flowchart of another scene recognition method provided by an embodiment of the present application;

6 is a schematic diagram of an application scenario of a scene recognition method provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed ways

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

For NFC-enabled phones, the phone can generate digital access cards. Moreover, multiple digital access cards can be stored in the mobile phone, such as company access cards, community access cards, etc. In this way, when the user needs to use the NFC function of the mobile phone, the user needs to select the correct access control card on the mobile phone. When the mobile phone displays the digital access control card of the company access control card, the user can pass the company's access control; when the mobile phone displays the digital access control card of the community access control card, the user can pass the residential access control.

Specifically, the mobile phone stores two NFC cards, "home access control card" and "company access control card". When the user is at the door of the company and needs to pass the company's access control, the user uses the NFC function of the mobile phone, and the user selects the "company access control card" on the mobile phone, and the mobile phone can be used as an access control card. The user will bring the mobile phone close to the access control machine, and the access control machine is triggered, allowing the user to pass the company's access control.

The above operations are relatively cumbersome, in order to simplify the operations and improve the user experience. In a possible implementation, the mobile phone may use a geo-fence to establish a corresponding relationship between the NFC card and the geographic location. For example, the location information (eg, the first location) when the user uses the "home access control card" is collected, and a corresponding relationship is established. When the mobile phone detects that the user has reached the first place again, and detects that the user triggers the NFC function, the mobile phone displays the NFC card of "home access control card".

It can be understood that this method can simplify the steps for the user to select the NFC card, but at other addresses than the company or home, the NFC card cannot be switched adaptively.

In another possible implementation, the mobile phone can acquire the user's location information, and if the mobile phone detects that the user is located at a subway station, the mobile phone can display the subway boarding code. So that users can use the bus code to pass through the subway gates to simplify user operations. It can be understood that this method is based on the current location information of the mobile phone to provide the user with a service related to the location information (display the bus code). However, the subway station is a relatively extensive location. When the user is located in the subway station, the user may not be close to the subway gate; or, the user is near the subway station and has not entered the subway station; that is, this method cannot accurately identify At the location of the subway gate, it is impossible to determine whether the user needs the mobile phone to provide the service of displaying the bus code. If the user is not close to the subway gate and does not want to pass the subway gate, the mobile phone will display the subway boarding code. Although this method simplifies the operation steps, it does not provide the user with a good experience.

Embodiments of the present application provide a scene recognition method and electronic device. Taking the implementation of the scene recognition method on a mobile phone as an example, the mobile phone can identify the current scene, so that the mobile phone can provide the user with corresponding services according to the current scene. For example, if the mobile phone determines that the current location information is a subway station and it is close to the subway gate, the mobile phone displays the subway boarding code. For another example, if the mobile phone detects that the current location information is the door of the community, and the mobile phone is close to the access control machine of the community, the mobile phone displays the NFC card of "Access Control of Home".

Specifically, the mobile phone can identify the current scene information through multiple sensors, etc., and detect the correlation between the current scene information and the service provided by the mobile phone. In this way, when the mobile phone detects the current scene again, the mobile phone displays the service.

For example, when the mobile phone collects information, the scene information collected many times: when the mobile phone is in the subway station and close to the subway gate; at this time, the mobile phone displays the subway QR code based on the user operation. The relationship between the scene information generated by the mobile phone and the operation, when the mobile phone is in the current scene next time (that is, in the subway station and close to the subway gate), the mobile phone displays the subway QR code.

For another example, when the mobile phone collects information, the scene information collected many times is: the mobile phone is located in a coffee shop, and the mobile phone is close to the cashier position; at this time, the mobile phone displays the coffee shop membership card based on user operations. Then, the mobile phone generates the relationship between the scene information and the operation. When the mobile phone is in the current scene again (that is, in the coffee shop, and the mobile phone is close to the cashier position), the mobile phone displays the coffee shop membership card.

The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Please refer to FIG. 1 , which is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, NFC chip module 170, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and user identification module (subscriber identification module, SIM) card interface 195 et al. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The electronic device 100 can implement the NFC function through the NFC chip module 170 and the application processor. The working modes of the NFC chip module 170 include:

Peer-to-peer mode: Data exchange can be performed between two NFC-enabled devices, such as exchanging music, transferring files, etc. Using this mode requires both devices to have the NFC function. NFC file transfer is basically an abandoned transmission method, because the NFC transmission speed is very slow, and it is usually only used to transfer data with a small amount of information such as a single contact and website between mobile phones. , so there are fewer scenes used in daily life.

Card Reader Mode: Can be used as a contactless card reader. Can read or write information from electronic tags, but because NFC electronic tags on the market are not widely used, consumers mostly recharge physical bus cards through this mode, but with the gradual development of virtual bus card functions Realization, people's reliance on the physical bus card will become weaker and weaker, and the virtual bus card service integrated into the mobile phone will be more convenient.

Card simulation mode: In fact, it is equivalent to a mobile phone equipped with NFC function to replace a large number of physical IC cards (bus cards, credit cards, etc.) usage scenarios to realize mobile payment function.

It should be noted that the electronic devices in the embodiments of the present application may be mobile phones, smart watches, smart bracelets, tablet computers, desktops, laptops, handheld computers, notebook computers, and ultra-mobile personal computers (ultra-mobile personal computers) with NFC functions. mobile personal computer, UMPC), netbooks, and devices including touch screens, such as cellular phones, personal digital assistants (PDAs), augmented reality (AR)\virtual reality (VR) devices, and the The electronic device can control the device, and the specific form of the electronic device is not particularly limited in this embodiment of the present application.

The embodiments of the present application illustrate the method by taking the electronic device as a mobile phone and implementing the scene recognition method on the mobile phone as an example.

Specifically, the mobile phone can identify the current scene and perform corresponding actions according to the current scene. For example, when the mobile phone is in a subway station, the mobile phone can recognize the current scene, and based on the current scene, the mobile phone displays an interface including "subway boarding code". Before this, the mobile phone needs to determine the current scene corresponding to the action, so as to perform the corresponding action after identifying the current scene subsequently.

Exemplarily, when the mobile phone is in a preset position, a corresponding action is performed. The mobile phone can count the scene information when the action is performed, and record the scene information. Based on the statistics of the scene information multiple times, the mobile phone can determine the corresponding relationship between the scene information and the action. In this way, when the mobile phone is in the preset position and the scene information is detected again, the mobile phone performs an action corresponding to the scene information.

In another example, the mobile phone may interact with a cloud server (or referred to as a remote server) to obtain a fingerprint database of the cloud server, where the fingerprint database includes multiple fingerprint information. Each fingerprint information corresponds to a scene (eg, the first scene), and the fingerprint information may include WIFI, Cell, GNSS, and light intensity information, and the like. In this way, when the mobile phone detects that the current environment matches a type of fingerprint information in the fingerprint database, the mobile phone can determine an action strongly related to the current scene according to the fingerprint information that matches the current environment, and execute the action.

In addition, when the mobile phone is used as a device for collecting fingerprint information, the mobile phone has the user authorization to report the collected information to the cloud server, and the mobile phone can upload the collected location information and related service actions to the cloud server. After the cloud server obtains the collection information uploaded by multiple devices, the cloud server can generate fingerprint information according to the collection information uploaded by the mobile phone according to a preset algorithm, and the multiple fingerprint information forms a fingerprint database.

First, the process of using a mobile phone as a terminal for collecting information, collecting information, and transmitting the collected information to a cloud server will be described. Please refer to FIG. 2 , which is a flow chart of the mobile phone transmitting the collected information to the cloud server. Among them, this process can also be referred to as the training phase of the scene recognition method.

As shown in FIG. 2 , the training phase includes steps 201 to 206 .

Step 201 : when the mobile phone is located at the first position, obtain the confidence level of the first event, and the first event and the first position have a preset logical relationship.

Wherein, the confidence level of the first event is used to characterize the execution degree of the first event.

It should be noted that the first event may be that the mobile phone runs the first application under the operation of the user, or the first event may be that the mobile phone receives a preset user operation and displays a preset interface. Specifically, after the mobile phone executes the first event, the mobile phone may display at least one preset interface. For example, the first location is the first subway station, and the execution of the first event by the mobile phone is that the mobile phone runs the first application, and displays an interface including "subway boarding code". Or, the first location is the first subway station, the mobile phone executing the first event is the mobile phone running the second application, the mobile phone displays an interface including the "health code", and, after the mobile phone displays the interface including the "health code", the mobile phone runs the second application. An application, the mobile phone displays an interface including the "subway code". Exemplarily, the first application may be an application with an electronic payment function, such as Alipay

,WeChat

Wait.

In some implementations, the preset logical relationship may be determined by the mobile phone according to the correlation between the first location and the first event. For example, the first location is the first subway station, and the first event is that the mobile phone displays an interface including "subway boarding code". Judging by the preset logical relationship, when the mobile phone is determined to be at the first subway station, executing the first event can make the user pass through the subway gate, and then the user can take the subway. When the mobile phone is in the first subway station, the user needs to take the subway is a preset logic. Therefore, the mobile phone can determine that it is currently in the first subway station and needs to detect whether to execute the first event.

In other implementations, the mobile phone interacts with the cloud server, and determines according to the information fed back by the cloud server that the mobile phone is currently in the first subway station, and it is necessary to detect whether the mobile phone executes the first event. Based on this, the mobile phone can determine the data training stage, and can collect data when the mobile phone performs the first action.

It is worth mentioning that there is a preset logical relationship between the first event and the current position of the mobile phone. It can also be understood that the current position (ie, the first position) is a preset condition for the mobile phone to execute the first event. For the training phase, this preset logical relationship can be preset in the mobile phone as a strong association rule (or called a strong rule).

The first position is an area, and when the phone is in the first position, the phone can perform multiple actions under the control of the user. For example, the mobile phone can run a video application under the control of the user, and play the video; or, the mobile phone can run the first application under the control of the user, so that the mobile phone can complete the payment action. That is, when the mobile phone is in the first position, it cannot be determined whether the mobile phone executes the first event, and when the mobile phone executes the first event. Therefore, a confidence level needs to be set. The confidence level is used to represent the execution degree of the first event, for example, whether the mobile phone executes the first event, whether the execution of the first event is completed, and the like. On the other hand, setting the confidence level is the confidence level for the mobile phone to recognize the first event. Specifically, in the training phase, the mobile phone is in the first position, and the mobile phone executes the first event, and the execution of the first event is completed (that is, the execution of the first event by the mobile phone is credible). In the next step, the mobile phone can use relevant information. If the mobile phone does not execute the first event or fails to execute the first event (that is, the execution of the first event by the mobile phone is untrustworthy), the mobile phone does not need to respond to the next action, and thus, it is not a complete training process.

Specifically, the mobile phone can identify the confidence level of the first event according to data collected by multiple sensors and the like. For example, continue to take the example that the first location is the first subway station and the first event is that the mobile phone displays an interface including "subway boarding code". After determining that the mobile phone is running the first application, the mobile phone can obtain the display interface of the current display screen. If the display interface of the mobile phone is an interface including "subway boarding code", the mobile phone can confirm that the first event starts to be executed. At this time, the confidence level of the first event may be 1, indicating that the mobile phone is executing the first event, that is, the mobile phone is credible to execute the first event. It can be understood that when the mobile phone is at the first subway station and the first application is run, the mobile phone obtains the display interface of the current display screen. If the display interface of the mobile phone does not include the "subway code", it can be confirmed that the confidence level of the first event is 0, that is, it is untrustworthy that the mobile phone executes the first event.

It is understandable that after the mobile phone displays the interface including the "subway boarding code", if the user moves the mobile phone close to the area where the subway gate is scanned for the code, so that the mobile phone completes the code scanning action, the obtained display interface may include "has entered. The interface that prompts messages such as "stop", "outbound", "update QR code" or "scan code failed". That is to say, when the mobile phone obtains the display interface of the display screen as an interface including: "inbound", "outbound", "update QR code" or "scan code failed" prompt information, it can also indicate that the first The confidence level of an event may be 1, indicating that the mobile phone is executing the first event, that is, it is credible that the mobile phone executes the first event.

It should be understood that the mobile phone can acquire the display interface of the display screen in real time, so that the mobile phone can determine the confidence level of the first event. Specifically, the mobile phone can determine whether the display interface of the display screen needs to be acquired according to the currently running application. When the mobile phone determines that the current first application is running, the mobile phone can acquire the display interface of the display screen in real time (or at a preset time interval).

Step 202: Determine whether the confidence level is greater than a first preset threshold. If the confidence level is greater than the first preset threshold, go to step 203; if the confidence level is less than or equal to the first preset threshold, go to step 206.

The first preset threshold may be used as a basis for judging whether the first event is executed, and the confidence level of the first event is greater than the first preset threshold, indicating that when the mobile phone is in the first position, the mobile phone is executing the first event, or the mobile phone is executing the first event. Completed the first event.

In other implementations, the confidence degree may be set to be greater than or equal to the first preset threshold, and step 203 is performed; the degree of execution is less than the first preset threshold, and step 206 is performed.

Step 203: Determine the execution result of the first event, verify the execution result, and obtain the verification result.

Specifically, the execution result includes successful execution of the first event (or understood as completion of execution of the first event) and failure of execution of the first event. The execution result of the first event may be determined according to data collected by sensors in the mobile phone, or the execution result of the first event may be determined by acquiring information on the current display interface of the mobile phone.

Exemplarily, continue to take as an example that the first event is that the mobile phone displays an interface including "subway boarding code". When the mobile phone displays an interface including "subway boarding code", at this time, the confidence level of the first event indicates that the first event is credible. The user aligns the display interface of the mobile phone with the code scanning port of the subway gate, so that the mobile phone completes the first event. After the mobile phone completes the first event, the display interface of the mobile phone will change. After the display interface of the mobile phone is changed, the mobile phone obtains the execution result of the first event, that is, the current display interface of the display screen of the mobile phone.

The mobile phone obtains the execution result of the first event, and determines the verification result of the first event by identifying the current display interface of the display screen of the mobile phone. The verification result indicates that the first event is successfully executed, or the verification result indicates that the first event is not successfully executed.

It should be noted that the above-mentioned determination of the execution result of the first event is determined according to the current display interface of the display screen of the mobile phone. In some implementations, when it is determined that the display screen of the mobile phone includes an interface of "subway code", the mobile phone obtains the current display interface of the display screen once every preset time interval, so as to determine the school of the first event according to the display interface. test results. In other implementations, when it is determined that the display screen of the mobile phone includes an interface of "subway boarding code", and it is determined that the current display interface of the mobile phone has changed, the mobile phone obtains the current display interface of the display screen, so as to determine the status of the first event according to the display interface. Check the result.

Step 204: According to the verification result, determine whether the first event is successfully executed. If the execution of the first event is successful, go to step 205; if the execution of the first event fails, go to step 206.

Specifically, after the mobile phone recognizes the current display interface of the display screen, if the display interface includes the prompt information of "inbound" or "outbound", it can be determined that the verification result indicates that the first event was successfully executed, and the execution steps 205. If the display interface does not include "inbound" or "outbound" prompt information, for example, the display interface includes "scan code failure" or "update QR code" prompt information, etc., the verification result can be determined. Indicate that the first event is not successfully executed (the first event fails to execute), and step 206 is executed.

Step 205: Acquire the location label corresponding to the first location in the mobile phone, and upload the location label corresponding to the first location to the cloud server.

The location tag may include at least one of WIFI, Cell, GNSS and light intensity information. If the mobile phone obtains the permission granted by the user, after the completion of the first event, the collected WIFI, Cell, GNSS and light intensity information can be used as the location label of the first location, and the location label can be uploaded to the cloud server.

Exemplarily, WIFI refers to all the site addresses (Basic Service Set Identifier, BSSID) searched by the WIFI of the mobile phone in the process of executing the first event, and the signal strength corresponding to each BSSID. Cell refers to the cell identity obtained by the mobile phone and the signal strength of the cell identity during the execution of the first event process by the mobile phone. GNSS refers to the satellite signal obtained by the mobile phone in the process of executing the first event. The light intensity signal refers to the light intensity of the environment in which the mobile phone is located as determined by a sensor (eg, an ambient light sensor) during the execution of the first event by the mobile phone.

Take for example that the first event is that the mobile phone displays an interface including "subway boarding code". The location tag indicates that when the mobile phone is located near the subway gate in the first subway station (for example, the position where the subway gate scans the code or just passed the subway gate), after the mobile phone successfully executes the first event, the mobile phone will collect the data. The location label is uploaded to the cloud server.

Step 206: No response.

Among them, the non-response here means that the mobile phone does not respond.

Specifically, the mobile phone determines that the confidence level is less than or equal to the first preset threshold, indicating that the degree of correlation between the first position and the first event is not high, and the mobile phone does not need to perform subsequent steps. And, when the mobile phone determines that the verification result of the first event indicates that the execution of the first event fails, it is not necessary to report the first location and the first event to the cloud server for the time being, and also does not need to collect the location label corresponding to the first location. At this point, the phone does not respond.

It is worth mentioning that, as terminals, multiple mobile phones can upload the location tag corresponding to the first location and the first event to the cloud server. Taking the first location as the first subway station as an example, the first mobile phone can upload the location label of the first subway station and the first event to the cloud server; the second mobile phone can also upload the location label of the first subway station like the cloud server, and the first event.

Wherein, the cloud server may generate a fingerprint tag of the first position (that is, unique corresponding information for the first position) according to the position tag corresponding to the first position.

It should be understood that the GNSS signal and light intensity signal can be used to determine whether the current mobile phone is indoors or outdoors, and the Cell information and WIFI information can be used to determine the area of the first location where the mobile phone is located.

In a possible implementation manner, the cloud server may store information uploaded by multiple terminals by means of data mining. Exemplarily, an association rule algorithm (Apriori algorithm) can be used to perform data mining on the cell and WIFI information corresponding to the first position, for example, frequent itemset mining can be performed on the cell and WIFI information. That is, when running the Apriori algorithm, in the frequent mode, the frequent itemsets are obtained. Frequent patterns are itemsets, sequences, or substructures that occur frequently in a dataset. An itemset is a collection of several items. In the location tag corresponding to the first location, the WIFI information (ie, the wireless network name list) uploaded by a terminal is an item set. Frequent itemsets refer to the frequency of an itemset appearing in all items, which is greater than the set of preset frequencies (minimum support threshold).

All in all, based on the first location tags uploaded by multiple terminals, the above-mentioned Apriori algorithm can be used to determine the item set with the highest occurrence frequency. Taking the frequent itemset mining of cell and WIFI information as an example, the itemsets that meet the conditions are mined through the minimum support threshold, that is, the itemsets whose support is greater than the minimum support threshold. Specifically, the support degree of each item set is determined through data mining, and it is judged whether the item set meets the fingerprint requirements of the first position. If the support degree of the item set is greater than the minimum support degree threshold, it means that the item set can be used as a Fingerprint feature of the first location.

For example, the calculation method of the support of each itemset can refer to the following formula 1:

Among them, X represents the ID of the base station obtained by the cell signal, that is, the CELL ID; Y represents the wireless network signal address obtained by the WIFI signal, which refers to the site address (Basic Service Set Identifier, BSSID) included in the WIFI list, that is, the WIFI BSSID; support( X→Y) represents the support degree of the itemsets from the base station to the specific area, N represents the total number of itemsets, and count(X, Y) represents the itemsets <cell, wifi>.

In other respects, if in the data mining stage, no item set including <cell, wifi> is mined, that is, there is no WIFI information in the location tag reported by the terminal. In this case, if you want to calculate the location of the terminal, you can perform cell positioning on the terminal according to the CELL ID reported by the terminal. It should be understood that the positioning accuracy is lower when the CELL ID is matched. Because the communication range of a base station is relatively large, this makes it impossible to accurately locate the specific area where the terminal is located.

In some embodiments, the above-mentioned process of data mining of the cloud server may be illustrated by the flowchart shown in FIG. 3A . As shown in Figure 3A, the cloud server data mining process includes:

Step 301: The cloud server uses a preset data processing algorithm to calculate the fingerprint feature of the first location according to the location tag uploaded by the terminal.

Exemplarily, after receiving the location tag uploaded by the terminal, the cloud server may calculate the fingerprint feature of the location tag in the above manner.

Step 302 : determine whether the fingerprint feature already exists in the fingerprint database of the first position; if the fingerprint feature already exists in the fingerprint database of the first position, execute step 303 ; otherwise, execute step 304 .

The fingerprint database of the first location includes a plurality of fingerprint features, and these fingerprint features enable the cloud server to uniquely determine the features of the first location. In addition, the fingerprint features in the fingerprint database are generated according to the location tags from multiple terminals. The currently calculated fingerprint features may have been stored in the fingerprint database. In order to avoid the repetition of fingerprint features and affect the matching of the first position, each additional Fingerprint features need to be compared.

Step 303: Do not add fingerprint database information.

If the fingerprint database has the same fingerprint feature as the current fingerprint feature, it is not necessary to add the fingerprint feature to the fingerprint database.

In another implementation, if the existing fingerprint features in the fingerprint database are obtained by data mining, the existing fingerprint features in the fingerprint database can be marked to increase the correlation between the fingerprint features and the first position.

Step 304: Save the itemsets obtained by data mining to the fingerprint database in the first location.

It should be understood that when the mobile phone can interact with the cloud server, the mobile phone can determine the first action corresponding to the first position according to the fingerprint database information of the first position. In addition, the cloud server can receive the location labels of the first location transmitted by multiple terminals, then the cloud server can update the fingerprint features in the fingerprint database according to the location labels, so that the fingerprint database provided by the cloud server for the mobile phone can accurately provide the mobile phone with The first action associated with the first position.

In some implementations, when the cloud server updates the fingerprint database in real time, it also includes the "aging" fingerprint information that will be deleted. The "aging" fingerprint information indicates that the fingerprint information has not been called within a preset time period. For example, when matching the current location of the mobile phone according to the fingerprint information in the fingerprint database, if the fingerprint information has not been used within 45 days, the fingerprint information is called "aging" fingerprint information. The cloud server The "aging" fingerprint information can be deleted.

Specifically, the process of deleting fingerprint information is shown in FIG. 3B , and the method includes steps 3-1 to 3-4. Wherein, the flowchart takes deleting a fingerprint feature as an example, and the cloud server may perform the above process for each fingerprint feature in the fingerprint database.

Step 3-1: The cloud server generates a timestamp of the fingerprint feature to determine the time interval during which the fingerprint feature is not used.

It should be noted that the earlier the timestamp of the fingerprint feature is generated, the higher the probability that the fingerprint feature is "aging". For example, the cloud server can process the fingerprint features with an earlier generation time stamp to determine the judgment order of the fingerprint features.

Step 3-2: Determine whether the time interval exceeds the preset time interval. If yes, go to step 3-3; otherwise, go to step 3-4.

Step 3-3: Delete the fingerprint feature.

Step 3-4: Do not process the fingerprint feature.

Secondly, the embodiment of the present application uses a mobile phone as a computing terminal to calculate the area of the current first location and provide the user with a first action as an example to illustrate the scene recognition method provided by the present application. As shown in FIG. 4 , the mobile phone implements the flow chart of the method, wherein the process can also be referred to as the calculation phase of the scene recognition method.

As shown in FIG. 4 , the calculation phase includes steps 401 to 406 .

Step 401: When the mobile phone determines the current first position, the mobile phone receives a fingerprint database of the first position from the cloud server, and the fingerprint database includes a plurality of fingerprint features of the first position.

It can be understood that the first position is an area. When the mobile phone is in a preset area of the first position (eg, a position close to the subway gate in the first subway station), the mobile phone only needs to perform the first action.

Exemplarily, as shown in FIG. 6 , it is a schematic diagram of the first subway station. As shown in FIG. 6 , when the user enters the first subway station with the mobile phone, the mobile phone detects that the current position is in the first area 50 and determines that the mobile phone is near the subway gate at the entrance of the first subway station. At this time, the mobile phone may display an interface including the "subway boarding code", that is, the mobile phone performs the first action. For example, when the mobile phone is in the first position 10 or in the second position 20, the mobile phone does not have to display an interface including "subway boarding code". Wherein, when the mobile phone detects that it is located in the first subway station, the calculation can be performed. Specifically, it needs to perform matching calculation with the fingerprint database of the first subway station to determine whether the mobile phone is currently in the first area 50 .

Step 402: The mobile phone obtains the location label of the first location.

Wherein, the location label includes: at least one of WIFI, Cell, GNSS and light intensity information.

Specifically, the corresponding location tag is determined according to the authority obtained by the mobile phone. For example, the mobile phone has the permission to collect WIFI, Cell, GNSS and light intensity information. When the mobile phone is in the first position, it can obtain the WIFI, Cell, GNSS and light intensity information in real time.

In some implementations, when the mobile phone is at the first location, the mobile phone collects a location tag, wherein the location tag includes WIFI, Cell, GNSS, and light intensity information. When the mobile phone detects that the information of any dimension in the location label has changed, the location label of the first location is updated. For example, when the mobile phone detects that it is currently located at the first position, the light intensity information collected by the mobile phone is the first light intensity, and the light intensity in the location tag of the first position is the first light intensity. After a preset time, the mobile phone is still in the first position. At this time, the mobile phone detects that the light intensity information has changed to the second light intensity, and the light intensity information in the updated location tag of the mobile phone is the second light intensity.

Step 403 : The mobile phone matches the location label with the fingerprint features in the fingerprint database to obtain a matching degree, and the matching degree is used to represent the matching degree between the location label and the fingerprint feature.

In some implementations, if the location label includes the item set <cell, wifi>, the following formula 2 can be used to calculate the matching degree (ie, matching degree) between the location label and the fingerprint database feature.

Among them, score represents the matching degree, A represents the itemset <cell, wifi> obtained by the user's mobile phone, and B represents the itemset <cell, wifi> in the fingerprint feature. COUNT(A U B) represents the same number of items in the itemset <cell, wifi> corresponding to A and the itemset <cell, wifi> corresponding to B; COUNT(B) represents the itemset <cell, wifi> corresponding to B > The number of items in the middle.

It is understandable that if the location tag collected by the mobile phone does not include the item set <cell, wifi>, the specific location of the mobile phone at the first location can be located by means of CELL ID matching. It should be understood that since there is no WIFI signal to enhance the positioning, the positioning accuracy at this time is low.

Exemplarily, taking the first location as the first subway station as an example, after the mobile phone completes the first action, the mobile phone collects the location tag and uploads the location tag to the cloud server. According to the location tags uploaded by multiple mobile phones, the cloud server may have multiple <cell, wifi> fingerprints in the fingerprint database of the first subway station. For example, the information collected by the location tag as cell indicates the cell where the mobile phone is located and cell_a, the signal strength of cell_a is E1, and the names of the WiFi signals collected by the WIFI information include: wifi_1, wifi_2, and wifi_3. The cloud server can generate three fingerprint features of the first subway station based on the location tag: <cell_a, wifi_1>, <cell_a, wifi_2> and <cell_a, wifi_3>.

After the mobile phone acquires the fingerprint features of the first subway station, the mobile phone can match all the fingerprint features with the location tags currently collected by the mobile phone. There are two fingerprint features that match the currently collected location tag, or three fingerprint features that match the currently collected location tag, all of which can indicate that the mobile phone is currently near the subway gate, and the mobile phone can perform the first action, that is, the display includes The display interface of "Subway Ride Code".

Step 404: Determine whether the matching degree is greater than a preset matching threshold. If the matching degree is greater than the preset matching threshold, step 405 is performed; if the matching degree is less than or equal to the preset matching threshold, step 406 is performed.

Wherein, the matching degree is greater than the preset matching threshold, indicating that the specific position of the mobile phone in the first position is the preset area indicated by the fingerprint database.

If the matching degree is less than or equal to the preset matching threshold, it means that the current specific location of the mobile phone does not match the preset area indicated by the fingerprint database. When the user moves the mobile phone in the first position, the specific position of the mobile phone in the first position changes, so that the position label collected by the mobile phone changes. At this time, the mobile phone can also obtain the location label in real time, and if the information in the location label is updated, the location label is updated. It can be understood that when the location tag of the mobile phone is updated, the mobile phone can perform step 403 again.

It is worth mentioning that, in a possible implementation, the mobile phone may also perform step 405 when the matching degree is greater than or equal to the preset matching threshold, and perform step 406 when the matching degree is less than the preset matching threshold.

Step 405: It is determined that the mobile phone is in a preset area in the first position, and the mobile phone performs the first action.

It can be understood that when it is determined that the mobile phone is in the preset area of the first position, and the mobile phone has a high probability of performing the first action when the mobile phone is in the preset area of the first position, the mobile phone performs the first action. In order to provide users with a good experience.

Step 406: No response.

The mobile phone is determined to be in the first position, but the mobile phone is not in the preset area. The mobile phone does not need to perform the first action. In this case, the mobile phone does not need to send a response according to the current position (eg, perform the first action), and the mobile phone does not respond.

Taking the scenario shown in FIG. 6 as an example, when the mobile phone is determined to be in the first subway station and the mobile phone is in the first area 50, after recognizing the user's operation, the mobile phone displays an interface including "subway boarding code". Based on the recognition of the mobile phone and the successful scanning of the "subway bus code", the user is instructed to carry the mobile phone through the subway gate. At this time, the mobile phone reports the currently collected location tag and the behavior of the mobile phone performing the first action (ie, displaying the interface including the "subway boarding code") to the cloud server. The cloud server can generate the fingerprint database of the first location according to the data reported by the mobile phone. The fingerprint database includes fingerprint features, and the fingerprint features are generated according to the position label of the first position.

In addition, when the mobile phone is in the first position, the mobile phone can obtain the fingerprint database of the first position from the cloud server. At the same time, the mobile phone obtains the current location label, matches the location label with the fingerprint features in the fingerprint database, and determines the area of the current first location of the mobile phone, and then executes the first action. For example, when the mobile phone is in the first position 10 (or the second position 20 ), the location label obtained by the mobile phone has a low degree of matching with the fingerprint features in the fingerprint database, indicating that the location label does not match the fingerprint database and the mobile phone does not respond. When the mobile phone is in the area of the first area 50, the mobile phone updates the location label, and matches the fingerprint feature in the fingerprint database here. The matching degree between the location label and the fingerprint feature in the fingerprint database is higher than the preset matching threshold, indicating that the location label and If the fingerprint database matches, the mobile phone performs the first action.

It should be understood that when the mobile phone is in the first position, the mobile phone can detect the location tag in the first area 50 and report the data to the cloud server; the mobile phone can also detect the location tag in the second area 51 and report the data to the cloud server.

Wherein, the first location may also be a beverage store (eg, a coffee shop), a bus station, a restaurant, a residential area, an office space, and the like. It should be noted that in the above scenario, the first location is the first subway station as an example. The first subway station is a public place. When the user is at the first subway station close to the subway gate, there is a high probability that the user wants to enter. station or exit. When the mobile phone determines that it is currently at the position of the first subway station close to the gate, the first action is performed, which can simplify the user's operation and provide convenience for the user. For specific public places, such as beverage shops, restaurants, residential quarters and office places, the mobile phone stores its specific membership card or access control card in these places, and the mobile phone only has the first action corresponding to these places. For example, the first location is a beverage shop. When the mobile phone is close to the cashier of the beverage shop, and the mobile phone determines that the user has consumption needs, the first action is to display the electronic membership card of the beverage shop on the mobile phone; the mobile phone has the electronic access card of the residential area or office. , the first location is the residential area or office. When the mobile phone is close to the access control machine in the residential area or office, and the mobile phone determines that the user needs to pass the residential area or office access control, the first action is to display the residential area or office. electronic access card.

It is understandable, but there is no membership card or electronic access card in these places in the mobile phone, so the mobile phone does not need to determine the corresponding relationship between the first position and the first action, that is, the mobile phone will not perform the first action in these places.

For example, in a mobile phone with NFC function, the company's access control card, community access control card and bus card are pre-stored. When the mobile phone is located in the company, the mobile phone obtains the location label corresponding to the company's location, and obtains the fingerprint database corresponding to the company's location from the cloud server. When the mobile phone detects that the current location tag matches the fingerprint database, and determines that the mobile phone is currently near the company's credit card machine, the mobile phone displays the company's access control card (electronic NFC card).

For another example, when the mobile phone is located on the first bus, the mobile phone obtains the location tag corresponding to the first bus, and at the same time, obtains the fingerprint database corresponding to the first bus stop from the cloud server. The mobile phone detects that the location tag matches the fingerprint database, and when the first bus reaches the first stop, the mobile phone updates the location tag. At this time, the mobile phone determines that the location tag matches the fingerprint database, and the mobile phone displays the bus card (electronic NFC card).

It should be understood that if the bus includes a WiFi signal, when the first bus reaches the first bus stop, the WiFi signal in the mobile phone changes and the location tag is updated, so that the mobile phone can match the location tag with the fingerprint database, so that the mobile phone can identify The first bus is the usual bus. Then the mobile phone displays the bus card, so that the user can take the first bus. That is to say, when the mobile phone reports data, it can create a corresponding fingerprint database for the mobile phone user, and recognize the action of scanning the bus code when the mobile phone is at the first bus stop. In order to perform matching calculation when the mobile phone is at the first bus stop, and then determine the bus that the user is about to take.

In other implementations, for example, the first location is a beverage store (or other consumption place), and the first action performed by the mobile phone when it is determined to be in the first location is to display the beverage store membership card. In this way, when the mobile phone detects that it is in the first position (ie, the beverage shop), the mobile phone can display the preferential information of the beverage shop.

It can be understood that in the method provided by the present application, the electronic device does not need to add additional auxiliary equipment, and the electronic device can report data to the cloud server, so that the cloud server builds a fingerprint database for the first position according to the data. Other terminals can obtain the fingerprint database of the cloud server, so that when the terminal receives the fingerprint database, it can determine the preset area of other terminals in the first position by matching, so that the mobile phone can perform the first action.

It is worth mentioning that, when the electronic device reports data, the electronic device can determine the confidence level of the first position and the first action according to the sensor, the display screen, and the like. The electronic device may associate the first position with the first action, and report the association to the cloud server. Secondly, when the cloud server generates the fingerprint database of the first location, it needs to perform data mining processing on a large amount of data according to the data uploaded by multiple terminals, so as to reduce the influence of noisy data on fingerprint characteristics, and obtain Fingerprint feature of the first location.

In one implementation, the mobile phone can sense the user's behavior of scanning the subway boarding code to pass through the subway gate, and the mobile phone can automatically collect the wifi/cell/light intensity/satellite information of the location and tag it with the truth value and upload it to the cloud server , the cloud side learns and updates the location fingerprint database. Further, in the follow-up, the mobile phone can download the latest location fingerprint database from the cloud side, and regularly obtain the wifi/cell/light intensity/satellite information of the user's location to match the fingerprint database. If the matching is successful, it can be recognized as the user at the subway gate. Nearby, so that the mobile phone can automatically pop up the subway boarding code for the user to quickly swipe the code to pass the gate.

Exemplarily, when the mobile phone determines the wifi/cell/light intensity/satellite information of the current location, a machine learning model can be used to calculate whether the current location is close to the subway gate. The method flow is shown in FIG. 5 , and the method includes steps 501 to 505 .

Step 501: The mobile phone is at the first subway station, and obtains the wifi/cell/light intensity/satellite information of the first subway station.

Step 502: Calculate the distance between the mobile phone and the subway gate in the first subway station based on the preset machine learning model.

Among them, the mobile phone uses the wifi/cell/light intensity/satellite information collected in real time and the wifi/cell/light intensity/satellite information corresponding to the preset first subway station as the input of the machine learning model, and obtains the output of the machine learning model. result. The output result is used to indicate the distance between the current location of the mobile phone and the subway gate.

Step 503: Determine whether the distance value is greater than the preset distance value. If yes, go to step 504; otherwise, go to step 505.

Step 504: It is determined that the mobile phone is near the subway gate of the first subway station, and the first action is performed.

Step 505: No response.

In the above, the electronic device is a mobile phone as an example to describe the method provided by the embodiment of the present application. When the electronic device is another device, the above method may also be used. It will not be repeated here.

It can be understood that, in order to realize the above-mentioned functions, the electronic device provided by the embodiments of the present application includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should be easily aware that, in conjunction with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Experts may use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of the embodiments of the present application.

In this embodiment of the present application, the electronic device may be divided into functional modules according to the foregoing method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.

An embodiment of the present application further provides a chip system. As shown in FIG. 7 , the chip system includes at least one processor 601 and at least one interface circuit 602 . The processor 601 and the interface circuit 602 may be interconnected by wires. For example, the interface circuit 602 may be used to receive signals from other devices, such as the memory of an electronic device. As another example, the interface circuit 602 may be used to send signals to other devices (eg, the processor 601). Exemplarily, the interface circuit 602 may read the instructions stored in the memory and send the instructions to the processor 601 . When the instructions are executed by the processor 601, the electronic device can be caused to perform the various steps in the above embodiments. Certainly, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.

Embodiments of the present application further provide a computer storage medium, where the computer storage medium includes computer instructions, when the computer instructions are executed on the above-mentioned electronic device, the electronic device is made to perform various functions or steps performed by the mobile phone in the above-mentioned method embodiments .

Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, enables the computer to perform various functions or steps performed by the mobile phone in the above method embodiments.

From the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated by Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

The above contents are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

A scene recognition method, comprising:

It is detected that the electronic device enters the first area;

After it is detected that the electronic device enters the first area, a location label corresponding to the first location when the electronic device is located at the first location in the first area is detected, and the location label represents the location label obtained by the electronic device in the current location environmental information, the first location is within the first area;

Compare the position label with the position information corresponding to the preset position, and obtain a comparison result, wherein the preset position information represents the environmental information of the electronic device in the preset scene of the first position, and the preset position information Set the location within the first area;

If the comparison result indicates that the location label matches the location information corresponding to the preset location, triggering the electronic device to automatically execute a first action corresponding to the first location, where the first action includes the electronic device The device runs the first application and displays a first interface, wherein the first interface includes a two-dimensional code;

Wherein, there is a preset logical relationship between the first action and the first position;

The location label includes: addresses of all the first WIFI sites collected by the electronic device, and the signal strength of each of the first WIFI sites, the first cell identifier obtained by the electronic device, and each of the first WIFI sites. at least one of the signal intensity of the first cell identifier and the first light intensity collected by the electronic device;

The preset location information includes: addresses of all second WIFI sites collected by the electronic device, and signal strength of each of the second WIFI sites, the second cell identifier obtained by the electronic device, and at least one of the signal intensity of each of the second cell identifiers, and the second light intensity collected by the electronic device;

The location information corresponding to the preset location is generated according to a location tag collected when the electronic device executes a first event in response to a user operation after the electronic device enters the first area;

The electronic device performs a first event in response to a user operation, including:

The electronic device receives a first operation input by a user, where the first operation is used to instruct the electronic device to run the first application;

In response to the first operation, the electronic device runs the first application and displays the first interface, wherein the first interface includes a two-dimensional code.
The method according to claim 1, wherein the electronic device performs the first event in response to a user operation, further comprising:

After the electronic device displays the first interface, the user's grip and flip operation is received, and the grip and flip operation causes the display screen of the electronic device to turn to face the code swiping port; or,

The electronic device further displays a second interface after displaying the first interface, and the second interface indicates that the scan code is successful.
The method according to claim 1 or 2, wherein the location information corresponding to the preset location is based on the electronic device executing a first event in response to a user operation after the electronic device enters the first area The collected location labels are generated, including:

After the electronic device enters the first area, the confidence level of the electronic device executing the first event is obtained, where the confidence level represents the execution degree of the user operation triggering the execution of the first event, wherein the first event is related to the The first action is associated, and the electronic device runs the first application when the electronic device executes the first event;

When the confidence level indicates that the first event is executed or successfully executed, a location tag currently collected by the electronic device is acquired, and the location tag represents the environmental information acquired by the electronic device in the current place;

The electronic device generates the position information corresponding to the preset position according to the position tag, or the electronic device transmits the position tag to the cloud server, so that the cloud server generates the preset position according to the position tag corresponding location information.
The method according to claim 1 or 2, wherein the location information corresponding to the preset location is based on the electronic device executing a first event in response to a user operation after the electronic device enters the first area The collected location labels are generated, including:

After it is detected that the electronic device enters the first area, the confidence level of the electronic device executing the first event is obtained, and the confidence level represents the execution degree of the user operation triggering the execution of the first event, wherein the first event is related to the execution of the first event. The first action is associated, and the electronic device runs the first application when the electronic device executes the first event;

When the confidence level indicates that the execution of the first event is completed, the execution result of the first event is obtained, and the execution result is checked to obtain a check result;

If the verification result indicates that the first event is successfully executed, obtain a location label currently collected by the electronic device, where the location label represents the environmental information obtained by the electronic device in the current location;

The electronic device generates the position information corresponding to the preset position according to the position tag, or the electronic device transmits the position tag to the cloud server, so that the cloud server generates the preset position according to the position tag corresponding location information.
The method according to any one of claims 1-4, characterized in that, before the comparing the location label with the location information corresponding to the preset location and obtaining the comparison result, the method further comprises:

The electronic device acquires position information corresponding to the electronic device at the preset position.
The method according to claim 3 or 4, wherein, when the confidence level indicates that the execution of the first event ends, comprising:

If it is determined that the confidence level is greater than a first preset threshold and less than or equal to a second preset threshold, it is determined that the electronic device starts to execute the first event; if it is determined that the confidence level is greater than the second preset threshold , determining that the electronic device completes the execution of the first event, wherein the first preset threshold is smaller than the second preset threshold.
The method according to claim 4, wherein the execution result includes a current display interface of the electronic device.
The method according to any one of claims 1-7, wherein if the location tag includes: addresses of all the first WIFI sites collected by the electronic device, and addresses of each of the first WIFI sites the signal strength, the first cell identifier obtained by the electronic device, and the signal strength of the first cell identifier;

Comparing the location label with the location information corresponding to the preset location to obtain a comparison result, including:

generating a first item set including the first WIFI station and the first cell identifier based on the location tag;

generating a second item set including the second WIFI station and the second cell identifier based on the location information corresponding to the preset location;

According to the first item set and the second item set, a comparison result of the position label and the position information corresponding to the preset position is calculated and obtained.
The method according to any one of claims 1-7, wherein, if the location label includes: a first cell identifier obtained by the electronic device, and a signal strength of the first cell identifier;

Comparing the location label with the location information corresponding to the preset location to obtain a comparison result, including:

Compare the first cell identification with the second cell identification, and obtain a comparison result; wherein, if the first cell identification and the second cell identification are the same, the comparison result indicates that the location label is the same as the second cell identification. The preset location information is consistent; if the first cell identifier is different from the second cell identifier, the comparison result indicates that the location label does not correspond to the preset location information.
The method according to any one of claims 1-9, wherein the two-dimensional code is a subway ride code or a two-dimensional code related to a health condition, a two-dimensional code related to a membership card, or a two-dimensional code related to a coupon. dimensional code.
The method according to any one of claims 3-10, wherein the acquiring a confidence level of the electronic device executing the first event comprises:

After the electronic device runs a first application in response to the first operation and displays the first interface, the electronic device acquires the first interface;

The electronic device identifies the first interface, and obtains a first identification result;

The electronic device determines the confidence level of the first event according to the first recognition result;

The electronic device acquires the current display interface every first preset time period, and determines the confidence level of the first event according to the current display interface.
The method according to any one of claims 3-10, wherein the acquiring a confidence level of the electronic device executing the first event comprises:

After the electronic device receives the user's grip and flip operation, after a second preset time period, the electronic device acquires the current display interface;

The electronic device identifies the current display interface, and obtains a second identification result;

The electronic device determines a confidence level of the first event according to the second recognition result.
An electronic device, comprising:

one or more processors; a memory in which code is stored; a touch screen for detecting touch operations and displaying an interface;

When executed by the one or more processors, the code causes the electronic device to perform the scene recognition method of any one of claims 1-12.