CN115390934A

CN115390934A - Method and terminal for opening function of back module

Info

Publication number: CN115390934A
Application number: CN202110553528.1A
Authority: CN
Inventors: 唐建中
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-05-20
Filing date: 2021-05-20
Publication date: 2022-11-25

Abstract

The present application provides a method of opening a function of a back module; the method relates to the technical field of electronics, and the conditions for triggering the opening of the corresponding functions of the back module are set through the use habits of a user when the user uses the corresponding functions of the back module of the electronic equipment. The back module corresponding function can be conveniently opened for the user under the condition that the use habit of the user is met, and the man-machine interaction performance between the terminal and the user is improved. The method is applied to a terminal, a back module is arranged on the back of the terminal and used for realizing a first function, and the method comprises the following steps: detecting the state of a terminal; and if the state of the terminal is detected to meet a first condition, starting a first function, wherein under the first condition, the back orientation of the terminal is changed.

Description

Method and terminal for opening function of back module

Technical Field

The present application relates to the field of electronic technologies, and in particular, to a method and a terminal for opening a function of a back module.

Background

With the progress of society and the improvement of living standard of people, people can contact more articles in daily life and work. These items are of a wide variety and once some are lost, they are difficult to retrieve. In some aspects, the item may be located by an electronic device. At present, an Ultra Wide Band (UWB) tag can be fixed on an object to be positioned, and an electronic device can detect a signal sent by the UWB tag on the object to detect the position of the object.

In order to detect UWB tag signals, the mobile phone must first turn on the UWB function. At present, a user needs to start a UWB function through a related application program of a mobile phone, and after the UWB function is started, the mobile phone can realize positioning, ranging and the like of a UWB tag. In this way, the user needs to find the application program for controlling the start of the UWB function among the application programs, so that the user cannot find the target application program quickly, that is, cannot start the UWB function quickly, and the man-machine interaction performance is poor.

Disclosure of Invention

The application provides a method and a terminal for opening a back module, which can simplify user operation when the terminal opens corresponding functions of the back module, improve human-computer interaction performance of the terminal and further improve user experience.

In a first aspect, the present application provides a method for opening a function of a back module, where the method is applied in a terminal, the back module is disposed on a back of the terminal, and the back module is used to implement a first function, and the method includes: detecting the state of a terminal; and if the state of the terminal is detected to meet a first condition, starting a first function, wherein under the first condition, the back orientation of the terminal is changed.

According to the technical scheme of the embodiment of the application, a first condition can be set, and the electronic equipment considers that the back orientation of the electronic equipment is changed when the state of the electronic equipment meets the first condition. Then, based on the usage habit of adjusting the back orientation when the user uses the corresponding function of the back module of the electronic device, the electronic device reversely deduces that the user wants to use the corresponding function of the back module when the back orientation of the electronic device changes. Based on this, the electronic device may set the first condition as a condition that triggers opening of the corresponding function of the back module. Subsequently, when the electronic device detects that the state of the electronic device meets a first condition (indicating that the back of the electronic device changes), the electronic device triggers to start a corresponding function of the back module.

Therefore, in the embodiment of the application, the first condition for triggering and opening the corresponding function of the back module can be set based on the use habit of adjusting the back orientation when the user uses the corresponding function of the back module, the memory cost of the user is not required to be increased, the user can operate the electronic equipment as the back module is used for corresponding the function, and the electronic equipment can conveniently open the corresponding function of the back module for the user.

In one possible design, after detecting that the state of the terminal satisfies a first condition, before turning on the first function, the method further includes:

displaying a first control, wherein the first control is used for prompting a user whether to start a first function;

the turning on the first function includes: and when the preset operation of the user on the first control is detected, starting the first function.

Through this scheme, can indicate the user whether to open the function that the back module corresponds to just open this function when the user instructs to open the back module and correspond the function, reduced user's maloperation and leaded to opening the probability that the back module corresponds the function, reduced the consumption of back module.

In a possible design, if a preset operation of the first control by a user is not detected within a preset time period after the first control is displayed, the display of the first control is stopped, or the display size of the first control is reduced.

According to the scheme, the shielding of the first control on other contents on the display screen can be avoided or reduced under the condition that the user does not start the corresponding function of the back module, and the man-machine interaction performance is improved.

In one possible design, the first condition may include any one or a combination of conditions: the terminal is lifted by a user; the terminal is lifted by a user for a first preset number of times; the terminal is lifted by a user for a second preset number of times within a preset time length; the terminal is lifted by a user, and the speed of lifting the terminal by the user is greater than a threshold value; the terminal is lifted by a user, and a first included angle formed between a screen of the terminal and a horizontal plane is within a first preset included angle range after the terminal is lifted.

Through the scheme, the use habit of back pointing can be adjusted in the process of using the corresponding function of the back module by the user, and the lifting gesture (corresponding to the adjustment of the back pointing) used by the user in the process of using the corresponding function of the back module is used as the gesture for triggering the opening of the corresponding function of the back module, so that the memory cost of the user is not increased.

Taking the back module as the UWB module as an example, a user can operate the electronic device like using the UWB function according to a usage habit, for example, the user can perform an operation such as lifting the electronic device, and the electronic device can conveniently turn on the UWB function for the user.

Moreover, the UWB function is started through the lifting gesture, so that the trouble caused by searching and opening the application for starting the UWB function from a plurality of application programs can be avoided, and the user operation of the terminal for starting the UWB function can be simplified.

In one possible design, the back module comprises any one or combination of more of the following: an ultra-wideband UWB module and a camera module; the first function comprises any one or a combination of more than one of the following functions: UWB functionality, camera functionality, augmented reality AR functionality, virtual reality VR functionality;

wherein the UWB module corresponds to the UWB function, and the camera module corresponds to the camera function and/or the AR function and/or the VR function.

In one possible design, the first functions that are enabled are different when the state of the terminal satisfies different first conditions. Or, if the state of the terminal is detected to satisfy the second condition, the second function is started.

The second function comprises any one or a combination of more of the following functions: UWB functionality, camera functionality, augmented reality AR functionality, virtual reality VR functionality.

The second condition comprises any one or more of the following conditions: the terminal is lifted by a user; the terminal is lifted by the user for a third preset number of times; the terminal is lifted by a user for a fourth preset time within a certain time length; the terminal is lifted by a user, and the speed of lifting the terminal by the user is greater than a threshold value; the terminal is lifted by a user, and an included angle formed between a screen of the terminal and the horizontal plane is within a third preset included angle range after the terminal is lifted.

Wherein the second function is different from the first function. The second condition is different from the first condition.

Illustratively, different numbers of lifts correspond to different back module functions being turned on. For example, detecting that the terminal is lifted up once (an example of a first condition) corresponds to turning on the camera function (an example of a first function), detecting that the terminal is lifted up twice (an example of a second condition) corresponds to turning on the UWB function (an example of a second function).

In one possible design, detecting the state of the terminal includes: detecting a state of the terminal using a machine learning model. Through the machine learning mode, the accuracy of state detection can be promoted.

In one possible design, the changing the orientation of the back of the terminal includes: and an included angle between a plane where the back of the terminal is located and the horizontal plane is changed from a first included angle to a second included angle, wherein the first included angle is smaller than the second included angle, and the second included angle is within a second preset included angle range.

In one possible design, prior to displaying the first control, the method further includes: detecting whether the terminal is held by a single hand of a user;

displaying a first control comprising: and if the terminal is detected to be held by the left hand of the user, displaying the first control in the left area of the display screen, and if the terminal is detected to be held by the right hand of the user, displaying the first control in the right area of the display screen.

Through the scheme, the terminal can display related controls in the area convenient for the user to operate, and the user can conveniently control and open the corresponding function of the back module through the corresponding controls when holding the terminal with one hand.

In a second aspect, the present application provides a terminal comprising a back module disposed on a back, the back module being configured to implement a first function, the terminal comprising:

the processing module is used for detecting the state of the terminal; and if the state of the terminal is detected to meet a first condition, starting the first function, wherein under the first condition, the back orientation of the terminal is changed.

In one possible design, the terminal further includes:

the display module is used for displaying a first control, and the first control is used for prompting a user whether to start a first function or not;

the input module is used for receiving the preset operation of a user on the first control;

the processing module is used for starting the first function and comprises: and the first function is started when the preset operation of the user on the first control through an input module is detected.

In a possible design, the display module is further configured to stop displaying the first control or reduce a display size of the first control if a preset operation of the user on the first control is not detected within a preset time period after the first control is displayed.

In one possible design, the back module comprises any one or combination of more of the following: a UWB module and a camera module; the first function comprises any one or a combination of more than one of the following functions: an ultra wideband UWB function, a camera function, an augmented reality AR function, a virtual reality VR function;

In one possible design, the first functions that are enabled are different when the state of the terminal satisfies different first conditions.

In one possible design, the processing module is configured to detect a state of the terminal, and includes: detecting a state of the terminal using a machine learning model.

In a third aspect, the present application provides a terminal comprising a processor and a memory, said memory being configured to store computer program code, said computer program code comprising computer instructions which, when executed by said processor, perform the method according to any one of the possible designs of the first aspect of the present application.

In a fourth aspect, the present application provides a computer-readable storage medium including computer instructions which, when executed on a terminal, cause the terminal to perform the method according to any one of the possible designs of the first aspect of the present application.

In a fifth aspect, the present application provides a computer program product for causing a computer to perform the method according to any one of the possible designs of the first aspect of the present application when the computer program product runs on the computer.

Drawings

Fig. 1 illustrates a UWB ranging principle provided in the present application;

fig. 2-1 is a schematic structural diagram of a terminal provided in the present application;

fig. 2-2 is a schematic back-side view of a terminal according to the present disclosure;

fig. 2-3 are schematic diagrams of software architectures of a terminal provided in the present application;

FIG. 3-1 is a flow chart of a method for recognizing user gestures provided herein;

3-2, 3-3 are schematic diagrams of one type of sensor data provided herein;

4-1-12 are schematic diagrams of example scenarios provided herein;

fig. 13 is a schematic structural diagram of a terminal provided in the present application;

fig. 14 is a chip system provided in the present application.

Detailed Description

First, the technology and technical terms related to the embodiments of the present application will be described.

UWB: UWB belongs to near field wireless communication technology, similar to bluetooth, wi-Fi, near Field Communication (NFC), and the like. The UWB technology may have an ultra-large bandwidth of 500MHz or more, and the operating frequency band may be between 3.1GHz to 10.6GHz, so that a crowded low frequency band may be avoided, and then a relatively stable and high-speed data transmission may be generally achieved. In addition, the signals transmitted by the devices in the UWB technology are not sine waves in general, but can transmit ultra-short pulse signals in the nanosecond or picosecond level, so that the power consumption of the UWB technology can be low. The low power consumption characteristic makes UWB convenient to be used as indoor range finding location, communication connection etc..

In the embodiments of the present application, signals transmitted and received by devices in UWB technology are collectively referred to as UWB signals. Electronic devices using UWB technology are collectively referred to as UWB devices. The UWB device is generally provided with a UWB module for implementing functions such as ranging and positioning, communication connection, and the like. Objects carrying or equipped with UWB modules, such as UWB tags, are collectively referred to as UWB objects. For example, the UWB module is hung on a key, which may be referred to as a UWB object.

After the user turns on the bluetooth function of the bluetooth device (for example, turns on the bluetooth switch shown in fig. 1), the bluetooth device scans the bluetooth signals of the surrounding bluetooth devices, and after the user turns on the UWB function on the electronic device, the electronic device may scan the UWB signals of the devices that also turn on the UWB function, and may determine the positions of the other devices according to the scanned UWB signals. The principle of UWB-based positioning of electronic devices is described below.

As one example, the electronic device may be positioned based on time of flight (TOF) techniques. Taking UWB devices as a mobile phone 1 and a mobile phone 2, respectively, as shown in fig. 1 (a), the mobile phone 1 may transmit a UWB signal through a UWB module, and the mobile phone 2 receives the UWB signal through the UWB module. The UWB signal transmission/reception timing is shown in fig. 1 (b). Then, the time of flight TTOF =1/2 (TTOT-TTAT) of the UWB signal. The handset 2 can calculate the distance to the handset 1 from the time of flight.

It should be noted that the electronic device is located based on UWB technology, and is not limited to being located based on time of flight, and other locating manners may be used, such as time difference of arrival (TDOA) location, angle of arrival (AOA) location, direction of arrival (DOA) location, or a combination of these manners. Furthermore, time-of-flight based positioning may also be a Two-way (Two-way) time-of-flight positioning or the like.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, the meaning of "a plurality" is two or more unless otherwise specified.

The embodiment of the application provides a method for opening a back module and a terminal, and the method can be applied to the process that the terminal starts the UWB function. Specifically, the method comprises the following steps. The terminal may detect a state of the terminal including, but not limited to, a state in which the terminal is held by a user. Taking the state that the terminal is held by the user as an example, when detecting that the state that the terminal is held by the user is changed according with the preset condition, the UWB function is started. The UWB function is started in the state that the terminal automatic detection terminal is held by a user, so that the user operation of the terminal when the UWB function is started can be simplified, the man-machine interaction performance of the terminal is improved, and the user experience can be further improved.

The terminal comprises a sensor, and the sensor is used for detecting the state of the terminal. The state of the terminal may be, for example but not limited to, the terminal being lifted at least once. The terminal may be a mobile phone (e.g., the mobile phone 100 shown in fig. 2-1), a tablet computer, etc., and the specific form of the device is not particularly limited in this application.

The execution subject of the method provided by the embodiment of the present application may be an apparatus for executing the method, and the apparatus of the method is, for example, the mobile phone 100 shown in fig. 2-1; or, the device of the method may also be a Central Processing Unit (CPU) of the terminal, or a control module in the terminal for executing the method. In the embodiment of the present invention, a method for a terminal to execute the embodiment of the present invention is taken as an example to describe a technical solution provided by the embodiment of the present application.

As shown in fig. 2-1, taking the mobile phone 100 as the terminal for example, the mobile phone 100 may specifically include: processor 101, radio Frequency (RF) circuitry 102, memory 103, touch screen 104, bluetooth device 105, one or more sensors 106, wi-Fi device 107, positioning device 108, audio circuitry 109, peripheral interface 110, and power supply 111. These components may communicate over one or more communication buses or signal lines (not shown in fig. 2-1). Those skilled in the art will appreciate that the hardware configuration shown in fig. 2-1 is not intended to be limiting, and that the handset 100 may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The various components of the handset 100 are described in detail below with reference to fig. 2-1:

the processor 101 is a control center of the cellular phone 100, connects various parts of the cellular phone 100 using various interfaces and lines, and performs various functions of the cellular phone 100 and processes data by running or executing an application program stored in the memory 103 and calling data stored in the memory 103. In some embodiments, processor 101 may include one or more processing units. For example: the processor 101 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

In some embodiments of the present application, the processor 101 may include a Micro Control Unit (MCU), where the MCU may run a screen-off detection algorithm, and the screen-off detection algorithm may detect a gesture of a user in a screen-off state, and control to start the UWB function if a preset gesture is detected, for example, a gesture that the user lifts up the mobile phone at least once.

The rf circuit 102 may be used for reception and transmission of wireless signals. In particular, the rf circuit 102 may receive downlink data of the base station and then process the received downlink data to the processor 101; in addition, data relating to uplink is transmitted to the base station. In general, radio frequency circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency circuitry 102 may also communicate with other devices via wireless communication. The wireless communication may use any communication standard or protocol including, but not limited to, global system for mobile communications, general packet radio service, code division multiple access, wideband code division multiple access, long term evolution, and the like.

The memory 103 is used for storing application programs and data, and the processor 101 executes various functions and data processing of the mobile phone 100 by running the application programs and data stored in the memory 103. The memory 103 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, and application programs (such as a sound playing function and an image playing function) required by at least one function; the storage data area may store data (e.g., audio data, a phonebook, etc.) created from use of the handset 100. In addition, the Memory 103 may include a high speed Random Access Memory (RAM), and may also include a nonvolatile Memory such as a magnetic disk storage device, a flash Memory device, or other volatile solid state storage device. The memory 103 may store various operating systems. The memory 103 may be independent and connected to the processor 101 through the communication bus; the memory 103 may also be integrated with the processor 101.

The touch screen 104 may specifically include a touch pad 104-1 and a display 104-2.

Wherein the touch pad 104-1 can capture touch events of a user of the cell phone 100 on or near the touch pad 104-1 (e.g., operations of the user on or near the touch pad 104-1 using any suitable object such as a finger, a stylus, etc.) and transmit the captured touch information to other devices (e.g., the processor 101). Among them, a touch event of a user near the touch pad 104-1 can be called a hover touch; hover touch may refer to a user not having to directly contact the touchpad in order to select, move, or drag a target (e.g., an icon, etc.), but rather only having to be in proximity to the device in order to perform a desired function. In addition, the touch pad 104-1 can be implemented by various types, such as resistive, capacitive, infrared, and surface acoustic wave.

Display (also referred to as a display screen) 104-2 may be used to display information entered by or provided to the user as well as various menus for handset 100. The display 104-2 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The trackpad 104-1 may be overlaid on the display 104-2, and when the trackpad 104-1 detects a touch event thereon or nearby, it is communicated to the processor 101 to determine the type of touch event, and the processor 101 may then provide a corresponding visual output on the display 104-2 based on the type of touch event.

It should be noted that although in fig. 2-1, the touch pad 104-1 and the display screen 104-2 are shown as two separate components to implement the input and output functions of the mobile phone 100, in some embodiments, the touch pad 104-1 and the display screen 104-2 may be integrated to implement the input and output functions of the mobile phone 100. It is understood that the touch screen 104 is formed by stacking multiple layers of materials, and only the touch pad (layer) and the display screen (layer) are shown in the embodiment of the present application, and other layers are not described in the embodiment of the present application. In addition, the touch pad 104-1 may be disposed on the front surface of the mobile phone 100 in a full panel manner, and the display screen 104-2 may also be disposed on the front surface of the mobile phone 100 in a full panel manner, so that a frameless structure can be realized on the front surface of the mobile phone.

In addition, the mobile phone 100 may also have a fingerprint recognition function. For example, the fingerprint identifier 112 may be disposed on the back side of the handset 100 (e.g., below the rear facing camera), or the fingerprint identifier 112 may be disposed on the front side of the handset 100 (e.g., below the touch screen 104). As another example, the fingerprint identifier 112 may be configured in the touch screen 104 to implement the fingerprint identification function, i.e., the fingerprint identifier 112 may be integrated with the touch screen 104 to implement the fingerprint identification function of the handset 100. In this case, the fingerprint recognizer 112 is disposed in the touch screen 104, may be a part of the touch screen 104, or may be disposed in the touch screen 104 in other manners. The primary component of fingerprint identifier 112 in the present embodiment is a fingerprint sensor, which may employ any type of sensing technology, including but not limited to optical, capacitive, piezoelectric, or ultrasonic sensing technologies, among others.

The handset 100 may also include a bluetooth device 105 for enabling data exchange between the handset 100 and other short-range devices (e.g., cell phones, smart watches, etc.). The bluetooth device in the embodiment of the present application may be an integrated circuit or a bluetooth chip.

In the embodiment of the present application, the mobile phone 100 may further include a UWB device 115, or UWB module. UWB device 115 may be used to enable data exchange between cell phone 100 and other short-range devices, such as cell phones, smart watches, and the like. The UWB device in the embodiment of the present application may be an integrated circuit or a UWB chip or the like. The signals transceived by the UWB device 115 may be ultra-short pulse signals, thus enabling lower power consumption. Based on the characteristic of low power consumption of the UWB module, the UWB module can be suitable for scenes such as indoor distance measurement positioning and the like.

The UWB module may be located on the bezel, the back of the electronic device, etc. The specific layout position of the UWB module is not limited in the embodiments of the application. In the embodiment of the application, the gesture which can open the UWB module with the part layout and further realize the UWB function can be set based on the layout position of the UWB module in the electronic equipment. In a possible design, the UWB module is laid out on the back, considering that the electronic device needs to call the UWB module to implement the UWB function, in order to improve the communication performance of the UWB module, when the user uses the UWB function, the back of the electronic device may be generally directed to another UWB device (such as a mobile phone integrated with a UWB chip) or a UWB object (such as a key carrying the UWB module), so that the other UWB device or the UWB object can be within the signal coverage range of the UWB module on the back of the electronic device, and then the UWB module laid out on the back can conveniently communicate with the UWB module of the other UWB device or the UWB object. Taking fig. 2-2 as an example, in (a) of fig. 2-2, the back of the mobile phone 2 faces the ground and does not face the mobile phone 1, so that the UWB signal of the mobile phone 2 may not cover the mobile phone 1, and the UWB signal of the mobile phone 1 may also not cover the mobile phone 2, so that the

mobile phones

2 and 1 may not search for the UWB signal of the other party, and the

mobile phones

1 and 2 may not establish communication connection through the UWB function. In order to improve the UWB performance of the mobile phone, when the user uses the mobile phone, the mobile phone may be generally lifted for use, for example, as shown in (b) of fig. 2-2, the user lifts the mobile phone 2, so that the included angle θ between the back of the mobile phone and the horizontal plane is greater than a certain included angle, and thus, the UWB signal of the UWB module at the back of the mobile phone 2 may generally cover the mobile phone 1, and correspondingly, the UWB signal of the mobile phone 1 also falls within the receiving coverage range of the mobile phone 2, so that the mobile phone 1 and the mobile phone 2 may perform UWB communication normally. Therefore, the user often adjusts the pointing direction of the back of the mobile phone during the use of the UWB function.

In this embodiment of the application, the electronic device may set a certain condition, and consider that when the state of the electronic device satisfies a certain condition (i.e., a first condition), for example, when the electronic device is lifted by a user (i.e., the user inputs a lifting gesture to the electronic device), the back direction of the electronic device changes, and then, according to a usage habit that the user adjusts the back direction of the mobile phone during using the UWB function, the electronic device may determine that the user is likely to want to use the UWB function according to the change of the back direction of the electronic device. Based on this, the electronic device may set the raise gesture to a gesture that triggers turning on UWB functionality. Subsequently, when the electronic device detects that the electronic device is lifted by a certain angle by a user, the UWB function is triggered to be started. Therefore, in the embodiment of the application, the lifting gesture used by the user in the process of using the UWB function can be used as the gesture for triggering the opening of the UWB function based on the use habit of the user using the UWB function, the memory cost of the user is not required to be increased, the user can operate the electronic device like using the UWB function, for example, the user can perform the operation such as lifting the electronic device, and the electronic device can conveniently open the UWB function for the user.

Based on the same principle, the electronic device can also set a lift gesture as a gesture to turn on other back module (such as a camera) functions. For example, when the electronic device is considered to be lifted by the user, the back pointing direction of the electronic device changes, and then, based on the usage habit of adjusting the back pointing direction of the electronic device when the user uses the camera function (for example, the back pointing direction of the electronic device changes when the photographing angle is adjusted), the electronic device may determine that the user is likely to use the camera function according to the change of the back pointing direction of the electronic device. Based on this, the electronic device may set the lift gesture as a gesture that triggers turning on the camera function. Subsequently, when the electronic device detects that the electronic device is lifted by a certain angle by a user, the camera function is triggered to be started.

For another example, based on a usage habit of the user in adjusting the back pointing of the electronic device when using the AR (or VR) function (e.g., the back pointing of the electronic device changes when navigating using the AR (or VR) function of the map software), the electronic device may determine that the user is likely to use the AR (or VR) function according to the change in the back pointing of the electronic device. Based on this, the electronic device may set the raise gesture as a gesture that triggers turning on an AR (or VR) function. Subsequently, when the electronic device detects that the electronic device is lifted by a certain angle by the user, the AR (or VR) function is triggered to be started. In some examples, when the mobile phone performs an AR (or VR) function, such as performing the AR (or VR) function for navigation, the camera may be called by the camera driver, so that real-time road conditions may be photographed to assist navigation.

In some embodiments, different trigger on conditions may also be set for different applications, different functions. Or when the terminal detects different conditions, the opened back module has different functions. Illustratively, within a preset time period, the electronic device detects an operation of lifting the mobile phone once, and correspondingly turns on the camera. And detecting two operations of lifting the mobile phone within a preset time period, and correspondingly starting the UWB function. Further illustratively, the electronic device detects that the angle range for lifting the mobile phone is within the first angle range, and correspondingly starts the AR function or starts the AR application. And the electronic equipment detects that the angle for lifting the mobile phone is within the second angle range, and correspondingly starts the UWB function. The electronic equipment detects that the angle range for lifting the mobile phone is within the third angle range, and correspondingly starts the VR function or starts the VR application. The electronic equipment detects that the angle range for lifting the mobile phone is within the fourth angle range, and correspondingly starts a camera function or camera application. Wherein, optionally, camera application, VR, AR all can call the camera module at cell-phone back.

The embodiment of the present application does not limit the type of the opening function that can be triggered by the hand-raising gesture. As long as the module is arranged on the back of the electronic device, the lifting gesture can be set as a gesture for triggering the opening of the function of the back module according to a similar back pointing principle.

Of course, the gesture for triggering the opening of the back module function may be other gestures besides the lifting gesture as long as the gesture conforms to the usage habit in the process of using the back module function.

The one or more sensors 106 include, but are not limited to, light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display of the touch screen 104 according to the brightness of ambient light, and a proximity sensor that turns off the power of the display when the mobile phone 100 is moved to the ear.

In the embodiment of the present application, as one of the motion sensors, an accelerometer (acc) may detect the magnitude of acceleration in each direction (generally, three axes: x, y, and z axes), may detect the magnitude and direction of gravity when stationary, and may be used for applications of recognizing gestures of a mobile phone (such as horizontal and vertical screen switching, related games, and magnetometer gesture calibration), and related functions of vibration recognition (such as pedometer and tapping).

In the embodiment of the present application, as one of the motion sensors, a gyroscope (Gyro) may be used to determine the motion posture of the electronic apparatus 100. In some embodiments, the angular velocity of the electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by a gyroscope. The gyroscope may be used for camera shake prevention. Illustratively, when the shutter is pressed, the gyroscope detects the shake angle of the electronic device 100, calculates the distance to be compensated for the lens module according to the shake angle, and enables the lens to counteract the shake of the electronic device 100 through reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

Angular velocities of the electronic device 100 about three axes of the gyroscope, etc., may be referred to as 3-axis data of the gyroscope. The magnitude of acceleration in the three axis directions of the accelerometer, etc., may be referred to as 3-axis data of the accelerometer.

In the embodiment of the present application, data collected by sensors such as a gyroscope and an accelerometer may be fused. For example, the data of 3 axes acquired by the accelerometer and the data of 3 axes acquired by the gyroscope are fused to obtain data of 6 axes.

As for other sensors such as barometer, hygrometer, thermometer, infrared sensor, etc. that can be configured on the mobile phone 100, they will not be described in detail herein.

The Wi-Fi device 107 is used for providing network access for the mobile phone 100 according to Wi-Fi related standard protocols, the mobile phone 100 can access to a Wi-Fi hotspot through the Wi-Fi device 107, so that the user can be helped to receive and send e-mails, browse webpages, access streaming media and the like, and wireless broadband internet access is provided for the user. In other embodiments, the Wi-Fi apparatus 107 can also act as a Wi-Fi wireless access point and can provide Wi-Fi network access to other devices.

A positioning device 108 for providing a geographic location for the handset 100. It can be understood that the Positioning device 108 may specifically be a receiver of a Global Positioning System (GPS) or a Positioning System such as the beidou satellite navigation System, russian GLONASS, and the like.

After receiving the geographic location sent by the positioning system, the positioning device 108 sends the information to the processor 101 for processing, or sends the information to the memory 103 for storage. In some other embodiments, the Positioning device 108 may also be an Assisted Global Positioning System (AGPS) receiver that assists the Positioning device 108 in performing ranging and Positioning services by acting as an assistance server, in which case the assistance server provides Positioning assistance by communicating with the Positioning device 108 (i.e., GPS receiver) of the apparatus, such as the handset 100, over a wireless communication network.

In other embodiments, the location device 108 may also be a Wi-Fi hotspot-based location technology. Because each Wi-Fi hotspot has a globally unique Media Access Control (MAC) address, the device can scan and collect the broadcast signals of the surrounding Wi-Fi hotspots under the condition of starting Wi-Fi, and therefore the MAC address broadcasted by the Wi-Fi hotspots can be acquired; the device sends the data (such as the MAC address) capable of identifying the Wi-Fi hotspot to the location server through the wireless communication network, the location server retrieves the geographical location of each Wi-Fi hotspot, and calculates the geographical location of the device according to the strength of the Wi-Fi broadcast signal, and sends the calculated geographical location to the positioning device 108 of the device.

The audio circuitry 109, speaker 113, microphone 114 can provide an audio interface between a user and the handset 100. The audio circuit 109 may transmit the electrical signal converted from the received audio data to the speaker 113, and convert the electrical signal into a sound signal by the speaker 113 for output; on the other hand, the microphone 114 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 109, and outputs the audio data to the RF circuit 102 to be transmitted to, for example, another cellular phone, or outputs the audio data to the memory 103 for further processing.

Peripheral interface 110, which is used to provide various interfaces for external input/output devices (e.g., keyboard, mouse, external display, external memory, SIM card, etc.). For example, the mouse is connected through a Universal Serial Bus (USB) interface, and the SIM card provided by the telecom operator is connected through a metal contact on a SIM card slot. Peripheral interface 110 may be used to couple the aforementioned external input/output peripherals to processor 101 and memory 103.

In this embodiment of the present invention, the mobile phone 100 may communicate with other devices in the device group through the peripheral interface 110, for example, the peripheral interface 110 may receive display data sent by the other devices for displaying, and the like.

The mobile phone 100 may further include a power supply device 111 (such as a battery and a power management chip) for supplying power to each component, and the battery may be logically connected to the processor 101 through the power management chip, so as to implement functions of managing charging, discharging, and power consumption through the power supply device 111.

Although not shown in fig. 2-1, the mobile phone 100 may further include a camera (front camera and/or rear camera), a flash, a micro-projector, a Near Field Communication (NFC) device, etc., which will not be described herein.

The software system of the electronic device 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention uses an Android system with a hierarchical architecture as an example to exemplarily explain a software structure of the electronic device 100.

Fig. 2-3 are block diagrams of software configurations of the electronic device 100 of an embodiment of the present invention.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the operating system (e.g., android system) of the electronic device is divided into four layers, from bottom to top, a kernel layer, a Hardware Abstraction Layer (HAL), an application framework layer, and an application layer.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a camera drive, an audio drive, a display drive and a sensor drive.

In some embodiments, such as in a lost object finding scenario, the UWB driver, for example, in the core layer is invoked to turn on the UWB module, and then to transmit and receive UWB signals, completing the object location.

A Hardware Abstraction Layer (HAL) is located between the kernel layer and the application framework layer, and is used to define an interface for driving the hardware implementation of the application, and convert the value of the hardware implementation of the drive into a software implementation programming language. For example, the value of the camera driver is recognized and converted into a software program language to be uploaded to an application program framework layer, and then the corresponding function is realized.

In some embodiments of the present application, the HAL may upload the sensing information (waveform data) collected by sensors such as gyroscopes, accelerometers, etc. to the application framework layer for further processing.

In some embodiments of the present application, the HAL maintains a list of sensors. The list of sensors may be used to frame level registration sensors.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. And the application program framework layer acquires the original input event from the kernel layer through the HAL and identifies the control corresponding to the input event. The application framework layer includes a number of predefined functions.

As shown in fig. 2-3, the application framework layer may include a camera service system, an audio processing system, a view system, a phone manager, an explorer, a notification manager, a window manager, and the like.

In some embodiments, the application framework layer includes a first module. The first module may be to provide a sign-on gesture function for an application. After the mobile phone is powered on, the preset application may register a preset gesture with the first module. A preset gesture such as, but not limited to, a gesture to lift the phone at least once. The preset application may be, but is not limited to, any one or more of the following: camera applications, AR applications, UWB applications. AR applications include, but are not limited to, mapping applications, gaming applications using AR technology. UWB applications include, but are not limited to, smart home applications using UWB functionality, file transfer applications (e.g., airdrop, point to share). The UWB application may be a system-level application or may be a third-party application, such as one that is downloadable from an application marketplace for installation.

The first module may be further configured to register some sensors according to the sensor list of the HAL, so that the framework layer may obtain sensing data collected by the sensors from the registered sensors, and calculate whether the user inputs a preset gesture to the electronic device according to the sensing data and a preset algorithm. When the gesture that the user lifts the mobile phone at least once is recognized, the first module reports the recognition result to the application registering the gesture, and the corresponding application can start the corresponding function.

Taking the application for registering the gesture as the UWB application as an example, when the first module recognizes the gesture that the user lifts the mobile phone at least once, the first module reports the recognition result to the UWB application. UWB applications may enable the UWB module via UWB driving. The UWB module may perform UWB signal scanning so that the electronic device determines nearby UWB devices or UWB objects, may locate UWB devices or UWB objects, and the like.

Taking the application for registering the gesture as the camera application as an example, when the first module identifies the gesture of lifting the mobile phone by the user at least once, the first module reports the identification result to the camera application. The camera application may start the camera via a camera drive. Alternatively, the camera application may call a front camera or a rear camera. For example, the camera application may invoke a camera that was invoked the last time the camera application was exited.

Taking the application registering the gesture as the AR application as an example, when the first module recognizes the gesture of the user lifting the mobile phone at least once, the first module reports the recognition result to the AR application. The AR application may turn on the AR function.

Taking the application registering the gesture as the VR application as an example, when the first module recognizes the gesture of the user lifting the mobile phone at least once, the first module reports the recognition result to the VR application. The VR application may turn on VR functionality.

Taking the application for registering the gesture as a camera application and a UWB application (smart home application) as an example, when the first module recognizes the gesture of the user lifting up the mobile phone at least once, the first module reports the recognition result to the camera application and the smart home application. Camera application can start the camera through the camera drive, and intelligent house application can start the UWB module through the UWB drive. UWB signals can be transmitted and received through the UWB module, so that UWB functions such as positioning and ranging are achieved. Optionally, the camera invoked by the camera application may assist the UWB module in positioning.

Optionally, the first module detects a state of the electronic device (including a gesture input to the electronic device by a user of the electronic device), which may be detected by a machine learning algorithm. The machine learning algorithm may be, for example, but not limited to, any one or more of the following algorithms: neural network algorithms, reinforcement learning algorithms, deep learning algorithms, and the like.

Illustratively, FIG. 3-1 shows the flow of the first module determining the gesture. The first module is used for judging that a model of the user gesture needs to be trained in advance. The model may be a model trained based on machine learning techniques. Such as but not limited to a convolutional neural network (convolutional neural network) model. Taking the CNN model as an example, as shown in fig. 3-1, training the CNN model requires acquiring a series of sample data, where the sample may be data from an accelerometer (e.g., 3-axis data) and data from a gyroscope (e.g., 3-axis data). After the samples are obtained, the samples need to be smoothed, normalized, and the like.

The normalization process can reduce the complexity of the algorithm. The smoothing process may further include operations such as noise reduction, fitting, etc. to reduce the effect of statistical errors. In the smoothing process, different sets of data operations may be set, for example, the smoothing process may be performed every 5 data.

And after the sample is processed, performing model training by using the processed sample to obtain a CNN model. In order to improve the accuracy of model identification, the model can be evaluated and tested. When the recognition rate of the model reaches a certain threshold value, the model is trained. When the recognition rate of the model is low, the model can be continuously trained until the model is trained.

The model training process may be training in a server or training at a terminal side, which is not limited in the embodiment of the present application.

After the CNN model training is completed, the first module may determine the user gesture using the CNN model. As one possible implementation, when the user operates the mobile phone, the accelerometer and the gyroscope collect state information of the mobile phone, that is, waveform data is output in response to the user's operation. The output waveform data comprises waveform data of a z axis, a y axis and an x axis (the waveform data can be used for reflecting the state information of the mobile phone). The waveform data includes, but is not limited to, acceleration, distance and angle that the electronic device moves in each axis direction, and the like. Fig. 3-2 shows exemplary waveform data for various axes of accelerometer output. Fig. 3-3 show exemplary waveform data for various axes of a gyroscope output.

The first module may acquire the waveform data from the accelerometer and the gyroscope, perform processes such as smoothing and normalization on the waveform data, and input the processed waveform data into the CNN model, where the CNN model outputs a recognition result for the waveform data (such as outputting a gesture of the user such as lifting the mobile phone twice).

Wherein the first module may set the computation granularity of each processing step. For example, for the smoothing process, it may be set to calculate smoothing every 5 data points. I.e., one smoothing is calculated every 5 data points of the waveform shown in fig. 3-2. As another example, a user gesture is calculated using the CNN model every 60 data points. It will be appreciated that when the computation granularity is set to be small, then in some cases, the computational efficiency may be improved. For example, if the user gesture is calculated using the CNN model every 30 data, the electronic device may calculate the user gesture when 30 data are acquired. When the calculation granularity is set to be larger, the electronic device usually calculates the user gesture once when acquiring more data, and the user gesture calculated according to more data is often more accurate. In the embodiment of the application, the calculation granularity can be flexibly set according to the actual application scene.

It is understood that after the first module obtains the user gesture, subsequent operations may be performed according to the user gesture.

Optionally, the first module may also be disposed in other layers, and the first module may also be divided into more sub-modules. Each sub-module is used to perform a corresponding function. For example, the first module may include a registration module operable to register one or more sensors and register preset gestures for the application. The first module may further include a gesture recognition module configured to obtain information from the sensor and determine whether the user inputs a predetermined gesture to the electronic device (e.g., whether to lift the mobile phone twice) according to the information.

Optionally, some steps in fig. 3-1 may be omitted or replaced by other steps, or some steps may be added to the flowchart shown in fig. 3-1. The embodiment of the present application does not limit the specific implementation scheme of the calculation gesture. For example, further noise reduction processing is added.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a brief dwell, and does not require user interaction. Such as a notification manager used to notify download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scrollbar text in a status bar at the top of the system, such as a notification of a running application in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The application layer may include a series of application packages.

As shown in fig. 2-3, the application packages may include camera, video, telephony, WLAN, music, sms, bluetooth, map, calendar, gallery, navigation, etc. applications.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application layer and the application framework layer as binary files. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The methods in the following embodiments can be implemented in the mobile phone 100 having the above hardware structure.

In some scenarios, a user needs to turn on the UWB functionality (an example of the first functionality) of the electronic device. For example, when a user needs to find a key (provided with a UWB module) which is not known to fall indoors, the user needs to start the UWB function so as to locate the UWB module on the key and further find the key. Taking a mobile phone as an example of the electronic device, in the embodiment of the application, the mobile phone can detect the state of the mobile phone. The state of the handset includes, but is not limited to, a state in which the handset is held by the user. When the state that the mobile phone is held by the user is detected to meet a certain condition (namely a first condition), the UWB function is started. It is considered that UWB and the like devices can be laid out on the back of the mobile phone and the like, and that the user is used to raise the mobile phone when using the UWB function so that the back of the mobile phone faces the communication object. Based on the use habit of the user, the mobile phone can think that the user probably wants to use the UWB function when the mobile phone is lifted by the user, and then the mobile phone can set the gesture of lifting the mobile phone to trigger the start of the UWB function. Subsequently, if it is detected that the electronic device is lifted by the user at least once, the electronic device starts the UWB function.

In the embodiment of the present application, the lifting of the mobile phone by the user may mean that the mobile phone is rotated and moves from bottom to top relative to the horizontal line.

Of course, the gestures that can be used to trigger turning on the UWB function may be other gestures, which is not limited in this embodiment.

Illustratively, the handset currently displays a lock screen interface, as shown in fig. 4-1 (a-2). The handset detects the holding state, assuming that the state in which the handset is held by the user is as (a-1) of fig. 4-1 and (b-1) of fig. 4-1 in this order, that is, the user lifts the handset. After the handset detects that the handset is lifted by the user (i.e., the first condition is satisfied), the handset turns on the UWB function as shown in (b-2) of fig. 4-1.

In the embodiment of the application, under the first condition, the back orientation of the terminal is changed. In a possible scheme, the change of the orientation of the back of the terminal may mean that an included angle between a plane where the back of the terminal is located and a horizontal line is changed from a first included angle to a second included angle, where the first included angle is smaller than the second included angle, and the second included angle is within a second preset included angle range. For example, as shown in (a-1) and (b-1) of fig. 4-1, the angle between the plane of the back of the terminal and the horizontal line is changed from θ 1 to θ 2, and θ 1 is smaller than θ 2, i.e. the mobile phone is changed from a nearly parallel horizontal line to a nearly vertical horizontal line. The range of the second preset included angle can be flexibly set, for example, the range of the included angle can be set to be close to 90 degrees.

In the embodiment of the application, when an included angle between a plane where the back of the electronic device is located and a horizontal plane is smaller than a certain angle, for example, when a screen of the electronic device maintains an angle approximately parallel to the horizontal plane, the direction of the electronic device changes, the direction of the back of the electronic device is not affected, and the direction of the back of the electronic device does not change.

Therefore, compared with the prior art that a user needs to control the mobile phone to return to the desktop first and then searches for a target application among numerous applications on the desktop to trigger the start of the UWB function, in the technical scheme of the embodiment of the application, firstly, the memory cost of the user is not increased, that is, the user does not need to clearly remember the position of the target application on the desktop. Secondly, a user does not need to perform a series of complex operations, for example, the user does not need to control the mobile phone to return to a desktop first, then search for a target application, and then start the UWB function through layer-by-layer setting options in the target application, so that the process of starting the UWB function by the user is simplified, and the UWB function can be started for the user more conveniently and intelligently. Moreover, the set gesture is a lifting gesture which accords with the use habit of the user, so that the user does not need to memorize a large number of gestures, and can operate the mobile phone as the UWB function, and the UWB function can be conveniently and rapidly triggered to start the mobile phone.

As a possible implementation manner, the mobile phone may start the UWB function without sensing by the user, in other words, the mobile phone may not prompt the user to start the UWB function. Or, the mobile phone starts the UWB function, which may be that the mobile phone prompts the user to start the UWB function. For example, the mobile phone displays an interface 301 as shown in (b-2) of fig. 4-1, and the interface 301 includes a prompt box 302 for prompting that "the UWB function is being turned on", so that the user can clearly know the function currently executed by the mobile phone.

It should be noted that the condition for triggering the turning on of the UWB function is not limited to detecting that the user lifts the terminal at least once, and may be combined with other conditions. For example, in some scenarios, the user may operate the terminal by mistake. In order to reduce the probability of power consumption increase caused by the fact that the UWB function is started due to misoperation triggering, whether the intention of the user is to start the UWB function or not can be judged according to conditions such as the lifting speed and the lifting angle of the terminal.

Illustratively, when it is detected that the user lifts the terminal and a certain lifting rate (flexibly settable) (an example of a first condition) is met, the UWB function is triggered to be turned on.

Further illustratively, when it is detected that the user lifts up the terminal and the angles for lifting up the terminal all satisfy a first preset included angle (an included angle between the screen of the terminal and the horizontal line is within a first preset included angle range) (an example of the first condition), the UWB function is turned on. Here, the preset angle may be flexibly set according to a use scene, and the like, and the embodiment of the present application is not limited. Assuming that the first preset included angle range is (θ i- θ j), taking fig. 4-1 as an example, initially, the included angle between the screen of the terminal and the horizontal plane is θ 1, after the terminal detects that the terminal is lifted by the user, the included angle between the screen of the terminal and the horizontal plane is θ 2, and θ 2 is within the range of (θ i- θ j), that is, the state of the terminal meets the first condition, then the terminal starts the UWB function.

In some cases, the angle between the terminal screen and the horizontal may be approximated by the angle between the plane of the terminal back and the horizontal. However, the two angles may not be exactly equal, due to industrial design or other factors.

Further illustratively, the terminal detects whether the terminal is lifted by the user, and when it is detected that the terminal is lifted by the user a first preset number of times (an example of a first condition), it is considered that the intention of the user is likely to turn on the UWB function, and the terminal turns on the UWB function. Assuming that the preset number of times is two, taking fig. 4-2 as an example, when it is detected that the mobile phone is lifted twice by the user, it is considered that the intention of the user is likely to turn on the UWB function, and the mobile phone turns on the UWB function.

Further illustratively, when it is detected that the user lifts the terminal a preset number of times (e.g., N times, where N is an integer greater than or equal to 2), and a rate at which the terminal is lifted each time satisfies a certain condition (which may be flexibly set) (an example of the first condition), turning on the UWB function is triggered. Or, in a preset time period (which can be flexibly set), if it is detected that the number of times that the user lifts the terminal reaches a second preset number of times, the UWB function is started. This means that the user cannot lift the terminal too slowly for N times, or the time interval (which can be flexibly set) between each two lifting operations of the N lifting operations needs to be small. For example, when an operation of lifting the terminal is detected once, and after ten minutes, an operation of lifting the terminal is detected once again, the terminal does not consider that the user inputs the preset gesture to the terminal because a time interval between two times of lifting operations is large.

Further illustratively, when it is detected that the user lifts the terminal N times, and the angle for lifting the terminal each time satisfies a preset angle (an included angle between the screen of the terminal and the horizontal line is within a preset angle range) (an example of the first condition), the UWB function is turned on. Here, the preset angle may be flexibly set according to a use scene, and the like, and the embodiment of the present application is not limited.

As another example, the terminal may ask the user whether the UWB function is actually to be turned on after detecting a preset gesture of the user (e.g., detecting that the terminal is lifted up once or twice). And under the condition that the user indicates that the UWB function needs to be started, the start of the UWB function is triggered. For example, the handset currently presents an interface such as that shown in (a-2) of fig. 5-1, as shown in (a-1) and (b-1) of fig. 5-1, and after the handset detects that the handset is lifted by the user, the handset may display an interface 303 such as that shown in (b-2) of fig. 5-1, where the interface 303 includes a UWB open control 304. The UWB turn-on control 304 is for turning on UWB functionality (an example of a first control).

In some cases, as shown in (a) of fig. 5-2, when a preset operation, such as a click operation, on the control 304 by the user is detected, the mobile phone turns on the UWB function. Alternatively, the mobile phone may display an interface shown in (b) of fig. 5-2 for prompting the user that the UWB function is being turned on. Alternatively, when the preset operation of the user on the control 304 is detected, the mobile phone does not prompt the user that the UWB function is being turned on.

In other cases, within a period of time from displaying the UWB open control, if the mobile phone does not detect the preset operation of the user on the UWB open control, the size of the UWB open control may be gradually reduced until the UWB open control disappears from the interface. For example, as shown in (a) of fig. 5-3, if the mobile phone detects that the user lifts the mobile phone, the mobile phone may display the UWB turn-on control 304, and after a certain period of time, if the mobile phone does not detect the operation of the control 304 by the user, it indicates that the user probably does not want to turn on the UWB function, or if the time for turning on the UWB function is delayed, the mobile phone may display the interface 309 shown in (b) of fig. 5-3, where the interface 309 includes the control 310. Wherein the size of control 310 is smaller than control 304. Before the UWB starting control disappears in the interface of the mobile phone, the user can trigger the mobile phone to start the UWB function by operating the UWB starting control.

Or, within a period of time from displaying the UWB startup control, if the mobile phone does not detect the preset operation of the user on the UWB startup control, the mobile phone may stop displaying the UWB startup control in the interface.

As one possible design, the position of the control 304 may be moved. For example, when a drag operation of the user on the control 304 is detected, the mobile phone may display the control 304 at a target position dragged by the user.

The control 304 in the drawings is only one example of a control that can be used for a user to turn on the UWB function, and the embodiment of the present application does not limit a specific interface style and the like of the control 304.

For example, control 304 may be replaced with control 314 in interface 313 shown in FIG. 6-1. As shown in fig. 6-2, upon detecting a user, such as clicking on the "on" option in control 314, the handset turns on the UWB functionality. Optionally, the handset may prompt the user that the UWB feature is being turned on. Alternatively, the handset does not prompt the user that the UWB functionality is being turned on.

When a user is detected, such as clicking on the "cancel" option in control 314, indicating that the user's operation of lifting the handset this time may be a malfunction, the user does not want to immediately turn on the UWB functionality, and then the handset does not turn on the UWB functionality.

As another example, control 304 may be replaced with a prompt control and text such as "click to turn on UWB functionality" displayed in the prompt control. Then, when the clicking operation of the user on the prompt control is detected, the mobile phone can start the UWB function. When the click operation of the user on the prompt control is not detected within a period of time after the prompt control is displayed, the size of the prompt control can be gradually reduced until the prompt control disappears in the interface. Or, when the click operation of the user on the prompt control is not detected within a period of time after the prompt control is displayed, the display of the prompt control can be stopped.

In some embodiments, the handset may detect a state of being held by the user and determine a position of the UWB open control in the interface based on the state of being held. As a possible implementation manner, when it is detected that the mobile phone is held by the left hand of the user, the UWB start control may be displayed by the mobile phone near the left position in the interface in order to facilitate the single-handed operation of the UWB start control by the left hand of the user. And when the mobile phone is detected to be held by the right hand of the user, displaying the UWB starting control close to the right position in the interface by the mobile phone. When the mobile phone is detected to be held by both hands of a user, the mobile phone can display the UWB opening control at any position in the interface. For example, as shown in fig. 7, when the mobile phone detects that the mobile phone is held by the right hand of the user, the UWB start control 304 is displayed at the right position of the interface 303, so that the UWB start control can be operated by the right hand of the user conveniently.

As an optional design, the area where the mobile phone displays the UWB open control in the interface may be a high-frequency operation area of the user. The high-frequency operation area can be obtained by counting the number of times of touching by the user.

It should be noted that, in this embodiment of the application, the left side of the terminal refers to a side corresponding to a left hand of a user when the screen of the terminal is opposite to the user, and the right side of the terminal refers to a side corresponding to a right hand of the user when the screen of the terminal is opposite to the user.

It can be appreciated that after the UWB functionality is turned on, the handset can scan UWB signals from nearby UWB devices. As shown in fig. 8 (a), the handset scans for nearby UWB devices and may display a UWB device list control 307.UWB device list control 307 may present scanned UWB devices. UWB device list controls 307 may include

controls

306, 305. Wherein a user may operate controls 306 to view details of or interact with the scanned UWB device. The user may operate control 305 to refresh the list of scanned UWB devices.

Illustratively, upon detecting the user clicking on the control 306, the handset displays a control 308 as shown in fig. 8 (b). The user may control the loudspeaker by operating controls 308. For example, a currently played song may be switched by operating the switching control. For another example, the playing control can be operated to control the playing of music and the pausing of the playing of music. For another example, the volume of the speaker box can be controlled by operating the volume control.

The

controls

307 and 308 may be collectively referred to as control for interacting with the UWB device or UWB object, and may be simply referred to as interaction control. A user may interact with a UWB device or UWB object (such as a bag with a UWB tag attached) by operating an interaction control in the handset. The interaction includes, but is not limited to, sending information to, receiving information from, controlling, etc. a UWB device or UWB object.

In the embodiment of the application, the state that the mobile phone is held by the user can be detected, and the position of the interactive control in the interface is determined according to the state that the mobile phone is held by the user. When the mobile phone is detected to be held by the left hand of the user with one hand, the mobile phone displays the interactive control at the left side position in the interface, when the mobile phone is detected to be held by the right hand of the user with one hand, the mobile phone displays the interactive control at the right side position of the interface, and when the mobile phone is detected to be held by the two hands of the user with one hand, the mobile phone displays the interactive control at any position (such as a position which is not overlapped with other icons) in the interface. Illustratively, referring to fig. 9, detecting that the handset is held by the user's right hand, the handset displays controls 307, 308 in the right position of the interface.

The embodiment of the application also provides a method for opening the back module. Considering that the frequency of using the UWB function by the user is possibly more, the mobile phone can also display the UWB opening control on the screen locking interface, and when the preset operation of the UWB opening control by the user is detected, the mobile phone can open the UWB function. Therefore, in the unlocking process, a user can conveniently notice that the UWB opening control which can be used for opening the UWB function is opened, and the UWB function can be conveniently and quickly opened by operating the UWB opening control.

Illustratively, as shown in fig. 10 (a), the mobile phone is in a screen-locked state. The user may perform an operation of pressing a power key, or lifting the cellular phone or double-clicking a screen, and the cellular phone may detect the operation input by the user, illuminate the screen, and may display a screen lock interface 311 such as that shown in fig. 10 (b), and the screen lock interface 311 may include a UWB open control 312. When the operation of the user on the UWB opening control is detected, such as clicking operation, the mobile phone can open the UWB function. Because the number of the application programs or the controls in the screen locking interface 311 is small, the user can quickly find the control for starting the UWB function from the small number of applications or controls, and further, the user can quickly trigger the mobile phone to start the UWB function by operating the control.

The embodiment of the application also provides a method for opening the back module. Under the condition that the terminal is turned off, the gesture of the user can be detected, and if the preset gesture is detected, the UWB function is started. As a possible implementation manner, the MCU runs an algorithm for detecting the touchscreen gesture, so that the MCU of the terminal can detect the gesture of the user in the touchscreen state, and if a preset gesture is detected, for example, the user lifts up the terminal twice, the MCU controls to start the UWB function.

In some embodiments, the terminal may detect the use of UWB functionality by an application. And in a period of time, if the application program using the UWB function is not detected, controlling to close the UWB function so as to reduce power consumption and reduce the risk of revealing user privacy.

It should be noted that, in the embodiment of the present application, the state of the terminal before the UWB function is turned on is not limited. For example, before the UWB function is turned on, the terminal may present an interface such as interface 1101 or interface 1102 or interface 1103 or lock screen interface or information screen shown in fig. 11.

In addition, in the embodiment of the present application, the gesture for triggering to turn on the UWB function is not limited, for example, the gesture for triggering to turn on the UWB function may be a gesture for tapping the back of the terminal for a preset number of times (for example, twice), in addition to the gesture for lifting the terminal at least once.

Besides the preset gesture can trigger the terminal to start the UWB function, other conditions for triggering the start of the UWB function can be set.

Illustratively, the UWB functionality is triggered to turn on upon detecting that a user turns on a UWB application. The UWB application may be set by a terminal or a user.

As another example, when it is detected that a service requiring the use of the UWB function is performed, the UWB function is triggered to be turned on. For example, when detecting that a file transfer is to be performed, the UWB function is turned on.

Further illustratively, the UWB function is turned on for a preset period and/or a preset location. For example, the terminal knows that the user frequently uses the UWB function at home (for example, frequently uses the UWB function to transmit files) according to the user profile that can be authorized to use, and then, when the terminal detects that the current location is at home, the terminal automatically turns on the UWB function, so that the user can use the UWB function to transmit files. For another example, the terminal knows that the user frequently uses the UWB function in the range from 21.

For another example, the UWB may be turned on according to the above conditions. For example, when the terminal detects that the user lifts up the mobile phone twice and the current time is within 21-00.

In some embodiments, the terminal may provide access to provision UWB functionality. Illustratively, as shown in fig. 12, when the user turns on the switch 1201, the UWB may be further allowed to be turned on intelligently. After the user allows the UWB function to be intelligently turned on, as shown in fig. 12, determination conditions such as a gesture, time, place, and effective period for intelligently turning on the UWB function may be set. Subsequently, when the terminal detects that the terminal meets the judgment conditions, the UWB module can be intelligently started so as to realize the UWB function, thereby simplifying the process of starting the UWB function and improving the interaction efficiency between the terminal and the user.

Similarly, as shown in fig. 12, setting switches may also be provided for camera, AR, VR, etc. functions. And judging conditions such as gestures, time, places and effective periods for starting corresponding functions can be set for the functions such as cameras, AR, VR and the like. As described above, different functions may correspond to different open gestures.

The terminal may also provide other settings for UWB functionality. For example, sensitivity, accuracy settings are provided. When the user selects the sensitivity option, the gesture for lifting the terminal once can be set as the gesture for starting the UWB function by default, so that the UWB function can be started when the situation that the terminal is lifted by the user once is detected, and the response to the user is more timely. When the user selects the accuracy option, the terminal can default a gesture capable of preventing mistaken touch as a gesture for starting the UWB function so as to judge the intention of the user more accurately, and the UWB function is triggered to be started as long as the exact intention of the user is determined to be starting the UWB function. For example, the terminal sets a gesture of detecting that the terminal is lifted twice as a gesture of turning on the UWB function, and when it is detected that the terminal is lifted twice by the user, the terminal determines that the intention of the user is indeed to turn on the UWB function, and the terminal triggers the turning on of the UWB function.

Each interface in the embodiment of the present application is an example, and each interface may also have other styles, layouts, functions, and the like in actual implementation, which is not limited in the embodiment of the present application. For example, for an interface for prompting whether the user starts the UWB function, prompting in a prompt box manner, prompting in an icon manner, or prompting in a floating ball manner may be adopted.

Other embodiments of the present application provide an apparatus, which may be the terminal described above. The apparatus may include: a display screen, a memory, and one or more processors. The display screen, memory and processor are coupled. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the terminal can execute various functions or steps executed by the mobile phone in the method embodiment. The structure of the terminal can refer to the structure of the handset 100 shown in fig. 2-1 or the terminal shown in fig. 2-3.

The core structure of the terminal may be represented as the structure shown in fig. 13, where the terminal includes: a processing module 1301, an input module 1302, a storage module 1303 and a display module 1304.

The processing module 1301 may include at least one of a Central Processing Unit (CPU), an Application Processor (AP), or a Communication Processor (CP). Processing module 1301 may perform operations or data processing related to control and/or communication of at least one of the other elements of the consumer electronic device. Specifically, the processing module 1301 may be configured to control content displayed on the home screen according to a certain trigger condition. The processing module 1301 is further configured to process the input instruction or data, and determine a display style according to the processed data.

The input module 1302 is configured to obtain an instruction or data input by a user, and transmit the obtained instruction or data to another module of the electronic device. Specifically, the input mode of the input module 1302 may include touch, gesture, proximity to a screen, and the like, or may be voice input. For example, the input module may be a screen of the electronic device, acquire an input operation of the user, generate an input signal according to the acquired input operation, and transmit the input signal to the processing module 1301.

The storage module 1303 may include volatile memory and/or nonvolatile memory. The storage module is used for storing instructions or data related to at least one of other modules of the user terminal equipment, and particularly, the storage module can record the position of an interface where a terminal interface element UI is located.

The display module 1304 may include, for example, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, an Organic Light Emitting Diode (OLED) display, a micro-electro-mechanical systems (MEMS) display, or an electronic paper display. For displaying content (e.g., text, images, videos, icons, symbols, etc.) viewable by a user.

Optionally, a communication module 1305 is further included for supporting the personal terminal to communicate with other personal terminals (through a communication network). For example, the communication module may be connected to a network via wireless communication or wired communication to communicate with other personal terminals or a network server. The wireless communication may employ at least one of cellular communication protocols, such as Long Term Evolution (LTE), long term evolution-advanced (LTE-a), code Division Multiple Access (CDMA), wideband Code Division Multiple Access (WCDMA), universal Mobile Telecommunications System (UMTS), wireless broadband (WiBro), or global system for mobile communications (GSM). The wireless communication may include, for example, short-range communication. The short-range communication may include at least one of wireless fidelity (Wi-Fi), bluetooth, near Field Communication (NFC), magnetic Stripe Transmission (MST), or GNSS.

Embodiments of the present application further provide a chip system, as shown in fig. 14, where the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 may be interconnected by lines. For example, the interface circuit 1402 may be used to receive signals from other devices (e.g., a memory of an electronic device). Also for example, the interface circuit 1402 may be used to send signals to other devices, such as the processor 1401. Illustratively, the interface circuit 1402 may read instructions stored in the memory and send the instructions to the processor 1401. The instructions, when executed by the processor 1401, may cause the electronic device to perform the various steps in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device is enabled to execute each function or step executed by the mobile phone in the foregoing method embodiment.

The embodiment of the present application further provides a computer program product, which when running on a computer, causes the computer to execute each function or step executed by the mobile phone in the above method embodiments.

Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for opening a function of a back module, the method being applied in a terminal, the back module being disposed on the back of the terminal, the back module being configured to implement a first function, the method comprising:

detecting the state of the terminal;

and if the state of the terminal is detected to meet a first condition, starting the first function, wherein under the first condition, the back orientation of the terminal is changed.

2. The method according to claim 1, wherein after detecting that the state of the terminal satisfies a first condition, before turning on the first function, the method further comprises:

the starting of the first function comprises: and when the preset operation of the user on the first control is detected, starting the first function.

3. The method according to claim 2, wherein if no preset operation of the first control by a user is detected within a preset time period after the first control is displayed, the display of the first control is stopped, or the display size of the first control is reduced.

4. The method according to any one of claims 1 to 3, wherein the first condition comprises any one or combination of conditions: the terminal is lifted by a user; the terminal is lifted by a user for a first preset number of times; the terminal is lifted by a user for a second preset number of times within a preset time length; the terminal is lifted by a user, and the speed of lifting the terminal by the user is greater than a threshold value; the terminal is lifted by a user, and a first included angle formed between a screen of the terminal and a horizontal plane is within a first preset included angle range after the terminal is lifted.

5. The method according to any one of claims 1 to 4,

the back module comprises any one or a combination of more than one of the following modules: an ultra wideband UWB module and a camera module; the first function comprises any one or more of the following functions in combination: UWB functionality, camera functionality, augmented reality AR functionality, virtual reality VR functionality;

wherein, the UWB module corresponds the UWB function, the camera module corresponds the camera function and/or the AR function and/or the VR function.

6. The method according to any of claims 1-5, wherein the first functions that are turned on are different when the status of the terminal satisfies different first conditions.

7. The method according to any one of claims 1-6, wherein detecting the state of the terminal comprises: detecting a state of the terminal using a machine learning model.

8. The method according to any one of claims 1-7, wherein the changing of the orientation of the back of the terminal comprises: and an included angle between a plane where the back of the terminal is located and the horizontal plane is changed from a first included angle to a second included angle, wherein the first included angle is smaller than the second included angle, and the second included angle is within a second preset included angle range.

9. A terminal, characterized in that it comprises a processor and a memory for storing computer program code, the computer program code comprising computer instructions which, when executed by the processor, perform the method according to any one of claims 1-8.

10. A computer-readable storage medium comprising computer instructions which, when executed on a terminal, cause the terminal to perform the method of any one of claims 1-8.