CN115016628A - Control method of electronic equipment and electronic equipment - Google Patents

Control method of electronic equipment and electronic equipment Download PDF

Info

Publication number
CN115016628A
CN115016628A CN202111499097.1A CN202111499097A CN115016628A CN 115016628 A CN115016628 A CN 115016628A CN 202111499097 A CN202111499097 A CN 202111499097A CN 115016628 A CN115016628 A CN 115016628A
Authority
CN
China
Prior art keywords
electronic device
information
electronic equipment
interface
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111499097.1A
Other languages
Chinese (zh)
Other versions
CN115016628B (en
Inventor
黄立波
车宇锋
李经纬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202111499097.1A priority Critical patent/CN115016628B/en
Publication of CN115016628A publication Critical patent/CN115016628A/en
Application granted granted Critical
Publication of CN115016628B publication Critical patent/CN115016628B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3215Monitoring of peripheral devices
    • G06F1/3218Monitoring of peripheral devices of display devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A control method of electronic equipment relates to the technical field of terminals, and the electronic equipment controls the on/off of a long-open function of the electronic equipment according to at least one piece of acquired customized information, so that the purpose of reducing the power consumption of the electronic equipment is achieved. The method comprises the following steps: in the process that the electronic equipment displays the first interface, if the electronic equipment determines that the long-open function of the electronic equipment is in a closed state, acquiring at least one piece of customized information; the first interface is displayed when a display screen of the electronic equipment is in a screen-off state; the customized information includes at least one of ambient light information, proximity light information, distance sensor information, attitude sensor information, screen status information, or sleep status information of the electronic device; and if at least one piece of customized information meets the corresponding preset condition, controlling the long-open function of the electronic equipment to be started.

Description

Control method of electronic equipment and electronic equipment
Technical Field
The present application relates to the field of electronic devices, and in particular, to a control method for an electronic device and an electronic device.
Background
With the continuous development of electronic devices, most electronic devices support an Always On Display (AOD) function, that is, when an electronic device is in a screen-off state, a partial area in a screen of the electronic device may be kept in a long-bright state to display preset information (e.g., time information, weather information, etc.). However, the AOD function of the electronic device requires some functions of the electronic device to be maintained in an Always On (AO) state, resulting in a problem that the electronic device has a large power consumption. For example, when the electronic device is in a screen-off state, and whether the AOD information is displayed on the display screen is determined according to whether the face information is detected, a camera of the electronic device needs to maintain an AO state, so that power consumption of the electronic device is large.
Disclosure of Invention
The embodiment of the application provides a control method of an electronic device and the electronic device, and the electronic device controls the on/off of the AO function of the electronic device according to acquired customized information, so that the purpose of reducing the power consumption of the electronic device is achieved.
In order to achieve the purpose, the technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for controlling an electronic device, including:
in the process that the electronic equipment displays the first interface, if the electronic equipment determines that the long-open function of the electronic equipment is in a closed state, acquiring at least one piece of customized information; the first interface is displayed when a display screen of the electronic equipment is in a screen-off state; the customized information includes at least one of ambient light information, proximity light information, distance sensor information, attitude sensor information, screen status information, or sleep status information of the electronic device; and if at least one piece of customized information meets the corresponding preset condition, controlling the long-open function of the electronic equipment to be started.
Therefore, the electronic equipment determines whether to start the long-open function of the electronic equipment according to whether the at least one piece of customized information meets the corresponding preset condition, so that the electronic equipment is controlled to be switched on/off by customizing the long-open function of the electronic equipment, and the power consumption of the electronic equipment is reduced.
Optionally, each of the at least one piece of customized information satisfies a corresponding preset condition, and includes at least one of:
the electronic device determines that the ambient light information is greater than a first threshold, or the electronic device determines that the approach light information is greater than a second threshold, or the electronic device determines that the posture of the electronic device is upward according to the distance sensor information and the posture sensor information, or the sleep state information of the electronic device is in a sleep state.
Optionally, the controlling the long-open function of the electronic device to be started comprises:
if the electronic equipment starts the screen-off display function, the electronic equipment displays a second interface; the second interface comprises first content displayed when the electronic equipment is in the screen extinguishing state.
Therefore, after the electronic equipment starts the screen-off display function, the electronic equipment can control the long-open module of the electronic equipment to start, so that the long-open module controls the long-open function of the hardware device supporting the long-open function to start, and the display screen of the electronic equipment displays the first content.
Optionally, the controlling the starting of the long-open function of the electronic device further includes:
if the electronic equipment does not start the screen-off display function, the electronic equipment displays a third interface; the third interface does not include display content.
Therefore, when the electronic equipment does not start the screen-off display function, if the electronic equipment controls the long-open module to start, and after the long-open module controls the long-open function of the hardware device supporting the long-open function to start, the display screen of the electronic equipment does not display any content.
Optionally, after the long-open function of the electronic device is started, the control method further includes: and displaying prompt information, wherein the prompt information is used for reminding a user that the long-open function of the electronic equipment is started.
Therefore, the electronic equipment reminds the user that the long-open function is started in a mode of displaying prompt information.
Optionally, the control method further includes: the electronic equipment displays a fourth interface, wherein the fourth interface is displayed when the display screen of the electronic equipment is in a bright screen state; and if the electronic equipment determines that the long-open function of the electronic equipment is in the open state, controlling the long-open function of the electronic equipment to be closed.
Therefore, when the display screen of the electronic equipment is in a bright screen state, the user can acquire information from the display screen at any time, the electronic equipment detects that the long-open function is in an open state, and the electronic equipment controls the long-open function to be closed, so that the power consumption of the electronic equipment is reduced.
Optionally, the control method further includes: the electronic equipment displays a fifth interface, wherein the fifth interface is an interface of the electronic equipment with an on/off control of a long-open function in a closed state; in the process that the electronic equipment displays the fifth interface, if the on/off control of the long-open function of the electronic equipment receives a first control instruction of a user, the electronic equipment responds to the first control instruction to start the long-open function of the electronic equipment.
That is to say, the setting interface of the electronic device may include an on/off control for controlling the long-open function of the electronic device, and after the electronic device receives a first control instruction of the on/off control for controlling the long-open function of the electronic device from a user, the electronic device starts the long-open function in response to the first control instruction.
Optionally, the control method further includes: the electronic equipment displays a sixth interface, wherein the sixth interface is an interface of which at least one on/off control of the customized information is in a closed state; in the process that the electronic device displays the sixth interface, if the at least one customized information on/off control receives a second control instruction of the user, the electronic device responds to the second control instruction to acquire the at least one customized information.
That is to say, the setting interface of the electronic device may further include an on/off control for subscribing to the customized information, and after the electronic device receives a second control instruction of the user for the on/off control for subscribing to the customized information, the electronic device obtains at least one piece of customized information in response to the second control instruction.
Optionally, the electronic device comprises: an application processor core and a low power consumption core;
wherein, the application processor core includes: the system comprises an application program, a customization module and a low-power-consumption processor interface; the low-power-consumption core comprises an intelligent decision module;
the application program acquires at least one piece of customized information and sends the at least one piece of customized information to the customized module;
the customization module is used for sending at least one piece of customization information to the low-power-consumption processor interface after receiving the at least one piece of customization information;
the low-power processor interface is used for sending the at least one piece of customization information to the low-power core after receiving the at least one piece of customization information from the customization module; and
and the intelligent decision module is used for controlling the on/off of the long-open function of the electronic equipment according to the at least one piece of customized information after the low-power-consumption core receives the at least one piece of customized information.
Therefore, a private path (namely a customization module) is added on the basis of the software architecture of the electronic equipment, and the purpose of sending the customization information to the low-power-consumption core is achieved through the private path. Therefore, the intelligent decision module can control the on/off of the long-open function of the electronic equipment according to the received customized information, so that the purpose of controlling the on/off of the long-open function in a customized manner is achieved, and the power consumption of the electronic equipment is reduced.
In a second aspect, the present application provides an electronic device having functions for implementing the method of the first aspect. The function can be realized by hardware, and can also be realized by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above. For example, the electronic device includes an intelligent decision module, which is configured to, in a process of displaying a first interface on the electronic device, obtain at least one piece of customized information if the electronic device determines that a long-open function of the electronic device is in a closed state; the first interface is displayed when a display screen of the electronic equipment is in a screen-off state; the customized information includes at least one of ambient light information, proximity light information, distance sensor information, attitude sensor information, screen status information, or sleep status information of the electronic device; and if at least one piece of customized information meets the corresponding preset condition, controlling the long-open function of the electronic equipment to be started.
In a third aspect, the present application provides an electronic device, comprising: one or more processors; a memory; wherein the memory has stored therein one or more computer programs comprising instructions which, when executed by the electronic device, cause the electronic device to carry out the control method of any of the above first aspects.
In a fourth aspect, the present application provides a computer-readable storage medium having stored therein instructions that, when run on an electronic device, cause the electronic device to perform the control method according to any one of the first aspects.
In a fifth aspect, the present application provides a computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the control method according to any one of the first aspect.
It is to be understood that the electronic device according to the second and third aspects, the computer storage medium according to the fourth aspect, and the computer program product according to the fifth aspect are all configured to execute the corresponding method provided above, and therefore, the beneficial effects achieved by the electronic device may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.
Drawings
FIG. 1 illustrates a user interface of an electronic device off-screen display;
fig. 2 is a first diagram illustrating a software structure of an electronic device according to the prior art;
fig. 3 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a first schematic diagram of a software structure of an electronic device according to an embodiment of the present disclosure;
FIG. 5 is a schematic flow chart of a method for controlling the ON/OFF of an AO module according to at least one customization information provided by an embodiment of the present application;
fig. 6 is a first schematic display diagram of an electronic device according to an embodiment of the present disclosure;
fig. 7 is a second display schematic diagram of an electronic device according to an embodiment of the present application;
fig. 8 is a third schematic display diagram of an electronic device according to an embodiment of the present application;
fig. 9 is a fourth schematic display diagram of an electronic device according to an embodiment of the present application;
fig. 10 is a second schematic diagram of a software structure of an electronic device according to an embodiment of the present application;
fig. 11 is a third schematic diagram of a software structure of an electronic device according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B, and may mean: a exists alone, A and B exist simultaneously, and B exists alone.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.
In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
Currently, most electronic devices have an AOD function, that is, when the electronic device is in a screen-off state, a partial area in a screen of the electronic device may be kept in a long-bright state to display preset information. The preset information includes, but is not limited to, time, date, notification message, remaining battery amount, and the like. The area displaying the preset information may be any area of the electronic device, for example, an area on the upper side, the lower side, the left side, or the right side of the electronic device, and is not limited herein. For example, an upper area in a screen of the electronic device may always maintain a long bright state to display preset information. Or, after the electronic device detects the face information in the screen-off state, a partial area in the screen of the electronic device may be lit up to display the preset information.
FIG. 1 illustrates a user interface for a screen-off display of an electronic device. In the user interface shown in fig. 1, a dark color region is an unlit region in the display screen, and a white color region is a lit region in the display screen. It can be seen that the electronic device can display information such as pictures, time, dates and the like in a partial area of the display screen in the screen-off state. Therefore, when the electronic equipment is in the screen locking state, the user can check information such as time, date and the like without frequently unlocking the electronic equipment. Obviously, the AOD function of an electronic device requires that a portion of the sensor (e.g., an image sensor) of the electronic device maintain the AO state. For example, an image sensor of the electronic device is in an AO state, and when the image sensor detects face information of a user, preset information is displayed in a screen of the electronic device, thereby causing a problem that power consumption of the electronic device is large.
In a possible scenario, in order to save power consumption of the electronic device, the existing software architecture of the electronic device only supports event trigger related AO functions in a bright screen state. For example, the AO function of the camera, that is, the electronic device can realize the functions of watching the screen without turning off the screen, watching the incoming call to reduce the volume, and the like in the on-screen state. That is, when the electronic device is in the screen-off state, the AO function of the electronic device is not available.
For example, as shown in fig. 2, in order to realize that the electronic device is in a screen-off state, the electronic device may realize that the AO function is extended, in the screen-off state, the low-power-consumption core needs to take over control of the camera through an integrated circuit (I2C) interface bus, and an image acquired by the camera may be output to the low-power-consumption core through a Mobile Industry Processor Interface (MIPI) bus to perform a low-power-consumption operation. Among them, the low power consumption core is a processing unit different from an Application Processor (AP) core in a processor of the electronic device.
For example, it is assumed that a camera sensor of the electronic device operates in a motion detection mode, in which the camera sensor detects ambient brightness change or target motion, and feeds back the ambient brightness change or the target motion to the low-power-consumption core through an interrupt signal, and the low-power-consumption core operates a task transferred by the AP high-power-consumption core, so as to achieve the purpose of reducing power consumption of the electronic device.
Supposing that a camera sensor of the electronic device operates in an Ultra Low Power (ULP) mode, in this mode, the camera sensor can combine large resolutions into a small resolution for processing, after receiving an image with a small resolution, a low power core performs face detection (not limited to a face) on the image with a small resolution, and when the electronic device detects the face in the image with a small resolution, the electronic device recalls and starts upper layer functions such as AOD. Therefore, based on the ULP mode of the camera sensor, the power consumption of the electronic equipment is reduced.
In another possible scenario, it is assumed that it is inconvenient for the user to hold the electronic device, for example, when the user is cooking, working, reading, driving, etc. If the user wants to acquire the time information, the user can watch the electronic device, at this time, the electronic device detects the face information of the user, and a partial area in the screen of the electronic device can display the time information. In order to save power consumption, a partial area in the screen of the electronic device may display the time information for a preset time period (e.g., 5 seconds, 10 seconds, etc.), and then stop displaying the time information. Obviously, the AOD function of the electronic device can be normally triggered, and the camera of the electronic device is required to keep the AO function in the long-open state, so that the electronic device can display the preset information after the camera acquires the face information of the user. For example, a camera of the electronic device is in an AO function long-open state, and when the image sensor detects face information of the user, preset information is displayed in a screen of the electronic device. Obviously, the problem of large power consumption of the electronic device is caused by the fact that the AO function of the camera of the electronic device is kept long.
However, the transfer capability of a part of interfaces of a software architecture of the existing electronic device is limited, and a low-power scheme cannot be designed, for example, a part of interfaces of a software architecture of the existing electronic device only supports transmission of information corresponding to 3 events, namely, face detection event subscription, face detection event unsubscription, and event reporting. In order to solve the problem that the power consumption is high when the AO function is opened for a long time in the electronic equipment, the electronic equipment can determine whether to open the AO function according to the customization information, so that the purpose of controlling the opening/closing of the AO function in a customization mode is achieved. If interface transmission customization information is added in a native Hardware Interface Definition Language (HIDL), the HIDL interface compatibility cannot be achieved, and all installation packages depending on the native HIDL service need to be recompiled, which causes the problem of increasing extra workload. Therefore, when the electronic device adopts the existing software architecture to transmit the customized information, the problem of large workload exists.
In order to solve the problem that the power consumption of the electronic device is large due to long-term opening of the AO function of the electronic device in the related art, embodiments of the present application provide a control method of the electronic device, which obtains customized information through an intelligent decision module of the electronic device to control the opening/closing of the AO function of the electronic device according to the customized information, thereby achieving the purpose of reducing the power consumption of the electronic device.
For example, the software architecture provided in the embodiment of the present application may be applied to an electronic device having a display screen, such as a mobile phone, a tablet computer, a Personal Computer (PC), a Personal Digital Assistant (PDA), a smart watch, a netbook, a wearable electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, an in-vehicle device, a smart car, and a smart audio device, and the embodiment of the present application does not limit the electronic device.
As shown in fig. 3, fig. 3 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
The electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a key 290, a motor 291, an indicator 292, a camera 293, a display 294, and a Subscriber Identity Module (SIM) card interface 295, among others. The sensor module 280 may include a pressure sensor 280A, a gyroscope sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, and the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than illustrated, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 210 may include one or more processing units, such as: the processor 210 may include an AP, a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.
Wherein the controller may be a neural center and a command center of the electronic device 200. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in processor 210 for storing instructions and data.
In some embodiments, processor 210 may include one or more interfaces. The interface may include an I2C interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, an MIPI (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL).
The I2S interface may be used for audio communication.
The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals.
The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
The MIPI interface may be used to connect the processor 210 with peripheral devices such as the display screen 294, the camera 293, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal.
The USB interface 230 is an interface conforming to the USB standard specification, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like.
It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only an illustration, and does not limit the structure of the electronic device 200. In other embodiments of the present application, the electronic device 200 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The wireless communication function of the electronic device 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor, the baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals.
The mobile communication module 250 may provide a solution including 2G/3G/4G/5G wireless communication applied on the electronic device 200. The modem processor may include a modulator and a demodulator.
The wireless communication module 260 may provide solutions for wireless communication applied to the electronic device 200, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like.
The electronic device 200 implements display functions via the GPU, the display screen 294, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 294 is used to display images, video, and the like. The display screen 294 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 200 may include 1 or N display screens 294, N being a positive integer greater than 1.
In the embodiment of the present application, the display screen 294 may be used for preset information displayed by the electronic device in the screen-off state, for example, the display screen 294 displays time information, weather information, and the like in the screen-off state.
The electronic device 200 may implement a shooting function through the ISP, the camera 293, the video codec, the GPU, the display screen 294, and the application processor.
The ISP is used to process the data fed back by the camera 293. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene.
The camera 293 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals.
Video codecs are used to compress or decompress digital video.
The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 200.
The internal memory 221 may be used to store computer-executable program code, which includes instructions.
Electronic device 200 may implement audio functions via audio module 270, speaker 270A, receiver 270B, microphone 270C, headset interface 270D, and an application processor, among other things. Such as music playing, recording, etc.
The pressure sensor 280A is used to sense a pressure signal, which can be converted into an electrical signal. In some embodiments, pressure sensor 280A may be disposed on display screen 294.
The gyro sensor 280B may be used to determine the motion pose of the electronic device 200.
The air pressure sensor 280C is used to measure air pressure.
The magnetic sensor 280D includes a hall sensor. The electronic device 200 may detect the opening and closing of the flip holster using the magnetic sensor 280D. In some embodiments, when the electronic device 200 is a flip, the electronic device 200 may detect the opening and closing of the flip according to the magnetic sensor 280D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.
The acceleration sensor 280E may detect the magnitude of acceleration of the electronic device 200 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 200 is stationary. The method can also be used for identifying the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and the like.
A distance sensor 280F for measuring distance. The electronic device 200 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, the electronic device 200 may utilize the distance sensor 280F to range for fast focus.
The proximity light sensor 280G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic apparatus 200 emits infrared light to the outside through the light emitting diode. The electronic device 200 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 200. When insufficient reflected light is detected, the electronic device 200 may determine that there are no objects near the electronic device 200. The electronic device 200 can utilize the proximity sensor 280G to detect that the user holds the electronic device 200 close to the ear for talking, so as to automatically turn off the screen to save power. The proximity light sensor 280G may also be used in a holster mode, a pocket mode to automatically unlock and lock the screen.
In the embodiment of the present application, the proximity light sensor 280G may be used to obtain light information of the environment where the electronic device 200 is located, and notify the processor 210 to automatically adjust the display backlight brightness, so as to reduce the power consumption of the electronic device 200.
The ambient light sensor 280L is used to sense ambient light brightness. The electronic device 200 may adaptively adjust the brightness of the display screen 294 based on the perceived ambient light level. The ambient light sensor 280L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 280L may also cooperate with the proximity light sensor 280G to detect whether the electronic device 200 is in a pocket to prevent inadvertent contact. In the embodiment of the present application, the electronic device 200 may determine whether to turn on/off the AO function of the electronic device 200 according to the information collected by the ambient light sensor 280L.
The fingerprint sensor 280H is used to collect a fingerprint. The electronic device 200 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and the like.
The temperature sensor 280J is used to detect temperature.
The touch sensor 280K is also referred to as a "touch panel". The touch sensor 280K may be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, which is also called a "touch screen". The touch sensor 280K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display screen 294.
The bone conduction sensor 280M may acquire a vibration signal.
Fig. 4 is a first schematic diagram of a software structure of an electronic device according to an embodiment of the present application.
As shown in fig. 4, the software architecture of the electronic device may include an AP core and a low power consumption core. The AP core may include an application, a Java native interface, native HIDL, and a low power processor interface, among others. The low power core may include an intelligent decision module.
The Application (APP) may include a system application. The system application refers to an application that is set in the electronic device before the electronic device is shipped from the factory. Exemplary system applications may include programs for settings, electronic device stewards, cameras, galleries, calendars, music, short messages, and conversations. The application package may also include a third party application, which refers to an application that the user installs after downloading the installation package from an application store (or application marketplace). For example, a game-like application (e.g.,
Figure BDA00034020583600000811
etc.) map-like applications (e.g., in a mobile communication device
Figure BDA00034020583600000810
Etc.), take-away applications (e.g., beauty)
Figure BDA00034020583600000812
Etc.), reading-like applications (e.g., reading-like applications
Figure BDA00034020583600000814
) Social applications (e.g., for social applications)
Figure BDA00034020583600000815
) And travel-like applications (e.g., for travel-like applications)
Figure BDA00034020583600000813
) And the like.
The Java Native Interface (JNI) provides several Application Program Interfaces (APIs) to implement communication between Java and other languages.
Native HIDL is an interface description language for APP to interface with low power consumption.
The low power processor interface may be configured to connect to the low power core for data transmission between the AP core and the low power core.
The intelligent decision module is used for controlling the on/off of an AO module of the electronic equipment according to the acquired customized information. The customized information includes, but is not limited to, ambient light information, proximity light information, distance sensor information, attitude sensor information, screen state information (e.g., AOD on state, off state, or on state), and sleep state information (e.g., sleep state or awake state) of the electronic device. The customized information may also include other information, such as gravity sensor information, and the like, without limitation.
In this embodiment of the application, the intelligent decision module may obtain the customization information from the low power consumption processor interface of the AP core, and may also obtain the customization information from the low power consumption core, which is not limited herein.
The technical solutions involved in the following embodiments can be implemented in the electronic device 200 having the above-described hardware structure and software structure.
In an embodiment of the present application, the intelligent decision module may determine whether to control the on/off of the AO module of the electronic device based on the received at least one piece of customization information. For example, assume that the intelligent decision module controls the on/off of the AO function of the camera based on the received at least one piece of customized information. And if the intelligent decision module only acquires the sleep state information of the electronic equipment. In this case, the intelligent decision module may control the on/off of the AO function of the camera according to the sleep state information of the electronic device. And if the intelligent decision module acquires the ambient light information, the distance sensor information and the attitude sensor information of the electronic equipment. In this case, the intelligent decision module may control the on/off of the AO function of the camera jointly based on the ambient light information, the distance sensor information, and the attitude sensor information of the electronic device.
In some embodiments, the AO function of the camera being long-open may refer to a hardware device (e.g., an image sensor) in the camera APP that supports the long-open function being in a long-open state. The AO function of the camera is not limited to the fact that the electronic equipment detects a face event according to an image collected by the camera in the screen-off state when being in the long-open state, and the electronic equipment can also detect information such as human eyes and two-dimensional codes in the screen-off state. For example, the upper-layer APP registers or cancels a face detection event by calling the long-open service module. After the camera drive of the low-power-consumption core detects a face detection event, the face detection event is reported to the upper APP through a callback function, and corresponding processing is triggered. For example, the electronic device triggers a display screen of the electronic device to display an AOD function (e.g., display time information).
In the embodiment of the application, when the camera APP is started, the camera service module issues a command for recovering hardware resources to the low-power core. Then, the AP core performs operations such as camera power-up, loading, and the like. When the camera APP is closed, the camera service module issues a command for releasing the hardware resources to the low-power-consumption core. At the moment, the intelligent decision module determines whether to control the camera to drive to immediately open the AO function of the camera or delay the AO function of the camera until the condition is met according to the customized information. Therefore, compared with the existing electronic equipment which can only control the AO function of the camera to keep a long-on or long-off state, the intelligent decision module controls the on/off of the AO function of the camera according to the customized information, the purpose of customizing the electronic equipment is achieved, and the power consumption of the electronic equipment is reduced.
An exemplary description of the intelligent decision module controlling the AO module to turn on/off based on the at least one customization information is provided below in connection with FIG. 5. Fig. 5 is a flowchart illustrating a method for controlling the on/off of the AO module according to at least one customized message according to an embodiment of the present application. As shown in fig. 5, the control method may include the steps of:
step 501, the electronic device detects that a user starts a screen-off display function.
In some embodiments, a setting interface of the electronic device may include a control for turning on the off-screen display function, and after the electronic device detects a touch operation of a user on the control for turning on the off-screen display function, the electronic device turns on the off-screen display function in response to the touch operation. For example, fig. 6 (a) shows a default user interface provided by the setup application after the electronic device opens the setup application. The user interface may include: flight mode, WLAN, bluetooth, mobile network, desktop, wallpaper, etc. The electronic device may detect a touch operation by a user on different function options in the user interface, and in response to the operation, the electronic device may turn on or off flight mode, WLAN, bluetooth, mobile network, desktop, wallpaper, and so on. The user interface comprises a desktop and wallpaper option which can be used for setting a desktop theme, a desktop display icon, wallpaper and the like of the electronic equipment.
As shown in fig. 6 (a), the electronic device may detect a user operation acting on the "desktop and wallpaper" option, in response to which the electronic device displays a user interface as shown in fig. 6 (B), which is an interface to set the desktop, lock screen, and extinguish screen of the electronic device. When the electronic apparatus detects a user operation on the "off screen display" option, the electronic apparatus displays a setting interface of the off screen display function as shown in (C) in fig. 6 in response to the operation. The electronic device can set the display time, the display picture, and the display style of the off-screen display function according to the operation of the user.
In other embodiments, the electronic device may further turn on the screen-off display function according to the received voice control operation of the user. For example, when the user inputs "turn on the off-screen display function" by voice, the electronic device turns on the off-screen display function in response to a voice control instruction received from the user.
It should be explained that the electronic device turns on the screen-off display function according to the received touch operation or the voice control instruction, which is only used as an exemplary description and is not limited in the embodiment of the present application.
Step 502, the intelligent decision module obtains screen state information.
In this embodiment of the application, the intelligent decision module may acquire the screen state information of the electronic device from the AP core, and may also acquire the screen state information of the electronic device from the low-power-consumption core, which is not limited herein.
For example, the AP core of the electronic device may transmit the screen state information of the electronic device to the intelligent decision module of the low-power-consumption core through the low-power-consumption processor interface, and the intelligent decision module acquires the screen state information of the electronic device.
Step 503, the intelligent decision module judges whether the screen is in a screen-off state according to the screen state information.
In the embodiment of the application, after the intelligent decision module acquires the screen state information of the electronic device, whether the display screen of the electronic device is in the screen-off state or not can be judged according to the screen state information.
For example, assuming that the screen state information of the electronic device acquired by the intelligent decision module is that all Liquid Crystal Displays (LCDs) are 1 (that is, all LCDs are in a lighting state), the intelligent decision module may determine that the display screen of the electronic device is in a bright screen state. Assuming that the screen state information of the electronic device acquired by the intelligent decision module is that all LCDs are 0 (that is, all LCDs are in a turned-off state), the intelligent decision module may determine that the display screen of the electronic device is in a turned-off state. Assuming that the screen state information of the electronic device acquired by the intelligent decision module is that the LCD part is 0 and the LCD part is 1 (that is, the LCD part is in a lit state and the LCD part is in a extinguished state), the intelligent decision module may determine that the display screen of the electronic device is in an AOD state.
If the intelligent decision module determines that the screen of the electronic device is in the screen-off state in step 503, step 504 is executed, otherwise, step 505 is executed.
Step 504, it is determined that the electronic device does not start the long-open module.
In the embodiment of the application, after the intelligent decision module determines that the electronic device is in the screen-off state, the intelligent decision module determines that the electronic device does not start an AO module of the electronic device. I.e. the AO-module in the electronic device is in a closed state.
For example, the face detection function of the electronic device is implemented based on the long-term opening of the AO function of the camera, and if the AO module of the electronic device is in the closed state, the electronic device cannot call the AO function of the camera through the AO module to implement the face detection function.
And 505, determining that the electronic equipment opens the long open module.
In the embodiment of the application, after the intelligent decision module determines that the electronic device is in the bright screen state, the electronic device starts the long-open module. For example, a camera of the electronic device that supports the AO function is in the AO state.
In step 506, the intelligent decision module determines to turn off the long open module.
In the embodiment of the application, when the intelligent decision module determines that the electronic device is in a bright screen state, if the intelligent decision module determines that the electronic device opens the AO module, the intelligent decision module determines to close the AO function of the electronic device.
For example, when the electronic device is in a bright screen state, the intelligent decision module determines that the electronic device starts the AO function of the camera, and the user can acquire preset information from the display screen of the electronic device at any time, so that the electronic device does not need to start the AO function of the camera to perform face detection. In this case, the intelligent decision module determines to close the AO module to close the AO function of the camera, or the electronic device may directly send an instruction to close the AO function to the camera to close the AO function of the camera, thereby saving power consumption of the electronic device.
In step 507, the intelligent decision module obtains at least one piece of customized information, and determines that the at least one piece of customized information meets a corresponding preset condition.
In this embodiment of the application, when the intelligent decision module determines that the electronic device is in a screen-off state and the electronic device does not start the AO module, the intelligent decision module may determine whether the acquired at least one piece of customized information meets a preset condition to determine whether to start the AO module. For example, the intelligent decision module may determine whether to start the AO function of the camera according to whether the acquired at least one piece of customized information satisfies a preset condition.
In some embodiments, after the intelligent decision module obtains the distance sensor information, the attitude sensor information, the ambient light information, or the proximity light information of the electronic device, the intelligent decision module may respectively determine whether the distance sensor information, the attitude sensor information, the ambient light information, or the proximity light information satisfies a preset condition.
In one possible scenario, after the intelligent decision module acquires the distance sensor information and the attitude sensor information of the electronic device, the intelligent decision module may determine that the attitude of the electronic device is upward (i.e., the screen of the electronic device is upward) according to the distance sensor information and the attitude sensor information. Under the condition, an image sensor of the electronic equipment can acquire a clear face image, and the intelligent decision module can determine to start the AO function of the camera according to the information of the distance sensor and the information of the attitude sensor. When the intelligent decision-making module determines that the electronic equipment is in a downward posture according to the information of the distance sensor and the information of the posture sensor, the image sensor of the electronic equipment can not acquire clear face images, and the intelligent decision-making module can determine not to start the AO function of the camera according to the information of the distance sensor and the information of the posture sensor, so that the purpose of reducing power consumption is achieved.
In another possible scenario, after the intelligent decision module acquires the ambient light information of the electronic device, the intelligent decision module determines that the ambient light information is greater than a first threshold. The first threshold value is the minimum value of the ambient light information of the image which can be clearly collected by the image sensor of the electronic device. In this case, the image sensor of the electronic device may acquire a clear image at the ambient brightness, and the intelligent decision module may determine to start the AO function of the camera according to the ambient light information. When the intelligent decision module determines that the ambient light information is less than or equal to the first threshold, for example, a camera of the electronic device is shielded or the ambient brightness of the electronic device is insufficient. Under the condition, the image sensor of the electronic equipment cannot acquire clear images, and the intelligent decision module can determine not to start the AO function of the camera according to the ambient light information, so that the purpose of reducing the power consumption of the electronic equipment is achieved.
In another possible scenario, after the intelligent decision module acquires the proximity light information where the electronic device is located, the intelligent decision module determines that the proximity light information is greater than the second threshold. The second threshold is a minimum value at which a proximity light sensor of the electronic device determines proximity light information of a user holding the electronic device. Such as a scenario where a user is holding an electronic device. In this case, the image sensor of the electronic device can acquire a clear image in the scene, and the intelligent decision module can determine to start the AO function of the camera according to the proximity light information. When the intelligent decision module determines that the access light information is less than or equal to a second threshold, for example, a scene where the electronic device is placed in a user's bag or pocket. Under the condition, the image sensor of the electronic equipment cannot acquire clear images, and the intelligent decision module can determine not to start the AO function of the camera according to the approaching light information, so that the purpose of reducing the power consumption of the electronic equipment is achieved.
In another possible scenario, it is assumed that the intelligent decision module acquires distance sensor information, attitude sensor information, ambient light information, and proximity light information of the electronic device. When the intelligent decision module determines that the attitude of the electronic equipment is upward according to the distance sensor information and the attitude sensor information, determines that the ambient light information is greater than a first threshold value, and determines that the approach light information is greater than a second threshold value, the intelligent decision module determines to start the AO function of the camera. When the intelligent decision module determines that at least one of the posture of the electronic device, the ambient light information or the proximity light information does not meet the preset condition, the intelligent decision module determines not to start the AO function of the camera. For example, the intelligent decision module determines that the acquired ambient light information is smaller than a first threshold, that is, the ambient brightness of the electronic device is insufficient. Under the condition, if the intelligent decision module determines to start the face detection function, an image sensor of the electronic equipment cannot acquire clear face images, and face detection cannot be accurately performed. Thus, the intelligent decision module determines not to activate the AO function of the camera.
It should be explained that, the distance sensor information, the attitude sensor information, the ambient light information, or the proximity light information of the electronic device may be obtained by the intelligent decision module from the AP core, or may be obtained from the low-power-consumption core, which is not limited in the embodiment of the present application. The intelligent decision module determines whether to start the face detection function according to whether the posture of the electronic device, the ambient light information or the proximity light information satisfies a preset condition, which is only an exemplary description. The intelligent decision module may also determine whether to start the AO function of the camera according to other customized information (e.g., sleep state information of the electronic device, etc.), which is not limited in this embodiment of the application.
If the intelligent decision module determines that at least one piece of customized information meets the preset condition in step 507, execute step 508, otherwise execute step 509.
Step 508, the intelligent decision module determines to start the long-open module.
In the embodiment of the application, when the intelligent decision module determines that the screen of the electronic device is in a screen-off state and the electronic device does not start the AO module, if the intelligent decision module determines that at least one piece of customized information meets the preset condition, the intelligent decision module determines to start the AO module.
For example, when the intelligent decision module determines whether to start the AO function of the camera according to the at least one piece of customized information, if the intelligent decision module determines that the posture of the electronic device, the ambient light information, and the proximity light information all satisfy the preset conditions, the intelligent decision module determines to start the AO function of the camera. In this case, the image sensor of the electronic device may collect image information in real time, for example, the electronic device may determine whether a human face is recognized according to the image information collected by the image sensor, and if the electronic device determines that the image information includes the human face information, the electronic device may display preset information in a preset area of the display screen.
In some embodiments, after the intelligent decision module determines to start the AO function of the camera, the electronic device may remind the user that the electronic device has started the AO function of the camera on a display interface (e.g., a notification management interface). Under the condition, when the user inconveniently holds the electronic equipment to watch time, if the electronic equipment detects the face of the user, the electronic equipment can start the AOD function so as to display time information in a preset area. For example, as shown in fig. 7, the mobile phone may display a prompt message "prompt: the long open function of the camera has been activated ".
In step 509, the intelligent decision module determines not to start the long-open module.
In the embodiment of the application, when the intelligent decision module determines that the screen of the electronic device is in a screen-off state and the electronic device does not start the long-open module, if the intelligent decision module determines that at least one of the customized information does not meet the preset condition, the intelligent decision module determines not to start the long-open module.
For example, assuming that the intelligent decision module determines whether to start the AO function of the camera according to the at least one piece of customized information, and when the intelligent decision module determines that the screen of the electronic device is in the screen-off state and the electronic device does not start the AO function of the camera, if the intelligent decision module determines that at least one of the posture of the electronic device, the ambient light information, or the proximity light information does not satisfy the preset condition, the intelligent decision module determines not to start the AO function of the camera. Namely, the intelligent decision module determines not to start the AO function of the camera supporting the AO function. Therefore, the purpose of reducing the power consumption of the electronic equipment is achieved.
In some embodiments, when it is assumed that the electronic device is in a screen-off state, after the intelligent decision module acquires the customized information, the intelligent decision module determines to turn on a switch of an AO function of the camera according to the customized information. If the electronic device detects the face information of the user, the electronic device may start the AOD function to display time information in a preset area. As shown in fig. 8, the electronic device is still used as the mobile phone for example, the left diagram in fig. 8 is that the mobile phone is in a screen-off state, after the mobile phone starts the AO function, the face information of the user is detected, and the display screen of the mobile phone may display the time information, as shown in the right diagram in fig. 8.
In some embodiments, a setting interface of the electronic device is provided with an on/off control of an AO module of the electronic device, and the electronic device can control the on/off of the AO module according to a received control instruction after receiving the control instruction of a user. For example, as shown in fig. 9, it is assumed that the electronic device is a mobile phone, and if the mobile phone detects that the user switches the AO module from the off state to the on state, the mobile phone starts the AO function in response to the operation of the user. As in fig. 9 (a) to 9 (B), the AO module of the camera is switched from the off state to the on state. After the mobile phone starts the AO module, the mobile phone can also respond to the customized information used for controlling the on/off of the AO module by the operation of a user. As shown in fig. 9, if the mobile phone detects that the user starts the ambient light information and the proximity light information on the setting interface of the AO module, the low power consumption core of the mobile phone may control the AO module to be turned on/off according to the ambient light information and the proximity light information. As shown in fig. 9 (C) to 9 (D), the low-power core of the mobile phone may control the AO module to switch from the on state to the off state according to the ambient light information and the proximity light information.
In a possible case of the embodiment of the present application, when the intelligent decision module obtains the customization information from the processor interface of the AP core, the AP core may transmit the customization information through the native interface, or the AP core may transmit the customization information through an interface added to the HIDL. When the AP core transmits the customized information at the HIDL add custom interface, the AP core needs to recompile all installation packages that depend on the native HIDL service.
Fig. 10 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application. The foregoing technical solution can also be implemented in an electronic device having a software structure shown in fig. 10, as shown in fig. 10, a software architecture of the electronic device includes an application (e.g., a camera APP or a long-open APP), a Java local interface, a long-open HIDL, a long-open service module, HIDL, a camera service module, a low-power processor interface, a camera driver 1, and a camera driver 2. The AP core and the low power core are each different processing units of a processor of the electronic device. The system comprises an application program, a Java local interface, a long-open HIDL (hardware in the software design), a long-open service module, an HIDL (hardware in the software design), a camera service module, a low-power processor interface and a camera driver 1, wherein the application program, the Java local interface, the long-open HIDL, the long-open service module, the HIDL, the camera service module, the low-power processor interface and the camera driver 1 are executed on an AP (access point) core; the camera driver 2 is executed in the low power consumption core. An operating system and user interface of the electronic device are also executed on the AP core.
The long open HIDL is an interface description language for long open APP with low power interface.
The long-open service module is used for transmitting the information of the long-open APP to the low-power-consumption core through the low-power-consumption processor interface after the information of the long-open APP is acquired from the native HIDL.
HIDL is an interface description language for specifying the interface between a hardware abstraction layer and its user, which allows specified types and function calls to be collected into interfaces and packages.
The camera service module is used for sending information acquired from the camera APP to the low-power-consumption core interface.
Both the camera driver 1 and the camera driver 2 can control on/off of the camera supporting the long open function.
As can be seen from fig. 10, there are two control lines in the electronic device software architecture, where the left control line is a registration service and reporting service channel, and the right control line is a control line triggered by the camera APP. When the AO function of the electronic device is running, the camera APP triggers an event (for example, the electronic device triggers a photographing event), the camera APP issues the event to the camera service module, and the camera service module sends a mutual exclusion control command to the low-power-consumption core through the low-power-consumption processor interface. And after receiving the mutual exclusion control command, the low-power-consumption core releases the camera resources (such as hardware resources and software resources) occupied by the low-power-consumption core. The electronic device stops the low power consumption function of the left control line in response to the mutex control command. The camera APP may be controlled by the camera driver 1 of the AP core, and may also be controlled by the camera driver 2 of the low power consumption core, which is not limited herein.
After the event triggered by the camera APP is ended, the camera service module sends an instruction to the low-power-consumption core through the low-power-consumption processor interface so as to inform the low-power-consumption core camera APP that the resource of the camera APP occupied by the low-power-consumption core camera APP is released. In this case, if the AP core registers the face detection service, the electronic device sends the service to the low-power core through the low-power processor interface. When the camera APP triggers an event (for example, a face image event is acquired), the low-power core reports the event to the AP core, so that the electronic device displays the AOD function in a preset area of the display screen.
The HIDL interface and the low-power-consumption processor interface in the software structure of the existing electronic equipment only support the transmission of information corresponding to native services, and some customized information cannot be transmitted from the AP core to the low-power-consumption core. In the embodiment of the application, a customized interface is added to a software architecture of the electronic device, and all installation packages depending on the HIDL service are compiled at the same time. For example, when the camera APP starts normally, the camera service module issues a command to recycle the hardware resource to the low power core. And then the AP performs normal operations such as power-on, loading and the like on the camera. When the camera APP is closed, the camera service module issues a command for releasing hardware resources to the low-power-consumption core. After the camera APP subscribes to the customization information, the camera APP transmits the customization information to the camera HIDL through the JNI. The camera HIDL sends the customization information to the low-power-consumption processor interface through the camera service module, and the low-power-consumption processor interface transmits the corresponding customization information to the low-power-consumption core from the AP core through the customization interface. After the intelligent decision module of the low-power-consumption core receives the customization information, if the intelligent decision module determines to start the AO function of the camera APP of the electronic equipment according to the customization information, the AO function of the camera supporting the long-open function is started under the drive control of the camera. And if the intelligent decision module determines to control the closing of the AO function of the camera APP of the electronic equipment according to the customized information, the camera drive controls the closing of the AO function of the camera supporting the long-open function.
Therefore, the customized information is transmitted by adding the customized interface to the electronic device, and the AP core transmits the customized information to the low-power-consumption core, so that the intelligent decision module can realize the customized control on the on/off of the AO function according to the customized information after the low-power-consumption core receives the customized information.
In another possible case of the embodiment of the present application, the AP core may transmit the customization information to the low power consumption core through a preset private path. Fig. 11 is a third schematic diagram of a software structure of an electronic device according to an embodiment of the present application. The above technical solution can also be implemented in an electronic device having a software structure shown in fig. 11, and as shown in fig. 11, a software architecture of the electronic device may include an application program, a Java native interface, a long open HIDL, a long open service module, HIDL, a camera service module, a private HIDL, a private service module, a low power consumption processor interface, a camera driver 1, and a camera driver 2. The system comprises an application program, a Java local interface, a long-open HIDL, a long-open service module, an HIDL, a camera service module, a private HIDL, a private service module, an intelligent decision module, a low-power processor interface and a camera driver 1, wherein the application program, the Java local interface, the long-open HIDL, the long-open service module, the HIDL, the camera service module, the private HIDL, the private service module, the intelligent decision module, the low-power processor interface and the camera driver 1 are executed on an AP core; the intelligent decision module and the camera driver 2 are executed in the low-power-consumption core. The intelligent decision module is used for determining whether to control the camera drive 2 to start the AO function of the camera or not according to the customized information received by the low-power-consumption core.
Among them, the private HIDL is an interface description language for transmitting customized information.
The private service module is used for transmitting the customized information to the low-power-consumption core through the private HIDL interface after acquiring the customized information from the private HIDL.
Therefore, a private HIDL path (namely, a private HIDL and a private service module) is added in a software architecture of the electronic device, so that the electronic device can transmit the customization information (such as the screen state of the electronic device, the ambient light sensor information and the like) of the AP core to the low-power-consumption core through the private HIDL path, and the low-power-consumption core can realize the customization control of the on/off of the AO function according to the customization information.
In the embodiment of the application, the electronic device may add a statement of a private HIDL and a private service module in a software architecture, and further, the electronic device may transmit the customization information from the AP core to the low power consumption core through the private HIDL and the private service module.
In the embodiment of the application, in order to transmit the customization information from the AP core to the low-power-consumption core through the private HIDL interface, the electronic device adds a customization function corresponding to the customization information to the private HIDL. For example, the electronic device may add the customized functions to the private HIDL according to the customized requirements, including but not limited to setAL (), setCL (), setDS (), setAS (), setLS (), and setSS (). Wherein, setAL () function is used to transmit ambient light information from the AP core to the low power core, setCL () is used to transmit proximity light information from the AP core to the low power core, setDS () is used to transmit distance sensor information from the AP core to the low power core, setAS () is used to transmit attitude sensor information from the AP core to the low power core, setLS () is used to transmit screen state information of the electronic device from the AP core to the low power core, setSS () is used to transmit sleep state information of the electronic device from the AP core to the low power core.
It should be explained that there is a corresponding relationship between the added customization function and the transmission of the customization information from the AP core to the low power consumption core by the private HIDL and the private service module. Each piece of customized information has a corresponding customized function on the private HIDL interface, so that the private HIDL interface transmits the corresponding customized information from the AP core to the low-power consumption core through the customized function. For example, assuming that the customized information includes proximity light information and attitude sensor information, the private HIDL interface is provided with customized functions setCL () and setAS () for transmitting the proximity light information and the attitude sensor information.
Therefore, the electronic equipment releases the coupling with the original HIDL in the development iteration by adding the customization function corresponding to the customization information in the private HIDL interface, so that the extra workload is reduced, and the iteration speed is accelerated.
In the embodiment of the application, the electronic device may add some additional instructions for controlling the customized information based on the existing instruction for reporting the event (for example, subscribing to the face detection event or unsubscribing from the face detection) according to the customized requirement. For example, the electronic device may set a request instruction and a corresponding response instruction for customized information such as ambient light information, proximity light information, distance sensor information, attitude sensor information, screen status, and sleep status. For example, the request command and the corresponding response command of the electronic device for each customized information setting can be referred to the following table 1.
TABLE 1
Customizing information Request instruction Responding to the instruction
Ambient light information CAMERA_FD_AL_STAT CAMERA_FD_AL_STAT_ACK
Proximity light information CAMERA_FD_CL_STAT CAMERA_FD_CL_STAT_ACK
Distance sensor information CAMERA_FD_DS_STAT CAMERA_FD_DS_STAT_ACK
Attitude sensor information CAMERA_FD_AS_STAT CAMERA_FD_AS_STAT_ACK
Status of screen CAMERA_FD_LS_STAT CAMERA_FD_LS_STAT_ACK
Sleep state CAMERA_FD_SS_STAT CAMERA_FD_SS_STAT_ACK
It should be noted that the customization information and the corresponding request command and response command in table 1 are only described as examples, and the actual customization information and the corresponding request command and response command are taken as the standard in the process of actually executing the command, and are not limited herein.
In this embodiment of the present application, the AP core sends a setting request instruction of the customization information to the low-power-consumption core through the private path, and after the low-power-consumption core receives the setting request instruction of the customization information, the low-power-consumption core may return a response instruction corresponding to the customization information to the AP core. For example, assuming that the low-power-consumption core determines whether to start the face detection function according to customized information (e.g., ambient light information), the AP core of the electronic device may call an ambient light function set by the interface of the low-power-consumption core processor through a setAL () function set by the private HIDL interface, and after sending an ambient light setting request instruction to the low-power-consumption core, the low-power-consumption core returns a response instruction corresponding to the ambient light information to the AP core. The low-power-consumption core can determine whether to start the face detection function according to the received ambient light information.
In this embodiment, the AP core of the electronic device may transmit the customization information to the low power consumption core in real time or periodically (for example, in a period of 5 seconds or 10 seconds) through the customization function set by the private HIDL interface. After the low-power-consumption core of the electronic equipment receives the customization information, the intelligent decision module can determine whether to control the camera to drive and start the AO function of the camera according to the received customization information. For example, after the low-power-consumption core of the electronic device receives the ambient light information transmitted by the AP core through the function of transmitting the ambient light information, the intelligent decision module may determine whether to control the camera to drive the start of the AO function of the camera according to the ambient light information. Therefore, the intelligent decision module can acquire the customized information, and a more flexible power consumption strategy is adopted according to the customized information, so that more optimal power consumption control is realized, and the purpose of reducing the power consumption of the electronic equipment is achieved.
In summary, in the embodiment of the present application, on the basis of the existing software architecture of the electronic device, a private path (i.e., a private HIDL and a private service module) is added, and the sending of the customized information to the low-power-consumption core is realized through the private path. And the intelligent decision module determines whether to control the camera to drive and start the AO function of the camera according to the customization information received by the low-power-consumption core. Therefore, the purpose of customizing the AO function of the camera is achieved, the power consumption problem caused by the long-term opening of the AO function in the existing software architecture is solved, and the purpose of effectively reducing the power consumption of the electronic equipment is achieved.
Compared with the existing software architecture of the electronic device, the existing software architecture of the electronic device cannot transmit the customized information from the AP core to the low-power-consumption core, and the low-power-consumption core cannot control the AO function of the camera in a customized manner, so that the problem of large power consumption caused by long-term opening of the AO function of the camera is solved. In the embodiment of the application, the private access is added on the basis of the existing software architecture of the electronic equipment, and the customized information is sent to the low-power-consumption core through the private access, so that the problem of power consumption caused by the fact that the AO function is long and the functions of the electronic equipment cannot be flexibly controlled in the existing software architecture is solved, and the purpose of effectively reducing the power consumption of the electronic equipment is achieved.
Fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in fig. 12, the electronic device may be a mobile phone. The electronic device may specifically include: a touch screen 1201, the touch screen 1201 comprising a touch sensor 1206 and a display screen 1207; one or more processors 1202; a memory 1203; one or more application programs (not shown); and one or more computer programs 1204, which may be connected by one or more communication buses 1205. Wherein the one or more computer programs 1204 are stored in the memory 1203 and configured to be executed by the one or more processors 1202, the one or more computer programs 1204 comprising instructions that can be used to perform the steps associated with the above embodiments.
It is to be understood that the electronic devices and the like described above include hardware structures and/or software modules for performing the respective functions in order to realize the functions described above. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
In the embodiment of the present application, the electronic device and the like may be divided into functional modules according to the method example, for example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiment of the present invention is schematic, and is only one logic function division, and another division manner may be available in actual implementation.
In a case where the functional modules are divided according to the respective functions, a possible composition diagram of the electronic device related to the above embodiment may include: a display unit, a transmission unit, a processing unit and the like. It should be noted that all relevant contents of each step related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.
Embodiments of the present application also provide an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to perform the associated method steps described above to implement the control method of the electronic device in the above embodiments.
Embodiments of the present application further provide a computer-readable storage medium, where computer instructions are stored, and when the computer instructions are executed on an electronic device, the electronic device is caused to execute the above related method steps to implement the control method of the electronic device in the above embodiments.
Embodiments of the present application further provide a computer program product, which includes computer instructions, when the computer instructions are run on an electronic device, cause the electronic device to execute the above related method steps to implement the control method of the electronic device in the above embodiments.
In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component or a module, and may include a processor and a memory connected to each other; the memory is used for storing computer execution instructions, and when the apparatus runs, the processor can execute the computer execution instructions stored in the memory, so that the apparatus executes the control method of the electronic device executed by the electronic device in the above-mentioned method embodiments.
In addition, the electronic device, the computer-readable storage medium, the computer program product, or the apparatus provided in this embodiment are all configured to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the computer-readable storage medium, the computer program product, or the apparatus can refer to the beneficial effects in the corresponding method provided above, and are not described herein again.
Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
Each functional unit in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or make a contribution to the prior art, or all or part of the technical solutions may be implemented in the form of a software product stored in a storage medium and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard drive, read only memory, random access memory, magnetic or optical disk, and the like.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (12)

1. A method of controlling an electronic device, the method comprising:
in the process that the electronic equipment displays a first interface, if the electronic equipment determines that the long-open function of the electronic equipment is in a closed state, acquiring at least one piece of customized information; the first interface is displayed when a display screen of the electronic equipment is in a screen-off state; the customized information comprises at least one of ambient light information, proximity light information, distance sensor information, attitude sensor information, screen status information, or sleep status information of the electronic device;
and if the at least one piece of customized information meets the corresponding preset condition, controlling the long-term function of the electronic equipment to be started.
2. The method according to claim 1, wherein the at least one customized message each satisfies a corresponding predetermined condition, comprising at least one of:
the electronic device determines that the ambient light information is greater than a first threshold, or the electronic device determines that the approach light information is greater than a second threshold, or the electronic device determines that the posture of the electronic device is upward according to the distance sensor information and the posture sensor information, or the sleep state information of the electronic device is a sleep state.
3. The method of claim 1 or 2, wherein the controlling the activation of the long-open function of the electronic device comprises:
if the electronic equipment starts the screen-off display function, the electronic equipment displays a second interface; the second interface comprises first content displayed when the electronic equipment is in a screen-off state.
4. The method of claim 1 or 2, the controlling the long-open function initiation of the electronic device, further comprising:
if the electronic equipment does not start the screen-off display function, the electronic equipment displays a third interface; the third interface does not include display content.
5. The method of claim 1 or 2, after the controlling the long-open function of the electronic device is initiated, the method further comprising:
and displaying prompt information, wherein the prompt information is used for reminding a user that the long-open function of the electronic equipment is started.
6. The method according to claim 1 or 2, characterized in that the method further comprises:
the electronic equipment displays a fourth interface, wherein the fourth interface is displayed when a display screen of the electronic equipment is in a bright screen state;
and if the electronic equipment determines that the long-open function of the electronic equipment is in an open state, controlling the long-open function of the electronic equipment to be closed.
7. The method according to claim 1 or 2, characterized in that the method further comprises:
the electronic equipment displays a fifth interface, wherein the fifth interface is an interface of the electronic equipment with an on/off control of a long-open function in a closed state;
in the process that the electronic equipment displays the fifth interface, if an on/off control of the long-open function of the electronic equipment receives a first control instruction of a user, the electronic equipment responds to the first control instruction to start the long-open function of the electronic equipment.
8. The method according to claim 1 or 2, characterized in that the method further comprises:
the electronic equipment displays a sixth interface, wherein the sixth interface is an interface of which the on/off control of the at least one piece of customized information is in a closed state;
in the process that the electronic device displays the sixth interface, if the at least one customized information on/off control receives a second control instruction of the user, the electronic device responds to the second control instruction to acquire the at least one customized information.
9. The method of claim 1 or 2, wherein the electronic device comprises:
an application processor core and a low power consumption core;
wherein the application processor core comprises: the system comprises an application program, a customization module and a low-power-consumption processor interface; the low-power-consumption core comprises an intelligent decision module;
the application program acquires the at least one piece of customized information and sends the at least one piece of customized information to the customized module;
the customization module is used for sending the at least one piece of customization information to the low-power-consumption processor interface after receiving the at least one piece of customization information;
the low-power processor interface is used for receiving the at least one piece of customization information from the customization module and then sending the at least one piece of customization information to the low-power core; and
and the intelligent decision module is used for controlling the on/off of the long-open function of the electronic equipment according to the at least one piece of customized information after the low-power-consumption core receives the at least one piece of customized information.
10. An electronic device, comprising:
one or more processors;
a memory;
wherein the memory has stored therein one or more computer programs comprising instructions which, when executed by the electronic device, cause the electronic device to carry out the method of controlling an electronic device according to any one of claims 1-9.
11. A computer-readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the method of controlling the electronic device according to any one of claims 1-9.
12. A computer program product, characterized in that it comprises computer instructions which, when run on an electronic device, cause the electronic device to carry out the method of controlling an electronic device according to any one of claims 1-9.
CN202111499097.1A 2021-12-09 2021-12-09 Control method of electronic equipment and electronic equipment Active CN115016628B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111499097.1A CN115016628B (en) 2021-12-09 2021-12-09 Control method of electronic equipment and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111499097.1A CN115016628B (en) 2021-12-09 2021-12-09 Control method of electronic equipment and electronic equipment

Publications (2)

Publication Number Publication Date
CN115016628A true CN115016628A (en) 2022-09-06
CN115016628B CN115016628B (en) 2023-06-27

Family

ID=83064998

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111499097.1A Active CN115016628B (en) 2021-12-09 2021-12-09 Control method of electronic equipment and electronic equipment

Country Status (1)

Country Link
CN (1) CN115016628B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117714834A (en) * 2023-06-21 2024-03-15 荣耀终端有限公司 Camera control method and related equipment thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108646973A (en) * 2018-05-10 2018-10-12 Oppo广东移动通信有限公司 Put out screen display methods, mobile terminal and computer readable storage medium
CN111108506A (en) * 2018-03-26 2020-05-05 华为技术有限公司 Prompt message display method and electronic equipment
WO2020155876A1 (en) * 2019-01-31 2020-08-06 华为技术有限公司 Screen display control method and electronic device
WO2021169337A1 (en) * 2020-02-29 2021-09-02 荣耀终端有限公司 In-screen fingerprint display method and electronic device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111108506A (en) * 2018-03-26 2020-05-05 华为技术有限公司 Prompt message display method and electronic equipment
CN108646973A (en) * 2018-05-10 2018-10-12 Oppo广东移动通信有限公司 Put out screen display methods, mobile terminal and computer readable storage medium
WO2020155876A1 (en) * 2019-01-31 2020-08-06 华为技术有限公司 Screen display control method and electronic device
WO2021169337A1 (en) * 2020-02-29 2021-09-02 荣耀终端有限公司 In-screen fingerprint display method and electronic device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117714834A (en) * 2023-06-21 2024-03-15 荣耀终端有限公司 Camera control method and related equipment thereof

Also Published As

Publication number Publication date
CN115016628B (en) 2023-06-27

Similar Documents

Publication Publication Date Title
CN110708086B (en) Split-screen display method and electronic equipment
WO2021052263A1 (en) Voice assistant display method and device
WO2021175213A1 (en) Refresh rate switching method and electronic device
WO2020259452A1 (en) Full-screen display method for mobile terminal, and apparatus
WO2021052279A1 (en) Foldable screen display method and electronic device
WO2021213164A1 (en) Application interface interaction method, electronic device, and computer readable storage medium
CN111258700B (en) Icon management method and intelligent terminal
WO2021036785A1 (en) Message reminding method and electronic device
CN114257670B (en) Display method of electronic equipment with folding screen
WO2023000772A1 (en) Mode switching method and apparatus, electronic device and chip system
WO2021073183A1 (en) Always on display method and mobile device
WO2021218429A1 (en) Method for managing application window, and terminal device and computer-readable storage medium
CN115794287A (en) Display method, electronic equipment and computer storage medium
CN113986162B (en) Layer composition method, device and computer readable storage medium
WO2020056778A1 (en) Method for shielding touch event, and electronic device
WO2021238370A1 (en) Display control method, electronic device, and computer-readable storage medium
CN114257671B (en) Image display method and electronic equipment
WO2022143180A1 (en) Collaborative display method, terminal device, and computer readable storage medium
CN115914460A (en) Display screen control method and electronic equipment
US20240211017A1 (en) System Power Consumption Control Method and Electronic Device
WO2022089216A1 (en) Interface display method and electronic device
EP4163782A1 (en) Cross-device desktop management method, first electronic device, and second electronic device
CN115016628B (en) Control method of electronic equipment and electronic equipment
WO2023207667A1 (en) Display method, vehicle, and electronic device
WO2023030168A1 (en) Interface display method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant