CN114065312A - Component display method and electronic equipment - Google Patents

Component display method and electronic equipment Download PDF

Info

Publication number
CN114065312A
CN114065312A CN202111173426.3A CN202111173426A CN114065312A CN 114065312 A CN114065312 A CN 114065312A CN 202111173426 A CN202111173426 A CN 202111173426A CN 114065312 A CN114065312 A CN 114065312A
Authority
CN
China
Prior art keywords
user
display screen
desktop
information
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111173426.3A
Other languages
Chinese (zh)
Inventor
师欣荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202111173426.3A priority Critical patent/CN114065312A/en
Publication of CN114065312A publication Critical patent/CN114065312A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82Protecting input, output or interconnection devices
    • G06F21/84Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The embodiment of the application provides a component display method and electronic equipment, relates to the technical field of terminals, and not only is the purpose of protecting privacy information achieved, but also the safety performance of the electronic equipment is improved. The method is applied to the electronic equipment comprising the display screen, and comprises the following steps: the method comprises the steps that the electronic equipment detects whether a first user in a first range of a display screen is a preset user or not; if the first user is a preset user, displaying the first desktop widget on the display screen; the first desktop small component comprises privacy information, and a preset user can check the privacy information; and if the first user comprises users except the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when the first desktop widget is displayed on the display screen.

Description

Component display method and electronic equipment
Technical Field
The application relates to the technical field of terminals, in particular to a component display method and electronic equipment.
Background
With the development of electronic devices, various Applications (APPs) are developed, so that a user can handle many things through the APPs on the electronic device, and convenience is provided for the user. At present, a card is displayed on a display interface of an electronic device, so that the electronic device provides information for a user more conveniently and intuitively. The card can be realized by a desktop widget, and a user can flexibly construct a UI (user interface) through the widget.
However, when the display interface of the electronic device displays the card, the content displayed in the card may expose the privacy of the user.
Disclosure of Invention
The embodiment of the application provides a component display method and electronic equipment, wherein face recognition can be performed on a first user in a first range of a display screen through the electronic equipment, and when it is determined that the first user comprises users other than a preset user according to a face recognition result, the electronic equipment screens desktop widgets to be displayed and information in the desktop widgets so as to hide the desktop widgets containing privacy information or hide privacy information in the desktop widgets. Therefore, the purpose of protecting the privacy information is achieved, and the safety performance of the electronic equipment is improved.
In order to achieve the purpose, the technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a component display method, which is applied to an electronic device including a display screen, and the method includes:
before the electronic equipment displays the first desktop widget on the display screen or in the process of displaying the first desktop widget on the display screen, detecting whether a first user in a first range of the display screen is a preset user, wherein the first desktop widget comprises privacy information, and the preset user can check the privacy information; and if the first user comprises users except the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when the first desktop widget is displayed on the display screen.
Therefore, when the user in the first range of the display screen of the electronic equipment is detected to include the user which is preset by the user, the electronic equipment screens the desktop small component to be displayed and the information in the desktop small component so as to hide the desktop small component containing the privacy information or the privacy information in the desktop small component, and the purpose of protecting the privacy information is achieved.
In the embodiment of the application, before the first desktop widget is displayed on the display screen or in the process of displaying the first desktop widget on the display screen, whether the first user in the first range of the display screen is a preset user or not is detected, so that the power consumption problem caused by continuous detection can be reduced, that is, in the process of not displaying the first desktop widget, the first user in the first range of the display screen can not be detected, and the power consumption of the electronic device can be saved.
In one possible implementation, the component display method further includes: if the first user in the first range of the display screen is detected as a preset user in the process that the electronic equipment displays the first desktop widget on the display screen, the first desktop widget continues to be displayed on the display screen.
In one possible implementation manner, the electronic device stores face information of a preset user; detecting whether a first user in a first range of a display screen is a preset user, including:
acquiring an image in a first range of a display screen; carrying out face recognition on the image to obtain face information of at least one first user; if the face information matched with the face information of each first user exists in the face information of the preset users, determining at least one first user as the preset user; and if the face information of the at least one first user has the face information which is not matched with the face information of the preset user, determining that the at least one first user comprises users except the preset user.
Therefore, whether the user using the electronic equipment is a preset user or not is determined by identifying the users in the first range of the display screen of the electronic equipment.
In another possible implementation manner, the detecting, by the electronic device, whether a first user in a first range of a display screen is a preset user before the electronic device displays the first desktop widget on the display screen, includes:
the electronic device detects whether a first user within a first range of the display screen is a preset user before determining that a start time of a preset time period is reached. For example, the electronic device may detect whether a first user within a first range of the display screen is a preset user within a first time period before it is determined that a start time of the preset time period is reached. The length of the first time period can be set according to requirements, and for example, the first time period can be several minutes before the starting time of the preset time period.
When the starting time is reached, if the first user is detected to include users other than the preset user, stopping displaying the first desktop widget on the display screen or hiding privacy information when the first desktop widget is displayed on the display screen. And when the starting time is reached, if the first user is detected to be a preset user, displaying the first desktop widget on a display screen.
Therefore, when the first desktop widget displayed in the display screen of the electronic equipment is the widget displayed within the preset time period, the electronic equipment identifies users within the first range of the display screen before the preset time period displayed by the first desktop widget to determine whether the user using the electronic equipment is the preset user.
In another possible implementation manner, the detecting, by the electronic device, whether a first user in a first range of the display screen is a preset user before the electronic device displays the first desktop widget on the display screen is performed by a widget displayed in a first area of the display screen includes:
when the electronic equipment detects an instruction for displaying a display interface of a display screen where the first area is located, whether a first user in a first range of the display screen is a preset user is detected. If the first user is detected to be a preset user, displaying the first desktop widget in a first area of a display interface of the display screen, and if the first user is detected to comprise users except the preset user, stopping displaying the first desktop widget in the first area of the display interface of the display screen or hiding privacy information when displaying the first desktop widget.
Therefore, for a first desktop widget which is fixed in a specific area (in a first area) of a display screen and is always displayed, when a user is switched to the display interface of the display screen where the first area is located through other display interfaces, namely when a terminal detects an instruction for displaying the display interface of the display screen where the first area is located, the electronic device identifies the user in the first range of the display screen to determine whether the user using the electronic device is a preset user.
In another possible implementation manner, during the process that the electronic device displays the first desktop widget in the display screen, users within the first range of the display screen may be identified in real time or periodically to determine whether the user using the electronic device is a preset user. If the first user is detected to be a preset user, the first desktop widget is continuously displayed on the display screen, and if the first user is detected to comprise users except the preset user, the first desktop widget is stopped being displayed on the display screen or privacy information is hidden when the first desktop widget is displayed on the display screen.
In another possible implementation manner, if it is detected that the first user in the first range of the display screen includes a user other than a preset user in the process of displaying the first desktop widget on the display screen by the electronic device, stopping displaying the first desktop widget on the display screen, includes:
the first desktop widget is removed from the display.
Therefore, if the electronic equipment displays the first desktop small component on the display screen, when the user using the electronic equipment is determined to include users other than the preset user, the first desktop small component is deleted, so that the privacy information in the first desktop small component is prevented from being leaked, and the safety performance of the electronic equipment is improved.
In another possible implementation manner, the stopping displaying the first desktop widget on the display screen, where the first desktop widget is a widget corresponding to the first application, includes:
and displaying a second desktop small component of the first application program on the display screen to replace the first desktop small component, wherein the information displayed by the second desktop small component is the information which can be viewed by all users.
Therefore, when the user using the electronic equipment is determined to comprise a user except the preset user, the first desktop widget displayed on the display screen is replaced by the second desktop widget not containing the privacy information, and the problem that the privacy information in the first desktop widget is leaked is avoided.
In another possible implementation, hiding private information while displaying the first desktop widget on the display screen includes:
and displaying the first desktop small component with the deleted privacy information on a display screen.
Therefore, when the fact that the user using the electronic equipment comprises a user other than the preset user is detected, the privacy information in the first desktop small component is deleted, the privacy information in the first desktop small component is prevented from being leaked, and the information in the first desktop small component can be displayed to the preset user in time.
In another possible implementation, hiding private information while displaying the first desktop widget on the display screen includes:
and replacing the privacy information in the first desktop small component with preset characters and then displaying the privacy information on the display screen. Therefore, the private information in the first desktop small component is replaced by the preset characters, so that the private information in the first desktop small component is prevented from being leaked, and the information in the first desktop small component can be displayed to a preset user in time.
In another possible implementation manner, after stopping displaying the first desktop widget on the display screen or hiding the private information while displaying the first desktop widget on the display screen, the method further includes:
detecting whether a first user in a first range of a display screen is a preset user; and if the first user is a preset user, displaying the first desktop widget on the display screen again or displaying the privacy information hidden by the first desktop widget on the display screen again.
Therefore, when the fact that the users using the electronic equipment are all preset users is detected, the first desktop widget or the privacy information hidden by the first desktop widget is displayed to the preset users in time.
In another possible implementation, the first desktop widget includes information pushed by one or more applications. Optionally, the first desktop widget may include information pushed by one application program, or may include information pushed by a plurality of application programs, which is not limited in this embodiment of the application. Therefore, the purpose of displaying information pushed by the application program is achieved by displaying the first desktop widget in the first area of the display screen.
In a second aspect, the present application provides an electronic device comprising: a display screen; one or more processors; before displaying the first desktop widget on the display screen or in the process of displaying the first desktop widget on the display screen, the processor detects whether a first user in a first range of the display screen is a preset user, wherein the first desktop widget contains privacy information, and the preset user can check the privacy information; and the processor determines that the first user comprises a user other than the preset user, and stops displaying the first desktop widget on the display screen or hides the privacy information when displaying the first desktop widget on the display screen.
In a third aspect, the present application provides an electronic device, comprising: a display screen; one or more processors; a memory; wherein the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the electronic device, cause the electronic device to perform the component display method of any of the first aspects.
In a fourth aspect, the present application provides a computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the component display method of any one of the first aspect.
In a fifth aspect, the present application provides a computer program product for causing an electronic device to perform the component display method of any one of the first aspect when the computer program product is run on the electronic device.
It is understood that the electronic device, the computer storage medium, and the computer program product provided above are all configured to execute the corresponding method provided above, and therefore, the beneficial effects achieved by the electronic device, the computer storage medium, and the computer program product may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.
Drawings
Fig. 1 is a first application scenario diagram of a component display method according to an embodiment of the present application;
fig. 2 is a schematic view of an application scenario of a component display method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a structural block diagram of an electronic device according to an embodiment of the present application;
fig. 5 is a schematic view of an application scenario of a component display method according to an embodiment of the present application;
fig. 6 is a schematic view of an application scenario of a component display method according to an embodiment of the present application;
FIG. 7 is a flowchart of a component display method according to an embodiment of the present disclosure;
fig. 8 is a schematic view of an application scenario of a component display method according to an embodiment of the present application;
fig. 9 is a schematic view six of an application scenario of a component display method according to an embodiment of the present application;
fig. 10 is a schematic view seventh of an application scenario of a component display method according to an embodiment of the present application;
fig. 11 is an application scenario schematic diagram eight of a component display method according to an embodiment of the present application;
fig. 12 is a schematic view nine of an application scenario of a component display method according to an embodiment of the present application;
fig. 13 is a schematic view of an application scenario of a component display method according to an embodiment of the present application;
fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.
In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
Currently, a display interface of an electronic device may display a desktop widget, wherein the desktop widget may be displayed on the display interface of the electronic device in the form of a card. The card is an information carrier with a closed outline, and provides important or closely related information in a condensed form intuitively and quickly for information display and interaction. The card may be displayed on a display interface of the electronic device (e.g., a desktop of the electronic device) so that a user may view the content displayed by the card upon opening the electronic device. An APP may correspond to one card or a plurality of cards, which is not limited herein. For example, assuming that the APP is weather, the APP corresponds to a card, the form of the card may be various, for example, the cards in different forms are different in size or shape, and the card displayed in the desktop of the mobile phone is only used for displaying information pushed by the weather.
Figure BDA0003294206240000041
Can correspond to a plurality of cards, and the plurality of cards are used for displaying on the desktop of the mobile phone
Figure BDA0003294206240000042
Pushed information. In addition, one card can also be used for displaying information pushed by a plurality of APPs, for example, information pushed by a plurality of APPs such as weather, a calendar, a clock, a map and the like can be displayed on one card. In addition, the content displayed in the card includes, but is not limited to, characters, numbers, images, videos, and the like, and the content displayed in the card is not limited in this embodiment.
In the embodiment of the application, a user can preset whether to allow the APP to push information through the card in the electronic equipment. In one example, assuming that the APP is weather, the user may preset whether to push weather information through a card in the weather APP, so that the electronic device may push the weather information in the card displayed on the display interface. As shown in FIG. 1, a user sets weather information to be pushed through a card at 6 am every day in a weather APP, and the electronic device can display the weather information of the day through the card at 6 am every day. For example, assuming that the APP is a conference APP, the user may set in the conference APP so that the electronic device may push conference prompt information in a card displayed on the display interface. As shown in fig. 2, the user may set, in the conference APP, to push the conference prompt information through the card 30 minutes in advance. For example, the meeting start time is 9:00 in fig. 2, and the display interface of the electronic device displays the meeting time, the meeting place, the meeting subject, the participants and the like in the card displayed at 8: 30.
The cards of fig. 1 and 2 above are shown in a timed push manner, but are merely some examples of the present application, and the present application is not limited thereto. The desktop can also be directly provided with a card, and the card displays corresponding push information in real time. In the above examples, the specific shape, form, etc. of the card display are not limited.
However, when the card is displayed on the display interface of the electronic device, the content displayed in the card may relate to the user privacy information. If the user using the electronic device is not the owner of the electronic device or the user currently viewing the electronic device includes other users besides the owner, the content displayed in the card may expose the privacy of the owner. For example, when the user of the electronic device in fig. 2 is not the owner, the meeting reminder displayed on the card displayed on the display interface of the electronic device may be leaked.
For this reason, an embodiment of the present application provides a component display method, where information of a preset user, which can view all information (including private information and non-private information) in a desktop widget of an electronic device, is stored in advance in the electronic device, for example, facial image information (or referred to as face information) of the preset user may be stored in advance, the electronic device performs face recognition on a first user in a first range of a display screen of the electronic device to obtain a face recognition result, and determines whether the first user is the preset user according to the face recognition result. If the first user comprises a user other than the preset user, the electronic equipment screens the desktop widget to be displayed and the privacy information contained in the desktop widget to hide the desktop widget containing the privacy information and/or the privacy information in the desktop widget. Therefore, the purpose of protecting the privacy information of the preset user is achieved, and the safety performance of the electronic equipment is improved.
For example, the component display method provided in the embodiment of the present application may be applied to an electronic device, where the electronic device may be an electronic device having a display screen, such as a mobile phone, a tablet computer, a Personal Computer (PC), a Personal Digital Assistant (PDA), a smart watch, a netbook, a wearable electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, an in-vehicle device, a smart car, and a smart audio device, and the embodiment of the present application does not limit the electronic device.
For example, fig. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. As shown in fig. 3, wherein the electronic device may include: the mobile terminal includes a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like.
It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the electronic device. In other embodiments, an electronic device may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.
The controller may be a neural center and a command center of the electronic device. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.
In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
It should be understood that the interface connection relationship between the modules illustrated in this embodiment is only an exemplary illustration, and does not constitute a limitation on the structure of the electronic device. In other embodiments, the electronic device may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.
The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device. The wireless communication function of the electronic device may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.
The electronic device implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like.
The electronic device may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.
The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device may include 1 or N cameras 193, N being a positive integer greater than 1.
Wherein, camera 193 can be the low-power consumption camera, including leading camera and rear camera. The front camera and the rear camera are used for collecting images or video streams. The front-facing camera can acquire images or video streams containing faces when the electronic equipment is unlocked, can acquire images or video streams containing faces of users when the users use the electronic equipment, and can acquire images or video streams when the users use the electronic equipment to shoot images, and the like.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device selects a frequency point, the digital signal processor is used for performing fourier transform and the like on the frequency point energy.
Video codecs are used to compress or decompress digital video. The electronic device may support one or more video codecs. In this way, the electronic device can play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.
The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can realize applications such as intelligent cognition of electronic equipment, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
The electronic device may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110. The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals.
The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the electronic device and data processing by executing instructions stored in the internal memory 121. For example, in the embodiment of the present application, the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area.
The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book and the like) created in the using process of the electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.
The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc. The SIM card interface 195 is used to connect a SIM card. The SIM card can be attached to and detached from the electronic device by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic equipment can support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc.
The software system of the electronic device may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of an electronic device.
Fig. 4 is a block diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 4, the structural block diagram of the electronic device includes a layered architecture 410 of software and an image processing part 420. The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, which are an application layer, an application framework layer, an Android runtime (Android runtime) and system library and a kernel layer from top to bottom. The application layer may include a series of application packages.
As shown in fig. 4, the application layer may include system applications. The system application refers to an application that is set in the electronic device before the electronic device is shipped from the factory. Exemplary system applications may include desktop managers, smart modules, weather, settings, electronic device caretakers, cameras, gallery, calendar, music, short messages, and phone calls, among other programs. The desktop manager is used for managing and displaying icons of all the application programs and the cards corresponding to the icons. The intelligent module is used for judging whether to display the desktop small component containing the privacy information and/or the privacy information in the desktop small component according to the face recognition result and informing the APP whether to update the card content. The intelligent module may also have other names, not limited.
The application program layer can also comprise a third party application, and the third party application refers to a user slave applicationThe store (or application marketplace) downloads the applications installed after the installation package. For example, map-like applications (e.g., map-like applications)
Figure BDA0003294206240000081
Etc.), take-away type applications (e.g., for example)
Figure BDA0003294206240000082
Etc.), reading-like applications (e.g., reading-like applications
Figure BDA0003294206240000083
) Social applications (e.g., for social applications)
Figure BDA0003294206240000084
) And travel-like applications (e.g., for travel-like applications)
Figure BDA0003294206240000091
) And the like.
The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 4, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and a component services manager, among others.
The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.
The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The content provider is also used to parse file information stored in the internal memory 121 into data that can be acquired by the application program. The content provider stores face information of a preset user.
The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
The phone manager is used to provide communication functions of the electronic device. Such as management of call status (including on, off, etc.).
The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.
The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.
The component service manager is used for receiving and storing the attribute information of the desktop gadget issued by the APP of the desktop, and simultaneously provides an interface for the desktop program to inquire the attribute information of the desktop gadget of the APP. The attribute information of the desktop widget may refer to information such as a position where the desktop widget is displayed, a font color displayed in the desktop widget, an icon, and an operation in response to a user input. Taking the Android system as an example, the component service manager can be used as a service process resident in the Android system, provide a remote call interface to receive attribute information of a desktop widget issued by an APP, and provide another remote call interface for a desktop program to query the attribute information of the desktop widget. The component service manager saves the unique identifier of the APP and the attribute information of the desktop gadget corresponding to the APP. The unique identifier of the APP may be an application package name of the APP. And the attribute information of the desktop small component corresponding to the APP is released and stored in a data structure form.
The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.
The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), AI complex management engines, and the like. The AI integrated management engine comprises an AI service module.
The AI integrated management engine is used for distributing and managing various functions of the AI. The AI service module is used for comprehensively managing AI functions and comprises the following steps: algorithm registration, result callback, encryption, decryption, signature, verification and the like of the algorithm model. For example, after the developer uploads the face recognition algorithm to the AI service module, the AI service module registers the face recognition algorithm. The AI service module operates a registered face recognition algorithm according to image data acquired by the camera and pre-stored face information of a preset user provided by the content provider to obtain a face recognition result, and sends the face recognition result to the intelligent module through the content provider. The intelligent module judges whether to display the desktop small component containing the privacy information and/or the privacy information in the desktop small component according to the face recognition result, and informs the APP whether to update the card content. The encryption and decryption of the algorithm model refers to the encryption/decryption of the algorithm by using a secret key. The signature of the algorithm model refers to the signature of the algorithm model by a private key. The verification of the algorithm model refers to the decryption verification of the signed algorithm model by using the public key of the private key holder.
The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, composition, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver and an AI interface channel. The AI interface channel is used for transmitting image data processed by the image signal processor and a control command of face recognition.
The image processing part comprises an image signal processor and a processing subsystem.
The processing subsystem is configured to process image data fed back by the camera 193 based on the ISP, and send the image data to the AI service module through the AI interface channel, so that the AI service module runs a face recognition result obtained by a face recognition algorithm based on the image data and pre-stored face information of a preset user provided by the content provider. The face recognition algorithm may be any algorithm capable of implementing a face recognition function, and is not limited herein.
Therefore, after the camera of the electronic equipment acquires the image in the first range of the display screen of the electronic equipment, the image signal processor processes the image acquired by the camera to obtain processed image data. And the processing subsystem sends the image data to the AI service module through the AI interface channel based on the image data processed by the image signal processor. The AI service module operates a face recognition algorithm according to the image data and face information of a pre-stored preset user to obtain a face recognition result, wherein the face recognition result is whether the first user is the user of the preset user or not.
And if the face recognition result determined by the AI service module is that the first user comprises users other than the preset user, the content provider provides the face recognition result provided by the AI service module to the intelligent module. The intelligent module screens the desktop small components to be displayed in the display interface of the electronic equipment according to the face recognition result, so that the display interface hides the desktop small components containing privacy information and/or the privacy information in the desktop small components. Therefore, the protection of the privacy information of the preset user is realized, and the safety performance of the electronic equipment is improved.
In an embodiment of the present application, an assembly display method includes: the electronic equipment detects whether a first user in a first range of the display screen is a preset user. And if the first user comprises users except the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when the first desktop widget is displayed on the display screen. The first desktop small component comprises privacy information, and a preset user can check the privacy information.
In one possible implementation manner, the electronic device detecting whether a first user in a first range of a display screen is a preset user includes: before the electronic equipment displays the first desktop widget on the display screen or in the process of displaying the first desktop widget on the display screen, whether a first user in a first range of the display screen is a preset user is detected.
Therefore, before the first desktop widget is displayed on the display screen or in the process of displaying the first desktop widget on the display screen, whether the first user in the first range of the display screen is a preset user or not is detected, the power consumption problem caused by continuous detection can be reduced, namely, the first user in the first range of the display screen can not be detected in the process of not displaying the first desktop widget, and the power consumption of the electronic equipment can be saved.
In one possible implementation, the method further includes: if the first user in the first range of the display screen is detected as a preset user in the process that the electronic equipment displays the first desktop widget on the display screen, the first desktop widget continues to be displayed on the display screen.
In one possible implementation manner, after the electronic device stops displaying the first desktop widget on the display screen or hides the privacy information while displaying the first desktop widget on the display screen, the electronic device continues to detect whether the first user within the first range of the display screen is a preset user. And if the first user is a preset user, displaying the first desktop widget on the display screen again or displaying the privacy information hidden by the first desktop widget on the display screen again.
The first desktop widget may be a widget preset by a user and displayed on a display screen of a mobile phone within a preset time period, or may also be a widget preset and displayed in a first area of the display screen, which is not limited in this embodiment of the application. The first area may be any area on the display screen, for example, a partial area on the home interface, or any area on other interfaces, and the position and shape of the first area are not limited in the present application. The first area may be an area set by a user or a default area of the system, which is not limited in the present application.
In one possible scenario, assume that the first desktop widget is a widget that is exposed within a preset time period. Before the electronic equipment displays the first desktop gadget on the display screen, whether a first user in a first range of the display screen is a preset user is detected, and the method comprises the following steps: the electronic device detects whether a first user within a first range of the display screen is a preset user before determining that a start time of a preset time period is reached. When the starting time is reached, if the first user is detected to include users other than the preset user, stopping displaying the first desktop widget on the display screen or hiding privacy information when the first desktop widget is displayed on the display screen. And when the starting time is reached, if the first user is detected to be a preset user, displaying the first desktop widget on a display screen.
Under the condition, a camera of the electronic device collects images in a first range of a display screen before the initial time of the preset time period is determined, an image signal processor processes the images collected by the camera to obtain processed image data, a processing subsystem sends the image data to an AI service module through an AI interface channel, and the AI service module detects whether a first user in the first range of the display screen is a preset user according to the image data and face information of the preset user, wherein the face information is stored in advance. If the AI service module determines that the first user is the preset user, the AI service module sends the identification result that the first user is the preset user to the intelligent module, and the intelligent module determines to display the first desktop widget within a preset time period. If the AI service module determines that the first user comprises users other than the preset user in the process of displaying the first desktop widget by the electronic equipment within the preset time period, the AI service module sends the identification result of the first user comprising the users other than the preset user to the intelligent module, and the intelligent module stops displaying the first desktop widget on the display screen or hides privacy information when displaying the first desktop widget on the display screen; if the electronic equipment displays the first desktop widget in the preset time period, the AI service module determines that the first user is a preset user, and the intelligent module continues to display the first desktop widget on the display screen.
In one possible implementation, the electronic device may detect whether a first user within a first range of the display screen is a preset user within a first time period before it is determined that a start time of the preset time period is reached. The length of the first time period can be set according to requirements, and for example, the first time period can be several minutes before the starting time of the preset time period.
Illustratively, as shown in FIG. 5, assume that the first desktop gadget in FIG. 5 is a gadget that is displayed within a preset time period (e.g., 8:30 to 9: 00). Here, the subject of the conference in fig. 5 is privacy information. The AI service module of the mobile phone detects whether the user within the first range of the display screen is a preset user 5 minutes, for example, 8:25 minutes before the start time (e.g., 8:30) of the preset time period. If the AI service module determines that the users in the first range of the display screen include users other than the preset user, the intelligent module determines that the first desktop widget is not displayed on the display screen at the starting time (8:30) of the preset time period, namely, stops displaying the first desktop widget on the display screen to inform the user of the conference information when the starting time (8:30) of the preset time period is reached, or the electronic device can hide the privacy information when the first desktop widget is displayed at the starting time (8:30) of the preset time period. If the AI service module determines that the user within the first range of the display screen is the predetermined user, as shown in fig. 5, the intelligent module determines to display the first desktop widget on the display screen at the start time (8:30) of the predetermined time period.
As shown in fig. 5, during displaying the first desktop widget on the display screen, the electronic device may continuously detect whether the first user within the first range of the display screen is a preset user, and if (for example, 8:30 to 8:45) the first user is the preset user, the electronic device may keep displaying the first desktop widget on the display screen, and assuming that the display screen of the mobile phone shows the first desktop widget (for example, 8:45), the AI service module determines that the users within the first range of the display screen include users other than the preset user, and the AI service module sends the recognition result of the first user including users other than the preset user to the intelligent module. The smart module stops displaying the first desktop widget on the display screen or hides the privacy information when displaying the first desktop widget on the display screen. If the AI service module detects that the user in the first range of the display screen is the preset user, the intelligent module determines to continue displaying the first desktop widget on the display screen until the preset time period is over.
In another possible scenario, assume that the first desktop widget is a widget displayed within a first area of a display screen of an electronic device. Before the electronic equipment displays the first desktop gadget on the display screen, whether a first user in a first range of the display screen is a preset user is detected, and the method comprises the following steps: when the electronic equipment detects an instruction for displaying a display interface of a display screen where the first area is located, whether a first user in a first range of the display screen is a preset user is detected. If the first user is detected to be a preset user, displaying the first desktop widget in a first area of a display interface of the display screen, and if the first user is detected to comprise users except the preset user, stopping displaying the first desktop widget in the first area of the display interface of the display screen or hiding privacy information when displaying the first desktop widget.
In this case, the first desktop widget is always displayed within the first area of the display screen of the electronic device. When detecting that a display interface of a display screen where a first area is located is displayed, an AI service module of the electronic device detects whether a first user in a first range of the display screen is a preset user. In one example, for a first desktop widget always displayed in a specific area (in a first area) of a display screen, when a user switches from other display interfaces to the display interface of the display screen in which the first area is located, that is, when a terminal detects an instruction to display the display interface in which the first area is located, an electronic device identifies users in a first range of the display screen to determine whether a user using the electronic device is a preset user. For example, a first desktop widget is arranged on a first area on a home interface, when a user switches from other display interfaces to the home interface through sliding, the terminal detects an instruction for displaying the display interface where the first area is located, or when the user exits from an application interface and returns to the home interface, the terminal detects an instruction for displaying the display interface where the first area is located, and the application does not limit a specific scene.
In this example, the process of acquiring an image by the electronic device to perform face recognition is the same as that in the above example, and is not described again. If the AI service module determines that the first user is the preset user, the AI service module sends the identification result that the first user is the preset user to the intelligent module, and the intelligent module determines that the information pushed by the application program is displayed in the first desktop widget. If the AI service module determines that the first user comprises users other than the preset user, the AI service module sends the identification result of the first user comprising the users other than the preset user to the intelligent module, and the intelligent module stops displaying information pushed by the application program in the first desktop widget on the display screen or hides privacy information when the first desktop widget is displayed on the display screen.
Illustratively, as shown in FIG. 6, assume that the first desktop widget in FIG. 6 is a widget that is exposed within a first area of the display screen. Here, the conference topic in fig. 6 is privacy information. After the mobile phone is unlocked, a first desktop widget is displayed in a first area of the mobile phone (e.g., a block diagram shown in a transparent form in fig. 6). The AI service module of the mobile phone detects whether the user in the first range of the display screen is a preset user. If the AI service module determines that the user in the first range of the display screen is a preset user, the intelligent module determines that information (e.g., meeting information in fig. 6) pushed by the application program is displayed in the first desktop widget. Assuming that in the process that the display screen of the mobile phone displays information pushed by the application program in the first desktop widget, the AI service module determines that users in the first range of the display screen include users other than the preset user, and the AI service module sends the first user identification result including the users other than the preset user to the intelligent module. The intelligent module displays the first desktop small component after the private information is deleted on the display screen or displays the first desktop small component for deleting the information pushed by the application program on the display screen. If the AI service module detects that the user in the first range of the display screen is the preset user, the intelligent module determines to continue displaying the first desktop widget on the display screen until the information pushed by the application program reaches the preset pushing time.
It should be noted that, in the example shown in fig. 5, in a case where it is determined that the first user includes a user other than the preset user, a manner of hiding the private information when the first desktop widget is displayed on the display screen may also be adopted; in the example shown in fig. 6, the first desktop widget may also be stopped from being displayed on the display screen in a manner of deleting the first desktop widget as shown in fig. 5, and the embodiment of the present application does not limit a specific manner of hiding the private information.
It should be noted that fig. 5 and fig. 6 are only exemplary descriptions, and the manner in which the smart module stops displaying the first desktop widget on the display screen or hides the private information when displaying the first desktop widget on the display screen is not limited to the manner in fig. 5 and fig. 6, and the following processes will be described in detail and will not be described herein again.
The technical solutions in the following embodiments may be implemented in an electronic device having the above hardware structure and software structure. The following takes an electronic device as an example, and the present solution is exemplarily described.
For example, as shown in fig. 7, after the mobile phone is powered on, the image signal processor controls the front-facing camera to acquire an image or a video stream within a first range of the display screen, the front-facing camera sends the acquired image or video stream to the image signal processor, and the image signal processor performs image processing on the acquired image data. And matching the mobile phone with the pre-stored face information based on the processed image data, and unlocking the screen by the mobile phone if the processed image data contains a user matched with the pre-stored face information.
In this embodiment of the application, after the screen is unlocked by the mobile phone, the preset user may set, in the APP installed in the mobile phone, whether to display the desktop widget corresponding to the APP in the display area (e.g., the mobile phone desktop) of the display screen of the mobile phone. For example, a preset user may set, in an APP installed in a mobile phone, that a desktop widget is displayed on a display screen of the mobile phone within a preset time period. The desktop gadget comprises information pushed by at least one APP. The preset user includes but is not limited to the owner, the family of the owner, the friends, and the like. The preset user can check the privacy information contained in the desktop widget, and the face information of the preset user is stored in the mobile phone in advance. After the screen is unlocked, the mobile phone detects whether a first user in a first range of the display screen is a preset user.
Optionally, the image signal processor controls the front camera to capture an image or video stream within a first range of the display screen. The front camera sends the collected image or video stream to an image signal processor, and the image signal processor performs image processing on the obtained image data. The image processing includes, but is not limited to, performing noise reduction processing, color correction, dead pixel removal, brightness adjustment, rotation, image scaling, and data format conversion on the image data. After the front camera of the mobile phone collects face information capable of identifying the identity of a user, a first range of the first user entering the display screen is determined, wherein the first range of the display screen is a shooting range of the front camera. The first user may be a current user of the electronic device, may also be a non-user located within a shooting range of the front-facing camera, and may also include both the current user and the non-user located within the shooting range of the front-facing camera.
After the face of the first user enters the shooting range of the front-facing camera, the image signal processor may control the front-facing camera to periodically (for example, with 2 minutes, 5 minutes, 8 minutes, etc. as one acquisition period) acquire an image or a video stream within the shooting range of the front-facing camera of the display screen. Of course, the image signal processor can also control the front camera to acquire images or video streams in real time, or acquire the images or the video streams at any time interval. In the embodiment of the application, after the mobile phone detects that the first user is located in the shooting range of the front camera of the mobile phone, the time interval for the front camera to acquire the face image is controlled by the image signal processor to be unlimited.
The desktop widget displayed on the display screen of the electronic device may be displayed in the form of a card, or may be displayed in other forms, which is not limited herein. The following explains the embodiments of the present application in detail by taking a card as an example.
When the card is displayed on the desktop of the mobile phone, the desktop of the mobile phone can display one card at a time, and can also display a plurality of cards at the same time, which is not limited herein. The user of the mobile phone can move the card to any position by dragging, and the mobile phone can adjust the position of the card in the desktop of the mobile phone according to the detected dragging action of the user. For example, a user of the mobile phone can drag the card to move towards the lower side area of the mobile phone desktop, so as to achieve the purpose of adjusting the position of the card in the mobile phone desktop.
When the information pushed by at least one APP meets the preset display time, the mobile phone may display the card in the first area of the desktop, where the first area may be a card display area of the desktop, the card display area may be an area preset by a user, and the card display area may be any area in the desktop of the mobile phone. For example, as shown in FIG. 2,
Figure BDA0003294206240000141
the conference time in the conference prompt information is between 9 am and 1 am in 9 months and 1 am in 2021 yearsAnd point 0 is 30 minutes, and the preset display time is 30 minutes before the conference starts. When the time of the mobile phone is 30 minutes at 8 am of 9/1/a, the card on the desktop of the mobile phone displays a card, and the card comprises
Figure BDA0003294206240000142
And pushing the conference prompt information.
The card display area may display one card or may display a plurality of cards at the same time, which is not limited in the present application. The information pushed by one APP can be displayed in one card, and the information pushed by a plurality of APPs can also be displayed. When many cards are shown in the card display area, many cards can correspond different APPs, also can include a plurality of cards of same APP in many cards, and this application does not limit to this.
When a card is displayed on the mobile phone desktop, the display position of the card on the mobile phone desktop is not limited in the embodiment of the application, and the card can be displayed at any position of the mobile phone desktop. For example, the cards may be displayed in the upper region, the left region, the right region, the middle region, and so on of the cell phone desktop. In addition, in the embodiment of the application, the shape of the card is not limited, and the card can be in any regular shape or irregular shape with a closed area. For example, the card may be rectangular, oval, square, and circular in regular shape.
When a plurality of cards are displayed in the mobile phone desktop at the same time, the plurality of cards can be stacked and displayed in the mobile phone desktop, and can also be tiled and displayed in the mobile phone desktop, and the like. Similarly, a plurality of cards can be displayed at any position of the desktop of the mobile phone, and the position of the display of the plurality of cards is not limited in the embodiment of the application.
For example, as shown in fig. 8, assuming that 3 cards are displayed in the mobile phone desktop at the same time, the 3 cards may be displayed in a stack in the mobile phone desktop. Optionally, a mark is displayed in the first area of the display screen, so that a user can more intuitively determine that a plurality of cards are displayed on the desktop of the mobile phone in a stacked manner and a currently displayed card is displayed according to the mark displayed in the first area of the display screen. As shown in fig. 8, it is determined that 3 cards are stacked on the desktop of the mobile phone according to the display marks of the cards, and the current cards are displayed. The display mark of the card in fig. 8 is only described as an example, and may be a mark in any shape and form, which is not limited in the embodiment of the present application.
Optionally, the smart module may control the 3 cards to be stacked and displayed in the card display area in the order from top to bottom according to the priorities of the 3 cards in the order from high to low of the priorities of the cards. For example, the smart module may first control the desktop manager to display the card with the highest priority on the desktop of the mobile phone, and then control the desktop manager to display the card with the lower priority on the desktop of the mobile phone.
It should be explained that the smart module can determine the priority of the card according to the priority of the APP corresponding to the card. If the priority of the APP corresponding to the card A is higher than that of the APP corresponding to the card B, the priority of the card A is higher than that of the card B. From this, when many cards are shown simultaneously to the cell-phone desktop, the user of cell-phone can see the card that the APP that the priority is high corresponds at first, has improved user's use and has experienced.
When a plurality of cards are displayed in the mobile phone desktop in a superposition mode, a user of the mobile phone can switch the currently displayed cards on the mobile phone desktop in an up-and-down sliding mode. For example, suppose that a card a, a card B, and a card C are superimposed and displayed on the desktop of the mobile phone, as shown in the display interface shown in the first picture shown in fig. 8, the card currently displayed on the desktop of the mobile phone is the card B. When the user of the mobile phone slides the card B upward, the card currently displayed on the desktop of the mobile phone is switched from the card B to the card C, as shown in the second picture shown in fig. 8. For example, as shown in the second picture shown in fig. 8, assuming that the card C is currently displayed on the desktop of the mobile phone, and the user of the mobile phone continues to slide the card C upward, the card currently displayed on the desktop of the mobile phone is switched from the card C to the card a.
When a plurality of cards are displayed in the mobile phone desktop in a superposition mode, and the currently displayed cards of the mobile phone desktop contain privacy information, the mobile phone detects that the first users in the first range of the display screen include users except the preset users. In this case, the mobile phone may delete the currently displayed card and display the next card; or, the priority of the currently displayed card can be reduced, so that other cards can be displayed by covering the currently displayed card; or the privacy information of the currently displayed card can be hidden and then displayed.
In this case, the phone may also notify the user to remove the currently displayed card from the phone's desktop. Continuing with the example of fig. 8, when the card a is currently displayed on the desktop of the mobile phone, the mobile phone detects that the first users in the first range of the display screen include users other than the preset user. The mobile phone may notify the user of the mobile phone by displaying a prompt message to remove the currently displayed card a from the desktop of the mobile phone, such as the third picture shown in fig. 8. If the mobile phone detects that the user clicks the operation of the cancel control, the desktop manager does not remove the card A from the desktop of the mobile phone. If the mobile phone detects that the user clicks the 'remove' control, the desktop manager removes the card A from the desktop of the mobile phone.
In some embodiments, after the user of the mobile phone removes the card containing the privacy information from the mobile phone desktop, the mobile phone desktop may display a default card, or may display a next card to be displayed that does not contain the privacy information, which is not limited herein.
When a plurality of cards are displayed in the mobile phone desktop in a superposition mode and the currently displayed card on the mobile phone desktop does not contain privacy information, the mobile phone detects that a user of the mobile phone slides the card leftwards, and in response to the sliding operation of the user, the mobile phone desktop displays prompt information to remind the user whether to remove the card.
In addition, when the display duration of the currently displayed card on the mobile phone desktop meets the preset removal condition, the desktop manager may automatically remove the currently displayed card from the mobile phone desktop, and may also notify the user of the mobile phone to remove the currently displayed card from the mobile phone desktop, which is not limited in the embodiment of the present application. For example, a user of the mobile phone may remove a currently displayed card from a desktop of the mobile phone by sliding left and right, and the mobile phone may remove the currently displayed card from the desktop when detecting a removal operation of the user for the card.
For example, as shown in the third picture in fig. 8, the user of the mobile phone slides the card to the left, and in response to the sliding operation of the user, the desktop of the mobile phone displays a prompt message to remind the user whether to remove the card. If the mobile phone detects that the user clicks the operation of the cancel control, the desktop manager does not remove the card from the desktop of the mobile phone. If the mobile phone detects that the user clicks the 'remove' control, the desktop manager removes the card from the desktop of the mobile phone. In the embodiment of the present application, the display duration of the card displayed on the desktop of the mobile phone may be preset by the smart module, or may be preset by a preset user, which is not limited herein. Alternatively, the smart module may set the display duration of the card according to the type of the card. For example, assuming the card is a conference type card, the smart module may set the type of card to be displayed half an hour before the conference begins until the conference begins. For example, assuming the card is a flight type card, the smart module may configure the type of card to be displayed on the cell phone desktop the day before the flight starts until the flight departure time.
It should be noted that the gesture sliding direction of the user switching and removing the card is only used as an exemplary description and is not limited herein. For example, a user of the mobile phone may switch the currently displayed card on the desktop of the mobile phone by sliding the card left and right, or may remove the currently displayed card on the desktop of the mobile phone by sliding the card up and down, and so on.
In the embodiment of the application, after the screen is unlocked by the mobile phone, the desktop widget is fixedly displayed in the first area of the display screen of the mobile phone. It can also be understood that the card display area in the desktop of the mobile phone can display fixed cards. Here, the card display area may also be any area in the desktop of the mobile phone, which is not limited in the embodiment of the present application. If the APP in the mobile phone does not push information, the fixed card displayed in the card display area is displayed in a transparent mode. If at least one APP in the mobile phone pushes information, the information pushed by the at least one APP is displayed in the fixed card.
In this embodiment of the application, the APP in the application layer may be preset with attribute information of a card, and the attribute information of the card corresponding to each APP is transmitted to the component service manager in the application framework layer under a certain condition.
In some embodiments, the attribute information of the card preset in the APP may be the attribute information of the card preset in the APP by a developer through a RemoteViews data structure. For example, the RemoteViews and the coordinate layout thereof are defined, and the font color, the character string content, the icon of the RemoteViews, the data information of the operation responding to the user input, and the like are set. The attribute information of the card preset in the APP can also be attribute information about the card layout described by the developer in the APP through a data structure of an xml file. In the embodiment of the application, the mode of presetting the attribute information of the card in the APP is not limited.
The preset attribute information of the card may be preset for an application developed by an electronic device manufacturer before the electronic device is shipped from a factory. Such as an electronic device that has just been shipped from a factory, on which no third-party application has been installed. For another example, the electronic device manufacturer and the third party application provider negotiate in advance and agree, and the attribute information of the card corresponding to the third party application downloaded through the application market of the electronic device itself is preset through the method. Of course, the application on the electronic device may also be part of the application that passes through the attribute information of the preset card, part of the application that does not pass through the attribute information of the preset card, and the like, which is not limited in this embodiment of the application.
In some embodiments, if the owner sets a lock screen in the mobile phone to protect the privacy of the mobile phone, when the mobile phone is powered on and started, the mobile phone screen displays the desktop of the mobile phone after the user unlocks the mobile phone. Alternatively, the method for unlocking the mobile phone includes, but is not limited to, password unlocking, pattern unlocking, fingerprint unlocking, Personal Identification Number (PIN) unlocking, face recognition unlocking, and the like. The password unlocking means that the mobile phone can be unlocked by inputting a preset password by a user. The pattern unlocking means that the user can unlock the mobile phone by inputting a preset pattern. The PIN unlocking means that the mobile phone can be unlocked by inputting a preset PIN code by a user. The face recognition unlocking means that after the camera shoots a face image, a processing subsystem of the mobile phone extracts a plurality of feature points on the face from the shot picture, such as eye distance, nose length, mouth size and the like. Then the processing subsystem compares the extracted feature points with face information prestored in the mobile phone, the similarity between the feature points reaches a preset similarity threshold value, the mobile phone can be unlocked, and the more the feature points are, the more the accuracy is.
Continuing with the exemplary explanation of fig. 7, after the image signal processor processes the image data including the face image collected by the front-facing camera, the image signal processor uploads the processed image data to the processing subsystem. After the processing subsystem acquires the processed image data, the processing subsystem sends the processed image data to the AI service module through the AI interface channel. The AI service module runs a pre-stored face recognition algorithm based on the acquired image data and pre-stored face information of a preset user provided by the image signal processor to obtain a face recognition result.
When the AI service module operates the face recognition algorithm to perform face recognition on the image data, the operated face recognition algorithm may be any face recognition algorithm. Such as swing face recognition algorithm and characteristic face method. The face recognition algorithm refers to a recognition algorithm that after a face is detected and key facial feature points are located, a main face region can be cut out and is fed back to the rear end after preprocessing. The recognition algorithm is to extract the face features and compare the face features with at least one piece of pre-stored face information to obtain a final face recognition result. Face recognition algorithms include, but are not limited to, face feature point-based recognition algorithms, template-based recognition algorithms, whole image-based recognition algorithms, neural network-based recognition algorithms, and the like.
It should be explained that the preset user in the embodiment of the present application is not limited to the owner, and may also be another user whose face information is stored in advance for the owner. That is, the face information prestored in the mobile phone is not limited to only store the face information of the owner, and also can store the face information of the user trusted by the owner. In this case, when the AI service module runs the face recognition algorithm, if each piece of face information in the collected face information matches with at least one piece of pre-stored face information, the AI service module may determine that the first user in the first range of the display screen is the preset user. If the face information in the collected face information does not match with at least one piece of pre-stored face information, the AI service module may determine that the first user includes users other than the pre-stored user.
As a possible implementation manner of the embodiment of the application, when the mobile phone detects whether a first user in a first range of the display screen is a preset user, the front-facing camera acquires an image in the first range of the display screen, and after the image signal processor processes the image in the first range acquired by the front-facing camera, the image signal processor uploads the processed image to the processing subsystem. And after the processing subsystem acquires the processed image, the processing subsystem sends the processed image to the AI service module through the AI interface channel. The AI service module carries out face recognition on the processed image to obtain face information of at least one first user; if the face information matched with the face information of each first user exists in the face information of the preset users, the AI service module determines that at least one first user is a preset user; if the face information of the at least one first user has the face information which is not matched with the face information of the preset user, the AI service module determines that the at least one first user comprises users except the preset user.
Optionally, assuming that the first desktop widget displayed on the display screen of the mobile phone is a widget displayed within a preset time period, in this case, before determining that the starting time of the preset time period is reached, the mobile phone detects whether the first user within the first range of the display screen is a preset user.
Optionally, assuming that a first desktop widget displayed on a display screen of the mobile phone is a widget displayed in a first area of the display screen, when the mobile phone detects an instruction for displaying a display interface of the display screen where the first area is located, it detects whether a first user in a first range of the display screen is a preset user.
The content provider provides the face recognition result provided by the AI service module and the preset privacy setting to the intelligent module, so that the intelligent module determines whether to display the privacy card on the desktop of the mobile phone and/or whether to display the privacy information in the card according to the face recognition result and the preset privacy setting. The privacy information may be preset personal identity information, travel information, meeting information, exercise health information, shopping information, and the like of the user, which is not limited herein.
The preset privacy settings include, but are not limited to, the following three cases.
In the first case, the smart module may mark a certain type of card or a card corresponding to a certain APP as a privacy card according to the user's setting. The smart module may add a mark to an Identifier (ID) of the card, so as to mark the card corresponding to the ID as a privacy card. For example, the smart module may tag cards related to privacy of individuals as privacy cards. For example, the smart module may tag calendar type cards, flight type cards, and identity type cards as privacy cards. For another example, the smart module may tag all cards corresponding to the application's athletic health as privacy cards.
In some embodiments, assuming that the smart module is a smart assistant, the desktop of the mobile phone may display an icon corresponding to the smart assistant, and the default user may set a certain type of card or a certain APP corresponding card in the smart assistant as a privacy card.
In the second case, the smart module may further mark a certain card or a plurality of cards corresponding to the APP as a privacy card. For example, the intelligent module may be connected to
Figure BDA0003294206240000181
The card that pushes away express delivery information in the corresponding card marks as the privacy card.
In a third case, the preset user may also be about to be in the card setting of the APPCertain information of the card is marked as private information. For example, as shown in FIG. 9, the preset user may be at
Figure BDA0003294206240000182
And marking the push information of the push conference subject as the private information in the privacy setting of the corresponding card.
The face recognition result acquired by the AI service module includes two situations that the first user in the first range of the display screen is the preset user and the first user includes users other than the preset user.
In some embodiments, the content provider provides the face recognition result provided by the AI service module to the intelligent module when the AI service module determines that the first user is a preset user. And the intelligent module determines all default information of the card to be displayed on the desktop of the mobile phone according to the face recognition result.
In some embodiments, the content provider provides the face recognition result provided by the AI service module to the intelligent module when the AI service module determines that the first user includes a user other than the preset user. The intelligent module filters the information pushed by the APP according to the face recognition result and the preset privacy setting so as to determine the card to be displayed or the information to be displayed of the card.
Simultaneously, the wisdom module will not show privacy card or not show each APP in the cell-phone of this event transmission in the privacy information in the card to inform each APP temporarily need not push privacy card or not push privacy information. After the APP that the card corresponds updates the card treats the display information, the wisdom module acquires the card after the update of APP propelling movement. The intelligent module filters the updated card, and informs the desktop manager that the information to be displayed of the card changes after the card to be displayed or the information to be displayed in the card is determined. At the moment, the updated card is displayed on the desktop of the mobile phone. Namely, the desktop of the mobile phone does not display the preset privacy card and privacy information.
The AI service module determines that the first user includes users other than the preset user, including but not limited to the following possible scenarios.
In a first possible scenario, when the mobile phone is powered on, the AI service module determines that the first user is a user other than the preset user according to the face recognition result, and the content provider provides the face recognition result provided by the AI service module to the intelligent module. Under the condition, the intelligent module informs the APPs in the mobile phone not to push the privacy cards and the privacy information until the AI service module determines that the first user is the preset user according to the face recognition result, and the intelligent module informs the APPs in the mobile phone to push the default information again. Therefore, when the first user comprises users except the preset user, the smart assistant filters the privacy card and the privacy information, so that the privacy card and the privacy information are not displayed on the desktop of the mobile phone, and the problem that the privacy information is leaked is avoided.
In a second possible scenario, the AI service module determines that the first users are all preset users according to the face recognition result, and the image signal processor acquires the face image acquired by the front-facing camera when all default information of the card is displayed on the desktop of the mobile phone. The AI service module operates a face recognition algorithm based on the face image to obtain a face recognition result. And the AI service module determines that the first user is a user other than the preset user according to the face recognition result. Namely, when the mobile phone desktop displays the privacy card and/or the privacy information, the user of the mobile phone is switched from the preset user to a user other than the preset user. Under this condition, the wisdom module can filter the privacy card and/or the privacy information of each APP propelling movement that obtain at present to hide privacy card and privacy information. Simultaneously, each APP is notified by the smart module that privacy cards or privacy information are not to be pushed temporarily. Therefore, when the first user is a user other than the preset user, the desktop manager of the mobile phone hides the privacy card and the privacy information according to the privacy setting, and the problem that the privacy information is leaked is avoided.
In a third possible scenario, when the mobile phone is turned on or a user of the mobile phone uses the mobile phone, the image signal processor acquires a face image acquired by the front camera. The AI service module operates a face recognition algorithm based on the face image to obtain a face recognition result. And the AI service module determines that the image acquired by the image signal processor simultaneously comprises a preset user and users except the preset user according to the face recognition result. Under this condition, the smart module can filter the privacy card and/or the privacy information of each APP propelling movement that obtain at present to hide the privacy information in the privacy card and/or the card. Simultaneously, each APP is notified by the smart module that privacy cards or privacy information are not to be pushed temporarily. Therefore, when the first user comprises users other than the preset user, the desktop manager of the mobile phone hides the privacy card and/or the privacy information in the card according to the privacy setting, and the problem that the privacy information is leaked is avoided.
As a possible situation of the embodiment of the application, in the process that the mobile phone displays the first desktop widget on the display screen, the AI service module detects that the first user in the first range of the display screen includes users other than the preset user, and the intelligent module controls the desktop manager to remove the first desktop widget from the display screen.
As another possible situation of the embodiment of the application, assuming that the first desktop widget is a widget corresponding to the first application, in the process that the mobile phone displays the first desktop widget on the display screen, the AI service module detects that the first user in the first range of the display screen includes users other than the preset user, and the intelligent module controls the desktop manager to display the second desktop widget of the first application on the display screen to replace the first desktop widget. And the information displayed by the second desktop small component is information which can be viewed by all users.
As another possible situation of the embodiment of the application, in the process that the mobile phone displays the first desktop widget on the display screen, the AI service module detects that the first user in the first range of the display screen includes users other than the preset user, and the intelligent module controls the desktop manager to display the first desktop widget deleted of the private information on the display screen.
As another possible situation of the embodiment of the application, in the process that the mobile phone displays the first desktop widget on the display screen, the AI service module detects that the first user in the first range of the display screen includes users other than the preset user, and the smart module controls the desktop manager to replace the privacy information in the first desktop widget with the preset character and then display the first desktop widget on the display screen.
It should be noted that, if desktop widgets are displayed in multiple areas on the display interface, for the desktop widgets corresponding to the multiple areas, the combination of the above multiple implementation manners for hiding the privacy information may be adopted to process the privacy information of the desktop widgets corresponding to the multiple areas, for example, a part of the desktop widgets may be removed from the display interface, and the privacy information of the part of the desktop widgets may be deleted or continuously displayed on the display interface after being replaced by preset characters.
By taking the card as an example, the smart module filters the privacy card and/or privacy information pushed by each APP currently acquired, so as to hide the privacy card and/or the privacy information in the card, including but not limited to the following cases.
As a first possible implementation manner, a card currently displayed on a desktop of the mobile phone is a privacy card, and the AI service module determines that the first user includes users other than the preset user. In this case, the smart module may call the default non-privacy card or the non-privacy card to be displayed in the card display area of the mobile phone desktop. Wherein, acquiescent non-privacy card can be the card that the APP such as weather, time corresponds. In addition, preset pictures and the like can be displayed in a card display area of the desktop of the mobile phone, so that the purpose of hiding the privacy card is achieved.
For example, as shown in fig. 10, when the user of the mobile phone is a preset user, the desktop of the mobile phone displays an example diagram of a card corresponding to exercise and health. When the AI service module determines that the users of the mobile phone include users other than the preset user, the intelligent module can call the default non-privacy card to be displayed in a card display area of the desktop of the mobile phone.
As a second possible implementation manner, when a certain card or a plurality of cards corresponding to the APP are marked as privacy cards, and when the AI service module determines that the first user includes users other than the preset user, the content provider provides the face recognition result provided by the AI service module to the intelligent module. In this case, the smart module notifies the desktop manager to hide the privacy card of this APP, showing the non-privacy card of this APP. Therefore, when the first user is a user other than the preset user, the desktop manager of the mobile phone hides the preset privacy card, and the problem that privacy information is leaked is avoided.
Illustratively, as shown in FIG. 11, assume that
Figure BDA0003294206240000201
Corresponding to 2 cards, of which,
Figure BDA0003294206240000202
the card that pushes away express delivery information among the corresponding cards is marked as the privacy card. When the first users are all preset users, the desktop display of the mobile phone is carried out
Figure BDA0003294206240000203
All corresponding cards. When the AI service module determines that the first user includes users other than the preset user, the intelligent module informs the desktop manager to hide
Figure BDA0003294206240000204
Privacy card of (1), display
Figure BDA0003294206240000205
The non-privacy card of (1).
As a third possible implementation manner, when a certain piece of information of a certain card corresponding to the APP is marked as private information, and when the AI service module determines that the first user includes users other than the preset user, the content provider provides the face recognition result provided by the AI service module to the intelligent module. After the intelligent module acquires a face recognition result, the intelligent module filters the information pushed by the APP, and the privacy information is determined not to be displayed. In this case, the smart module notifies the desktop manager to hide the card's private information. Therefore, when the first user comprises a user other than the preset user, the desktop manager of the mobile phone hides the preset privacy information, and the problem that the privacy information is leaked is avoided.
Illustratively, as shown in FIG. 12, assume that the intended user will be
Figure BDA0003294206240000206
And the push information of the push conference subject in the corresponding card is marked as private information. When the first user is a preset user, the desktop display of the mobile phone
Figure BDA0003294206240000207
All preset information of the corresponding card. When the AI service module determines that the first user includes users other than the preset user, the intelligent module informs the desktop manager to hide
Figure BDA0003294206240000208
The private information marked in advance in the card is protected and remains unchanged, and other non-private information is protected. Referring to FIG. 12, if the first user includes a user other than the predetermined user, the desktop manager pair
Figure BDA0003294206240000209
The privacy information "conference subject" of the corresponding card: the display method of the card is 'hidden'.
In addition, the intelligent module can replace the privacy information with a preset symbol, or perform fuzzy processing on the privacy information. Therefore, the problem that users except the preset user acquire the privacy information is solved. For example, the smart module may replace the private information with a "#, #", or the smart module may obfuscate the private information with a mosaic.
As a fourth possible implementation manner, when the card currently displayed on the desktop of the mobile phone is a privacy card, and the AI service module determines that the first user includes users other than the preset user, the smart module may notify the desktop manager to hide the privacy card. For example, the desktop manager may control the privacy card to slide out of the mobile phone desktop from any direction, or the desktop manager may also control the privacy card to gradually become smaller until the privacy card disappears on the mobile phone desktop, and so on. The privacy card hiding mode is not limited in the embodiment of the application.
For example, as shown in fig. 13, when the first user is a preset user, the desktop of the mobile phone displays an example of a card corresponding to the sports health. When the AI service module determines that the first user comprises users other than the preset user, the intelligent module informs the desktop manager to hide the privacy card in a mode of sliding out of the desktop of the mobile phone upwards. That is, the position of the display card on the desktop of the mobile phone does not display any card. Here, the desktop manager controls the privacy card to slide upwards and out of the desktop of the mobile phone only as an exemplary description, and the privacy card hiding manner in the embodiment of the present application is not limited.
In the embodiment of the application, the cards corresponding to the multiple APPs are displayed on the desktop of the mobile phone at the same time, and the AI service module determines that the first user comprises users other than the preset user. Under this kind of condition, the wisdom module can be based on the privacy setting of presetting each APP that the user set up in advance and inform the cell-phone desktop to show the card that each APP corresponds. For example, the desktop of a cell phone is displayed simultaneously
Figure BDA00032942062400002010
And
Figure BDA0003294206240000211
and the AI service module determines that the first user comprises users except the preset user. The intelligent module can be preset according to preset users
Figure BDA0003294206240000212
And
Figure BDA0003294206240000213
the desktop manager card is notified that the information to be displayed has changed. Desktop manager pair
Figure BDA0003294206240000214
Privacy card and
Figure BDA0003294206240000215
and hiding the privacy information in the corresponding card. Thereby avoidingThe problem that the express information and the conference subject of the user are leaked is solved, and the privacy information of the user is protected.
It should be noted that, if cards are displayed in multiple areas on the display interface, for cards corresponding to the multiple areas, the privacy information of the cards corresponding to the multiple areas may be processed by adopting a combination of the above multiple implementation manners for hiding the privacy information, for example, a part of the cards may be removed from the display interface, and the privacy information of the part of the cards may be deleted or replaced by preset characters and then continuously displayed on the display interface.
To sum up, in the embodiment of the application, after the processing subsystem acquires the image data processed by the image signal processor, the processing subsystem sends the image data to the AI service module through the AI interface channel, and the AI service module runs a pre-stored face recognition algorithm to obtain a face recognition result, so as to determine whether a first user in a first range of the display screen is a preset user. And if the AI service module determines that the first user comprises users other than the preset user, the content provider provides the face recognition result determined by the AI service module to the intelligent module. The smart module screens the cards to be displayed on the mobile phone desktop, so that the preset privacy cards and/or the privacy information in the cards are hidden in the mobile phone desktop. Therefore, the method and the device not only realize the protection of the private information, but also improve the safety performance of the mobile phone.
Compared with the prior art that all default information is displayed on the card of the mobile phone desktop, the face recognition method and the mobile phone desktop have the advantages that the face recognition is carried out on the face in the front camera collection range, and if the face recognition result is that users except the preset user are included in the front camera collection range, the preset privacy card and/or the preset privacy information are/is hidden on the mobile phone desktop. Therefore, the problem that the private information is leaked is avoided, the private information is protected, and the safety performance of the mobile phone is improved.
In the embodiment of the application, the AI service module runs a pre-stored face recognition algorithm to obtain a face recognition result, and determines that users in the acquisition range of the front camera of the electronic equipment include users other than the preset user. In this case, the electronic device may notify the APPs not to push the privacy card and/or privacy information to the desktop manager to ensure that the cards displayed on the desktop of the electronic device do not include the privacy card and/or privacy information. Therefore, the privacy information of the preset user is protected, and the safety performance of the electronic equipment is improved.
In the embodiment of the application, when the AI service module determines whether the user of the electronic device is a preset user, the AI service module is not limited to adopt a face recognition technology, and can also adopt other technologies to implement the face recognition technology. For example, in this embodiment, the AI service module may further collect fingerprint information of the user and compare the fingerprint information with pre-stored fingerprint information to identify whether the user of the electronic device is a predetermined user. And if the fingerprint information of the user of the electronic equipment is matched with any one of the at least one pre-stored fingerprint information, determining that the user is a preset user. And if the fingerprint information of the user of the electronic equipment is not matched with the at least one piece of pre-stored fingerprint information, determining that the user is a user preset user except the preset user.
As shown in fig. 14, an embodiment of the present application discloses an electronic device, which may be the above-mentioned mobile phone. The electronic device may specifically include: a touch screen 1401, said touch screen 1401 comprising a touch sensor 1406 and a display screen 1407; one or more processors 1402; a memory 1403; one or more application programs (not shown); and one or more computer programs 1404, which may be connected by one or more communication buses 1405. Wherein the one or more computer programs 1404 are stored in the memory 1403 and configured to be executed by the one or more processors 1402, the one or more computer programs 1404 including instructions that can be used to perform the relevant steps in the embodiments described above.
It is to be understood that the above-mentioned terminal and the like include hardware structures and/or software modules corresponding to the respective functions for realizing the above-mentioned functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.
In the embodiment of the present application, the electronic device and the like may be divided into functional modules according to the method example, for example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiment of the present invention is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Embodiments of the present application also provide an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to perform the associated method steps described above to implement the component display method of the embodiments described above.
Embodiments of the present application further provide a computer-readable storage medium, in which computer instructions are stored, and when the computer instructions are executed on an electronic device, the electronic device is caused to execute the above related method steps to implement the component display method in the above embodiments.
Embodiments of the present application further provide a computer program product, which when run on a computer, causes the computer to execute the above related steps to implement the component display method executed by the electronic device in the above embodiments.
In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component or a module, and may include a processor and a memory connected to each other; the memory is used for storing computer execution instructions, and when the device runs, the processor can execute the computer execution instructions stored in the memory, so that the device can execute the component display method executed by the electronic equipment in the above method embodiments.
In addition, the electronic device, the computer-readable storage medium, the computer program product, or the apparatus provided in this embodiment are all configured to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the computer-readable storage medium, the computer program product, or the apparatus can refer to the beneficial effects in the corresponding method provided above, and are not described herein again.
Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
Each functional unit in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or make a contribution to the prior art, or all or part of the technical solutions may be implemented in the form of a software product stored in a storage medium and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard drive, read only memory, random access memory, magnetic or optical disk, and the like.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A component display method applied to an electronic device comprising a display screen, the method comprising:
before displaying a first desktop widget on the display screen or in the process of displaying the first desktop widget on the display screen, the electronic device detects whether a first user in a first range of the display screen is a preset user, wherein the first desktop widget contains privacy information, and the preset user can check the privacy information;
if the first user comprises a user other than the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when the first desktop widget is displayed on the display screen.
2. The method of claim 1, further comprising:
if the first user in the first range of the display screen is detected as a preset user in the process that the electronic equipment displays the first desktop small component on the display screen, continuing to display the first desktop small component on the display screen.
3. The method of claim 1 or 2, wherein the first desktop widget is a widget displayed within a preset time period, and the electronic device detects whether the first user within a first range of the display screen is a preset user before displaying the first desktop widget on the display screen, comprising:
the electronic equipment detects whether a first user in a first range of the display screen is a preset user or not before the starting time of the preset time period is determined to be reached;
if the first user includes a user other than the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when the first desktop widget is displayed on the display screen, including:
when the starting time is reached, if it is detected that the first user includes users other than the preset user, stopping displaying the first desktop widget on the display screen or hiding the privacy information when displaying the first desktop widget on the display screen.
4. The method of claim 3, further comprising:
and when the starting time is reached, if the first user is detected to be a preset user, displaying the first desktop widget on the display screen.
5. The method of claim 1 or 2, wherein the first desktop widget is a widget displayed in a first area of the display screen, and wherein detecting, by the electronic device, whether a first user within a first range of the display screen is a preset user before displaying the first desktop widget on the display screen comprises:
the electronic equipment detects whether a first user in a first range of a display screen is a preset user when detecting an instruction for displaying the display interface of the display screen where the first area is located.
6. The method of any of claims 1-5, wherein the first desktop widget comprises information pushed by one or more applications.
7. The method according to any one of claims 1 to 5, wherein if it is detected that the first user in the first range of the display screen includes a user other than the preset user during the process of displaying the first desktop widget on the display screen by the electronic device, the stopping displaying the first desktop widget on the display screen comprises:
removing the first desktop widget from the display screen.
8. The method of any of claims 1-5, wherein the first desktop widget is a widget corresponding to a first application, and ceasing to display the first desktop widget on the display screen comprises:
and displaying a second desktop small component of the first application program on the display screen to replace the first desktop small component, wherein the information displayed by the second desktop small component is information which can be viewed by all users.
9. The method of any of claims 1-5, wherein hiding the private information while displaying the first desktop widget on the display screen comprises:
and displaying the first desktop small component deleted from the privacy information on the display screen.
10. The method of any of claims 1-5, wherein hiding the private information while displaying the first desktop widget on the display screen comprises:
and replacing the privacy information in the first desktop small component with preset characters and then displaying the privacy information on the display screen.
11. The method of any of claims 1-10, wherein after ceasing to display the first desktop widget on the display screen or hiding the private information while displaying the first desktop widget on the display screen, the method further comprises:
detecting whether a first user in a first range of the display screen is a preset user;
if the first user is the preset user, displaying the first desktop widget on the display screen again or displaying the privacy information hidden by the first desktop widget on the display screen again.
12. The method according to any one of claims 1 to 11, wherein the electronic device stores face information of the preset user; the detecting whether the first user in the first range of the display screen is a preset user comprises:
acquiring an image within a first range of the display screen;
performing face recognition on the image to obtain face information of at least one first user;
if the face information matched with the face information of each first user exists in the face information of the preset user, determining that the at least one first user is the preset user;
if the face information of the at least one first user has face information which is not matched with the face information of the preset user, determining that the at least one first user comprises users except the preset user.
13. An electronic device, comprising:
a display screen;
one or more processors;
a memory;
wherein the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the electronic device, cause the electronic device to perform the component display method of any of claims 1-12.
14. A computer-readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the component display method of any one of claims 1-12.
15. A computer program product, characterized in that it comprises computer instructions which, when run on an electronic device, cause the electronic device to perform the component display method according to any one of claims 1-12.
CN202111173426.3A 2021-10-08 2021-10-08 Component display method and electronic equipment Pending CN114065312A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111173426.3A CN114065312A (en) 2021-10-08 2021-10-08 Component display method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111173426.3A CN114065312A (en) 2021-10-08 2021-10-08 Component display method and electronic equipment

Publications (1)

Publication Number Publication Date
CN114065312A true CN114065312A (en) 2022-02-18

Family

ID=80234210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111173426.3A Pending CN114065312A (en) 2021-10-08 2021-10-08 Component display method and electronic equipment

Country Status (1)

Country Link
CN (1) CN114065312A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114968018A (en) * 2022-07-26 2022-08-30 荣耀终端有限公司 Card display method and terminal equipment
CN115098204A (en) * 2022-06-17 2022-09-23 深圳传音控股股份有限公司 Widget display method, intelligent terminal and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105554226A (en) * 2014-10-31 2016-05-04 宇龙计算机通信科技(深圳)有限公司 Mode switching method and system, and terminal
CN106603817A (en) * 2016-11-14 2017-04-26 乐视控股(北京)有限公司 Incoming call processing method and device and electronic equipment
CN107679381A (en) * 2017-09-15 2018-02-09 维沃移动通信有限公司 A kind of announcement information processing method and mobile terminal
CN107832110A (en) * 2017-10-18 2018-03-23 维沃移动通信有限公司 A kind of information processing method and mobile terminal
CN110472393A (en) * 2019-07-18 2019-11-19 平安科技(深圳)有限公司 Information display method, device, storage medium and equipment based on bio-identification
WO2021018169A1 (en) * 2019-07-30 2021-02-04 华为技术有限公司 Privacy protection method for electronic device, and electronic device
CN112398978A (en) * 2019-07-30 2021-02-23 华为技术有限公司 Privacy protection method of electronic equipment and electronic equipment
CN113348457A (en) * 2019-01-22 2021-09-03 摩根大通国家银行 Method for protecting privacy on mobile communication device
CN113360222A (en) * 2020-03-06 2021-09-07 华为技术有限公司 Application information display method and related equipment

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105554226A (en) * 2014-10-31 2016-05-04 宇龙计算机通信科技(深圳)有限公司 Mode switching method and system, and terminal
CN106603817A (en) * 2016-11-14 2017-04-26 乐视控股(北京)有限公司 Incoming call processing method and device and electronic equipment
CN107679381A (en) * 2017-09-15 2018-02-09 维沃移动通信有限公司 A kind of announcement information processing method and mobile terminal
CN107832110A (en) * 2017-10-18 2018-03-23 维沃移动通信有限公司 A kind of information processing method and mobile terminal
CN113348457A (en) * 2019-01-22 2021-09-03 摩根大通国家银行 Method for protecting privacy on mobile communication device
CN110472393A (en) * 2019-07-18 2019-11-19 平安科技(深圳)有限公司 Information display method, device, storage medium and equipment based on bio-identification
WO2021018169A1 (en) * 2019-07-30 2021-02-04 华为技术有限公司 Privacy protection method for electronic device, and electronic device
CN112398978A (en) * 2019-07-30 2021-02-23 华为技术有限公司 Privacy protection method of electronic equipment and electronic equipment
CN113360222A (en) * 2020-03-06 2021-09-07 华为技术有限公司 Application information display method and related equipment

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
CIWI刺猬: "iOS14如何用Widgetsmith&快捷指令打造一个独特的桌面", 《HTTPS://ZHUANLAN.ZHIHU.COM/P/259865432》 *
SJZX: "Widgetsmith怎么用?Widgetsmith中文版使用教程", 《HTTPS://WWW.LIUZHISHI.COM/NEWS/1113.HTML》 *
隆回县小沙江镇爱疯网络传媒工作室: "打造理想iPhone桌面!iOS14小组件推荐", 《HTTPS://BAIJIAHAO.BAIDU.COM/S?ID=1680149039011350411&WFR=SPIDER&FOR=PC》 *
青小蛙: "趣组件 - 支持定时轮播的图片、时钟、日历等 5 种屏幕小组件[iPhone_iPad]", 《HTTPS://WWW.APPINN.COM/QU-ZU-JIAN-FOR-IOS/》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115098204A (en) * 2022-06-17 2022-09-23 深圳传音控股股份有限公司 Widget display method, intelligent terminal and storage medium
CN114968018A (en) * 2022-07-26 2022-08-30 荣耀终端有限公司 Card display method and terminal equipment
CN114968018B (en) * 2022-07-26 2022-12-16 荣耀终端有限公司 Card display method and terminal equipment
WO2024021519A1 (en) * 2022-07-26 2024-02-01 荣耀终端有限公司 Card display method and terminal device

Similar Documents

Publication Publication Date Title
CN113794800B (en) Voice control method and electronic equipment
CN112130742B (en) Full screen display method and device of mobile terminal
CN110543289B (en) Method for controlling volume and electronic equipment
US11930130B2 (en) Screenshot generating method, control method, and electronic device
WO2020029306A1 (en) Image capture method and electronic device
WO2021013132A1 (en) Input method and electronic device
CN112887583A (en) Shooting method and electronic equipment
US20220269800A1 (en) Privacy protection method for electronic device and electronic device
CN109981885B (en) Method for presenting video by electronic equipment in incoming call and electronic equipment
CN112352239A (en) Application permission management method and electronic equipment
CN113965694B (en) Video recording method, electronic device and computer readable storage medium
CN114065312A (en) Component display method and electronic equipment
CN114077365A (en) Split screen display method and electronic equipment
CN113805797A (en) Network resource processing method, electronic device and computer readable storage medium
CN113971271A (en) Fingerprint unlocking method and device, terminal and storage medium
CN114444000A (en) Page layout file generation method and device, electronic equipment and readable storage medium
CN113970888A (en) Household equipment control method, terminal equipment and computer readable storage medium
CN114125145B (en) Method for unlocking display screen, electronic equipment and storage medium
CN111339513B (en) Data sharing method and device
CN113497888B (en) Photo preview method, electronic device and storage medium
CN115730091A (en) Comment display method and device, terminal device and readable storage medium
CN113867854A (en) Prompting method and terminal equipment
CN116049868B (en) Privacy protection method, device and storage medium
WO2024087980A1 (en) Dial interface display method and electronic device
WO2023221895A1 (en) Target information processing method and apparatus, and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination