CN116048196B - Cover opening and closing detection method and related device - Google Patents

Cover opening and closing detection method and related device Download PDF

Info

Publication number
CN116048196B
CN116048196B CN202210910895.7A CN202210910895A CN116048196B CN 116048196 B CN116048196 B CN 116048196B CN 202210910895 A CN202210910895 A CN 202210910895A CN 116048196 B CN116048196 B CN 116048196B
Authority
CN
China
Prior art keywords
image
fingerprint module
display screen
capacitance
fingerprint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210910895.7A
Other languages
Chinese (zh)
Other versions
CN116048196A (en
Inventor
王穆
成战刚
栗忠明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202210910895.7A priority Critical patent/CN116048196B/en
Publication of CN116048196A publication Critical patent/CN116048196A/en
Application granted granted Critical
Publication of CN116048196B publication Critical patent/CN116048196B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1675Miscellaneous details related to the relative movement between the different enclosures or enclosure parts
    • G06F1/1677Miscellaneous details related to the relative movement between the different enclosures or enclosure parts for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3215Monitoring of peripheral devices
    • G06F1/3218Monitoring of peripheral devices of display devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/13Sensors therefor
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Image Input (AREA)

Abstract

The embodiment of the application provides a method for detecting an open cover and a related device, wherein the method comprises the following steps: collecting a first image through a fingerprint module; under the condition that the first image is a display screen image, determining that the electronic equipment is in a closed cover state; the display screen image is an image comprising display contents of a display screen; under the condition that the electronic equipment is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is smaller than or equal to a first distance threshold. The application can save hardware resources required by the cover opening and closing detection of the electronic equipment.

Description

Cover opening and closing detection method and related device
Technical Field
The application relates to the technical field of computers, in particular to a cover opening and closing detection method and a related device.
Background
With the continuous development of science and technology, electronic devices such as notebook computers are increasingly common in daily life. In order to save the power consumption of the notebook computer, the notebook computer needs to be subjected to cover closing detection. For example, after detecting that the notebook computer is covered, the notebook computer can be put into a screen-off state or a dormant state so as to achieve the purpose of saving energy.
At present, cover closing detection of a notebook computer is realized based on electromagnetic induction between a Hall device and a magnet, so that the hardware resource expense of the notebook computer is high.
Disclosure of Invention
The embodiment of the application provides a cover opening and closing detection method and a related device, which realize cover opening and closing detection of electronic equipment by replacing devices such as a Hall device, a magnet and the like with a fingerprint module.
In a first aspect, an embodiment of the present application provides a method for detecting an open cover, where the method includes:
collecting a first image through a fingerprint module;
under the condition that the first image is a display screen image, determining that the electronic equipment is in a closed cover state; the display screen image is an image comprising display contents of a display screen; under the condition that the electronic equipment is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is smaller than or equal to a first distance threshold.
It can be appreciated that with the continuous development of fingerprint identification technology, it has become a trend to add fingerprint modules to electronic devices, and the fingerprint modules are commonly included in hardware resources of the electronic devices. In the application, the electronic equipment is used for collecting the image (namely the first image), and the electronic equipment is confirmed to be in the cover closing state under the condition that the collected first image is the display screen image, namely, the fingerprint module in the electronic equipment can be used for completing the cover opening and closing detection of the electronic equipment, and independent hardware (such as a Hall device, a magnet and the like) is not required to be independently arranged for the cover opening and closing detection of the electronic equipment, so that the aim of saving hardware resources is fulfilled.
It can be understood that the fingerprint module in the electronic equipment can be used for collecting fingerprint information of a user to unlock (or can be called as unlocking) or decrypt and the like, and can also be used for detecting the opening and closing cover of the electronic equipment, so that the purpose of improving the utilization rate of hardware resources is achieved.
In the embodiment of the present application, when the electronic device is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is less than or equal to the first distance threshold, which can be understood as the setting position of the fingerprint module, and the description of the "first" section may be referred to hereinafter. The first distance threshold may be understood as a distance threshold a, and in the embodiment of the present application, the electronic device is covered to enable the fingerprint module to be affected by the display screen to collect the image.
In the embodiment of the application, the electronic equipment can judge according to the category of the fingerprint module. Illustratively, in the case that the fingerprint module is a capacitive fingerprint module, the fingerprint module may be determined according to the capacitance of the capacitive array; under the condition that the fingerprint module is an optical fingerprint module, the fingerprint module can be judged according to the image characteristics.
With reference to the first aspect, in one possible implementation manner, the fingerprint module is a capacitive fingerprint module, and the first image is obtained according to a first capacitance matrix acquired by a capacitive array of the capacitive fingerprint module;
The first image is the display screen image, including:
the first capacitance matrix and the reference capacitance matrix meet the reference condition, and the reference capacitance matrix is determined by the capacitance influence of the display screen on the capacitive fingerprint module after the display screen is covered through statistical analysis.
In this embodiment, the fingerprint module may be understood as a capacitive fingerprint module, and the capacitive fingerprint module includes a capacitive array formed by a plurality of capacitors, where the capacitive array may be understood as a sensor, and the capacitance of each capacitor in the capacitive array may be changed by an external influence such as a finger or a display screen, which may be described in detail with reference to fig. 5 and fig. 6.
It can be understood that, in the case that the fingerprint module is a capacitive fingerprint module, the capacitive fingerprint module obtains an image according to a capacitance matrix obtained by the capacitive array, so that whether the first image is a display screen image can be judged according to the capacitance matrix.
In this embodiment, the first image is obtained according to a first capacitance matrix acquired by a capacitance array of the capacitive fingerprint module, which can be understood that the capacitive fingerprint module acquires the first capacitance matrix by the capacitance array first and then obtains the first image according to the first capacitance matrix.
Since the image acquired by the capacitive fingerprint module is obtained by the acquired capacitance information, it can be understood that each image corresponds to the capacitance information, i.e. the capacitance matrix. In the embodiment of the present application, the reference capacitance matrix may be understood as a capacitance matrix obtained according to an image of a display screen.
It is understood that when the electronic device is covered, the capacitance change of the capacitive array of the capacitive fingerprint module is caused by the display screen, and the image obtained by the capacitance change can be understood as the image of the display screen. Therefore, the reference capacitance matrix can be determined by statistically analyzing the capacitance effect of the display screen on the capacitive fingerprint module after closing the cover. The method specifically comprises the steps of covering the electronic equipment for multiple times in the early development stage, recording a capacitance matrix obtained after covering each time, and then carrying out statistical analysis to obtain the reference capacitance matrix.
In this embodiment, the first capacitance matrix may be understood as a real-time capacitance matrix or a real-time capacitance group; the above reference capacitance matrix may be understood as a preset capacitance group or a preset capacitance matrix hereinafter, and specific reference may be made to the description related to the case one, which is not repeated herein.
With reference to the first aspect, in one possible implementation manner, the above reference conditions include any one or more of the following: the absolute value of the difference between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the first threshold value, the average value of the absolute values of the differences between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the second threshold value, and the same number of capacitances at the two positions corresponding to the matrix is larger than or equal to the third threshold value.
In this embodiment, the first threshold may be understood as a threshold B, the second threshold may be understood as a threshold C, and the third threshold may be understood as a threshold a, and specific reference may be made to the description of the "mode one" and the "mode two" in the "case one", which are not described herein.
With reference to the first aspect, in one possible implementation manner, the fingerprint module is an optical fingerprint module, and the first image is obtained by shooting with a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a focusing image shot in a shooting distance range of the camera, and the first image does not include a fingerprint.
It will be appreciated that, unlike capacitive fingerprint modules, in the case where the fingerprint module is an optical fingerprint module, the image is not obtained from capacitance information, but is obtained from camera shooting.
It can be understood that the camera shoots images according to the convex lens imaging principle, and the distance range of the camera capable of clearly shooting images is also determined under the condition of a certain focal length. In the embodiment of the application, the shooting distance range of the camera can be understood as the distance range of the camera capable of clearly shooting the image, or the distance range of the camera capable of focusing and shooting the focusing image. Typically, the optical fingerprint module adopts a micro-camera, and the object distance of the micro-camera can be 3 cm, 4 cm, etc. generally, that is, a position 3 cm away from the micro-camera can be clearly imaged to capture a clear focusing image.
In this embodiment, when the first image is a focused image captured within a capturing distance range of the camera, the object captured by the camera may be considered to be close to the camera, and at this time, the first image is either a fingerprint image or a display screen image. Therefore, when the first image is a focused image captured within the capture distance range of the camera and the fingerprint is not included in the first image, the first image may be regarded as a display screen image.
The description of the present embodiment may also refer to fig. 8, and the description of fig. 8, which will not be repeated here.
With reference to the first aspect, in one possible implementation manner, the fingerprint module is an optical fingerprint module, and the first image is obtained by shooting with a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a reference image; the reference image is determined according to an image displayed in a region of the display screen opposite to the optical fingerprint module after the electronic device is covered.
Under the condition that the image collected by the optical fingerprint module is a focusing image, whether the image is a display screen image can be judged by taking whether the image is a fingerprint image as a basis, the optical fingerprint module can be arranged at a plurality of special positions, and whether the image is a display screen image can be judged by taking the special image on the display screen as a basis.
In this embodiment, the reference image may be understood as a preset image hereinafter, and the description in fig. 9 may be referred to specifically, which is not repeated here.
With reference to the first aspect, in one possible implementation manner, the method further includes:
And determining that the electronic equipment is in the uncapped state when the first image is not the display screen image.
With reference to the first aspect, in one possible implementation manner, in a case where the fingerprint module is an optical fingerprint module, the first image is not the display screen image, including:
the first image is an out-of-focus image captured outside the capture distance range of the camera.
It may be appreciated that, in the foregoing embodiment, the first image may be determined to be a display screen image, and accordingly, if it is determined that the first image is not the display screen image, the electronic device may be considered to be in the open-cover state.
In an exemplary embodiment, in the case that the fingerprint module is a capacitive fingerprint module, the determination may be made by whether the first capacitance matrix and the reference capacitance matrix satisfy the reference condition. Specifically, under the condition that the first capacitance matrix and the reference capacitance matrix meet the reference condition, determining that the electronic equipment is in a closed cover state; accordingly, under the condition that the first capacitance matrix and the reference capacitance matrix do not meet the reference condition, the first image is considered to be not a display screen image, and the electronic equipment is determined to be in the uncapped state.
In another example, when the fingerprint module is an optical fingerprint module, the determining may be performed by using image features, specifically, the first image may be a focused image captured within a capturing distance range of the camera, and the electronic device is determined to be in a closed state when the first image does not include a fingerprint.
Accordingly, when the first image is a focused image captured within a capturing distance range of the camera and the first image includes a fingerprint, or the first image is an out-of-focus image captured outside the capturing distance range of the camera, the first image is considered not to be a display screen image, and it is determined that the electronic device is in an open cover state.
The description of the embodiments of the present application may also refer to the following descriptions of fig. 8, 9, 10 and 11, which are not repeated here.
In a second aspect, an embodiment of the present application provides an electronic device, including:
the acquisition unit is used for acquiring a first image through the fingerprint module;
the determining unit is used for determining that the electronic equipment is in a closed cover state under the condition that the first image is a display screen image; the display screen image is an image comprising display contents of a display screen; under the condition that the electronic equipment is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is smaller than or equal to a first distance threshold.
Collecting a first image through a fingerprint module;
under the condition that the first image is a display screen image, determining that the electronic equipment is in a closed cover state; the display screen image is an image comprising display contents of a display screen; under the condition that the electronic equipment is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is smaller than or equal to a first distance threshold.
With reference to the second aspect, in some embodiments, the fingerprint module is a capacitive fingerprint module, and the first image is obtained according to a first capacitance matrix acquired by a capacitive array of the capacitive fingerprint module;
the first image is the display screen image, including:
the first capacitance matrix and the reference capacitance matrix meet the reference condition, and the reference capacitance matrix is determined by the capacitance influence of the display screen on the capacitive fingerprint module after the display screen is covered through statistical analysis.
With reference to the second aspect, in some embodiments, the above reference conditions include any one or more of the following: the absolute value of the difference between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the first threshold value, the average value of the absolute values of the differences between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the second threshold value, and the same number of capacitances at the two positions corresponding to the matrix is larger than or equal to the third threshold value.
With reference to the second aspect, in some embodiments, the fingerprint module is an optical fingerprint module, and the first image is obtained by shooting with a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a focusing image shot in a shooting distance range of the camera, and the first image does not include a fingerprint.
With reference to the second aspect, in some embodiments, the fingerprint module is an optical fingerprint module, and the first image is obtained by shooting with a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a reference image; the reference image is determined according to an image displayed in a region of the display screen opposite to the optical fingerprint module after the electronic device is covered.
With reference to the second aspect, in some embodiments, the determining unit is further configured to determine that the electronic device is in an open cover state when the first image is not the display screen image.
With reference to the second aspect, in some embodiments, in a case where the fingerprint module is an optical fingerprint module, the first image is not the display screen image, including:
The first image is an out-of-focus image captured outside the capture distance range of the camera.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a display screen, and a fingerprint module; the fingerprint module is used for collecting images; the memory is coupled to the processor, the memory is for storing computer program code, the computer program code comprising computer instructions, the processor invoking the computer instructions to cause the method of the first aspect or any possible implementation of the first aspect to be performed.
In a fourth aspect, an embodiment of the present application provides a chip, including a logic circuit and an interface, where the logic circuit and the interface are coupled; the interface is for inputting and/or outputting code instructions and the logic circuitry is for executing the code instructions to cause the method of the first aspect or any possible implementation of the first aspect to be performed.
In a fifth aspect, embodiments of the present application disclose a computer program product comprising program instructions which, when executed by a processor, cause the method of the first aspect or any of the possible implementations of the first aspect to be performed.
In a sixth aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored therein, which when run on a processor causes the method of the first aspect or any of the possible implementations of the first aspect to be performed.
Drawings
In order to more clearly illustrate the technical solution of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described. It is evident that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art;
FIG. 1a is a schematic diagram of an open/close cover detection by a Hall device according to an embodiment of the present application;
FIG. 1b is a schematic diagram of signal flow for detecting an open/close cover by a Hall device according to an embodiment of the present application;
FIG. 2a is a schematic diagram of fingerprint unlocking according to an embodiment of the present application;
FIG. 2b is a schematic diagram illustrating a connection relationship between a fingerprint module and a Hall device according to an embodiment of the present application;
fig. 3a is a schematic diagram of an opening and closing surface of a notebook computer according to an embodiment of the present application;
FIG. 3b is a schematic diagram of a C-plane fingerprint module area according to an embodiment of the present application;
fig. 4 is a schematic flow chart of a method for detecting an open cover according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a capacitive array of a capacitive fingerprint module according to an embodiment of the present application;
FIG. 6 is a schematic diagram of capacitance values of each capacitive node in a capacitive array according to an embodiment of the present application;
FIG. 7 is a schematic diagram of image types collected by an optical fingerprint module according to an embodiment of the present application;
FIG. 8 is a flowchart of determining a cover opening/closing state based on whether an image is out of focus and whether the image includes a fingerprint according to an embodiment of the present application;
FIG. 9 is a flowchart of determining a cover opening/closing state according to whether an image is a preset image according to an embodiment of the present application;
fig. 10 is a schematic flow chart of a method for detecting that an electronic device is in an open cover state according to an embodiment of the present application;
fig. 11 is a schematic flow chart of a method for detecting that an electronic device is in a closed state according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application.
Detailed Description
The terminology used in the following embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates to the contrary. It should also be understood that the term "and/or" as used in this disclosure refers to and encompasses any or all possible combinations of one or more of the listed items.
It is easy to understand that saving power consumption of electronic devices has been a constant effort of researchers. For example, for a notebook computer, it is necessary to detect the state of the notebook computer, and in the case that the notebook computer is in a closed state, the notebook computer may enter an energy-saving mode to save the power consumption of the notebook computer. Subsequently, when the notebook computer is detected to be in the uncapped state, the screen can be automatically turned on or the dormancy can be closed, so that the user can use the notebook computer continuously. It may be understood that, in the embodiment of the present application, the energy-saving mode may be a mode that the notebook computer operates to reduce the power consumption of the device through a screen-off or a sleep mode, and the energy-saving mode may also be referred to as a sleep mode, or an energy-saving mode, a sleep mode, and a sleep mode, which are not limited in this application.
For convenience of understanding, the embodiment of the application refers to the cover opening detection and the cover closing detection of the notebook computer for short.
In some embodiments, the detection of the open/close cover of the notebook computer can be realized through a Hall device. Referring to fig. 1a and fig. 1b, fig. 1a is a schematic diagram of an open/close cover detection by a hall device according to an embodiment of the present application, and fig. 1b is a schematic diagram of a signal flow direction of an open/close cover detection by a hall device according to an embodiment of the present application.
As shown in fig. 1a, a magnet 101 is mounted on a surface of a screen of a notebook computer 100 (also referred to as a B surface of the notebook computer), and a hall device 102 is mounted on a surface of a keyboard of the notebook computer 100 (also referred to as a C surface of the notebook computer). It will be appreciated that the positions of the magnet 101 and the hall device 102 are corresponding, i.e. that during the process of closing and opening the notebook computer, the distance between the magnet 101 and the hall device 102 changes, which may result in a change in the magnetic field in the vicinity of the hall device 102.
As shown in fig. 1b, the power supply supplies power to the hall device at a voltage of 3.3 volts (V), and the hall device is connected to the processor of the notebook computer, and the hall device may output different sleep switch signals (may also be referred to as LID signals) according to the change of the magnetic field, for example, may be a high level signal or a low level signal. Illustratively, when the magnet 101 shown in fig. 1a approaches the hall device 102, the magnetic flux amount induced by the hall device becomes large, and when a certain threshold is reached, the hall device outputs a low level; when the magnet 101 shown in fig. 1a is far away from the hall device 102, the magnetic flux induced by the hall device becomes small, and when a certain threshold is reached, the hall device outputs a high level.
Correspondingly, the processor performs corresponding processing according to the level input by the Hall device. For example, in the case where the level of the hall device input is low, the notebook computer may enter the power saving mode; under the condition that the energy-saving mode is already entered, if the high level input by the Hall device is received, the notebook computer can close the energy-saving mode and enter a normal operation state. It is understood that the processor may be an acceleration processor (accelerated processing unit, APU) or a microprocessor or the like.
With the continuous development of computer science and technology, the application of the fingerprint unlocking function on notebook computers is more and more common, and many brands of notebook computers on the market at present already support fingerprint unlocking. Referring to fig. 2a, fig. 2a is a schematic diagram illustrating fingerprint unlocking according to an embodiment of the present application.
As shown in fig. 2a, a magnet 201 is mounted on the B surface of the notebook computer 200, and a hall device 202 and a fingerprint module 203 are mounted on the C surface of the notebook computer. In the embodiment of the application, the fingerprint module can be understood as a module for processing fingerprint information input by a user. Alternatively, the fingerprint module may also be referred to as a fingerprint module, a fingerprint device, or the like. The fingerprint module can be used for collecting fingerprints of users and can also be used for comparing the collected fingerprints with preset fingerprints. For example, the electronic device (such as a notebook computer, a mobile phone, etc.) can take a fingerprint which is input by a user through the fingerprint module for the first time as a preset fingerprint, after the user sets the fingerprint to unlock, the fingerprint module compares the fingerprint with the preset fingerprint after the fingerprint is acquired subsequently, and the unlocking is performed under the condition that the comparison result is the same or the similarity is greater than a threshold value, or signals are output to other modules to unlock; and when the comparison result is different or the similarity is smaller than the threshold value, unlocking and the like are not performed.
It should be understood that the position of the fingerprint module 203 shown in fig. 2a is merely an example, and the position of the fingerprint module may be adjusted according to practical situations, for example, may be left or right on the basis of fig. 2a, which is not limited by the present application.
It can be appreciated that in some embodiments, the fingerprint module 203 and the hall device 202 shown in fig. 2a may be connected in a manner shown in fig. 2b, and fig. 2b is a schematic diagram of a connection relationship between the fingerprint module and the hall device according to an embodiment of the present application.
As shown in fig. 2b, in some embodiments, the fingerprint module may share a 3.3V power supply with a hall device, where the hall device is used to sense magnetic flux and output an LID signal to a processor, and the processor performs energy-saving processing according to the LID signal, which may be described in detail with reference to fig. 1 b. The fingerprint module and the APU are communicated through universal serial bus (universal serial bus, USB) signals, collected fingerprint information is sent to the APU, and the APU performs fingerprint collection, fingerprint identification and the like according to the fingerprint information.
It will be appreciated that when detecting the opening and closing of the cover by the hall device shown in fig. 1a and 1b, hardware resources such as the hall device and the magnet are required. Based on the above problems, the embodiment of the application provides a cover opening and closing detection method, which is characterized in that a fingerprint module is arranged at a position capable of collecting an image of a display screen, the fingerprint module is used for collecting an image, and the cover closing of a notebook computer is determined under the condition that the collected image is the image of the display screen; after the energy-saving mode is entered, under the condition that the image acquired through the fingerprint module is a non-display screen image, the cover opening of the notebook computer is determined.
According to the application, whether the image acquired by the fingerprint module is the display screen image or not is used for judging the opening and closing of the notebook computer, and independent hardware resources (such as the Hall device and the magnet) are not required to be independently set for opening and closing cover detection, so that the purpose of saving hardware resources is realized. In addition, the implementation of the method provided by the application does not influence the fingerprint unlocking function of the fingerprint module, so that the method can realize 'one module two-use method' and improve the hardware utilization rate.
In addition, because the fingerprint module needs to be continuously powered during the use of the notebook computer by a user so as to conveniently identify the fingerprint of the user at any time, compared with other devices (such as a touch pad) on the notebook computer, the fingerprint module is adopted to carry out opening and closing cover detection, so that the hardware resources are fewer, and the hardware resources are basically not required to be additionally increased.
For example, a touch pad (also referred to as a touch pad or a trackpad) is an input device widely used in notebook computers, and the movement of a finger of a user can be sensed by the touch pad to control the movement of the pointer. However, the touch pad may be understood as a "scene power" device, that is, when the notebook computer works normally, the touch pad may be used normally; however, when the notebook computer enters into energy-saving modes such as sleep, the power supply of the touch pad can be actively turned off. That is, the touch pad itself needs to be turned off in the energy saving mode due to the large power consumption, and if the touch pad is enabled to operate all the time, the corresponding hardware cost needs to be increased, and the power consumption is increased.
First, the arrangement position of the finger print module in the embodiment of the application is described.
It can be appreciated that in the embodiment of the application, the fingerprint module is arranged at a position where the display screen image can be acquired. For example, the fingerprint module can be arranged on the opening and closing surface of the notebook computer, and when the notebook computer is closed, the fingerprint module is opposite to the display screen of the upper cover, and the distance between the fingerprint module and the display screen is smaller than or equal to the distance threshold A.
The distance threshold a may be understood as a distance value (may be simply referred to as a critical value) that the fingerprint module can be affected by the display screen to collect an image of the display screen. For example, when the distance between the upper cover and the fingerprint module is greater than 2 cm, the display screen cannot influence the fingerprint module so that the fingerprint module can collect images of the display screen, but when the distance between the upper cover and the fingerprint module is less than or equal to 1 cm, the fingerprint module can be influenced by the display screen to collect images, and then the distance threshold A can be a value less than 1 cm.
In a word, under the condition that satisfies above-mentioned condition, the user closes the notebook computer and covers, can let fingerprint module receive the display screen influence and gather the image. For easy understanding, refer to fig. 3a, and fig. 3a is a schematic view of an opening and closing surface of a notebook computer according to an embodiment of the present application.
The portion 301 shown in fig. 3a may be understood as a cover (may also be referred to as a top cover) of the notebook computer 300, i.e. the notebook computer 300 may include the top cover 301, the keyboard 304, the touch pad 305, etc. Wherein the upper cover 301 may include a display screen 302; optionally, as shown in FIG. 3a, a bezel 303 may be included around the display screen 302.
For a notebook computer, the face including the display screen 302 as in fig. 3a may be referred to as the B-face, and the face including the keyboard 304 and the touch pad 305 may be referred to as the C-face. The opening and closing surface of the notebook computer can be understood as the surface B and/or the surface C. It will be appreciated that the state of the notebook computer as shown in fig. 3a can be understood as an open-lid state; when the notebook computer is closed, the B surface is opposite to the C surface.
When the notebook computer is covered, the area of the C-plane opposite to the display screen area of the B-plane may be referred to as a "C-plane fingerprint module area" in the embodiment of the present application, that is, an area where the fingerprint module may be disposed.
Referring to fig. 3b, fig. 3b is a schematic diagram of a C-plane fingerprint module area according to an embodiment of the application.
As shown in fig. 3b, the area 307 can be understood as the C-face fingerprint module area, that is, after the notebook computer is covered along the arrow direction, the area 307 is opposite to the area corresponding to the display screen 306 of the upper cover, rather than opposite to the border around the display screen 306.
It will be appreciated that the fingerprint module is disposed in the region 307 as in fig. 3b, and can be opposed to the display to capture the display image. Generally, the more the fingerprint module is located within the region 307 as in fig. 3b, the better the acquisition of the display screen image.
Second, the method provided by the embodiment of the application is introduced.
In order to facilitate understanding of the method provided by the embodiment of the present application, referring to fig. 4, fig. 4 is a schematic flow chart of an open/close cover detection method provided by the embodiment of the present application.
It can be understood that the method provided by the embodiment of the application can be executed by electronic equipment, the electronic equipment can be any electronic equipment comprising a fingerprint module, and the fingerprint module is arranged at a position where the display screen image can be acquired, and the electronic equipment can be a notebook computer, a two-in-one tablet computer, a folding mobile phone and the like by way of example.
It can be appreciated that the two-in-one tablet computer can be understood as a device comprising a tablet computer and a keyboard, that is, the tablet computer and the keyboard can be connected together for use by magnetic attraction or the like, and can be manually separated. Similar to a notebook computer, in the case that the electronic device is a two-in-one tablet computer, the fingerprint module can be arranged on a detachable keyboard, and after the two-in-one tablet computer is covered, the fingerprint module is opposite to a display screen of the tablet computer.
As shown in fig. 4, the method includes:
401: and collecting images through the fingerprint module.
In the step, the electronic equipment collects images through the fingerprint module. As the name implies, the fingerprint module can collect fingerprint images by taking the pressing operation of the finger as a trigger condition; in addition, in the process of opening and closing the cover of the electronic equipment, the upper cover and the fingerprint module can be close to each other to trigger the fingerprint module to collect images.
In the embodiment of the application, the fingerprint image can be understood as an image acquired by taking a finger as an object, and can also be understood as an image comprising a fingerprint. A display image may be understood as an image comprising the display content of the display. The display screen displays an opened picture a, and the display screen image may be a part of the picture a, for example, a part opposite to the fingerprint module when the electronic device is covered.
402: and judging whether the image is a display screen image or not.
In this step, the electronic device may determine according to the category of the fingerprint module. Illustratively, in the case that the fingerprint module is a capacitive fingerprint module, the fingerprint module may be determined according to the capacitance of the capacitive array; under the condition that the fingerprint module is an optical fingerprint module, the fingerprint module can be judged according to the image characteristics.
If the determination result in step 402 is yes, step 403 is executed: and determining that the electronic equipment is in a closed cover state.
If the determination result in step 402 is no, step 404 is executed: and determining that the electronic equipment is in the uncapped state.
It may be understood that in the embodiment of the present application, the electronic device may include a processor, where the processor determines, according to the acquired image, whether the electronic device is in a closed cover state or an open cover state, or the fingerprint module determines, according to the acquired image, whether the electronic device is in the closed cover state or the open cover state, and then sends the determination result to the processor. For example, the fingerprint module may output a capping signal to the processor when it is determined to be in a capping state, such as may be high level; the uncap signal is output to the processor when the uncap state is determined, and may be low, for example.
It will be appreciated that after performing step 401, the electronic device must only obtain one branch in steps 403 and 404, but in multiple implementations, different implementations may eventually obtain two branches.
It can be understood that, since the fingerprint module is a module that is continuously powered, the electronic device may also repeatedly execute the method according to the actual situation (such as triggering of a finger or a display screen) after executing the method shown in fig. 4 once.
The method shown in fig. 4 generally describes the method provided by the embodiment of the present application, and the following describes the method of capturing an image by the fingerprint module (i.e. step 401 described above) and determining whether the image is a display screen image (i.e. step 402 described above) in the embodiment of the present application.
In the first case, the fingerprint module is a capacitive fingerprint module.
The capacitive fingerprint module comprises a capacitive array formed by a plurality of capacitors, and the capacitive array can be understood as an inductor. For ease of understanding, please refer to fig. 5, fig. 5 is a schematic diagram of a capacitive array of a capacitive fingerprint module according to an embodiment of the present application.
The capacitive fingerprint module may include a plurality of transverse channels and a plurality of longitudinal channels, as shown in fig. 5, and the capacitive fingerprint module includes 5 transverse channels (the transverse channels are denoted by R in the present application), i.e., R0-R4; comprising 5 longitudinal channels (the application is represented by T for longitudinal channels), i.e. T1-T4. It will be appreciated that the arrangement of the capacitor array may be determined according to practical situations, and the capacitor array shown in fig. 5 is merely shown as an example for ease of understanding.
The capacitance connected between each channel (i.e., the lateral channel or the vertical channel) in the capacitor array and ground can be understood as self-capacitance, such as the capacitance 501 and the capacitance 502 in fig. 5 can be understood as self-capacitance, the capacitance 501 can be understood as self-capacitance of the lateral channel R4, and the capacitance 502 can be understood as self-capacitance of the vertical channel T0. The capacitances of the connections between the lateral and longitudinal channels in the capacitive array can be understood as mutual capacitances, as can be understood by the capacitance 503 in fig. 5 as mutual capacitances between the longitudinal channel T4 and the lateral channel R4.
It will be appreciated that the capacitive array shown in fig. 5 includes self-capacitance and mutual capacitance, and in practical cases, the capacitive fingerprint module may be understood as a self-capacitance fingerprint module or a mutual capacitance fingerprint module according to whether the observed variable is self-capacitance or mutual capacitance. Alternatively, the self-capacitance fingerprint module may include only self capacitance, and the mutual capacitance module may include only mutual capacitance.
Taking mutual capacitance as an example, the capacitance value of the capacitor array shown in fig. 5 may be represented by a matrix of 5*5, abbreviated as a capacitance matrix. In the embodiment of the present application, the capacitance matrix of the capacitor array acquired at a time may also be referred to as a capacitance group, i.e., the capacitance group may include the capacitance of each capacitor in the capacitor array.
In order to facilitate understanding, in the embodiment of the application, the capacitance value when the capacitance is not influenced by the outside is set to be 0, and the capacitance variation after the capacitance is changed due to the influence of the outside is set to be within 10, namely, the capacitance variation is changed within 0-10. It will be appreciated that in practice the amount of change in capacitance is determined based on factors such as the actual capacitance parameter, and the change in capacitance after being affected by external influences may be other values, even negative values, and the above settings are made for ease of understanding and should not be construed as limiting the application.
The capacitance (also understood as the capacitance value) in the capacitor array changes after being influenced by the outside world. Illustratively, when a finger is pressed against the finger support member, the capacitive array on the finger support member may be in contact with the electrolyte on the finger to form an electric field. It can be understood that the fingerprint surface of the finger is uneven, the convex part of the finger can be contacted with the capacitor, but the concave part of the finger can not be contacted with the capacitor, so that the capacitance difference of different blocks on the capacitor array is caused, and the fingerprint module can obtain a fingerprint image according to the capacitance difference of different blocks.
Similarly, since the display screen itself has certain electrical characteristics, such as a pulse signal, and the display screen is very close to the fingerprint module after closing the cover, an additional capacitor is introduced to the fingerprint module, so that the capacitance detected by the fingerprint module changes.
Referring to fig. 6, fig. 6 is a schematic diagram illustrating capacitance values of each capacitive node in a capacitive array according to an embodiment of the application. As shown in fig. 6, when the fingerprint module is not affected by the outside, the capacitance array of the fingerprint module is a capacitance matrix 601; after being influenced by the outside world, the capacitance (which can also be understood as the capacitance value) in the capacitor array changes, resulting in a capacitance matrix 602. It will be appreciated that the corresponding image a may be obtained from the capacitance information corresponding to the capacitance matrix 601 and the corresponding image B may be obtained from the capacitance information corresponding to the capacitance matrix 602. Illustratively, if the change from capacitance matrix 601 to capacitance matrix 602 is due to the effect of the finger fingerprint, then image B described above may be understood as a fingerprint image; if the change from capacitance matrix 601 to capacitance matrix 602 is due to the effect of the display, then image B described above can be interpreted as a display image.
Therefore, in the embodiment of the application, in the case that the fingerprint module is a capacitive fingerprint module, the image can be determined by collecting the capacitance of each capacitor of the capacitor array.
Correspondingly, in the embodiment of the application, under the condition that the fingerprint module is a capacitive fingerprint module, whether the fingerprint module is a display screen image can be determined by comparing a capacitance group of the capacitance array acquired in real time (called as a real-time capacitance group for short) with a preset capacitance group.
It will be appreciated that although the fingerprint of each individual is different, the fingerprint itself has a particular structure, such as a raised "ridge", a recessed "valley"; and have relatively regular shapes such as a vortex shape, a hoof shape, an arch shape, and the like. The display screen is different from the structure of the fingerprint, and has no texture features ("ridges" and "valleys") similar to the fingerprint, nor has a similar fingerprint shape. Therefore, the influence of the fingerprint and the display screen on the capacitance of the capacitive fingerprint module is different, and the finally obtained images are different, even have larger difference.
In an exemplary embodiment, in a development stage before a product is marketed, a capping test may be performed on the electronic device multiple times, each capping may obtain a capacitance set of the capacitor array, and then statistical analysis may be performed on the collected multiple capacitance set data to obtain a preset capacitance set. For example, ten thousand capacitance sets (may be referred to as test capacitance sets) may be obtained by covering the electronic device ten thousand times, and then the ten thousand test capacitance sets are statistically analyzed to obtain the preset capacitance set. It will be appreciated that in practical situations, the display screens of electronic devices of different manufacturers or the display screens of different product lines of the same manufacturer may be different, and thus, the different display screens may individually determine the respective preset capacitance sets in the above manner.
In the embodiment of the present application, the preset capacitance set may be one or more capacitance sets with more repetition times in the test process, for example, in ten thousand capacitance sets, the repetition times of the capacitance set a are the highest and occupy more (for example, more than 60%), so the capacitance set a may be used as the preset capacitance set. Alternatively, the preset capacitance set may be a capacitance set obtained by a common portion of a plurality of capacitance sets in the test process, for example, the repetition number of the capacitance set B in the ten-thousand capacitance sets is highest but is smaller (for example, less than 60%), and then the common portion of the ten-thousand capacitance sets, for example, the common portion of the repetition in more than 60% of the capacitance sets may be counted.
Therefore, when the acquired image determines whether the acquired image is the display screen image, the acquired real-time capacitance group of the capacitor array is the display screen image if the real-time capacitance group is the same as or has the similarity larger than or equal to a threshold value, and the acquired real-time capacitance group is not the display screen image if the real-time capacitance group is the similarity smaller than the threshold value. The above-mentioned similarity can also be understood as the difference between the two capacitance sets, the smaller the difference, the higher the similarity, and the larger the difference, the smaller the similarity.
When the capacitance sets are compared, the capacitance values in the capacitance sets are not only related to the magnitude of the capacitance values in the capacitance sets, but also the positions of the capacitance values in the capacitance array, and the capacitance matrix of the capacitance array is used for describing the capacitance values, so that the real-time capacitance sets can be called real-time capacitance matrices, and the preset capacitance sets can be called preset capacitance matrices.
Illustratively, assuming that the capacitance matrix 602 shown in fig. 6 is a preset capacitance matrix, specific data is shown in fig. 6, each data corresponding to the capacitance of one capacitor in the actual capacitor array. Illustratively, the capacitance 1 of row 1 and column 1 in the capacitance matrix 602 (from left to right, from top to bottom) corresponds to the capacitance of the capacitances corresponding to the vertical channel T0 and the horizontal channel R0 in FIG. 5, and the capacitance 2 of row 1 and column 2 corresponds to the capacitance of the capacitances corresponding to the vertical channel T1 and the horizontal channel R0 in FIG. 5; the capacitance 3 of row 1 and column 3 corresponds to the capacitance of the capacitances corresponding to the vertical channel T2 and the horizontal channel R0 in fig. 5, and so on.
In the case where the acquired real-time capacitance matrix is the same as the capacitance matrix 602, the image obtained from the capacitance information corresponding to the real-time capacitance matrix can be regarded as a display screen image.
In the case where the acquired real-time capacitance matrix is not exactly the same as the capacitance matrix 602, the determination may be made, for example, by:
mode 1 is determined by the number of different capacitance values in the two matrices.
If the capacitance value of the real-time capacitance matrix, the number of which is less than or equal to the threshold value a, is different from the capacitance matrix 602, the image obtained from the capacitance information corresponding to the real-time capacitance matrix may also be considered as a display screen image. It will be appreciated that if the capacitance value of the real-time capacitance matrix, whose number is greater than the threshold value a, is different from the capacitance matrix 602, then the resulting image of the capacitance information corresponding to the real-time capacitance matrix is considered to be not a display screen image.
It can be understood that the threshold value a may be determined according to practical situations, and in general, the larger the threshold value a, the more accurate the determination result. The threshold a may be determined by the total number of capacitances in the capacitance array, for example, and may be a number less than or equal to 20% of the total number. For example, the total number of the capacitors is 25, the threshold a may be set to 5, and if 3 capacitance values in the real-time capacitance matrix are different from the capacitance matrix 602, the image obtained by the capacitance information corresponding to the real-time capacitance matrix may be considered to be a display screen image, and if 9 capacitance values in the real-time capacitance matrix are different from the capacitance matrix 602, the image obtained by the capacitance information corresponding to the real-time capacitance matrix may be considered to be not a display screen image.
Mode 2, is determined by the absolute value of the difference in capacitance values in the two matrices.
The capacitance values of the same position in the real-time capacitance matrix and the capacitance matrix 602 can be compared, if the absolute value of the difference value of the capacitance values is smaller than or equal to the threshold value B, the image obtained by the capacitance information corresponding to the real-time capacitance matrix can be considered to be a display screen image, and if the absolute value of the difference value of the capacitance values is larger than the threshold value B, the image obtained by the capacitance information corresponding to the real-time capacitance matrix can be considered to be not a display screen image.
It can be understood that the threshold B may be determined according to practical situations, and in general, the smaller the threshold B, the more accurate the determination result. It will be appreciated that a larger threshold value B may be set if the value of the capacitance itself is larger, and a smaller threshold value B may be set if the value of the capacitance itself is smaller. The threshold B may be empirically determined, for example, by 5% of the maximum or minimum value in the capacitance matrix 602, etc.
In practice, various discrimination methods can be adopted. The threshold value may be set separately for each location in the capacitance matrix, such as where the absolute value of the difference between the capacitances at the same location is less than or equal to 5% or other empirical value of the capacitance at that location in the capacitance matrix 602, so that the capacitance at each location in the real-time capacitance matrix needs to satisfy the respective condition. The threshold value may be uniformly set for the capacitance matrix, for example, the absolute value of the capacitance difference value corresponding to each position, or the average value of the absolute values corresponding to each position is less than or equal to 5% of the maximum capacitance in the capacitance matrix 602, or other empirical values. In the case where the average value is adopted as the judgment condition, the average value can be regarded as being less than or equal to the threshold value C. It is understood that the threshold C may be set according to actual situations. Such as an empirical value, to which the present application is not limited.
In the embodiment of the application, the two judging modes can be coupled, namely, two modes are considered at the same time; it is also possible to decouple, i.e. only one of these is used.
In the second case, the fingerprint module is an optical fingerprint module.
The optical fingerprint module can acquire images by shooting through the camera by utilizing the light reflection principle.
Illustratively, the optical fingerprint module may include a complementary metal oxide (complementary metal oxide semiconductor, CMOS) camera. The user presses the finger on the light-permeable screen and can trigger the optical fingerprint module to collect the fingerprint image, the light-permeable screen comprises the light emitting device and the CMOS camera, the pressing of the user can trigger the light emitting device to emit light so as to illuminate the finger area, and then the CMOS camera photographs the finger to obtain the fingerprint image. The light-transmissive screen may be an organic light-emitting diode (OLED) screen, for example.
In the embodiment of the present application, the light emitting device may be any light source capable of supplementing light. Illuminating the user's finger may increase the sharpness of the captured fingerprint image or may increase the probability that the fingerprint image can be captured in a darkened environment. In addition, it can be appreciated that when the optical fingerprint module is used for collecting fingerprints, the finger is very close to the CMOS camera in the optical fingerprint module. In order to collect a clear fingerprint image at a short distance, the CMOS camera is generally a short focal lens, and even a macro lens.
Based on the above characteristics of the optical fingerprint module, it can be understood that a clear image can be acquired only when the distance between the external object and the optical fingerprint module is within the shooting distance range (such as 3 cm or 4 cm) corresponding to the lens, otherwise, the optical fingerprint module can only acquire the image in the out-of-focus state.
In the embodiment of the application, the image in the out-of-focus state can be understood as an out-of-focus image; in contrast, an image acquired within the camera shooting distance range may be referred to as a focused image with accurate focusing.
It can be understood that when the optical fingerprint module collects fingerprint images, the image collection can be triggered by pressing a finger, however, after the electronic device is completely covered, the upper cover cannot be pressed on the optical fingerprint module, so that the module can collect the display screen images. Therefore, in the embodiment of the present application, in the case where the fingerprint module is an optical fingerprint module, the electronic device may periodically acquire images (may be understood as actively acquiring images) with the duration a as a time interval.
In the embodiment of the application, the duration A can be determined according to actual conditions. In general, the smaller the duration a, the more sensitive the detection of the open-close lid. Illustratively, the duration a may be a duration of less than 3 seconds, such as 1 second, 2 seconds, etc. It will be appreciated that when a user finger press operation is detected, a fingerprint image of the user may be preferentially acquired.
It can be understood that in a normal use scene, only after the electronic device is covered, the distance between the upper cover and the optical fingerprint module can enable the camera in the optical fingerprint module to collect the focusing image. In contrast, the image collected under the condition other than the cover closing condition is generally an out-of-focus image, for example, the electronic device is normally used under the cover opening condition, or the cover closing angle is smaller, so that the distance between the upper cover and the optical fingerprint module is larger than the corresponding shooting distance of the camera. Therefore, under normal conditions, the image collected by the optical fingerprint module is either an out-of-focus image or a focusing image; in which, the focusing image is either a fingerprint image or a display screen image, as shown in fig. 7, fig. 7 is a schematic diagram of an image category collected by an optical fingerprint module according to an embodiment of the present application.
It can be understood that in the case where the cover angle is small and only the out-of-focus image can be captured, even if the display screen falls within the field of view of the camera, the out-of-focus image obtained in the above scene is not understood as the display screen image because the out-of-focus image has already been out-of-focus, that is, the display screen image in the embodiment of the present application does not include the out-of-focus image obtained in the above scene.
Based on the analysis, in the embodiment of the application, if the fingerprint module is an optical fingerprint module, whether the fingerprint module is a display screen image can be judged according to the image characteristics. Referring to fig. 8, fig. 8 is a flowchart of determining a cover opening/closing state according to whether an image is out of focus and whether the image includes a fingerprint according to an embodiment of the application. The method as shown in fig. 8 may be performed by an electronic device, the method comprising:
801: and collecting images through an optical fingerprint module.
In this step, the optical fingerprint module may periodically collect images, or may trigger image collection by finger pressing operation. It will be appreciated that, since the scene of this step is not limited, the image acquired in this step may be an out-of-focus image or an in-focus image.
802: and judging whether the image is an out-of-focus image.
It will be appreciated that the out-of-focus image has a sharp outline of the object in the in-focus image compared to the in-focus image, while the out-of-focus image has little variation between the larger pixel values. In the embodiment of the application, whether the image is the out-of-focus image can be judged in various modes.
In one possible implementation manner, the transverse direction and the longitudinal direction of the image can be respectively differentiated, and the accumulated difference result is used as a judging basis for judging whether the image is out of focus or not.
In another possible implementation, edge data may be obtained by taking a second derivative of the image, then taking a variance of the edge data to obtain a variance value, and determining whether the image is out of focus by the variance value.
In yet another possible implementation, a fast fourier transform of the image may be calculated and then the high and low frequency distribution of the image may be analyzed, and if the high frequency content of the image is less than a certain threshold, the image may be considered an out-of-focus image.
If the determination result in step 802 is yes, step 803 is executed: and determining that the electronic equipment is in the uncapped state.
If the determination result in step 802 is no, step 804 is performed: and judging whether the image is a fingerprint image or not.
This step may be implemented in a variety of ways. In one possible implementation, the captured image may be compared to the entered fingerprint image, and if the captured image matches the entered fingerprint image, the captured image may be considered to be the fingerprint image. In another possible implementation, the image may be identified based on fingerprint features. Alternatively, if the image is triggered by pressing, the acquired image may be considered as a fingerprint image.
If the determination result in step 804 is yes, step 805 is executed: unlocking is performed based on the fingerprint image.
In this step, if the electronic device is in a locked state, the electronic device may unlock according to a comparison result of the acquired fingerprint image and the fingerprint image input by the user in advance, or continue to lock. The fingerprint image may be filtered out if the electronic device itself is already unlocked. It can be understood that, in the case that the image collected by the optical fingerprint module is a fingerprint image, the electronic device is necessarily in the uncapped state.
If the determination result in step 804 is no, step 806 is performed: and determining that the electronic equipment is in a closed cover state.
It will be appreciated that, since the fingerprint module is a module that is continuously powered, the electronic device may also repeatedly execute the method according to the actual situation (such as finger triggering or according to a set time interval) after executing the method shown in fig. 9 once.
Under the condition that the image collected by the optical fingerprint module is a focusing image, whether the image is a display screen image can be judged by taking whether the image is a fingerprint image as a basis, the optical fingerprint module can be arranged at a plurality of special positions, and whether the image is a display screen image can be judged by taking the special image on the display screen as a basis.
Taking a notebook computer adopting a windows operating system as an example, a task bar is generally arranged below a display interface, a label (logo) icon is arranged at the leftmost position of the task bar, and a date and time icon is arranged at the rightmost position of the task bar. It can be understood that if the optical fingerprint module is arranged at the position of the C surface opposite to the logo icon, an image comprising the logo icon is acquired when the cover is closed; if the optical fingerprint module is arranged at the position of the C surface opposite to the date and time icon, an image comprising the date and time icon is acquired when the cover is closed.
It will be appreciated that, in addition to the above two specific positions, in practical situations, the strip may also determine other positions according to the interface design of the electronic device to set the optical fingerprint module, which is not limited by the present application.
For ease of understanding, referring to fig. 9, fig. 9 is a flowchart illustrating a process of determining the opening/closing state according to whether the image is a preset image according to an embodiment of the application. The method as shown in fig. 9 may be performed by an electronic device, the method including:
901: and collecting images through an optical fingerprint module.
902: and judging whether the image is an out-of-focus image.
If the determination result in step 902 is yes, step 903 is executed: and determining that the electronic equipment is in the uncapped state.
If the determination result in step 902 is no, step 904 is performed: and judging whether the image is a preset image or not.
In this step, the preset image may be understood as an image corresponding to the area opposite to the optical fingerprint module in the display screen in the closed state of the electronic device. For example, in the case where the electronic device displays a taskbar, the preset image may be the logo icon image or the date-time icon image; in the case that the electronic device does not display the task bar, the preset image may be other images determined according to historical experience, for example, the task bar is hidden by entering a full-screen playing video, and the preset image may be an icon image entering a full-screen display, a playing/pausing icon image, or the like.
It can be appreciated that, due to the usage field Jing Jiaoduo of the electronic device, a plurality of preset images may be set in the embodiment of the present application to cover various usage scenarios as much as possible. In addition, with the upgrade of the software of the electronic device, the display interface may be changed due to the upgrade, and in the embodiment of the present application, the preset image may also be adaptively updated according to the upgrade of the software.
In this step, whether the image is a preset image or not may be determined by combining the sharpness of the image and the similarity of the image. For example, in the case where an image is a focused image having a sharpness greater than a threshold D, the image may be regarded as a preset image if the sharpness and the similarity are greater than the threshold D and the threshold E, respectively, and may not be regarded as a preset image if the sharpness is greater than the threshold D but the similarity is less than the threshold D, by comparing the similarity between the image and the preset image.
It will be appreciated that if the sharpness of the image itself is less than the threshold D, the image may be considered to be an out-of-focus image acquired outside the shooting distance of the camera, and may not be considered to be a preset image.
If the determination result in step 904 is yes, step 905 is executed: and determining that the electronic equipment is in a closed cover state.
If the determination result in step 904 is no, step 903 is executed: and determining that the electronic equipment is in the uncapped state.
It can be appreciated that the setting of the preset image may be not perfect enough, resulting in a failure of the user to correspond to the actual usage scenario and a misjudgment. For example, the optical fingerprint module is arranged at a position opposite to the right lower corner of the display screen, when the user plays the video in full screen, the right lower corner of the interface is a volume icon, but the preset image does not comprise the volume icon image, or the preset volume icon image has a larger phase difference with the actual volume icon image, so that misjudgment is caused.
Therefore, in some embodiments, in order to improve the accuracy, in the case that the determination result of step 904 is no, the electronic device may execute step 804 in the method shown in fig. 8 described above: and judging whether the image is a fingerprint image or not. Correspondingly, under the condition that the image is a fingerprint image, determining that the electronic equipment is in an uncovering state; and determining that the electronic equipment is in a covering state when the image is not a fingerprint image.
It will be appreciated that the above embodiments are more prone to be described in terms of closing the electronic device, and for example, when the electronic device is closed, the capacitance matrix of the capacitance array of the capacitive fingerprint module is changed, for example, from the capacitance matrix 601 that is not affected by the outside to the capacitance matrix 602 that is affected; the image collected by the optical fingerprint module can be changed, for example, the out-of-focus image is changed into the in-focus image.
In fact, the effect of the electronic device cover opening on the fingerprint module is opposite to that of the electronic device cover closing on the fingerprint module. For example, during the uncapping process, the uncapping operation may change the capacitance array of the capacitive fingerprint module from the capacitance matrix 602 to the capacitance matrix 601, and may change the image acquired by the optical fingerprint module from an in-focus image to an out-of-focus image. Therefore, it will be understood that the method in the above embodiment is equally applicable to the uncapping process, except that the determination result concerning the step will become "determining that the electronic apparatus is in the uncapped state".
It can be understood that the fingerprint image can be acquired only when the electronic device is in the open-cover state, and the fingerprint image cannot be acquired if the electronic device is in the closed-cover state. Therefore, different detection flows can be provided according to different states. Referring to fig. 10 and fig. 11, fig. 10 is a schematic flow chart of a method for detecting an electronic device in an open cover state according to an embodiment of the present application, and fig. 11 is a schematic flow chart of a method for detecting an electronic device in an open cover state according to an embodiment of the present application.
As shown in fig. 10, the above method includes:
1001: and setting the fingerprint module to be in a 'detection state' under the condition that the electronic equipment is determined to be in the uncapped state.
In this step, the electronic device determines that the electronic device is in the uncapped state according to different situations, for example, when the electronic device is just started, because the electronic device is started after uncapping is generally required, the electronic device can be defaulted to be in the uncapped state. After the electronic equipment is started, the state of the electronic equipment can be continuously updated according to the image information acquired by the fingerprint module, and then the current state of the electronic equipment can be determined according to the judgment result of the image acquired last time.
In this step, the detection procedure adopted by the electronic device in the cover-opened state may be referred to as "detection state", and the above-mentioned naming is merely for distinguishing from the subsequent "leaving detection state" procedure adopted by the electronic device in the cover-closed state in fig. 11, and should not be construed as limiting the present application. In the embodiment of the present application, the electronic device needs to process the fingerprint image in the "detection state", and the processing step of filtering the fingerprint image in the "leaving detection state", which will not be described in detail in the subsequent step 1101.
1002: and collecting images through the fingerprint module.
The specific implementation of this step may refer to the foregoing description of step 401, the capacitive fingerprint module image capturing in the first case and the optical fingerprint module image capturing in the second case, and the description of step 801, which are not repeated here.
1003: and judging whether the image is a fingerprint image or not.
It will be appreciated that in the case where the fingerprint module in this step is an optical fingerprint module, the determination of whether the image is an out-of-focus image may be performed first, and after the determination of the image is an in-focus image, whether the image is a fingerprint image may be further determined, which may be described in detail in the foregoing description of step 804.
It can be understood that, in the case that the fingerprint module is a capacitive fingerprint module, the capacitance matrix obtained after the finger triggers the capacitive sensing can also obtain a corresponding image, and on the premise that the image can be obtained, the above-mentioned method of step 804 can also be adopted to determine whether the image is a fingerprint image.
If the determination result in step 1003 is yes, step 1004 is executed: unlocking is performed based on the acquired fingerprint image.
If the determination result in step 1003 is no, step 1005 is executed: and judging whether the image is a display screen image or not.
In this step, in the case where the fingerprint module is an optical fingerprint module, since it has been determined in step 1003 that the image is not a fingerprint image, it can be determined whether the image is a display screen image according to whether the image is a focused image. Specifically, in the case where the image is a focused image, the image is considered to be a display screen image; in the case where the image is an out-of-focus image, the image is considered not to be a display screen image.
The specific determination mode in the case that the fingerprint module is a capacitive fingerprint module may refer to the related description in the first case, and will not be described herein.
If the determination result in step 1005 is yes, step 1006 is executed: and determining that the electronic equipment is in a closed cover state.
If the determination result in step 1005 is no, step 1007 is executed: and determining that the electronic equipment is in the uncapped state.
As shown in fig. 11, the above method includes:
1101: and setting the fingerprint module to be in a 'leaving detection state' under the condition that the electronic equipment is in the closed cover state.
Similar to the above determination of the uncapping state in step 1001, the uncapping state may be determined by continuously updating the image information collected by the fingerprint module, for example, from the uncapping state to the uncapping state.
1102: and collecting images through the fingerprint module.
Because the electronic equipment is in the cover closing state and the fingerprint module is in a state of working all the time, under the condition that the fingerprint module is an optical fingerprint module, the electronic equipment can periodically acquire a focusing image through the optical fingerprint module; under the condition that the fingerprint module is a capacitive fingerprint module, the electronic equipment can continuously collect a real-time capacitance matrix through the capacitive fingerprint module.
1103: and judging whether the image is a display screen image or not.
In this step, in the case that the fingerprint module is an optical fingerprint module, the judgment can be performed in various modes.
On the one hand, since the electronic device is already in the closed state, the acquired image is a focused image and cannot be a fingerprint image, but in order to be able to switch from the closed state to the open state subsequently, in one possible implementation, whether the image is a display screen image or not may be determined by determining whether the image is a fingerprint image, and if the image is not a fingerprint image, the image is a display screen image.
On the other hand, the electronic device is in a black screen state because the electronic device is in an energy-saving mode after the cover is closed. Thus, in one possible implementation, it may be determined whether the image is a display screen image by an image characteristic (such as a pixel value) of the black screen image.
Under the condition that the fingerprint module is a capacitive fingerprint module, the electronic equipment is turned into a black screen state due to the fact that the electronic equipment is in an energy-saving mode after the fingerprint module is covered, and a preset capacitance group corresponding to the black screen can be used as a comparison object to judge whether the image is a display screen image or not.
In the case where the determination result of step 1103 is yes, execution 1104: and determining that the electronic equipment is in a closed cover state.
In the case where the determination result of step 1103 is no, 1105: and determining that the electronic equipment is in the uncapped state.
It will be appreciated that if it is detected that the image is not a display screen image in the closed state, the electronic device may be considered to be opened, and thus the state of the electronic device may be changed to the open state. It can be understood that, due to the limitation of the setting position of the fingerprint module in the embodiment of the application, the fingerprint image must be acquired after the cover is opened, and if the fingerprint image is detected, the electronic device can be considered to be opened.
The method for detecting the opening and closing cover provided by the embodiment of the application is introduced, and the electronic equipment related to the embodiment of the application is introduced.
Referring to fig. 12, fig. 12 is a schematic structural diagram of an electronic device 100 according to an embodiment of the application.
As shown in fig. 12, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 160, an audio module 170, a speaker 170A, a microphone 170B, an earphone interface 170C, a sensor module 180, a keypad 190, a fan 191, an indicator 192, a camera 193, a display screen 194, and the like.
The sensor module 180 may include a pressure sensor 180A, a distance sensor 180F, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and the like.
It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The electronic device 100 may be a notebook computer, for example.
The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.
The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to realize a function of controlling a mouse through the touch sensor 180K. Alternatively, the above-described touch sensor 180K may also be referred to as a touch pad.
The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may communicate audio signals to the wireless communication module 160 through the I2S interface to implement a function of performing a video or voice call through a bluetooth headset.
PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of listening to a video or voice call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.
The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function.
In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.
The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.
The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.
In addition to the USB interface described above, the electronic device 100 may also include a high-definition multimedia interface (high definition multimedia interface, HDMI), which may be used to transmit audio and/or video signals.
It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.
The charge management module 140 is configured to receive a charge input from a charger. In some embodiments, the charge management module 140 may receive a charge input of the wired charger through the USB interface 130. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.
The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like.
The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.
The wireless communication function of the electronic device 100 may be implemented by an antenna, a wireless communication module 160, a modem processor, a baseband processor, and the like.
The antenna is used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, etc.), or displays pictures or video through display 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be separate from the processor 110 or may be provided in the same device as the other functional modules.
The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied on the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via an antenna.
In some embodiments, the antenna of the electronic device 100 and the wireless communication module 160 are coupled such that the electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).
The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 is used to display pictures, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.
In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into a macroscopic picture or video. ISP can also optimize the noise, brightness and skin color of the picture. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.
The camera 193 is used to capture still pictures or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP for conversion into a digital picture or video signal. ISP outputs digital picture or video signal to DSP for processing. The DSP converts digital pictures or video signals into standard RGB, YUV, etc. format pictures or video signals. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1. In the embodiment of the present application, when the fingerprint module is an optical fingerprint module, an image may be captured by the camera 193, and the image may be, for example, a fingerprint image or a display screen image.
The digital signal processor is used to process digital signals, and may process other digital signals in addition to digital pictures or video signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.
Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.
The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, a picture or video playing function, etc.) required for at least one function of the operating system. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a microphone 170B, an earphone interface 170C, an application processor, and the like. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals.
Microphone 170B, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a video or voice call, the user may sound near the microphone 170B through his/her mouth, inputting a sound signal to the microphone 170B. The electronic device 100 may be provided with at least one microphone 170B. In other embodiments, the electronic device 100 may be provided with two microphones 170B, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170B to enable collection of sound signals, noise reduction, identification of sound sources, directional recording, etc.
The earphone interface 170C is used to connect a wired earphone. The headset interface 170C may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed at the fingerprint sensor 180H. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. For example, when a touch operation or a pressing operation is applied to the fingerprint sensor 180H, the fingerprint sensor 180H may be triggered to collect fingerprint information.
A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.
The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph.
The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, and so on.
In the embodiment of the present application, the fingerprint sensor 180H may also be referred to as a fingerprint module, and the fingerprint module may be, for example, the capacitive fingerprint module or the optical fingerprint module. Under the condition that the fingerprint module is a capacitive fingerprint module, the capacitive fingerprint module can comprise a capacitive array, and an image is obtained through capacitance information acquired by the capacitive array. Under the condition that the fingerprint module is an optical fingerprint module, the optical fingerprint module can comprise a camera and collect images through the camera. The image may be a fingerprint image or a display screen image, for example.
The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.
The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K is used to detect a touch operation or a pressing operation acting on or near it, and may also control an operation of the mouse, such as a click operation, a move operation, or the like, according to the above operation.
The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, or may be used to indicate a message, such as an indication notice or the like.
In some embodiments, the processor 110 may invoke computer instructions stored in the internal memory 121 to perform methods of examples of the present application, such as the methods described above in fig. 4, 8, 9, 10, and 11.
For example, in the case that the fingerprint module is a capacitive fingerprint module, the processor 110 may invoke the computer instructions stored in the internal memory 121, collect the capacitance matrix in real time through the capacitive fingerprint module, and then compare the capacitance matrix with a preset capacitance matrix to determine whether the capacitance matrix is covered.
Also for example, in the case that the fingerprint module is an optical fingerprint module, the processor 110 may invoke the computer instructions stored in the internal memory 121, collect the image in real time through the optical fingerprint module, and determine whether to close the cover by whether the collected image is focused, includes a fingerprint, is a preset image, and the like.
The application also provides a chip which comprises a logic circuit and an interface, wherein the logic circuit is used for realizing the operation and/or the processing of the electronic equipment in the method.
The present application also provides a computer program for implementing the operations and/or processes performed by an electronic device in the method provided by the present application.
The present application also provides a computer readable storage medium having computer code stored therein which, when run on a computer, causes the computer to perform the operations and/or processes performed by the electronic device in the method provided by the present application.
The application also provides a computer program product comprising computer code or a computer program which, when run on a computer, causes operations and/or processes performed by an electronic device in a method provided by the application to be performed.
As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …" depending on the context. Similarly, the phrase "at the time of determination …" or "if detected (a stated condition or event)" may be interpreted to mean "if determined …" or "in response to determination …" or "at the time of detection (a stated condition or event)" or "in response to detection (a stated condition or event)" depending on the context.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.
Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims (10)

1. A method for detecting opening and closing of a cover, the method comprising:
collecting a first image through a fingerprint module;
under the condition that the first image is a display screen image, determining that the electronic equipment is in a closed cover state; the display screen image is an image comprising display contents of a display screen; under the condition that the electronic equipment is covered, the fingerprint module is opposite to the display screen, and the distance between the fingerprint module and the display screen is smaller than or equal to a first distance threshold.
2. The method of claim 1, wherein the fingerprint module is a capacitive fingerprint module, and the first image is obtained from a first capacitance matrix acquired by a capacitive array of the capacitive fingerprint module;
The first image is the display screen image, including:
the first capacitance matrix and the reference capacitance matrix meet the reference condition, and the reference capacitance matrix is determined by the capacitance influence of the display screen on the capacitive fingerprint module after the cover is closed through statistical analysis.
3. The method of claim 2, wherein the reference conditions include any one or more of: the absolute value of the difference between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the first threshold value, the average value of the absolute values of the differences between the capacitances at the two positions corresponding to the matrix is smaller than or equal to the second threshold value, and the same number of capacitances at the two positions corresponding to the matrix is larger than or equal to the third threshold value.
4. The method of claim 1, wherein the fingerprint module is an optical fingerprint module, and the first image is captured by a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a focusing image shot in a shooting distance range of the camera, and the first image does not comprise a fingerprint.
5. The method of claim 1, wherein the fingerprint module is an optical fingerprint module, and the first image is captured by a camera in the optical fingerprint module;
the first image is a display screen image, including:
the first image is a reference image; the reference image is determined according to an image displayed in a region, opposite to the optical fingerprint module, of the display screen after the electronic equipment is covered.
6. The method according to any one of claims 1-5, further comprising:
and under the condition that the first image is not the display screen image, determining that the electronic equipment is in an uncovering state.
7. The method of claim 6, wherein, in the case where the fingerprint module is an optical fingerprint module, the first image is not the display screen image, comprising:
the first image is an out-of-focus image shot outside the shooting distance range of the camera in the optical fingerprint module.
8. The electronic equipment is characterized by comprising a processor, a memory, a display screen and a fingerprint module; the fingerprint module is used for collecting images; the memory is coupled to the processor, the memory for storing computer program code comprising computer instructions that the processor invokes to cause the method of any of claims 1-7 to be performed.
9. A chip comprising logic circuitry and an interface, the logic circuitry and the interface being coupled; the interface being for inputting and/or outputting code instructions, the logic circuitry being for executing the code instructions to cause the method of any of claims 1-7 to be performed.
10. A computer readable storage medium, characterized in that the computer readable storage medium is adapted to store a computer program which, when executed, is adapted to carry out the method of any one of claims 1-7.
CN202210910895.7A 2022-07-29 2022-07-29 Cover opening and closing detection method and related device Active CN116048196B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210910895.7A CN116048196B (en) 2022-07-29 2022-07-29 Cover opening and closing detection method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210910895.7A CN116048196B (en) 2022-07-29 2022-07-29 Cover opening and closing detection method and related device

Publications (2)

Publication Number Publication Date
CN116048196A CN116048196A (en) 2023-05-02
CN116048196B true CN116048196B (en) 2023-10-20

Family

ID=86127857

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210910895.7A Active CN116048196B (en) 2022-07-29 2022-07-29 Cover opening and closing detection method and related device

Country Status (1)

Country Link
CN (1) CN116048196B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN210573479U (en) * 2019-07-15 2020-05-19 重庆玮硕恒基电脑配件有限公司 Device for opening and closing upper cover of pen-electricity screen end
CN113325941A (en) * 2020-02-29 2021-08-31 荣耀终端有限公司 Method for displaying finger print under screen and electronic equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016007444A1 (en) * 2014-07-07 2016-01-14 Goodix Technology Inc. Integration of touch screen and fingerprint sensor assembly

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN210573479U (en) * 2019-07-15 2020-05-19 重庆玮硕恒基电脑配件有限公司 Device for opening and closing upper cover of pen-electricity screen end
CN113325941A (en) * 2020-02-29 2021-08-31 荣耀终端有限公司 Method for displaying finger print under screen and electronic equipment

Also Published As

Publication number Publication date
CN116048196A (en) 2023-05-02

Similar Documents

Publication Publication Date Title
US11759143B2 (en) Skin detection method and electronic device
CN114946169B (en) Image acquisition method and device
CN113810600B (en) Terminal image processing method and device and terminal equipment
CN113810601B (en) Terminal image processing method and device and terminal equipment
WO2021217367A1 (en) Method and apparatus for starting application program, and terminal
US11272116B2 (en) Photographing method and electronic device
CN113542580B (en) Method and device for removing light spots of glasses and electronic equipment
EP4280586A1 (en) Point light source image detection method and electronic device
US20230230343A1 (en) Image Processing Method, Electronic Device, Image Processing System, and Chip System
CN114880251B (en) Memory cell access method, memory cell access device and terminal equipment
CN117130975B (en) Bus interface expansion method and related equipment
CN116389884B (en) Thumbnail display method and terminal equipment
US11989885B2 (en) Speckle detection method and electronic device
CN116048196B (en) Cover opening and closing detection method and related device
CN114257737B (en) Shooting mode switching method and related equipment
CN115706869A (en) Terminal image processing method and device and terminal equipment
CN116048769B (en) Memory recycling method and device and terminal equipment
CN115705663B (en) Image processing method and electronic equipment
CN116055870B (en) Photographing method and electronic equipment
CN115696067B (en) Image processing method for terminal, terminal device and computer readable storage medium
CN114520870B (en) Display method and terminal
CN116233599B (en) Video mode recommendation method and electronic equipment
US20240236504A9 (en) Point light source image detection method and electronic device
CN115734323B (en) Power consumption optimization method and device
CN112199361A (en) Database redundant information processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant