WO2022047808A1 - 一种图像处理装置、电子设备及图像处理方法 - Google Patents

一种图像处理装置、电子设备及图像处理方法 Download PDF

Info

Publication number
WO2022047808A1
WO2022047808A1 PCT/CN2020/113852 CN2020113852W WO2022047808A1 WO 2022047808 A1 WO2022047808 A1 WO 2022047808A1 CN 2020113852 W CN2020113852 W CN 2020113852W WO 2022047808 A1 WO2022047808 A1 WO 2022047808A1
Authority
WO
WIPO (PCT)
Prior art keywords
clock signal
frequency
image processing
image
processing apparatus
Prior art date
Application number
PCT/CN2020/113852
Other languages
English (en)
French (fr)
Inventor
刘龙
吴学成
袁正军
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202080006663.8A priority Critical patent/CN114531905B/zh
Priority to EP20952050.1A priority patent/EP4198688A4/en
Priority to PCT/CN2020/113852 priority patent/WO2022047808A1/zh
Publication of WO2022047808A1 publication Critical patent/WO2022047808A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/324—Power saving characterised by the action undertaken by lowering clock frequency
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3215—Monitoring of peripheral devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231—Monitoring the presence, absence or movement of users
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/325—Power saving in peripheral device
    • G06F1/3265—Power saving in display device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/3287—Power saving characterised by the action undertaken by switching off individual functional units in the computer system
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present application relates to the field of electronic technologies, and in particular, to an image processing apparatus, an electronic device, and an image processing method.
  • AOD always on display
  • OLED organic light-emitting diode
  • AOD utilizes the single-pixel self-illumination characteristics of OLED screens, and can only light up local pixels on the OLED screen to display the clock and some common information. In this way, the user does not need to press the entire power button to light up the entire OLED screen every time the user checks the clock or frequently used information, thereby helping to save the power of the electronic device.
  • On-screen wake-up refers to switching the electronic device from the off-screen display state to the normal working state.
  • the electronic device supports wake-up on the off-screen display, in addition to a part of the always-on area on the display screen of the electronic device for displaying information, there are also some areas that are always in a working state (either lit or not lit). ), the user wakes the electronic device by double-tapping these areas.
  • the power consumption of the wake-up screen in the standby state not only includes the power consumption of the always-on area used to display the content, but also additionally increases the power consumption of a part of the screen area to detect the user's double-click operation.
  • AOD displays more and more content, and these contents will always be displayed on the screen in the standby state of the electronic device, which increases the power consumption of the electronic device in the standby state. , which also increases the power consumption of the screen wake-up.
  • the present application provides an image processing apparatus, an electronic device, and an image processing method for reducing the power consumption of the image processing apparatus (eg, electronic equipment).
  • the present application provides an image processing apparatus, and the image processing apparatus may include a first clock generation system, a second clock generation system, a low power consumption system and a high power consumption system.
  • the first clock generation system can generate a first clock signal of a first frequency
  • the second clock generation system can generate a second clock signal of a second frequency
  • the first frequency is lower than the second frequency.
  • the low power consumption system can process the image information based on the first clock signal and trigger the image processing apparatus to switch to the normal working state.
  • the low power consumption system may work based on one of the first clock signal and the second clock signal
  • the high power consumption system may work based on the second clock signal.
  • a low-power consumption system is set in the image processing device, and the low-power consumption system uses a first clock signal with a lower frequency in the standby state to realize the standby identification, which helps to reduce the standby state of the image processing device.
  • the clock signal used by the low-power system in the normal working state after waking up can be one of a low-frequency first clock signal and a high-frequency second clock signal, rather than a fixed clock signal.
  • the high-frequency second clock signal makes the power consumption control scheme more flexible and helps further reduce the power consumption of the image processing device. It can be seen that the present application helps to save the power consumption of the low-power system and even the entire image processing device by rationally designing the clock signals used by the low-power system in different states (ie, the standby state and the normal working state).
  • the low power consumption system includes a plurality of first functional components, and the plurality of first functional components are in a standby non-power-down region. In this way, even if the image processing apparatus is in the standby state, the plurality of first functional components can still work, thereby facilitating the realization of the standby wake-up function in the standby state by using the plurality of first functional components.
  • the high power consumption system includes a plurality of second functional components, and the plurality of second functional components are in a standby power-down region. In this way, when the image processing apparatus is in the standby state, the plurality of second functional components do not work, thereby helping to reduce power consumption in the standby state.
  • the plurality of first functional components may include a controller, an image signal processor and an artificial intelligence processor
  • the plurality of second functional components may include a central processing unit.
  • the image signal processor can process the image information to obtain the processed image information when the image processing device is in the standby state
  • the artificial intelligence processor can extract the features of the processed image information when the image processing device is in the standby state, and determine whether the feature matches the target feature to obtain a matching result
  • the controller can send a trigger signal to the central processing unit according to the matching result when the image processing device is in a standby state
  • the central processing unit can respond to the trigger signal to switch the image processing device to normal working condition.
  • multiple first functional components in the low power consumption system and multiple second functional components in the high power consumption system can cooperate with each other to realize the standby wake-up function of the image processing apparatus by means of image recognition.
  • the artificial intelligence processor determines whether the image meets the characteristics of wake-up from standby, so it also helps to improve the professionalism and energy efficiency of image recognition.
  • triggering the image processing apparatus to switch to the normal working state it may include: controlling the screen to light up. In this way, this method supports the direct lighting of the screen, so that the application on the screen can be directly operated, and the user experience is better.
  • the plurality of first functional components may further include an interface, and the interface may receive image information from the image collector and transmit the image information to the image signal processor when the image processing apparatus is in a standby state.
  • the plurality of first functional components may further include a memory, and the memory may store the processed image information when the image processing apparatus is in a standby state.
  • the artificial intelligence processor can directly call the processed image information stored in the memory to execute the image recognition algorithm.
  • the image processing apparatus may further include a frequency converter system, and the frequency converter system may receive the first clock signal from the first clock generation system, and then perform frequency conversion on the first clock signal to generate a frequency-converted first clock signal.
  • the frequency converter system can also receive the second clock signal from the second clock generation system, and then frequency-convert the second clock signal to generate the frequency-converted first clock signal.
  • a second clock signal is provided, and the frequency-converted second clock signal is provided to the low power consumption system or the high power consumption system.
  • the frequency converter system can convert the frequency of the first clock signal or the second clock signal into a clock signal required by each first functional component or each second functional component, which helps to make the clock signal more satisfying for each first functional component or each second functional component. Requirements for each second functional component.
  • the frequency conversion system may include a plurality of frequency converters, and the plurality of frequency converters respectively correspond to the plurality of first functional components.
  • Each frequency converter can receive the first clock signal and output the frequency-converted first clock signal to the corresponding first functional component, or receive the second clock signal and output the frequency-converted second clock signal to the corresponding first functional component .
  • the frequency converters corresponding to each first functional component are multiplexed for the first clock signal and the second clock signal, so one frequency converter can support the frequency modulation operation of the two clock signals and then provide them to the corresponding first clock signal.
  • a functional component helps to reduce the design cost of the image processing device.
  • the frequency of the converted first clock signal is higher than the first frequency.
  • there is at least one frequency converter among the plurality of frequency converters and the at least one frequency converter can output the clock signal of the first frequency to the at least one first functional unit when the corresponding at least one first functional component is idle.
  • a functional component when the at least one first functional component is working, outputs the frequency-converted first clock signal to the at least one first functional component, so as to save power consumption.
  • the low power consumption system may work based on the first clock signal in the first working mode, and work based on the second clock signal in the second working mode.
  • this method supports the use of a clock signal that matches the working mode to implement services, and helps to select an appropriate clock signal according to the needs of the working mode.
  • This method can not only improve the flexibility of power consumption control, but also reduce the image The power consumption of the processing device under normal operating conditions.
  • the second clock generation system when the image processing apparatus is in a standby state, the second clock generation system is turned off. In this way, the image processing apparatus can only use the low-frequency first clock signal to operate in the standby state, thereby helping to save the power consumption of the image processing apparatus in the standby state.
  • the present application provides an electronic device, including the image processing device and the image collector according to any one of the above-mentioned first aspect.
  • the image collector includes a camera.
  • the present application provides an image processing method, which is applied to an image processing apparatus, and the method includes: the image processing apparatus controls a first clock generation system to generate a first clock signal of a first frequency, and controls a second clock to generate The system generates a second clock signal of a second frequency, wherein the first frequency is less than the second frequency.
  • the image processing device can control the low-power system to process image information based on the first clock signal and trigger the image processing device to switch to the normal working state.
  • the image processing device can control the low-power system. The operation is based on one of the first clock signal and the second clock signal, and the high power consumption system is controlled to operate based on the second clock signal.
  • the low power consumption system includes a plurality of first functional components, and the plurality of first functional components are located in a standby non-power-down region.
  • the high power consumption system includes a plurality of second functional components located in a standby power-down region.
  • the plurality of first functional components may include a controller, an image signal processor and an artificial intelligence processor
  • the plurality of second functional components may include a central processing unit.
  • the image processing device can also control the image signal processor to process the image information to obtain the processed image information, control the artificial intelligence processor to extract the characteristics of the processed image information, and determine whether the characteristics match the target characteristics to obtain the matching result, and control the controller Send a trigger signal to the central processing unit according to the matching result, and then control the central processing unit to switch the image processing apparatus to a normal working state in response to the trigger signal.
  • the image processing apparatus switches to a normal working state, including: the image processing apparatus controls the screen to light up.
  • the plurality of first functional components may further include an interface.
  • the image processing apparatus may further control the interface to receive image information from the image collector and send the image information to the image processing apparatus when the image processing apparatus is in a standby state. transmitted to the image signal processor.
  • the plurality of first functional components may further include a memory.
  • the image processing apparatus may further control the memory to store the processed image information when the image processing apparatus is in a standby state.
  • the image processing apparatus may further include a frequency converter system, in this case, the image processing apparatus may further control the frequency converter system to receive the first clock signal from the first clock generation system, and then according to the first clock signal
  • the clock signal generates the frequency-converted first clock signal, provides the frequency-converted first clock signal to the low power consumption system, and controls the frequency converter system to receive the second clock signal from the second clock generation system, and then according to the second clock signal
  • a frequency-converted second clock signal is generated, and the frequency-converted second clock signal is provided to a low power consumption system or a high power consumption system.
  • the frequency conversion system may include a plurality of frequency converters, and each frequency converter of the plurality of frequency converters may correspond to one first functional component of the plurality of first functional components.
  • the image processing apparatus may further control each frequency converter to receive the first clock signal and output the frequency-converted first clock signal to the corresponding first functional component, or control each frequency converter to receive the second clock signal and output the frequency-converted second clock signal to the corresponding first functional component.
  • the image processing apparatus may also stop working when the at least one frequency converter stops working in the corresponding at least one first functional component. , turning off the output of at least one frequency converter.
  • the frequency of the converted first clock signal is higher than the first frequency
  • there is at least one frequency converter in the plurality of frequency converters and the image processing apparatus may also correspond to the at least one frequency converter.
  • the clock signal of the first frequency is output to the at least one first functional component, and when the at least one first functional component is working, the frequency-converted first clock signal is output to the at least one first functional component.
  • the image processing apparatus when the image processing apparatus is in a normal working state, the image processing apparatus may further control the low power consumption system to work based on the first clock signal in the first working mode, and based on the second clock signal in the second working mode clock signal works.
  • the image processing apparatus when the image processing apparatus is in a standby state, the image processing apparatus may turn off the second clock generation system.
  • FIG. 1 exemplarily shows a schematic structural diagram of an electronic device
  • FIG. 2 exemplarily shows a schematic structural diagram of an image processing apparatus provided by an embodiment of the present application
  • FIG. 3 exemplarily shows a schematic diagram of the overall structure of an image processing apparatus provided by an embodiment of the present application
  • FIG. 4 exemplarily shows a schematic structural diagram of a frequency converter module provided by an embodiment of the present application
  • FIG. 5 exemplarily shows a timing control diagram corresponding to a standby wake-up process in a cycle of an image processing apparatus in a standby state
  • FIG. 6 exemplarily shows a schematic flowchart of a wake-up method from standby.
  • the image processing apparatus disclosed in the present application can be applied to an electronic device with a camera function.
  • the image processing device may be an electronic device or an independent unit.
  • the unit may be embedded in the electronic device and can be used when the electronic device is in standby mode.
  • the standby wake-up function is executed in the state, and the electronic device is in a normal working state after the wake-up.
  • the image processing apparatus may also be a unit packaged inside the electronic device, which is used to implement the standby wake-up function of the electronic device.
  • the electronic device may be a portable electronic device including functions such as a personal digital assistant and/or a music player, such as a mobile phone, a tablet computer, a wearable device with wireless communication capabilities (eg, a smart watch), or a vehicle-mounted device.
  • portable electronic devices include, but are not limited to, carry-on Or portable electronic devices with other operating systems.
  • the aforementioned portable electronic device may also be, for example, a laptop computer (Laptop) having a touch-sensitive surface (eg, a touch panel). It should also be understood that, in some other embodiments of the present application, the above-mentioned electronic device may also be a desktop computer having a touch-sensitive surface (eg, a touch panel).
  • FIG. 1 exemplarily shows a schematic structural diagram of an electronic device 100 . It should be understood that the illustrated electronic device 100 is only an example and that the electronic device 100 may have more or fewer components than those shown, two or more components may be combined, or may have different Parts configuration.
  • the various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the electronic device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • a processor 110 an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receive
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc. Each component of the electronic device 100 will be described in detail below with reference to FIG. 1 .
  • the processor 110 may include one or more chips, for example, may include a system on a chip (SoC) or a chipset formed of multiple chips.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include a central processing unit (CPU) or an application processor (AP), a modem processor, a graphics processor graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and/or neural network Processor (neural-network processing unit, NPU), etc.
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the CPU may be the nerve center and command center of the electronic device 100 .
  • the CPU can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.
  • the executed instructions include but are not limited to operating system program instructions or application software program instructions.
  • the CPU or AP is also called the application central processing unit (ACPU).
  • the controller may include a sensor hub for processing data from one or more sensors, and the types of data output by various sensors will be described in detail later.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be directly called from the memory, so that repeated access can be avoided, the waiting time of the processor 110 can be reduced, and the processing efficiency can be improved.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver ( universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface , and/or Universal Serial Bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
  • MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc.
  • the processor 110 communicates with the camera 193 through a CSI interface, so as to realize the shooting function of the mobile phone 100 .
  • the processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the mobile phone 100 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like.
  • the GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (eg, leakage or impedance).
  • the power management module 141 may also be provided in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the display screen 194 may be an integrated flexible display screen, or may be a spliced display screen formed by using two rigid screens and a flexible screen located between the two rigid screens.
  • the display screen 194 may display information in a standby state in response to a wake-up operation of the electronic device.
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB or YUV format image signals.
  • the electronic device 100 may include one or more cameras 193, for example, may include both a front camera and a rear camera.
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 100 emits infrared light to the outside through the light emitting diode.
  • Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100 .
  • the proximity light sensor 180G may be disposed near the display screen, such as the forehead position or the chin position of the display screen.
  • the electronic device 100 may first call the proximity light sensor 180G to determine whether there is an object in front of the screen, such as a human face or a gesture. After it is determined that there is an object, the image processing apparatus is called to execute the image processing method, and then the electronic device 100 is woken up.
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • Ambient light sensor 180L may also cooperate with proximity light sensor 180G.
  • the ambient light sensor 180L may also be disposed near the display screen, such as the forehead position or the chin position of the display screen.
  • the electronic device 100 may firstly call the ambient light sensor 180L to determine whether the light in front of the screen changes, and then call the proximity light sensor 180G to determine whether there is an object in front of the screen.
  • the electronic device 100 may further include a Bluetooth device, a positioning device, a flash, a pico-projection device, or a near field communication (NFC) device, etc., which will not be repeated here.
  • a Bluetooth device a positioning device
  • a flash a pico-projection device
  • NFC near field communication
  • first and second are only used for the purpose of distinguishing the description, and should not be understood as indicating or implying relative importance, nor should it be understood as indicating or implied order.
  • a first clock generation system and “a second clock generation system” merely indicate different clock generation systems by way of example, and do not imply a difference in the importance or priority of the two clock generation systems.
  • the standby wake-up refers to switching the electronic device from the standby state to the working state.
  • the electronic device is in a standby state, although the electronic device is turned on, it does not perform substantial work, and the screen of the electronic device is turned off.
  • switching the electronic device to the working state may mean turning on the screen, activating voice interaction, or activating a phone interface, SMS interface, or other interface, or any of the above .
  • the wake-up from standby includes lighting the screen, it may refer to lighting the entire screen of the electronic device.
  • the wake-up from standby when the wake-up from standby includes lighting the screen, it may refer to lighting a part of the screen of the electronic device, for example, only lighting a part of the screen used to display the screen information corresponding to the AOD, so as to reduce the energy consumption of the electronic device. Power consumption after being woken up.
  • This standby wake-up solution has lower power consumption and is more helpful to improve the battery life of electronic devices, and is currently widely used in various electronic devices.
  • AI wake-up uses human consciousness and thinking to learn the characteristics of users. Even if the user does not touch the electronic device, AI wake-up can use the learned features to wake up the electronic device.
  • Commonly used AI wake-up methods include hanging gesture wake-up and gaze wake-up. When the electronic device supports air gesture wake-up, the user can wake up the electronic device by drawing a pre-set shape in the air.
  • the user can wake up the electronic device by looking at the screen.
  • the two wake-up methods can directly wake up the electronic device through a hovering gesture or staring, without the user pressing a button, thereby facilitating the interaction between the user and the electronic device.
  • the solution in this application is suitable for waking up electronic devices from standby.
  • the methods of waking up from standby are not limited to wake-up by hanging gestures and wake-up by gaze, but can also be other methods of waking up electronic devices by recognizing images, such as face recognition, hanging fingerprint recognition, and palm print. identification etc.
  • the above methods are all based on image recognition to extract features in the image, so as to use the features to wake up the electronic device.
  • the image processing apparatus provided by the present application is used to wake up the image processing apparatus (eg, electronic equipment) with low power consumption in a standby state.
  • the image processing apparatus may be the electronic device 100 in FIG. 1 or a part of the components in the electronic device 100 , such as a main board or functional components in the electronic device 100 , or may be the processor 110 in the electronic device 100 . This is not limited.
  • FIG. 2 exemplarily shows a schematic structural diagram of an image processing apparatus provided by an embodiment of the present application.
  • the image processing apparatus may include a first clock generation system, a second clock generation system, a low power consumption system, and a High power consumption system, wherein the clock output terminal (a 1 ) of the first clock generation system is connected to the first clock input terminal (b 1 ) of the low power consumption system, and the first clock output terminal (a 2 ) of the second clock generation system ) is connected to the second clock input terminal (b 2 ) of the low power consumption system, and the second clock output terminal (a 3 ) of the second clock generation system is connected to the clock input terminal (b 3 ) of the high power consumption system.
  • the first clock generation system may generate a first clock signal of a first frequency, and the first clock signal is used by the low-power system to perform processing when the image processing apparatus is in a standby state, for example, to perform wake-up from standby, and the second clock signal
  • the clock generation system can generate a second clock signal of a second frequency, the second clock signal is used for the high power consumption system to maintain normal operation when the image processing apparatus is in a normal working state, and the first frequency is lower than the second frequency.
  • the image processing apparatus When the image processing apparatus is in a standby state, the image processing apparatus can turn on the a1 terminal of the first clock generation system, and turn off the a2 terminals and a3 terminals of the second clock generation system. In this way, the low-frequency first clock signal It can be transmitted to the low-power system through the turned on a 1 terminal and b 1 terminal, so that the low-power system can process the image information (such as the image information captured by the front camera) based on the low-frequency first clock signal.
  • the image information When a human face or a gesture is detected in the image processing system, the low power consumption system can trigger the image processing device to switch to the normal working state.
  • the frequency of the clock signal used by the low-power system when the image processing device is in the standby state is lower than the frequency of the clock signal provided when the image processing device is in the normal working state, and the low-frequency clock signal helps The purpose is to make the low power consumption system in the low power consumption mode, thereby reducing the power consumption of the image processing apparatus when the image processing apparatus executes the standby wake-up in the standby state.
  • the image processing device When the image processing device is in a normal working state, the image processing device can turn on the a3 terminal of the second clock generation system, so that the high - frequency second clock signal can be transmitted to the high - power through the conductive a3 terminal and b3 terminal.
  • the power consumption system is used so that the high power consumption system maintains the normal operation of the image processing apparatus based on the high frequency second clock signal.
  • the low-power consumption system can also be in a working state, and the clock signal used in this working state can be determined according to the current service, for example, it can be a high-frequency first clock signal, It can also be a low frequency second clock signal.
  • the image processing apparatus may turn on the a1 terminal of the first clock generation system and turn off the a2 terminal of the second clock generation system, so that the low-frequency first clock signal passes through the conduction a 1 side and b 1 side are transmitted to the low power consumption system.
  • the image processing apparatus can turn off the a1 terminal of the first clock generation system and turn on the a2 terminal of the second clock generation system, so that the high-frequency second clock signal can pass through the conduction a 2 and b 2 are transmitted to low power systems.
  • the frequency of the clock signal used by the low-power system when it is in a normal working state matches the current service of the low-power system, instead of using a second clock signal with a high frequency, which not only makes the power
  • the power consumption control scheme is more flexible, and it also helps to reduce the power consumption of the image processing device in a normal working state.
  • the clock signal used by the low power consumption system when the image processing apparatus is in a normal working state will be specifically introduced in the following embodiments, and will not be described here.
  • the image processing apparatus controls the output of the clock signal by turning on or off the clock output terminal of the clock generating system
  • a switch may also be set on the clock transmission link between each clock generation system and the low power consumption system or the high power consumption system, and the image processing apparatus turns on or off the clock transmission link by turning on or off. The switch set on to control the output of the clock signal.
  • the first clock signal can pass through The turned on terminal a1 and terminal b1 are transmitted to the low power consumption system, and when the image processing apparatus turns off the switch, the first clock signal is not transmitted to the low power consumption system.
  • the first clock signal when the second clock signal corresponds to a 38.4MHz clock signal used by the image processing apparatus during normal operation, the first clock signal may be any clock signal with a frequency lower than 38.4MHz, such as a 32KHz clock Signal.
  • a clock signal with a lower frequency for example, 32KHz, lower than 38.4MHz used in a normal working state
  • this method can not only wake up the image processing device normally, but also does not need to periodically use a high-frequency clock signal to Performs wake-on-standby to help reduce power consumption of electronic devices. It can be seen from this that the embodiments of the present application help to save the power consumption of the low-power system and even the entire image processing apparatus by reasonably designing the clock signals used by the low-power system in different states (ie, the standby state and the normal working state). .
  • the low power consumption system may include a plurality of first functional components, and the plurality of first functional components are in a standby non-power-down region, also called an always awake region.
  • the high power consumption system may include a plurality of second functional components, and the plurality of second functional components are in a standby power-down area, also called a non-always wake-up area.
  • the plurality of second functional components in the high power consumption system do not work, that is, in the low power consumption state, thereby helping to reduce the power consumption of the image processing apparatus in the standby state.
  • multiple second functional components are in a low power consumption state, which may specifically refer to: multiple second functional components have no clock input or only very low clock input, or multiple second functional components have no power supply voltage input ( That is, multiple second functional components are completely powered off) or only have a very low power supply voltage input. Therefore, the low power consumption states of the plurality of second functional components may include states such as fully powered off, partially powered off, sleep, hibernation, or standby.
  • FIG. 3 exemplarily shows a schematic diagram of the overall structure of an image processing apparatus provided by an embodiment of the present application.
  • a plurality of first functional components may include an image signal processor, an artificial intelligence processor, a controller, and a memory. and interface, the plurality of second functional components may include a central processing unit.
  • the image signal processor, artificial intelligence processor, controller and memory can be connected through a bus, and the image signal processor can also be connected to an image collector through an interface, and the image collector can be the camera described above (such as a front camera),
  • the controller can also be connected to the image collector and the central processing unit, respectively.
  • the plurality of second functional components in the standby power-down area include, in addition to the central processing unit, a digital signal processor (DSP), a graphics processor (GPU), a baseband processor, a secure element (SE) or a voice One or more components such as subsystems.
  • the plurality of second functional components may further include a second artificial intelligence processor, a second memory and a second image signal processor, the second artificial intelligence processor, the second memory and the second image signal processing
  • the power consumption of the device is greater than that of the devices used to achieve the same operation in the standby non-power-down region, that is, the artificial intelligence processor, memory and image signal processor in the standby non-power-down region.
  • the power consumption of the second artificial intelligence processor is larger than that of the artificial intelligence processor in the standby non-power-down area, so as to perform processing with high power consumption but high performance.
  • the plurality of first functional components and the plurality of second functional components may periodically perform the following steps to realize the standby wake-up function: during the working process, the controller sends a message to the image acquisition device at the start time of the current cycle Image acquisition instruction; the image acquisition device acquires image information according to the image acquisition instruction, and sends it to the image processor through the interface; the image processor processes the image information to obtain the processed image information, and transmits it to the memory through the bus for storage, after the transmission is completed Then send a notification message to the controller; after the controller receives the notification message, it sends a standby recognition instruction to the artificial intelligence processor; according to the standby recognition instruction, the artificial intelligence processor calls the instruction of the AI image recognition algorithm stored in the memory, based on the AI image
  • the recognition algorithm extracts the features of the processed image information, and then matches the extracted features with the target features to obtain a matching result, and sends the matching result to the controller through the bus; wherein, the matching result includes matching or non-matching;
  • the central processing unit switches the image processing apparatus to a normal working state, which may include controlling the screen of the image processing apparatus to light up.
  • This method supports the user to directly light the screen when the screen is off, so as to directly operate the application on the screen and improve the user experience.
  • the central processing unit may be the core of the image processing apparatus, and is configured to run at least an operating system program or an application software program. In this way, when the user triggers an application on the screen, the central processing unit can run the corresponding application software program based on the user's triggering operation.
  • the multiple first functional components may refer to corresponding processing units in the electronic device shown in the content description part of FIG. 1 , for example, the image signal processor in FIG. 3 corresponds to the content description part shown in FIG. 1 .
  • ISP the artificial intelligence processor in Figure 3 corresponds to the NPU shown in the content description part of Figure 1
  • the controller in Figure 3 corresponds to the controller shown in the content description part of Figure 1, including the sensor hub
  • Figure 1 The memory in 3 corresponds to the internal memory shown in the content description part of FIG. 1 .
  • the plurality of first functional components may be trimmed-version components, and the trimmed-version components are obtained by cutting out functions required by a part on the basis of the full-version components, and the trimmed-version components are relatively version components have lower processing power and consume less power.
  • the plurality of second functional components may further include the corresponding processing units shown in FIG. 1 , that is, as mentioned above, the plurality of second functional components Including a second artificial intelligence processor, a second memory and a second image signal processor, these processing units, as complete functional components, perform high-strength processing capabilities when the image processing device is in a normal working state, so as to maintain the normal operation of the electronic equipment.
  • the following exemplarily introduces the relevant information of the first functional component of each tailored version in the standby power-down area.
  • the image processor in the standby power-down area may refer to a mini image processor (MINI ISP).
  • the MINI ISP can support input image information in Bayer Raw8 format, RGB format or Y format, and can support RGB format or Y format. Output image information.
  • the MINI ISP can support the maximum resolution of 1280x960, the minimum cropping window of 32x32, the downsampling function of any multiple from 1 to 8 times, and can also support nonlinear special effects synthesis (after effects, AE ) function, white balance (automatic white balance, AWB) function, local area network screen capture (local area network screen capture, LSC) function and one or more of the Gamma correction function.
  • AE nonlinear special effects synthesis
  • AWB automated white balance
  • LSC local area network screen capture
  • the power consumption of this tailored version of the MINI ISP can be reduced from 100mW to 1mW in one cycle of standby wake-up.
  • the artificial intelligence processor in the standby power-down area may refer to a lightweight artificial intelligence processor (Tiny NPU).
  • the Tiny NPU can only support the data type of INT8 format and support the INT8 or 2-bit weight storage format.
  • the image processing capability of the Tiny NPU in the standby state is about 200Gops, and the performance reaches 6Tops/W.
  • the controller in the standby power-down area may refer to a general-purpose smart sensor hub (Sensor Hub).
  • Sensor Hub uses an ARM Cortex-M7 low-power processor, the Sensor Hub will wake up from standby within one cycle.
  • the power consumption is around 4mW.
  • the memory in the standby power-down area may refer to the local memory (Local Ram).
  • the Local Ram can be deployed on a chip alone, or can be deployed on the same other functional components described. on the chip.
  • the storage space of the Local Ram can be controlled to be slightly larger than the minimum space required to implement the standby wake-up function, for example, it can be only slightly larger than the total space required by the processed image information and AI image processing algorithms.
  • the interface can refer to the CSI MIPI interface.
  • the CSI MIPI interface is used to connect the image collector and the image signal processor, and can transmit the image information collected by the image collector to the image signal processor.
  • first functional components and multiple second functional components may be deployed in the same chip (for example, a system-on-a-chip (SOC)), or may be deployed in multiple distributed in the chip.
  • SOC system-on-a-chip
  • a plurality of first functional components and a plurality of second functional components may be deployed in one chip.
  • the chip can also be provided with a standby power-down area and a standby non-power-down area.
  • the components in the standby power-down area can be powered by the standby power-off power supply (that is, in a power-off state in the standby state), and multiple secondary functions
  • the components are deployed in the standby power-down area, so as to turn off each second functional component not related to the standby wake-up function in the standby state, so as to achieve the purpose of saving power consumption.
  • the components in the standby non-power-down area can be powered by the standby non-power-down power supply (that is, the power supply state is also in the standby state), and a plurality of first functional components are deployed in the standby non-power-down area to realize the standby state in the standby state. Wake function. Since the correlation between the plurality of second functional components and the standby wake-up function is weak, this application does not introduce too many second functional components.
  • the following describes an implementation process for supplying power to a plurality of first functional components.
  • the power supply voltage required by each first functional component may be lower than the voltage output by the standby non-power-off power supply, and the power supply voltage required by each first functional component is different.
  • the image processing apparatus may further include a power management unit (power management unit, PMU), and the power management unit includes a plurality of voltage converters (the power supply in FIG. 3 ).
  • PMU power management unit
  • the power management unit includes a plurality of voltage converters (the power supply in FIG. 3 ).
  • Each of the dashed boxes in the management unit) each of the plurality of voltage converters may correspond to one or more first functional components.
  • each voltage converter can include a buck and/or a voltage regulator.
  • the buck or voltage regulator can output 4V or 3.3V to the standby non-power-down power supply.
  • the V voltage is stepped down and the stepped down voltage is provided to the corresponding first functional component.
  • the step-down device can step-down the 4V or 3.3V voltage output by the standby non-power-off power supply and provide the first-stage step-down voltage to the voltage regulator to stabilize the voltage.
  • the voltage transformer can perform two-stage step-down on the voltage output by the step-down device, and provide the voltage after the second-stage step-down processing to the corresponding first functional component.
  • the step-down device can be a Buck type circuit or a switched capacitor (SC) type circuit
  • the voltage regulator can be a low dropout linear regulator (low dropout regulator, LDO).
  • LDO low dropout regulator
  • the following voltage converters may be included in the power management unit.
  • the voltage converter formed by the buck 1 and the voltage regulator 1 the 4V/3.3V voltage output by the standby non-power supply is first stepped down to 0.75V through the buck 1, and then stepped down to 0.6V through the voltage regulator , and finally supplied to the bus to power the image signal processor, artificial intelligence processor, controller and memory connected on the bus through the bus.
  • the voltage converter formed by the buck 2, and the voltage converter formed by the buck 3 and the voltage regulator 3 On the one hand, the 4V/3.3V voltage output by the standby non-power-down power supply is stepped down through the buck 2 to After 0.8V, it is supplied to the first power supply terminal of the interface, on the other hand, it is stepped down to 1.3V through the voltage reducer 3, and then reduced to 1.2V through the voltage regulator 3, and then supplied to the second power supply terminal of the interface, The interface is powered by the voltage difference between the first power supply terminal and the second power supply terminal of the use interface.
  • the image collector since the image collector needs to collect image information in a standby state, the image collector can also be powered by a standby non-power-down power supply.
  • the power management unit may also include a voltage converter corresponding to the image acquisition device (not shown in FIG. 3 ), the voltage converter is used to step down the 4V/3.3V voltage output by the standby non-power-down power supply to 1.1V/1.8V/2.85V, and then provide the step-down voltage to the image grabber.
  • the structure of the voltage converter corresponding to the image acquisition device may refer to the structure of the voltage converter corresponding to the first functional component, which will not be repeated here.
  • the low-power consumption system simultaneously includes an image signal processor, an artificial intelligence processor, a controller, a memory and an interface, and the controller uniformly manages the operations performed by other components in the standby state.
  • Various wake-up operations of the processing device in the standby state are helpful to maintain the controllability of the wake-up from the standby state.
  • the low power consumption system may only include some functional components in the image signal processor, the artificial intelligence processor, the controller, the memory and the interface, and the implementation process of wake-up from standby may not be controlled by device for unified management.
  • the low-power system may only include an image signal processor, an artificial intelligence processor, and a controller.
  • the image signal processor may acquire image information (such as image information downloaded from a network, or other image information sent by the device) and directly send the processed image information to the artificial intelligence processor, and the artificial intelligence processor can call the AI image recognition algorithm stored in an external storage device (such as a cloud server) to identify whether the processed image information contains When there is a human face or gesture, a notification message is sent to the controller to wake up the image processing apparatus by the controller.
  • the low-power system may only include an image signal processor, an artificial intelligence processor, a controller and a memory. In this case, the image signal processor can acquire image information and process the processed image.
  • the artificial intelligence processor can call the AI image recognition algorithm stored in the memory to identify whether there is a face or gesture in the processed image information, and send a notification message to the controller when there is a face or gesture, so that the The controller wakes up the image processing device.
  • the low-power system may only include an image signal processor, an artificial intelligence processor, a controller, and an interface.
  • the image signal processor can obtain images collected by the image collector through the interface. information, and directly send the processed image information to the artificial intelligence processor, and the artificial intelligence processor can call the AI image recognition algorithm stored in the external storage device to identify whether there is a face or gesture in the processed image information. Send a notification message to the controller when a face or gesture occurs, so that the controller wakes up the image processing device.
  • the image processing apparatus may further include a frequency converter system, and the first clock input end (c 1 ) of the frequency converter system is connected to the clock of the first clock generation system
  • the output terminal a 1 , the second clock input terminal (c 2 ) of the frequency converter system is connected to the clock output terminal a 2 /a 3 of the second clock generation system, and the frequency converter system also has a plurality of clock output terminals (eg d 1 ) .
  • the clock output terminal d 1 of the frequency converter system is used for In connection with the clock input end of the image signal processor, the clock output end d2 of the frequency converter system is used for connecting the clock input end of the artificial intelligence processor, and the clock output end d3 of the frequency converter system is used for connecting the clock of the controller Input terminal, the clock output terminal d 4 of the frequency converter system is used to connect the clock input terminal of the memory, the clock output terminal d 5 of the frequency converter system is used to connect the clock input terminal of the interface, and the clock output terminal d of the frequency converter system 6 Used to connect the clock input of the image grabber.
  • the clock output terminal d 1 of the frequency converter system is used for In connection with the clock input end of the image signal processor
  • the clock output end d2 of the frequency converter system is used for connecting the clock input end of the artificial intelligence processor
  • the clock output end d3 of the frequency converter system is used for connecting the clock of the controller Input terminal
  • the clock output terminal d 4 of the frequency converter system is used to connect the
  • the frequency converter system can receive the first clock signal from the first clock generation system through the clock output terminal a1 and the clock input terminal c1, and then generate a frequency-converted first clock signal according to the first clock signal.
  • the clock signal is provided to the low power consumption system and the image collector with the frequency-converted first clock signal.
  • the frequency converter system can receive the second clock signal from the second clock generation system through the clock output terminal a 2 /a 3 and the clock input terminal c 2 , and then generate frequency conversion according to the second clock signal
  • the second clock signal after frequency conversion is provided to the high power consumption system and the low power consumption system; alternatively, the frequency converter system only provides the second clock signal after frequency conversion to the high power consumption system, and the frequency converter system only provides the second clock signal after frequency conversion to the high power consumption system and passes
  • the clock output terminal a 1 and the clock input terminal c 1 receive the first clock signal from the first clock generation system, and then generate the first clock signal after frequency conversion according to the first clock signal, and provide the frequency conversion to the low power consumption system and the image collector after the first clock signal.
  • the frequency converter system may also have a clock output terminal for connecting to the clock input terminal of the bus.
  • Frequency conversion by the frequency converter system may include frequency division or frequency multiplication, ie increasing or decreasing the frequency of the received first clock signal or the frequency of the second clock signal.
  • the structure of the frequency converter system may have various possibilities.
  • the frequency converter system may include a first phase-locked loop, a second phase-locked loop, and a frequency converter.
  • Converter module the clock input terminal of the first phase-locked loop is connected to the clock output terminal c 1 of the frequency converter system
  • the clock input terminal of the second phase-locked loop is connected to the clock output terminal c 2 of the frequency converter system
  • the first lock loop is connected to the clock output terminal c 2 of the frequency converter system.
  • the clock output end of the phase loop and the clock output end of the second phase-locked loop are respectively connected to the clock input end of the frequency converter module, and the frequency converter module also includes a plurality of clock output ends, which are respectively connected to the frequency converter module. Multiple clock outputs of the converter system.
  • the first phase-locked loop can receive the first clock signal output by the first clock generation system through the clock output terminal a1 and the clock input terminal c1, and then perform frequency multiplication processing on the first clock signal to obtain a frequency multiplication
  • the frequency converter module further divides the frequency-multiplied first clock signal to obtain a plurality of first clock signals after frequency division, and a plurality of first clock signals after frequency division.
  • the second phase-locked loop can receive the second clock signal output by the second clock generation system through the clock output terminal a 2 /a 3 and the clock input terminal c 2 , and then perform frequency multiplication processing on the second clock signal to obtain the multiplied frequency
  • the second clock signal is further divided by the frequency converter module to perform a frequency division operation on the multiplied second clock signal to obtain a plurality of frequency-divided second clock signals, and the frequency-divided second clock signals correspond to
  • the plurality of first functional components, and/or the plurality of second clock signals after frequency division respectively correspond to the plurality of second functional components and the image collector.
  • the turn-on and turn-off of the output of the first clock generation system may also be realized by controlling the first phase-locked loop
  • the turn-on and turn-off of the output of the second clock generation system may also be achieved This is achieved by controlling the second phase-locked loop.
  • the controller can also be connected to the control terminal of the first phase-locked loop and the control terminal of the second phase-locked loop (not shown in FIG. 3 ). When the image processing apparatus is in a standby state, the controller can control the first phase-locked loop. The loop is in the open state, and the second phase-locked loop is controlled to be in the closed state.
  • the second clock generation system outputs the first clock signal.
  • the second clock signal is cut off by the second phase locked loop, and only the first clock signal output by the first clock generation system is provided to the low power consumption system and the image collector through the first phase locked loop.
  • the controller can control the first phase-locked loop to be in an off state and control the second phase-locked loop to be in an on state at the same time.
  • Both the first clock generation system and the second clock generation system can output clock signals to the frequency converter system, but the first clock signal output by the first clock generation system is cut off by the first phase-locked loop, and only the second clock generation system outputs the clock signal.
  • the second clock signal is provided to the high power consumption system, the low power consumption system and the image collector through the second phase locked loop.
  • the controller can control both the first phase-locked loop and the second phase-locked loop to be turned on, so that the first clock generates the system output
  • the first clock signal is provided to the low power consumption system and the image collector through the first phase locked loop
  • the second clock signal output by the second clock generation system is provided to the high power consumption system through the second phase locked loop.
  • the frequency multiplier of the first clock signal by the first phase-locked loop can be set by those skilled in the art based on experience.
  • the multiplier of the frequency is smaller, the frequency of the multiplied first clock signal provided to each of the first functional components and the image collector is smaller, which is more helpful for reducing power consumption.
  • the multiple is too small, it is easy to fail to start each of the first functional components and the image collector because the frequency is too low.
  • the frequency multiplier of the first phase-locked loop can be set according to the minimum frequency of the clock signal required to start the respective first functional components and the image collector, so as to start the respective first functional components and the image acquisition smoothly In the case of the device, try to save power consumption.
  • the frequency multiplier of the first phase-locked loop can be set to a value between 3750 and 9375.
  • the frequency multiplier of the first phase-locked loop is set to If set to 5750, the first phase-locked loop can multiply the 32KHz first clock signal to 184MHz, and then the frequency conversion module divides the 184MHz first clock signal to each first functional component and the image collector.
  • the multiple of the frequency multiplication of the second clock signal by the second phase-locked loop can be set according to the frequency of the clock signal required by each processing unit during normal operation.
  • the frequency multiplier of the second phase-locked loop can be set to a value between 20 and 83333.
  • the second phase-locked loop can multiply the frequency of the first clock signal of 38.4MHz to at least 960MHz, and then the frequency conversion module divides the second clock signal of 960MHz to each second functional component.
  • the frequency multiplier of the first phase-locked loop when the image processing device is in the normal working state it can be the same as that in the standby state, or it can be determined according to the current working mode of the low-power system.
  • the frequency multiplier of the first phase-locked loop may also be larger, the power consumption required in the current working mode is smaller, and the frequency multiplier of the first phase-locked loop may also be smaller.
  • Table 1 exemplarily shows a comparison table of the first phase-locked loop and the second phase-locked loop:
  • phase locked loop input clock signal Clock Accuracy output clock signal Power consumption first phase locked loop 32KHz ⁇ 3% 120MHz ⁇ 300MHz About 0.1mW second phase locked loop 38.4MHz ⁇ 1% 800MHz ⁇ 3.2GHz 2mW ⁇ 6mW
  • the image processing device uses 32KHz and the first phase-locked loop after each cycle start time in the standby state to provide the first functional components of each cropped version
  • the clock signal is used to realize the standby wake-up function of the first functional unit of each cutting version.
  • the first functional components of each tailored version work under the clock signal of 120 MHz to 300 MHz, so that the power consumption of the first functional components of each tailored version is small, and the power consumption of the first phase-locked loop itself is only 0.1mW or so.
  • the solution in the present application can effectively reduce the total power consumption of the image processing apparatus in the standby state.
  • FIG. 4 exemplarily shows a schematic structural diagram of a frequency converter module provided by an embodiment of the present application.
  • the frequency converter module may include multiple frequency converters (eg, each of the frequency converters in FIG. 4 ).
  • the dotted box corresponds to one frequency converter), and each frequency converter in the plurality of frequency converters corresponds to one first functional component or an image collector in the plurality of first functional components.
  • the clock output terminal of the first phase-locked loop can be respectively connected to the clock input terminal of each frequency converter, and the clock output terminal of each frequency converter can be connected to the corresponding clock input terminal of the first functional component or the image collector.
  • each frequency converter when the first phase-locked loop is turned on, each frequency converter can receive the frequency-multiplied first clock signal output by the first phase-locked loop, and perform frequency conversion adjustment on the frequency-multiplied first clock signal , and then output the first clock signal adjusted by frequency conversion to the corresponding first functional component or image collector.
  • the clock output terminal of the second phase-locked loop can also be connected to the clock input terminal of each frequency converter.
  • each frequency converter can receive the first frequency converter.
  • the second frequency-multiplied clock signal output by the second phase-locked loop, and the frequency-converted second clock signal is adjusted by frequency conversion, and then the frequency-converted and adjusted second clock signal is output to the corresponding first functional component or image acquisition. device.
  • each frequency converter may include a frequency converter, and the frequency converter is used to perform frequency conversion adjustment on the received clock signal after frequency multiplication according to a preset frequency conversion multiplier.
  • the frequency converter module receiving the multiplied first clock signal output by the first phase-locked loop as an example, since the first clock signal is first multiplied by the first phase-locked loop to a higher frequency and then converted by the frequency converter , so the frequency of the converted first clock signal will still be greater than the frequency of the original first clock signal.
  • the image signal processor corresponds to the frequency converter 1
  • the frequency conversion multiplier of the frequency converter 1 is 2.
  • the frequency conversion The device 1 can convert the first clock signal of 184MHz to 92MHz and provide it to the image signal processor; the artificial intelligence processor corresponds to the inverter 2, the controller corresponds to the inverter 3, the memory corresponds to the inverter 4, the inverter 2, the inverter 3 The frequency conversion multiples of inverter 4 and inverter 4 are both 1.
  • inverter 2, inverter 3 and inverter 4 can respectively provide the first clock signal of 184MHz to the artificial intelligence processor, controller and memory;
  • the interface corresponds to inverter 5
  • the frequency conversion multiplier of inverter 5 is 6, so that inverter 1 can convert the first clock signal of 184MHz to 30.7MHz and provide it to the interface;
  • the image collector corresponds to inverter 6, and the frequency conversion multiplier of inverter 6 is 7, so , the frequency converter 6 can convert the first clock signal of 184MHz to 26.3MHz and provide it to the image acquisition device.
  • the frequency of the clock signal output by the clock output terminal of each frequency converter is greater than the frequency of the original clock signal before frequency multiplication.
  • the frequency converter may further include the following components.
  • the frequency converter when the frequency converter corresponds to one of the auxiliary control components such as the image signal processor, the artificial intelligence processor, the interface and the image collector, the frequency converter can also It includes a switch, the first end of the switch is connected to the clock output end of the frequency converter in the frequency converter, the second end of the switch is connected to the clock input end of the corresponding auxiliary control component, and the controller can also be connected to the switch in the frequency converter. the control terminal.
  • the controller determines that the auxiliary control part corresponding to the frequency converter is working, the controller can turn on the switch in the frequency converter to turn on the output of the frequency converter, so that the auxiliary control part corresponding to the frequency converter is in the frequency converter. It works under the clock signal output by the frequency converter.
  • the controller determines that the auxiliary control component corresponding to the frequency converter stops working, the controller can turn off the switch in the frequency converter to turn off the output of the frequency converter, thereby saving the power consumption of the auxiliary control component.
  • these components will actively perform operations such as sending control instructions, calling auxiliary control components, transmitting data and storing data in standby state. Therefore, these components belong to the main control component.
  • the component needs to be always supplied with a clock signal in the standby state. In this case, in order to save the power consumption of the main control unit, although the clock signal supply of the main control unit cannot be disconnected, a clock signal with a lower frequency can be provided to the main control unit when it is not required to perform the main control operation. To maintain the survival of the main control components. Based on this, continue to refer to as shown in FIG.
  • the frequency converter when the frequency converter corresponds to a main control component such as a controller or a memory (or bus), the frequency converter may also include a converter, and the first clock input end of the converter is connected to the The clock output end of the frequency converter in the frequency converter, the second clock input end of the converter is connected to the clock output end of the first clock generation system, the clock output end of the converter is connected to the clock input end of the corresponding element, and the controller can also Connect to the control terminal of the converter in the frequency converter.
  • a main control component such as a controller or a memory (or bus)
  • the frequency converter may also include a converter, and the first clock input end of the converter is connected to the The clock output end of the frequency converter in the frequency converter, the second clock input end of the converter is connected to the clock output end of the first clock generation system, the clock output end of the converter is connected to the clock input end of the corresponding element, and the controller can also Connect to the control terminal of the converter in the frequency converter.
  • the controller determines that the main control component corresponding to the frequency converter performs the main control operation, the controller can turn on the first clock input terminal and the clock output terminal of the converter in the frequency converter to convert the frequency-converted first
  • the clock signal is provided to the corresponding main control component, so that the main control component corresponding to the frequency converter performs the main control operation under the frequency-converted first clock signal.
  • the controller may turn on the second clock input terminal and the clock output terminal of the converter in the frequency converter to provide the first clock signal.
  • the main control component corresponding to the frequency converter is kept alive under the first clock signal.
  • the main control component Since the frequency of the clock signal output by the clock output end of each frequency converter is greater than the frequency of the first clock signal before frequency multiplication, according to this implementation manner, the main control component will be at a higher frequency when the main control operation does not need to be performed. It can survive under the small first clock signal (eg 32KHz), and when the master control operation needs to be performed, the master control operation will be performed under the higher frequency converted first clock signal (eg 184MHz), so this method It also helps to reduce the power consumption of the main control unit.
  • the small first clock signal eg 32KHz
  • the master control operation will be performed under the higher frequency converted first clock signal (eg 184MHz), so this method It also helps to reduce the power consumption of the main control unit.
  • controlling the frequency converter not to output the clock signal by turning off the switch in the frequency converter corresponding to the auxiliary control component is only an optional implementation.
  • the controller can also control the frequency converter corresponding to the auxiliary control component not to output the clock signal in other ways, for example, the controller can also turn off the clock output terminal of the frequency converter corresponding to the auxiliary control component, Or close the clock output terminal on the frequency converter module for connecting the clock input terminal of the auxiliary control component.
  • the controller can turn off the clock output terminal d 1 .
  • the 92KHz first clock signal output by the inverter 1 can be turned off at the clock output terminal d 1 . It is locked inside the frequency converter module and will not be output to the image signal processor. There are many possible implementations, which will not be repeated here.
  • the following is an exemplary introduction to the standby wake-up process in one cycle in the standby state with reference to the structure shown in FIG. 4 .
  • the duration of one cycle is 100ms, and the controller only performs standby recognition on one image in one cycle.
  • the default mode of the multiple frequency converters in the standby state is: switch K1, switch K2, switch K5 and switch K6 are disconnected, and the second clock input terminal (e 32 ) of converter 3 is connected to the clock output terminal of converter 3 , the second clock input terminal (e 42 ) of the converter 4 is connected to the clock output terminal of the converter 4 .
  • the frequency converter corresponding to the main control unit works with a low-frequency clock signal, and the frequency converter corresponding to the auxiliary control unit does not output a clock signal. It is assumed that the clock signal provided by the frequency converter 6 for the image acquisition device is MCLK.
  • FIG. 5 exemplarily shows the timing control diagram corresponding to the standby wake-up process in one cycle of the image processing apparatus in the standby state.
  • the control process of the controller in this cycle includes: Step 1, at the timing of 100ms After the timer expires, the controller first controls the first clock input terminal (e 31 ) of the converter 3 to connect to the clock output terminal of the converter 3, so that the controller switches from the low frequency clock signal of 32KHz to the high frequency clock signal of 184MHz. Work.
  • Step 2 the controller turns on the switch K1 and the switch K5 to provide the first clock signal of 92 MHz output by the inverter 1 to the image signal processor, and the first clock signal of 30.7 MHz output by the inverter 5 to the interface, Enables the image signal processor and interface to work.
  • Step 3 the controller turns on the switch K6 to provide the first clock signal of 26.3MHz output by the inverter 6 (that is, the MCLK operates at a frequency of 26.3MHz) to the image collector, and configures the image collector to be in standby mode ( standby mode) to switch to streaming mode.
  • the switch K6 turns on the switch K6 to provide the first clock signal of 26.3MHz output by the inverter 6 (that is, the MCLK operates at a frequency of 26.3MHz) to the image collector, and configures the image collector to be in standby mode ( standby mode) to switch to streaming mode.
  • the controller configures the working mode of the image collector.
  • the controller sends a mode switching instruction to the image collector, and the image collector switches its own working mode according to the received mode switching instruction.
  • the controller first turns on the switch K6 to provide the MCLK clock to the image collector and then configures the working mode of the image collector, so that the image collector can successfully switch to the outflow with the support of the MCLK clock. model.
  • the controller needs to first send a mode switching instruction to the image collector, and after the image collector successfully switches to the standby mode, Open switch K6 to end supplying the MCLK clock to the image grabber.
  • Step 4 the image collector obtains a frame of image through exposure under the support of the first clock signal of 26.3 MHz, and transmits the frame of image to the image signal processor through the interface.
  • one frame of image can be transmitted in multiple times, and only part of the image information of one frame of image is transmitted each time.
  • the image signal processor may be in an idle mode (ie, Idle).
  • the image signal processor can process the received image information, so the image signal processor can be in the active mode (ie Active).
  • the interface can be in a low power mode (low power, LP).
  • the interface continuously transmits the image information sent by the image collector to the image signal processor, so the interface can be in the transmission mode (ie Transmit).
  • Step 5 the controller controls the second clock input terminal (e 32 ) of the converter 3 to connect to the clock output terminal of the converter 3, so that the controller uses the low frequency clock signal of 32KHz to maintain low power consumption and waits for the notification from the image collector. .
  • the controller since the controller no longer needs to perform other operations during the image capture process, when the controller controls the image capturer to switch to the first clock signal of 26.3MHz, the controller can immediately Switch to low-power operation to save power.
  • Step 6 after the controller receives the notification sent by the image collector to start transmitting the image, it controls the first clock input end (e 31 ) of the converter 3 to connect to the clock output end of the converter 3, so that the controller changes from the 32KHz clock to the clock output end of the converter 3.
  • the low-frequency clock signal is switched to work under the high-frequency clock signal of 184MHz, and the first clock input end e 41 of the control converter 4 is connected to the clock output end of the converter 4 under the high-frequency clock signal, so that the memory is changed from the 32KHz clock signal. Switch to 184MHz clock signal to work.
  • the process of transmitting the image information from the image collector to the image signal processor, the image signal processor processing the image information, and the image signal processor transmitting the processed image information to the memory are performed in parallel. Therefore, By switching the working state of the memory to high power consumption when the image collector starts to transmit the first part of the image information, even if the image signal processor quickly processes the first part of the image information and sends it to the memory when it receives the first part of the image information, the memory The high-frequency clock signal can also support the timely storage of the processed first part of the image information.
  • the memory has a clock signal in the entire standby state, but until the first part of the image information sent by the image signal processor is received, the memory is in an idle mode. After receiving the first part of the image information sent by the image signal processor until the last part of the image information is received, the memory is in an active mode.
  • Step 7 the controller controls the second clock input terminal (e 32 ) of the converter 3 to be connected to the clock output terminal of the converter 3, so that the controller uses a low-frequency clock signal of 32KHz to maintain low power consumption and waits for the image signal processor. notify.
  • Step 8 after the controller receives the notification of the completion of image reception sent by the image signal processor, it first controls the first clock input end ( e31 ) of the converter 3 to connect to the clock output end of the converter 3, so that the controller switches Work under the high-frequency clock signal up to 184MHz, and configure the image collector to switch from the outflow mode to the standby mode with the support of the 184MHz high-frequency clock signal, and then turn off the switch K6 to turn off the clock signal MCLK of the image collector. Turn on the switch K5 to turn off the clock signal of the interface, and turn off the switch K1 to turn off the clock signal of the image signal processor to save power consumption.
  • the image signal processor still needs time to process and transmit the last part of the image information.
  • the image collector and the interface complete the work first, and the image signal processor completes the work. Therefore, after transmitting the last part of the image information, the image collector can also send a notification of the completion of the image transmission to the controller, so that the controller can configure the image collector from the outflow mode to the standby mode according to the notification, and turn off the switch K6 To turn off the clock signal MCLK of the image acquisition device, at the same time turn off the switch K5 to turn off the clock signal of the interface, and wait for the notification from the image signal processor.
  • the image signal processor After the image signal processor stores the last part of the processed image information, the image signal processor can also send a notification of image storage completion to the controller, so that the controller turns off the switch K1 according to the notification to turn off the image signal processor. clock signal.
  • the clock control of each component is more refined, which is more conducive to reducing power consumption, but if the time difference between the completion of work between various components is small, this method may not be as easy to implement in control as the previous method. .
  • the power consumption of the interface varies with its working mode.
  • the interface does not transmit image signals, even if the clock signal of the interface is not turned off, the power consumption of the interface itself is relatively small.
  • the controller may not turn off the clock signal of the interface. In this case, when the interface no longer transmits image data, Thus the interface can be in a low power consumption mode as illustrated in FIG. 4 .
  • auxiliary components such as the image collector, the interface, and the image signal processor
  • the controller since the work of the image collector, the interface and the image signal processor has been completed in this cycle, and these auxiliary components are no longer required to work in the subsequent period of the cycle, the controller also These auxiliary components can be directly powered off (power down, PD).
  • power down There are many ways to power off the auxiliary components. For example, you can directly disconnect the output terminal of the voltage converter corresponding to the auxiliary component, or you can also set a switch between the output terminal of the voltage converter corresponding to the auxiliary component and the auxiliary component.
  • the controller is connected with the control terminal of the switch. When the auxiliary component needs to be powered off, the controller can disconnect the switch corresponding to the auxiliary component.
  • Step 9 the controller turns on the switch K2 to provide the artificial intelligence processor with the 184MHz clock signal output by the frequency converter 2, so that the artificial intelligence processor calls the AI image recognition algorithm in the memory to extract the characteristics of the processed image, And match the feature with the target feature to get the matching result.
  • the controller may switch the memory to a low-frequency clock signal, so as to maintain the low-power consumption operation of the memory in this period.
  • the controller may switch back to the high-frequency clock signal immediately after switching the memory to the low-frequency clock signal, so the controller may not switch the memory clock signal, so that the memory will be in idle mode under the high frequency clock signal during this period.
  • the memory when the artificial intelligence processor obtains the AI image recognition algorithm and the processed image in the memory, the memory will be in the active mode, and when the artificial intelligence processor obtains the information to perform the calculation, the memory will be in the idle mode . Therefore, the memory can be in an active mode or an idle mode during the process of image recognition by the artificial intelligence processor.
  • Step 10 the controller controls the second clock input terminal e32 of the converter 3 to connect to the clock output terminal of the converter 3, so that the controller uses a 32KHz low frequency clock signal to maintain low power consumption and waits for the notification from the artificial intelligence processor.
  • Step 11 after the controller receives the matching result notified by the artificial intelligence processor, the first clock input end e31 of the control converter 3 is connected to the clock output end of the converter 3, so that the controller switches to a high frequency clock signal of 184MHz .
  • the switch K2 Under the high frequency clock signal, the switch K2 is closed to close the clock signal of the artificial intelligence processor, and the second clock input end e 42 of the control converter 4 is connected to the clock output end of the converter 4, so that the memory is switched to 32KHz Low-power operation under the clock signal.
  • step 11 after the artificial intelligence processor notifies the matching result, the artificial intelligence processor and the memory are no longer required to work in the subsequent period of the cycle, so the controller can also be powered off directly The artificial intelligence processor and memory are powered on until the next cycle start time or normal working state to save power consumption.
  • Step 12 the controller determines whether there is a face or gesture according to the matching result, if so, sends trigger information to the central processing unit to wake up the image processing device, if not, the controller controls the second clock input of the converter 3 e 32 is connected to the clock output terminal of the converter 3, so that the controller uses a 32KHz low-frequency clock signal to maintain low-power operation, waits for the next 100ms timer to expire, and repeats the above steps 1 to 12.
  • the central processing unit to wake up the image control device refers to switching the image processing device to a normal working state, such as lighting the screen and/or waking up the voice interaction system.
  • a normal working state each of the second functional components and the image collector can use the second clock signal to work, and each of the first functional components can use one of the first clock signal and the second clock signal to work.
  • Which clock is used specifically Signals can be set according to business scenarios.
  • each frequency converter corresponding to each first functional component in the frequency converter module may be multiplexed.
  • the first A phase-locked loop and a second phase-locked loop use the same frequency translator to provide a clock signal to the same first functional unit.
  • the image processing When the current business scene belongs to the scene in the first working mode that needs to frequently recognize faces or gestures (for example, the first working mode is the dynamic gesture detection mode, and the user is playing a game in the dynamic gesture detection mode, in this scenario, the image processing When the device needs to recognize the user's dynamic gestures at a frequency of about 30fps, to match the gestures on the game interface and determine the user's game score), each first functional component needs to use a high-frequency clock signal to support high-frequency image recognition work, Therefore, the image processing apparatus can close the transmission path of the first phase-locked loop to the frequency converter corresponding to each first functional component, and open the transmission path of the second phase-locked loop to the frequency converter corresponding to each first functional component, so as to The high-frequency second clock signal output by the second phase-locked loop is provided to the first functional component through a frequency converter.
  • the image processing device needs to follow the When the frequency of about 5fps is used to identify the user's eyes to match the current screen orientation and determine whether the screen needs to be rotated), each first functional component needs to use a low-frequency clock signal to support low-frequency image recognition. Therefore, the image processing device can closing the transmission path of the second phase-locked loop to the frequency converter, and opening the transmission path of the first phase-locked loop to the frequency converter, so that the low-frequency first clock signal output by the first phase-locked loop is provided by the frequency converter to the first functional component.
  • first working mode and the second working mode only represent two different types of working processes or working states, and the clock signals used in different working processes or working states.
  • the frequencies are different, and the specific meaning of the working mode is not limited in the embodiments of the present application.
  • a switch can also be provided on the transmission path of the phase-locked loop and each frequency converter, and the control end of the switch is connected to the controller (or central processing unit), when the controller (or central processing unit) turns on the switch, The transmission path of the phase-locked loop to each of the first functional components is opened, and when the controller (or the central processing unit) turns off the switch, the transmission path of the phase-locked loop to each of the first functional components is closed.
  • the output end of the phase-locked loop has a control interface, and the control interface is connected with the controller (or central processing unit), when the controller (or central processing unit) turns on the output of the phase-locked loop through the control interface , the transmission path of the phase-locked loop to each first functional component is opened, when the controller (or central processing unit) closes the output of the phase-locked loop through the control interface, the transmission of the phase-locked loop to each first functional component Path is closed.
  • the controller can also control the bus corresponding to The first clock input end of the frequency converter is connected to the clock output end, so that the bus realizes the information transmission between various components under the high frequency clock signal.
  • the controller can control the second clock input terminal of the frequency converter corresponding to the bus to connect to the clock output terminal, so that the bus can operate at a low frequency The clock signal is kept alive to reduce the power consumption of the bus.
  • the above embodiments of the present application provide a refined clock control method.
  • the controller uniformly manages the operation of each component in the standby state, it also adjusts each component according to the working state of each component.
  • the clock of the component for example, when a component is not working, the controller can directly turn off the clock of the component, or switch the component to a lower frequency clock, so as to reduce the power consumption of the component.
  • the clock of each component is adjusted in combination with a refined clock control method during wake-up from standby, which helps to further reduce the power consumption of each component in the standby state.
  • FIG. 5 only exemplarily shows the standby wake-up process of the image processing apparatus in one cycle, and the entire implementation process of the standby wake-up of the image processing apparatus will be described below.
  • the standby wake-up process in each cycle can be referred to as shown in FIG. 5 , which will not be repeated in this application.
  • FIG. 6 exemplarily shows a schematic flowchart of a method for waking up from standby, and the method is introduced by taking gesture waking up as an example.
  • the method includes: Step 601 , the image processing apparatus determines that the image processing apparatus is in a standby state working method below. If the working mode is on-screen display, step 602 is executed; if the working mode is standby wake-up, step 603 is executed.
  • the working mode in the standby state can be set by the user.
  • the image processing apparatus can actively provide the user with a standby configuration interface, and the user can select the working mode in the standby state on the standby configuration interface.
  • a default working mode is initially set in the image processing device, and the user can enter the standby configuration interface through the setting button to modify the default working mode.
  • Step 602 the image processing apparatus displays the display content corresponding to the screen-on-display display on the screen in the standby state.
  • the user when the user needs to monitor common information such as the clock at all times in the standby state, the user can select the on-screen display as the working mode in the standby state, and the user can also set the content displayed on the off-screen display. In this way, the image processing apparatus will always display the content displayed on the screen that is set by the user during the entire process of the standby state, so as to meet the needs of the user and improve the user experience.
  • Step 603 the image processing apparatus detects the brightness change value of the ambient light in the standby state.
  • the standby wake-up can be selected as the working mode in the standby state.
  • the application processor in the image processing apparatus may send a notification message to the controller, so as to trigger the controller to start the standby wake-up monitoring service.
  • the controller can first switch each frequency converter to the default mode in the standby state.
  • the controller when configuring the frequency converter corresponding to the image collector, the controller needs to configure the image collector to switch to standby mode with the support of the MCLK clock, and then turn off the switch K6 to turn off the MCLK clock. In this way, the image collector and the switch K6 are switched to default mode.
  • the controller (or the application processor) can also power off the standby power supply, so as to power off each second functional component (including the application processor) in the high power consumption system.
  • the controller can also turn on the first clock generation system and turn off the second clock generation system, so that each first functional component and the image collector in the low power consumption system use the low frequency first clock signal to perform standby wake-up.
  • the ambient light of the image processing device when the user gestures in front of the screen, the ambient light of the image processing device will change, so detecting the change of the ambient light can be used as a precondition for wake-up from standby.
  • the standby non-power-off power supply and the ambient light sensor can also be connected, and the standby non-power-off power supply is in the standby state.
  • the ambient light sensor is powered, so the controller can control the ambient light sensor to detect the change of ambient light in the standby state, so as to obtain the brightness change value of the ambient light.
  • the controller may also directly control the image collector to collect at least two frames of images, and compare the brightness of the at least two frames of images to determine the brightness change value of the ambient light.
  • the brightness change value of the ambient light is only a feature that reflects the existence of an object in front of the ambient light sensor.
  • the embodiment of the present application does not limit the use of this feature to detect changes in ambient light. Anything that can indicate that there is an object in front of the ambient light sensor
  • the features of the object are all within the scope of protection of the present application, such as temperature, color difference, grayscale, and the like.
  • Step 604 the image processing apparatus determines whether the brightness change value of the ambient light is greater than a preset threshold, and if so, executes step 605 , and if not, executes step 603 .
  • the image processing apparatus needs about 5 mW of power consumption to detect changes in ambient light, and about 10 mW of power consumption is required to perform one standby identification.
  • it is equivalent to setting a first-level screening condition for standby recognition. Only when the screening condition is satisfied, the standby recognition will be performed, and if it is not satisfied, it will not be performed. Standby recognition. Since ambient light detection consumes less power than standby recognition, this approach helps reduce power consumption in standby.
  • Step 605 the image processing device performs standby recognition according to the first cycle, and recognizes a frame of images in each first cycle; if the frame of images includes gestures, perform step 606; if the frame of images does not include gestures, and continuous If no gesture is detected in the K first cycles, step 603 is performed; if the frame image does not include gestures, and the number of cycles in which no face is detected does not reach K, step 605 is performed.
  • K may take any positive integer greater than or equal to 2.
  • the value of K can be set by those skilled in the art based on experience. For example, it may take 1 second from when the human hand is blocked from the ambient light sensor to when the human hand is completely placed in front of the screen. Therefore, if the period of the first cycle is long is 500 milliseconds, the value of K can be set to 2.
  • the recognition can continue, and it is determined that the user has not performed the gesture wake-up operation until the human hand is not recognized twice. In this way, by setting the number of recognition times, the user can have enough time to place a complete human hand in front of the screen, which helps to improve the recognition accuracy.
  • Step 606 the image processing device continues to recognize images according to the second cycle, and recognizes one frame of image in each second cycle; if the number of times the gesture is recognized is greater than or equal to T times, step 607 is performed; if the number of times the gesture is recognized is less than T time, step 603 is executed.
  • T may be any positive integer.
  • the number of times the gesture is recognized is greater than or equal to T times, which may mean that there are gestures after T times of continuous recognition, or it may mean that any number of times greater than T is recognized and there are gestures for T times.
  • the number of recognitions is constant, the larger the value of T is, the more accurate the image recognition is, and the smaller the value of T is, the less accurate the image recognition is.
  • the second period may be smaller than the first period, for example, when the first period is 500 milliseconds, the second period may be 300 milliseconds.
  • the image processing device continues to recognize images at a frame rate of 5 frames per second (fps).
  • the second period may also be 100 milliseconds.
  • the image processing apparatus will recognize the image at a frame rate of 10 frames per second (fps).
  • the power consumption of about 10mW is required to recognize the image according to the first cycle, and the power consumption of about 20mW to 30mW is required to recognize the image according to the second cycle.
  • recognizing images according to the first cycle is equivalent to setting a second-level screening condition for standby wake-up.
  • Step 607 the image processing apparatus is switched from the standby state to the normal working state. It can be understood that, during the execution of the above steps 603 to 607, if the image processing apparatus receives a wake-up instruction in other ways (for example, the user presses the power button), the image processing apparatus can end the current standby wake-up operation, and the standby wake-up operation is performed. The state switches directly to the normal working state.
  • the power consumption level that can be achieved by the standby wake-up method in the present application is described below with a specific example. In this example, it is assumed that gaze wake-up is performed according to a period of 200 milliseconds.
  • Table 2 exemplarily shows a schematic table of power consumption of each first functional component and the image collector, where the power consumption unit is mW:
  • the total power consumption of each first functional component and the image collector to perform a standby wake-up in one cycle is only about 17.8mW.
  • each functional unit as shown performs wake-up from standby, several hundred mW of power consumption can be saved.
  • the image processing device is used for 7 hours with the screen on, and the screen is off in dark light (there is no flash, so the first-level detection is turned off when the screen is off in dark light, that is, no execution is performed.
  • Standby wake-up use for 8 hours and charge for 1 hour, then the duration of bright light off screen is 8 hours.
  • the standby wake-up is performed under the bright light and the screen off, if the time during which the light does not change in these 8 hours is calculated as 5 hours, and the power consumption of 1.5 mA is consumed per hour when the light does not change, then the 5 hours (unit is H ) is approximately:
  • the power consumption consumed by performing standby wake-up in one day is about:
  • the power consumption of performing wake-up from standby in one day requires hundreds of mAHs or even thousands of mAHs.
  • the solution in the present application can effectively reduce the power consumption of the image processing apparatus, and help to improve the battery life of the image processing apparatus.
  • the image processing apparatus and the image processing method in the embodiments of the present application can be applied not only to the above-mentioned electronic devices, but also to robots or other smart home products, such as washing machines, LCD TVs, microwave ovens, etc. , which is not specifically limited.
  • connection should be understood as an electrical connection or an electrical connection. Coupling should not be understood as being directly connected by wires, and the “connection” should be understood as being indirectly connected by other devices.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Power Sources (AREA)

Abstract

一种图像处理装置、电子设备及图像处理方法，当图像处理装置处于待机状态时，低功耗系统基于第一时钟信号处理图像信息并触发图像处理装置切换至正常工作状态，当图像处理装置处于正常工作状态时，低功耗系统基于第一时钟信号和第二时钟信号中的一个工作，而高功耗系统基于第二时钟信号工作。这种方式通过合理设计低功耗系统在不同状态(即待机状态和正常工作状态)下所使用的时钟信号，有助于节省低功耗系统乃至整个图像处理装置的功耗，且还能使功耗控制方案更加灵活。

Description

一种图像处理装置、电子设备及图像处理方法 技术领域
本申请涉及电子技术领域，尤其涉及一种图像处理装置、电子设备及图像处理方法。
背景技术
息屏显示(always on display，AOD)是现阶段电子设备中的一项重要功能。AOD通常被应用在使用有机发光二极管(organic light-emitting diode，OLED)屏幕的电子设备中。AOD利用OLED屏幕所具有的单像素自发光的特性，可以只点亮OLED屏幕上的局部像素点来显示时钟和一些常用信息。如此，用户每次查看时钟或者常用信息时就不用按下整个电源按键来点亮整个OLED屏幕，从而有助于节省电子设备的电量。
现阶段，支持息屏显示的电子设备大都采用息屏唤醒功能来唤醒系统。息屏唤醒是指将电子设备由息屏显示状态切换至正常工作状态。当电子设备支持息屏唤醒时，电子设备的息屏显示屏幕上除了存在部分常亮区域用于显示信息外，还存在部分区域始终处于工作状态(可以是点亮的也可以是不点亮的)，用户通过双击这些区域来唤醒电子设备。这种情况下，息屏唤醒在待机状态下的功耗不仅包括用于显示内容的常亮区域的功耗，还额外增加了部分屏幕区域的功耗以用于检测用户的双击操作。随着用户所关注的信息变多，AOD显示的内容也越来越多，而这些内容在电子设备的待机状态下会始终显示在屏幕上，这就使得电子设备在待机状态下的功耗增加，无形中也增加了息屏唤醒的功耗。
除了息屏显示的应用场景，本领域一直在尝试开发一种不需要用户干预来唤醒电子设备的方案。在一种可能的方案中，当电子设备处于待机状态的时候，可以让电子设备中的部分部件处于始终唤醒(always on，AO)状态，并等待处理来自摄像头的图像信息。当摄像头采集到图像信息后，该部分部件通过识别图像信息来唤醒整个电子设备，从而节省系统功耗。不过处于AO状态的部件的功耗控制一直不理想，无论电子设备是在待机状态还是在正常工作状态，处于AO状态的部件都需要消耗较多的功耗。因此，如何合理设计以进一步节省这部分部件的功耗就成为一个问题。
发明内容
有鉴于此，本申请提供一种图像处理装置、电子设备及图像处理方法，用于降低图像处理装置(例如电子设备)的功耗。
第一方面，本申请提供一种图像处理装置，该图像处理装置可以包括第一时钟产生系统、第二时钟产生系统、低功耗系统和高功耗系统。其中，第一时钟产生系统可以产生第一频率的第一时钟信号，第二时钟产生系统可以产生第二频率的第二时钟信号，第一频率小于第二频率。当图像处理装置处于待机状态时，低功耗系统可以基于第一时钟信号处理图像信息并触发图像处理装置切换至正常工作状态。当图像处理装置处于正常工作状态时，低功耗系统可以基于第一时钟信号和第二时钟信号中的一个工作，而高功耗系统可以基于第二时钟信号工作。
在上述设计中，在图像处理装置中设置低功耗系统，并由低功耗系统在待机状态下使用频率较低的第一时钟信号来实现待机识别，有助于降低图像处理装置在待机状态下执行 唤醒时的功耗。且，在该方案中，低功耗系统在唤醒后即在正常工作状态下所使用的时钟信号可以为低频率的第一时钟信号和高频率的第二时钟信号中的一个，而不是固定使用高频率的第二时钟信号，这使得功耗控制方案更加灵活，有助于进一步降低图像处理装置的功耗。由此可知，本申请通过合理设计低功耗系统在不同状态(即待机状态和正常工作状态)下所使用的时钟信号，有助于节省低功耗系统乃至整个图像处理装置的功耗。
在一种可能的设计中，低功耗系统中包括多个第一功能部件，多个第一功能部件处于待机非掉电区。如此，即使图像处理装置处于待机状态，多个第一功能部件也仍然可以工作，从而有助于利用多个第一功能部件实现待机状态下的待机唤醒功能。
在一种可能的设计中，高功耗系统中包括多个第二功能部件，多个第二功能部件处于待机掉电区。如此，当图像处理装置处于待机状态时，多个第二功能部件不工作，从而有助于降低待机状态下的功耗。
在一种可能的设计中，多个第一功能部件可以包括控制器、图像信号处理器和人工智能处理器，多个第二功能部件可以包括中央处理单元。其中，图像信号处理器可以在图像处理装置处于待机状态时，处理图像信息以得到处理后的图像信息，人工智能处理器可以在图像处理装置处于待机状态时，提取处理后的图像信息的特征，并确定特征是否匹配目标特征以得到匹配结果，控制器可以在图像处理装置处于待机状态时，根据匹配结果向中央处理单元发送触发信号，中央处理单元可以响应于触发信号，从而将图像处理装置切换至正常工作状态。通过该设计，低功耗系统中的多个第一功能部件和高功耗系统中的多个第二功能部件可以相互配合，以通过图像识别的方式实现图像处理装置的待机唤醒功能。且，这种方式通过人工智能处理器确定图像是否符合待机唤醒的特征，因此还有助于提高图像识别的专业性和能效。
在一种可能的设计中，触发图像处理装置切换至正常工作状态时，可以包括：控制屏幕点亮。如此，这种方式支持直接点亮屏幕，以便于直接对屏幕上的应用进行操作，用户的体验较好。
在一种可能的设计中，多个第一功能部件还可以包括接口，接口可以在图像处理装置处于待机状态时，从图像采集器接收图像信息并将图像信息传输给图像信号处理器。
在一种可能的设计中，多个第一功能部件还可以包括存储器，存储器可以在图像处理装置处于待机状态时，存储处理后的图像信息。如此，人工智能处理器能够直接调用存储器中存储的处理后的图像信息，以执行图像识别算法。
在一种可能的设计中，图像处理装置还可以包括频率变换器系统，频率变换器系统可以从第一时钟产生系统接收第一时钟信号，然后对第一时钟信号进行变频产生变频后的第一时钟信号，并向低功耗系统提供变频后的第一时钟信号，且频率变换器系统还可以从第二时钟产生系统接收第二时钟信号，然后对第二时钟信号进行变频产生变频后的第二时钟信号，并向低功耗系统或高功耗系统提供变频后的第二时钟信号。如此，频率变换器系统能够将第一时钟信号或第二时钟信号变频为各个第一功能部件或各个第二功能部件所需的时钟信号，有助于使时钟信号更加满足各个第一功能部件或各个第二功能部件的需求。
在一种可能的设计中，频率变换系统可以包括多个频率变换器，多个频率变换器分别对应多个第一功能部件。每个频率变换器可以接收第一时钟信号并向对应的第一功能部件输出变频后的第一时钟信号，或接收第二时钟信号并向对应的第一功能部件输出变频后的第二时钟信号。通过该设计，各个第一功能部件对应的频率变换器针对第一时钟信号和第 二时钟信号是复用的，因此一个频率变换器能够支持对两种时钟信号进行调频操作进而提供给对应的第一功能部件，这种方式有助于降低图像处理装置的设计成本。
在一种可能的设计中，多个频率变换器中还存在至少一个频率变换器，该至少一个频率变换器可以在对应的至少一个第一功能部件停止工作时，关闭至少一个频率变换器的输出，以节省功耗。
在一种可能的设计中，变频后的第一时钟信号的频率高于第一频率。这种情况下，多个频率变换器中还存在至少一个频率变换器，该至少一个频率变换器可以在对应的至少一个第一功能部件空闲时，将第一频率的时钟信号输出给至少一个第一功能部件，在至少一个第一功能部件工作时，将变频后的第一时钟信号输出给至少一个第一功能部件，以节省功耗。
在一种可能的设计中，在图像处理装置处于正常工作状态时，低功耗系统可以在第一工作模式下基于第一时钟信号工作，且在第二工作模式下基于第二时钟信号工作。如此，该种方式支持使用与工作模式相匹配的时钟信号来实现业务，有助于根据工作模式的需求选择合适的时钟信号，这种方式不仅能够提高功耗控制的灵活性，还能降低图像处理装置在正常工作状态下的功耗。
在一种可能的设计中，在图像处理装置处于待机状态时，第二时钟产生系统被关闭。如此，图像处理装置在待机状态下可以只使用低频率的第一时钟信号工作，从而有助于节省图像处理装置在待机状态下的功耗。
第二方面，本申请提供一种电子设备，包括上述第一方面任一项所述的图像处理装置和图像采集器。可选地，所述图像采集器包括摄像头。
第三方面，本申请提供一种图像处理方法，该方法应用于图像处理装置，该方法包括：图像处理装置控制第一时钟产生系统产生第一频率的第一时钟信号，并控制第二时钟产生系统产生第二频率的第二时钟信号，其中，第一频率小于第二频率。在处于待机状态时，图像处理装置可以控制低功耗系统基于第一时钟信号处理图像信息并触发图像处理装置切换为正常工作状态，在处于正常工作状态时，图像处理装置可以控制低功耗系统基于第一时钟信号和第二时钟信号中的一个工作，并控制高功耗系统基于第二时钟信号工作。
在一种可能的设计中，低功耗系统包括多个第一功能部件，多个第一功能部件位于待机非掉电区。
在一种可能的设计中，高功耗系统包括多个第二功能部件，多个第二功能部件位于待机掉电区。
在一种可能的设计中，多个第一功能部件可以包括控制器、图像信号处理器和人工智能处理器，多个第二功能部件可以包括中央处理单元，当图像处理装置处于待机状态时，图像处理装置还可以控制图像信号处理器处理图像信息以得到处理后的图像信息，控制人工智能处理器提取处理后的图像信息的特征，并确定特征是否匹配目标特征以得到匹配结果，控制控制器根据匹配结果向中央处理单元发送触发信号，进而控制中央处理单元响应于触发信号以将图像处理装置切换至正常工作状态。
在一种可能的设计中，图像处理装置切换至正常工作状态，包括：图像处理装置控制屏幕点亮。
在一种可能的设计中，多个第一功能部件还可以包括接口，这种情况下，图像处理装置还可以控制接口在图像处理装置处于待机状态时从图像采集器接收图像信息并将图像 信息传输给图像信号处理器。
在一种可能的设计中，多个第一功能部件还可以包括存储器，这种情况下，图像处理装置还可以控制存储器在图像处理装置处于待机状态时存储处理后的图像信息。
在一种可能的设计中，图像处理装置还可以包括频率变换器系统，这种情况下，图像处理装置还可以控制频率变换器系统从第一时钟产生系统接收第一时钟信号，然后根据第一时钟信号产生变频后的第一时钟信号，并向低功耗系统提供变频后的第一时钟信号，以及控制频率变换器系统从第二时钟产生系统接收第二时钟信号，然后根据第二时钟信号产生变频后的第二时钟信号，并向低功耗系统或高功耗系统提供变频后的第二时钟信号。
在一种可能的设计中，频率变换系统可以包括多个频率变换器，多个频率变换器中的每个频率变换器可以对应多个第一功能部件中的一个第一功能部件。这种情况下，图像处理装置还可以控制每个频率变换器接收第一时钟信号并向对应的第一功能部件输出变频后的第一时钟信号，或控制每个频率变换器接收第二时钟信号并向对应的第一功能部件输出变频后的第二时钟信号。
在一种可能的设计中，多个频率变换器中还存在至少一个频率变换器，这种情况下，图像处理装置还可以在至少一个频率变换器在对应的至少一个第一功能部件停止工作时，关闭至少一个频率变换器的输出。
在一种可能的设计中，变频后的第一时钟信号的频率高于第一频率，多个频率变换器中还存在至少一个频率变换器，图像处理装置还可以在该至少一个频率变换器对应的至少一个第一功能部件空闲时，将第一频率的时钟信号输出给至少一个第一功能部件，在至少一个第一功能部件工作时，将变频后的第一时钟信号输出给至少一个第一功能部件。
在一种可能的设计中，在图像处理装置处于正常工作状态时，图像处理装置还可以控制低功耗系统在第一工作模式下基于第一时钟信号工作，在第二工作模式下基于第二时钟信号工作。
在一种可能的设计中，在图像处理装置处于待机状态时，图像处理装置可以关闭第二时钟产生系统。
本申请的第二方面至第三方面中每种可能的设计的有益效果可以参照第一方面，此处不再赘述。
附图说明
图1示例性示出了一种电子设备的结构示意图；
图2示例性示出本申请实施例提供的一种图像处理装置的结构示意图；
图3示例性示出本申请实施例提供的一种图像处理装置的整体结构示意图；
图4示例性示出本申请实施例提供的一种频率变换器模组的结构示意图；
图5示例性示出图像处理装置在待机状态下一个周期内的待机唤醒过程对应的时序控制图；
图6示例性示出一种待机唤醒方法的流程示意图。
具体实施方式
本申请公开的图像处理装置可以应用于具有摄像功能的电子设备中。在本申请一些实 施例中，图像处理装置可以是电子设备或一个独立的单元，当图像处理装置是一个独立的单元时，该单元可以嵌入在所述电子设备中，并能在电子设备处于待机状态时执行待机唤醒功能，唤醒后的电子设备处于正常工作状态。在本申请另一些实施例中，图像处理装置也可以是封装在电子设备内部的单元，用于实现电子设备的待机唤醒功能。电子设备可以是包含诸如个人数字助理和/或音乐播放器等功能的便携式电子设备，诸如手机、平板电脑、具备无线通讯功能的可穿戴设备(如智能手表)、或车载设备等。便携式电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2020113852-appb-000001
或者其它操作系统的便携式电子设备。上述便携式电子设备也可以是诸如具有触敏表面(例如触控面板)的膝上型计算机(Laptop)等。还应当理解的是，在本申请其他一些实施例中，上述电子设备也可以是具有触敏表面(例如触控面板)的台式计算机。
图1示例性示出了一种电子设备100的结构示意图。应理解，图示电子设备100仅是一个范例，并且电子设备100可以具有比图中所示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
如图1所示，电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。下面结合图1对电子设备100的各个部件进行具体的介绍。
处理器110可以包括一个或多个芯片，例如可以包括片上系统(SoC)或多个芯片所形成的芯片组。处理器110可包括一个或多个处理单元，例如，处理器110可以包括中央处理单元(central processing unit，CPU)或应用处理器(application processor，AP)，还包括调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，CPU可以是电子设备100的神经中枢和指挥中心。CPU可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制，执行的指令包括但不限于操作系统程序指令或应用软件程序指令。CPU或AP也叫应用中央处理器(application central processing unit，ACPU)。所述控制器可以包括传感器集线器(sensor hub)，用于处理来自一个或多个传感器的数据，各类传感器所输出的数据类型具体在后续描述。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用，从而可避免重复存取，可减少处理器110的等待时间，因而可提高处理的效率。
在一些实施例中，处理器110可以包括一个或多个接口。比如，接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
MIPI接口可以被用于连接处理器110与显示屏194，摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。在一些实施例中，处理器110和摄像头193通过CSI接口通信，实现手机100的拍摄功能。处理器110和显示屏194通过DSI接口通信，实现手机100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器110与摄像头193，显示屏194，无线通信模块160，音频模块170，传感器模块180等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备100的结构限定。在本申请另一些实施例中，电子设备100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
电源管理模块141用于连接电池142，充电管理模块140与处理器110。充电管理模块140用于从充电器接收充电输入。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，显示屏194，摄像头193，和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量，电池循环次数，电池健康状态(例如漏电或阻抗)等参数。在其他一些实施例中，电源管理模块141也可以设置于处理器110中。在另一些实施例中，电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在本申请实施例中，显示屏194可以是一个一体的柔性显示屏，也可以是采用两个刚性屏以及位于两个刚性屏之间的一个柔性屏所形成的拼接的显示屏。当运行本申请实施例提供的图像处理方法时，显示屏194可以在待机状态下响应于电子设备的唤醒操作而显示信息。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP 处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB或YUV等格式的图像信号。在一些实施例中，电子设备100可以包括1个或多个摄像头193，例如可以同时包括前置摄像头和后置摄像头。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。处理器110通过运行存储在内部存储器121的指令，和/或存储在设置于处理器中的存储器的指令，执行电子设备100的各种功能应用以及数据处理。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定电子设备100附近有物体。接近光传感器180G可以设置在显示屏附近，例如显示屏的额头位置或下巴位置。当执行本申请中的图像处理方法时，电子设备100可以先调用接近光传感器180G确定屏幕前方有没有物体，例如人脸或手势。在确定有物体后，再调用图像处理装置执行图像处理方法，进而唤醒电子设备100。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合。环境光传感器180L也可以设置在显示屏附近，例如显示屏的额头位置或下巴位置。当执行本申请中的图像处理方法时，电子设备100可以先调用环境光传感器180L确定屏幕前方光线是否发生变化，再调用接近光传感器180G确定屏幕前方有没有物体。
尽管图1中未示出，电子设备100还可以包括蓝牙装置、定位装置、闪光灯、微型投影装置、或近场通信(near field communication，NFC)装置等，在此不予赘述。
下面将结合附图对本申请作进一步地详细描述。需要说明的是，在本申请的描述中“至少一个”是指一个或多个，其中，多个是指两个或两个以上。鉴于此，本发明实施例中也可以将“多个”理解为“至少两个”。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，字符“/”，如无特殊说明，一般表示前后关联对象是一种“或”的关系。另外，需要理解的是，在本申请的描述中，“第一”、“第二”等词汇，仅用于区分描述的目的，而不能理解为指示或暗示相对重要性，也不能理解为指示或暗示顺序。例如，“第一时钟产生系统”和“第二时钟产生系统”，只是示例性地指出不同的时钟产生系统，而并不意味着这两个时钟产生系统的重要程度或优先级的不同。
在本申请实施例中，待机唤醒是指将电子设备由待机状态切换至工作状态。当电子设备处于待机状态时，电子设备虽然开机但是并不执行实质性的工作，电子设备的屏幕灭屏。当电子设备被唤醒后，电子设备切换至工作状态可以是指点亮屏幕，也可以是指激活语音交互，还可以是指激活电话交互界面、短信交互界面或其它交互界面，或者上述任意多项。在本申请一些实施例中，当待机唤醒包括点亮屏幕时，可以是指点亮电子设备的整个屏幕。在本申请另一些实施例中，当待机唤醒包括点亮屏幕时，可以是指点亮电子设备的部分屏幕，例如只点亮用于显示AOD对应的息屏信息的部分屏幕，以降低电子设备被唤醒后的功耗。本待机唤醒方案的功耗更低，更有助于提高电子设备的续航能力，目前也被广泛应用于各类电子设备中。
传统的待机唤醒方式需要用户按压电源按键、音量按键或侧键。然而，这种方式对于手指受伤或其它情况导致不方便按压按键的用户来说并不适用。这种情况下，一种新的待机唤醒方式应运而生，即人工智能(artificial intelligence，AI)唤醒。AI唤醒利用人的意识和思维对用户的特征进行学习，即使用户不接触电子设备，AI唤醒也能够利用学习得到的特征来唤醒电子设备。常用的AI唤醒方式包括悬空手势唤醒和注视唤醒。当电子设备支持悬空手势唤醒时，用户可以通过在空中画一个预先设置好的形状来唤醒电子设备。当电子设备支持注视唤醒时，用户可以通过注视屏幕来唤醒电子设备。这两种唤醒方式可以直接通过悬空手势或注视来唤醒电子设备，而无需用户按压按键，从而便于用户与电子设备的交互。
本申请中的方案适用于待机唤醒电子设备，待机唤醒的方式不限于悬空手势唤醒和注视唤醒，还可以为其它通过识别图像来唤醒电子设备的方式，例如人脸识别、悬空指纹识别和掌纹识别等。以上方式都是基于图像的识别来提取图像中的特征，从而利用所述特征唤醒电子设备。
本申请提供的图像处理装置，用以在待机状态下以较低的功耗来唤醒图像处理装置(例如电子设备)。该图像处理装置可以是图1中的电子设备100或电子设备100中的部分部件，例如电子设备100中的主板或功能部件，也可以是电子设备100中的处理器110，本申请实施例对此不作限定。
图2示例性示出本申请实施例提供的一种图像处理装置的结构示意图，如图2所示，该图像处理装置可以包括第一时钟产生系统、第二时钟产生系统、低功耗系统和高功耗系统，其中，第一时钟产生系统的时钟输出端(a 1)连接低功耗系统的第一时钟输入端(b 1)，第二时钟产生系统的第一时钟输出端(a 2)连接低功耗系统的第二时钟输入端(b 2)，第二时钟产生系统的第二时钟输出端(a 3)连接高功耗系统的时钟输入端(b 3)。在该实施方式 中，第一时钟产生系统可以产生第一频率的第一时钟信号，第一时钟信号用于低功耗系统在图像处理装置处于待机状态下执行处理，例如执行待机唤醒，第二时钟产生系统可以产生第二频率的第二时钟信号，第二时钟信号用于高功耗系统在图像处理装置处于正常工作状态下维持正常工作，第一频率小于第二频率。
当图像处理装置处于待机状态时，图像处理装置可以打开第一时钟产生系统的a 1端，并关断第二时钟产生系统的a 2端和a 3端，如此，低频率的第一时钟信号可以通过导通的a 1端和b 1端传输给低功耗系统，以使低功耗系统基于低频率的第一时钟信号处理图像信息(例如前置摄像头拍摄的图像信息)，当图像信息中检测到人脸或手势时，低功耗系统可以触发图像处理装置切换为正常工作状态。采用该种实施方式，低功耗系统在图像处理装置处于待机状态时所使用的时钟信号的频率低于图像处理装置处于正常工作状态时所提供的时钟信号的频率，低频率的时钟信号有助于使低功耗系统处于低功耗模式，从而降低图像处理装置在待机状态执行待机唤醒下的功耗。
当图像处理装置处于正常工作状态时，图像处理装置可以打开第二时钟产生系统的a 3端，如此，高频率的第二时钟信号可以通过导通的a 3端和b 3端传输给高功耗系统，以使高功耗系统基于高频率的第二时钟信号维持图像处理装置的正常工作。此外，当图像处理装置处于正常工作状态时，低功耗系统也可以处于工作状态，而该工作状态所使用的时钟信号则可以根据当前业务来决定，例如可以为高频率的第一时钟信号，也可以为低频率的第二时钟信号。当使用第一时钟信号时，图像处理装置可以打开第一时钟产生系统的a 1端，并关断第二时钟产生系统的a 2端，以使低频率的第一时钟信号通过导通的a 1端和b 1端传输给低功耗系统。当使用第二时钟信号时，图像处理装置可以关断第一时钟产生系统的a 1端，并打开第二时钟产生系统的a 2端，以使高频率的第二时钟信号通过导通的a 2端和b 2端传输给低功耗系统。采用该种实施方式，低功耗系统在处于正常工作状态时所使用的时钟信号的频率与低功耗系统的当前业务相匹配，而不是固定使用高频率的第二时钟信号，这不仅使得功耗控制方案更加灵活，还有助于降低图像处理装置在正常工作状态下的功耗。关于低功耗系统在图像处理装置处于正常工作状态时使用哪种时钟信号，将在以下的实施例中进行具体介绍，此处先不做说明。
需要说明的是，上述内容中所述的“图像处理装置通过开启或关断时钟产生系统的时钟输出端来控制时钟信号的输出”只是一种可选地实施方式。在另一种可选地实施方式中，每个时钟产生系统与低功耗系统或高功耗系统的时钟传输链路上也可以设置开关，图像处理装置通过导通或断开时钟传输链路上设置的开关来控制时钟信号的输出。例如，假设第一时钟产生系统的a 1端和低功耗系统的b 1端之间的时钟传输链路上设置有开关，则当图像处理装置导通该开关时，第一时钟信号可以通过导通的a 1端和b 1端传输给低功耗系统，当图像处理装置断开该开关时，第一时钟信号不被传输给低功耗系统。
本申请实施例中，当第二时钟信号对应为图像处理装置在正常工作时所使用的38.4MHz的时钟信号，则第一时钟信号可以为频率低于38.4MHz的任意时钟信号，例如32KHz的时钟信号。如此，该种实施方式在图像处理装置处于待机状态时先使用较低频率(例如32KHz，低于正常工作状态所使用的38.4MHz)的时钟信号进行图像处理，在确定要唤醒图像处理装置时，才会切换至较高频率(例如38.4MHz)的时钟信号来支持唤醒后的正常工作，由此可知，这种方式不仅能够正常唤醒图像处理装置，还无需周期性的使用高频率的时钟信号来执行待机唤醒，从而有助于降低电子设备的功耗。由此可知，本申请 实施例通过合理设计低功耗系统在不同状态(即待机状态和正常工作状态)下所使用的时钟信号，有助于节省低功耗系统乃至整个图像处理装置的功耗。
在一种可选地实施方式中，低功耗系统可以包括多个第一功能部件，多个第一功能部件处于待机非掉电区，也叫始终唤醒区。如此，即使图像处理装置处于待机状态，低功耗系统中的多个第一功能部件也仍然可以工作，从而有助于实现图像处理装置在待机状态下的待机唤醒功能。对应的，高功耗系统可以包括多个第二功能部件，多个第二功能部件处于待机掉电区，也叫非始终唤醒区。如此，当图像处理装置处于待机状态时，高功耗系统中的多个第二功能部件也不工作，即处于低功耗状态，从而有助于降低图像处理装置在待机状态下的功耗。具体地，多个第二功能部件处于低功耗状态，具体可以是指：多个第二功能部件没有时钟输入或者仅有非常低的时钟输入，或者多个第二功能部件没有电源电压输入(即多个第二功能部件完全下电)或者仅有非常低的电源电压输入。因此，多个第二功能部件的低功耗状态可以包括完全下电、部分下电、睡眠、休眠或待机等状态。
图3示例性示出本申请实施例提供的一种图像处理装置的整体结构示意图，如图3所示，多个第一功能部件可以包括图像信号处理器、人工智能处理器、控制器、存储器和接口，多个第二功能部件可以包括中央处理单元。其中，图像信号处理器、人工智能处理器、控制器和存储器可以通过总线连接，图像信号处理器还可以通过接口连接图像采集器，图像采集器可以是前文描述的摄像头(例如前置摄像头)，控制器还可以分别连接图像采集器和中央处理单元。
需理解，待机掉电区中的多个第二功能部件除了包括中央处理单元外，还包括数字信号处理器(DSP)、图形处理器(GPU)、基带处理器、安全元件(SE)或语音子系统等一个或多个部件。可选地，多个第二功能部件还可进一步包括第二人工智能处理器，第二存储器和第二图像信号处理器，所述第二人工智能处理器，第二存储器和第二图像信号处理器的功耗大于待机非掉电区中用于实现同类操作的器件，即待机非掉电区中的人工智能处理器、存储器和图像信号处理器。例如第二人工智能处理器的功耗大于待机非掉电区中的人工智能处理器，以进行高功耗但高性能的处理。
当图像处理装置处于待机状态时，多个第一功能部件和多个第二功能部件可以周期执行如下步骤以实现待机唤醒功能：在工作过程中，控制器在当前周期启动时刻向图像采集器发送图像采集指令；图像采集器根据图像采集指令采集得到图像信息，并通过接口发送给图像处理器；图像处理器处理图像信息得到处理后的图像信息，并通过总线传输至存储器进行存储，在传输完成后向控制器发送通知消息；控制器接收到通知消息后，向人工智能处理器发送待机识别指令；人工智能处理器根据待机识别指令，调用存储器中存储的AI图像识别算法的指令，基于AI图像识别算法提取处理后的图像信息的特征，再将提取得到的特征与目标特征进行匹配得到匹配结果，通过总线将匹配结果发送给控制器；其中，匹配结果包括匹配或不匹配；控制器获取匹配结果后，若匹配结果为匹配，则说明图像信息中包括人脸或手势等特征，因此控制器可以向中央处理单元发送触发信号；若匹配结果为不匹配，则说明图像信息中不包括人脸或手势等特征，因此控制器可以不作处理，而是等待下一个周期启动时刻到来后重复执行上述操作；中央处理单元在接收到触发信号后，响应于该触发信号将图像处理装置切换至正常工作状态。
示例性地，本申请实施例中，中央处理单元将图像处理装置切换至正常工作状态，可以包括控制图像处理装置的屏幕点亮。这种方式支持用户在灭屏状态下直接点亮屏幕，以 便于直接对屏幕上的应用进行操作，提高用户的体验。本申请实施例中，中央处理单元可以是图像处理装置的核心，用于至少运行操作系统程序或应用软件程序。如此，当用户触发屏幕上的应用时，中央处理单元可以基于用户的触发操作运行对应的应用软件程序。
本申请实施例中，多个第一功能部件可以是指图1内容描述部分所示意的电子设备中的对应的处理单元，例如图3中的图像信号处理器对应为图1内容描述部分所示意出的ISP，图3中的人工智能处理器对应为图1内容描述部分所示意出的NPU，图3中的控制器对应为图1内容描述部分所示意出的控制器，包括传感器集线器，图3中的存储器对应为图1内容描述部分所示意出的内部存储器。
在一种可选地实施方式中，多个第一功能部件可以是裁剪版部件，裁剪版部件是在完整版部件的基础上裁剪出部分所需要的功能而得到的，裁剪版部件相对于完整版部件来说具有更低的处理能力，功耗也更少。在这种情况下，为了保证图像处理装置的原功能不受影响，多个第二功能部件还可以包括图1所示意出的对应处理单元，即如之前提到的，多个第二功能部件包括第二人工智能处理器，第二存储器和第二图像信号处理器，这些处理单元作为完整的功能部件在图像处理装置处于正常工作状态时执行高强的处理能力，以维持电子设备的正常工作。为便于理解，下面示例性地介绍待机掉电区中每个裁剪版的第一功能部件的相关信息。
待机掉电区中的图像处理器，可以是指迷你图像处理器(MINI ISP)，该MINI ISP可以支持Bayer Raw8格式、RGB格式或Y格式的输入图像信息，并可以支持RGB格式或Y格式的输出图像信息。在处理图像信息时，该MINI ISP可以支持1280x960的最大分辨率、支持32x32的最小裁剪窗口、支持1至8倍中任一倍数的下采样功能，还可以支持非线性特效合成(after effects，AE)功能、白平衡(automatic white balance，AWB)功能、局域网屏幕捕捉(local area network screen capture，LSC)功能和Gamma校正功能中的一项或多项。相对于完整版的ISP来说，这种裁剪版的MINI ISP在待机唤醒的一个周期内的功耗能从100mW降低至1mW。
待机掉电区中的人工智能处理器，可以是指轻量级人工智能处理器(Tiny NPU)，该Tiny NPU可以只支持INT8格式的数据类型，并支持INT8或者2比特的weight存储格式。该Tiny NPU在待机状态下的图像处理能力在200Gops左右，能效能达到6Tops/W。
待机掉电区中的控制器，可以是指通用智能传感集线器(Sensor Hub)，当该Sensor Hub采用ARM Cortex-M7的低功耗处理器时，该Sensor Hub在待机唤醒的一个周期内的功耗在4mW左右。
待机掉电区中的存储器，可以是指本地存储器(Local Ram)，当图像处理装置包括芯片时，该Local Ram可以单独部署在一个芯片上，也可以和所描述的其它功能部件部署在同一个芯片上。该Local Ram的存储空间可以控制为比实现待机唤醒功能所需的最小空间稍大一些，例如可以仅比处理后的图像信息和AI图像处理算法所需的总空间稍大一些。
接口，可以是指CSI MIPI接口，CSI MIPI接口用于连通图像采集器和图像信号处理器，能够将图像采集器采集到的图像信息传输至图像信号处理器。
本申请实施例中，多个第一功能部件和多个第二功能部件可以部署在同一个芯片(例如片上系统(system-on-a-chip，SOC))中，也可以分散部署在多个芯片中。为了节省图像处理装置所占据的空间，本申请实施例可以将多个第一功能部件和多个第二功能部件部署在一个芯片中。且，该芯片上还可以设置有待机掉电区和待机非掉电区，待机掉电区中的 部件可以由待机下电电源(即待机状态下处于断电状态)供电，多个第二功能部件部署在待机掉电区内，以在待机状态下关闭与待机唤醒功能不相关的各个第二功能部件，达到节省功耗的目的。待机非掉电区中的部件可以由待机非下电电源(即在待机状态下也处于供电状态)供电，多个第一功能部件部署在待机非掉电区内，以在待机状态下实现待机唤醒功能。由于多个第二功能部件与待机唤醒功能的相关性较弱，因此本申请对多个第二功能部件不作过多介绍。下面介绍一下对多个第一功能部件进行供电的实现过程。
本申请实施例中，每个第一功能部件所需的供电电压可以小于待机非下电电源输出的电压，且各个第一功能部件所需的供电电压各不相同。在一种可选地实施方式中，继续参照图3所示，图像处理装置还可以包括电源管理单元(power management unit，PMU)，电源管理单元中包括多个电压转换器(如图3中电源管理单元中的各个虚线框所示)，多个电压转换器中的每个电压转换器可以与一个或多个第一功能部件对应。其中，每个电压转换器可以包括降压器和/或稳压器，当只包括降压器或稳压器时，降压器或稳压器可以对待机非下电电源输出的4V或3.3V电压进行降压并将降压后的电压提供给对应的第一功能部件。当同时包括降压器和稳压器时，降压器可以对待机非下电电源输出的4V或3.3V电压进行一级降压并将一级降压后的电压提供给稳压器，稳压器可以对降压器输出的电压进行二级降压并将二级降压处理后的电压提供给对应的第一功能部件。其中，降压器可以是Buck型电路或开关电容(SC)型电路，稳压器可以是低压差线性稳压器(low dropout regulator，LDO)。示例来说，在图3中，电源管理单元中可以包括如下电压转换器。
降压器1和稳压器1所形成的电压转换器：待机非下电电源输出的4V/3.3V电压先经由降压器1降压至0.75V，再经由稳压器降压至0.6V，最后被提供给总线，以通过总线为总线上连接的图像信号处理器、人工智能处理器、控制器和存储器供电。
降压器2所形成的电压转换器、以及降压器3和稳压器3所形成的电压转换器：待机非下电电源输出的4V/3.3V电压一方面经由降压器2降压至0.8V后被提供给接口的第一供电端，另一方面经由降压器3降压至1.3V，再经由稳压器3降压至1.2V，然后被提供给接口的第二供电端，以使用接口的第一供电端和第二供电端之间的电压差为接口供电。
在一个示例中，由于图像采集器需要在待机状态下采集图像信息，因此图像采集器也可以由待机非下电电源供电。这种情况下，电源管理单元中还可以包括图像采集器对应的电压转换器(图3中未进行示意)，该电压转换器用于将待机非下电电源输出的4V/3.3V电压降压至1.1V/1.8V/2.85V，然后将降压后的电压提供给图像采集器。其中，图像采集器对应的电压转换器的结构可以参照第一功能部件对应的电压转换器的结构，此处不再赘述。
在上述实施方式，低功耗系统同时包括图像信号处理器、人工智能处理器、控制器、存储器和接口，并由控制器统一管理其它各个部件在待机状态下所执行的操作，通过统一管理图像处理装置在待机状态下的各项唤醒操作，有助于维持待机唤醒的可控性。然而，这只是一种可选地实施方式。在其它可选地实施方式中，低功耗系统也可以只包括图像信号处理器、人工智能处理器、控制器、存储器和接口中的部分功能部件，且待机唤醒的实现过程也可以不经由控制器进行统一管理。例如在一种情况下，低功耗系统可以只包括图像信号处理器、人工智能处理器和控制器，这种情况下，图像信号处理器可以获取图像信息(例如网络下载的图像信息，或者其它设备发送的图像信息)并直接将处理后的图像信息发送给人工智能处理器，而人工智能处理器可以调用外部存储设备(例如云端服务器)存储的AI图像识别算法识别处理后的图像信息中是否存在人脸或手势，当存在人脸或手 势时向控制器发送通知消息，以由控制器唤醒图像处理装置。又例如在另一种情况下，低功耗系统可以只包括图像信号处理器、人工智能处理器、控制器和存储器，这种情况下，图像信号处理器可以获取图像信息并将处理后的图像信息发送给存储器，而人工智能处理器可以调用存储器中存储的AI图像识别算法识别处理后的图像信息中是否存在人脸或手势，当存在人脸或手势时向控制器发送通知消息，以由控制器唤醒图像处理装置。又例如在又一种情况下，低功耗系统可以只包括图像信号处理器、人工智能处理器、控制器和接口，这种情况下，图像信号处理器可以通过接口获取图像采集器采集的图像信息，并直接将处理后的图像信息发送给人工智能处理器，而人工智能处理器可以调用外部存储设备中存储的AI图像识别算法识别处理后的图像信息中是否存在人脸或手势，当存在人脸或手势时向控制器发送通知消息，以由控制器唤醒图像处理装置。
本申请的下列实施例基于控制器统一管理其他各个部件在待机状态下所执行的操作为例进行介绍。在一种可选地实施方式中，继续参照图3所示，图像处理装置还可以包括频率变换器系统，频率变换器系统的第一时钟输入端(c 1)连接第一时钟产生系统的时钟输出端a 1，频率变换器系统的第二时钟输入端(c 2)连接第二时钟产生系统的时钟输出端a 2/a 3，频率变换器系统还具有多个时钟输出端(例如d 1、d 2、d 3、d 4、d 5、d 6)，这多个时钟输出端分别与多个第一功能部件和图像采集器对应，例如：频率变换器系统的时钟输出端d 1用于连接图像信号处理器的时钟输入端，频率变换器系统的时钟输出端d 2用于连接人工智能处理器的时钟输入端，频率变换器系统的时钟输出端d 3用于连接控制器的时钟输入端，频率变换器系统的时钟输出端d 4用于连接存储器的时钟输入端，频率变换器系统的时钟输出端d 5用于连接接口的时钟输入端，频率变换器系统的时钟输出端d 6用于连接图像采集器的时钟输入端。当图像处理装置处于待机状态时，频率变换器系统可以通过时钟输出端a 1和时钟输入端c 1从第一时钟产生系统接收第一时钟信号，然后根据第一时钟信号产生变频后的第一时钟信号，并向低功耗系统和图像采集器提供变频后的第一时钟信号。当图像处理装置处于正常工作状态时，频率变换器系统可以通过时钟输出端a 2/a 3和时钟输入端c 2从第二时钟产生系统接收第二时钟信号，然后根据第二时钟信号产生变频后的第二时钟信号，并向高功耗系统和低功耗系统提供变频后的第二时钟信号；或者，频率变换器系统只向高功耗系统提供变频后的第二时钟信号，且通过时钟输出端a 1和时钟输入端c 1从第一时钟产生系统接收第一时钟信号，然后根据第一时钟信号产生变频后的第一时钟信号，并向低功耗系统和图像采集器提供变频后的第一时钟信号。可以理解的，虽然图3未进行示意，但是频率变换器系统还可以具有一个时钟输出端，用于连接总线的时钟输入端。频率变换器系统进行频率变换可以包括分频或倍频，即提高或降低接收的第一时钟信号的频率或第二时钟信号的频率。
本申请实施例中，频率变换器系统的结构可以有多种可能，例如在一个示例中，继续参照图3所示，频率变换器系统可以包括第一锁相环、第二锁相环和频率变换器模组，第一锁相环的时钟输入端连接频率变换器系统的时钟输出端c 1，第二锁相环的时钟输入端连接频率变换器系统的时钟输出端c 2，第一锁相环的时钟输出端和第二锁相环的时钟输出端分别连接频率变换器模组的时钟输入端，频率变换器模组还包括多个时钟输出端，这多个时钟输出端分别连接频率变换器系统的多个时钟输出端。这种情况下，第一锁相环可以通过时钟输出端a 1和时钟输入端c 1接收第一时钟产生系统输出的第一时钟信号，然后对第一时钟信号进行倍频处理，得到倍频后的第一时钟信号，进而经由频率变换器模组对倍频后 的第一时钟信号进行分频操作，得到分频后的多个第一时钟信号，分频后的多个第一时钟信号分别对应多个第一功能部件和图像采集器。第二锁相环可以通过时钟输出端a 2/a 3和时钟输入端c 2接收第二时钟产生系统输出的第二时钟信号，然后对第二时钟信号进行倍频处理，得到倍频后的第二时钟信号，进而经由频率变换器模组对倍频后的第二时钟信号进行分频操作，得到分频后的多个第二时钟信号，分频后的多个第二时钟信号分别对应多个第一功能部件，和/或，分频后的多个第二时钟信号分别对应多个第二功能部件和图像采集器。
在该示例的一种可能的实现方式中，第一时钟产生系统的输出的开启和关断还可以通过控制第一锁相环来实现，第二时钟产生系统的输出的开启和关断还可以通过控制第二锁相环来实现。例如，控制器还可以连接第一锁相环的控制端和第二锁相环的控制端(图3中未进行示意)，当图像处理装置处于待机状态时，控制器可以控制第一锁相环处于开启状态，同时控制第二锁相环处于关闭状态，如此，虽然第一时钟产生系统和第二时钟产生系统都能输出时钟信号给频率变换器系统，但是第二时钟产生系统输出的第二时钟信号被第二锁相环所截断，只有第一时钟产生系统输出的第一时钟信号通过第一锁相环提供给低功耗系统和图像采集器。当图像处理装置处于正常工作状态、且低功耗系统需要第二时钟信号工作时，控制器可以控制第一锁相环处于关闭状态，同时控制第二锁相环处于开启状态，如此，虽然第一时钟产生系统和第二时钟产生系统都能输出时钟信号给频率变换器系统，但是第一时钟产生系统输出的第一时钟信号被第一锁相环所截断，只有第二时钟产生系统输出的第二时钟信号通过第二锁相环提供给高功耗系统、低功耗系统和图像采集器。当图像处理装置处于正常工作状态、且低功耗系统需要第一时钟信号工作时，控制器可以控制第一锁相环和第二锁相环都处于开启状态，如此，第一时钟产生系统输出的第一时钟信号通过第一锁相环提供给低功耗系统和图像采集器，而第二时钟产生系统输出的第二时钟信号通过第二锁相环提供给高功耗系统。
本申请实施例中，在图像处理装置处于待机状态时，第一锁相环对第一时钟信号进行倍频的倍数可以由本领域技术人员根据经验进行设置。当倍频的倍数越小，则提供给各个第一功能部件和图像采集器的倍频后的第一时钟信号的频率越小，越有助于降低功耗。但是如果倍数过小，则容易由于频率过低而无法启动各个第一功能部件和图像采集器。因此，示例性地，第一锁相环的倍频倍数可以根据启动各个第一功能部件和图像采集器所需的时钟信号的最小频率来设置，以在顺利启动各个第一功能部件和图像采集器的情况下尽量节省功耗。例如，当第一时钟信号的频率为32KHz时，第一锁相环的倍频倍数可以设置为3750～9375之间的一个值，这种情况下，如果将第一锁相环的倍频倍数设置为5750，则第一锁相环可以将32KHz的第一时钟信号倍频至184MHz，进而由频率变换模组将184MHz的第一时钟信号分频给各个第一功能部件和图像采集器。相应地，在图像处理装置处于正常工作状态时，第二锁相环对第二时钟信号进行倍频的倍数可以按照各个处理单元在正常工作时所需的时钟信号的频率来设置，例如当第二时钟信号的频率为38.4MHz时，第二锁相环的倍频倍数可以设置为20～83333之间的一个值，这种情况下，如果将第二锁相环的倍频倍数设置为25，则第二锁相环可以将38.4MHz的第一时钟信号至少倍频至960MHz，进而由频率变换模组将960MHz的第二时钟信号分频给各个第二功能部件。至于第一锁相环在图像处理装置处于正常工作状态时的倍频倍数，则可以与待机状态下相同，也可以根据低功耗系统当前的工作模式来确定，在当前的工作模式所需的功耗越大时，第一锁相环的倍频倍数也可以越大，在当前的工作模式所需的功耗越小，第一锁相环的倍频倍数也可 以越小。
表1示例性示出第一锁相环和第二锁相环的一种对照关系表：
锁相环 输入时钟信号 时钟精度 输出时钟信号 功耗
第一锁相环 32KHz ≤3％ 120MHz～300MHz 约0.1mW
第二锁相环 38.4MHz ≤1％ 800MHz～3.2GHz 2mW～6mW
表1
参照表1可知，在第一锁相环接收的第一时钟信号的频率为32KHz、第二锁相环接收的第二时钟信号的频率为38.4MHz时，虽然第一锁相环的时钟精度不如第二锁相环的时钟精度高，且第一锁相环所能输出的时钟信号的频率范围不如第二锁相环所能输出的时钟信号的频率范围大，但是第一锁相环输出的时钟信号的频率明显比第二锁相环输出的时钟信号的频率小很多，第一锁相环在这种小频率的时钟信号下的功耗只有0.1mW左右，而第二锁相环在大频率的时钟信号下的功耗却至少为2mW，第一锁相环的功耗相比于第二锁相环的功耗至少能降低20倍。
基于表1所示意的各项数据，按照本申请中的方案，图像处理装置在待机状态下的每个周期启动时刻后是使用32KHz和第一锁相环为各个裁剪版的第一功能部件提供时钟信号，以实现各个裁剪版的第一功能部件的待机唤醒功能。这种情况下，各个裁剪版的第一功能部件在120MHz～300MHz的时钟信号下工作，从而各个裁剪版的第一功能部件的功耗较小，且第一锁相环自身的功耗也只有0.1mW左右。显然，相比于现有技术中周期性启动各个处理单元以实现待机唤醒的方案来说，本申请中的方案能有效降低图像处理装置在待机状态下的总功耗。
图4示例性示出本申请实施例提供的一种频率变换器模组的结构示意图，如图4所示，频率变换器模组中可以包括多个频率变换器(如图4中的每个虚线框对应一个频率变换器)，多个频率变换器中的每个频率变换器对应多个第一功能部件中的一个第一功能部件或图像采集器。第一锁相环的时钟输出端可以分别连接每个频率变换器的时钟输入端，每个频率变换器的时钟输出端可以连接对应的第一功能部件或图像采集器的时钟输入端。这种情况下，当第一锁相环开启时，每个频率变换器可以接收第一锁相环输出的倍频后的第一时钟信号，并对倍频后的第一时钟信号进行变频调整，然后将变频调整后的第一时钟信号输出给对应的第一功能部件或图像采集器。且，虽然图4中未进行示意，但是第二锁相环的时钟输出端也可以连接每个频率变换器的时钟输入端，当第二锁相环开启时，每个频率变换器可以接收第二锁相环输出的倍频后的第二时钟信号，并对倍频后的第二时钟信号进行变频调整，然后将变频调整后的第二时钟信号输出给对应的第一功能部件或图像采集器。
本申请实施例中，每个频率变换器中都可以包括变频器，变频器用于按照预设的变频倍数对接收到的倍频后的时钟信号进行变频调整。以频率变换器模组接收第一锁相环输出的倍频后的第一时钟信号为例，由于第一时钟信号是先经由第一锁相环倍频为较高频率再经由变频器进行变频，因此变频后的第一时钟信号的频率还是会大于原第一时钟信号的频率。例如，继续参照附图4所示，当第一锁相环将32KHz的第一时钟信号倍频为184MHz时：图像信号处理器对应变频器1，变频器1的变频倍数为2，如此，变频器1可以将184MHz的第一时钟信号变频为92MHz并提供给图像信号处理器；人工智能处理器对应变频器2，控制器对应变频器3，存储器对应变频器4，变频器2、变频器3和变频器4的变频倍数均 为1，如此，变频器2、变频器3和变频器4可以分别将184MHz的第一时钟信号提供给人工智能处理器、控制器和存储器；接口对应变频器5，变频器5的变频倍数为6，如此，变频器1可以将184MHz的第一时钟信号变频为30.7MHz并提供给接口；图像采集器对应变频器6，变频器6的变频倍数为7，如此，变频器6可以将184MHz的第一时钟信号变频为26.3MHz并提供给图像采集器。显然，每个频率变换器的时钟输出端输出的时钟信号的频率都大于倍频前的原时钟信号的频率。在一种可选地实施方式中，频率变换器中还可以包括如下部件。
针对于图像信号处理器、人工智能处理器、接口和图像采集器，这些元件在待机状态下只有被控制器调用时才会执行对应的工作，而结束工作后只要控制器不调用则会一直处于不工作的状态，因此这些元件属于辅控部件。当辅控部件结束工作后，即使频率变换器向辅控部件输出时钟信号，辅控部件也不会使用该时钟信号进行工作，反而还会浪费时钟信号在向辅控部件的传输路径上所产生的损耗。基于此，继续参照图4所示，当频率变换器对应图像信号处理器、人工智能处理器、接口和图像采集器等辅控部件中的一种辅控部件时，该频率变换器中还可以包括开关，开关的第一端连接该频率变换器中的变频器的时钟输出端，开关的第二端连接对应的辅控部件的时钟输入端，控制器还可以连接该频率变换器中的开关的控制端。当控制器确定该频率变换器对应的辅控部件工作时，控制器可以导通该频率变换器中的开关，以打开该频率变换器的输出，使该频率变换器对应的辅控部件在该频率变换器输出的时钟信号下工作。当控制器确定该频率变换器对应的辅控部件停止工作时，控制器可以断开该频率变换器中的开关，以关闭该频率变换器的输出，从而节省辅控部件的功耗。
针对于控制器和存储器(或者还可以包括总线)，这些元件在待机状态下会主动执行发送控制指令、调用辅控元件、传输数据和存储数据等操作，因此这些元件属于主控部件，主控部件在待机状态下需要一直被供给时钟信号。这种情况下，为了节省主控部件的功耗，虽然不能断开主控部件的时钟信号供给，但是可以在不需要主控部件执行主控操作时给其提供一个频率较低的时钟信号，以维持主控部件的存活即可。基于此，继续参照图4所示，当频率变换器对应控制器或存储器(或总线)等主控部件时，该频率变换器中还可以包括转换器，转换器的第一时钟输入端连接该频率变换器中的变频器的时钟输出端，转换器的第二时钟输入端连接第一时钟产生系统的时钟输出端，转换器的时钟输出端连接对应的元件的时钟输入端，控制器还可以连接该频率变换器中的转换器的控制端。当控制器确定该频率变换器对应的主控部件执行主控操作时，控制器可以导通该频率变换器中的转换器的第一时钟输入端和时钟输出端，以将变频后的第一时钟信号提供给对应的主控部件，使该频率变换器对应的主控部件在变频后的第一时钟信号下执行主控操作。当控制器确定该频率变换器对应的主控部件结束主控操作时，控制器可以导通该频率变换器中的转换器的第二时钟输入端和时钟输出端，以将第一时钟信号提供给对应的主控部件，使该频率变换器对应的主控部件在第一时钟信号下维持存活状态。由于每个频率变换器的时钟输出端输出的时钟信号的频率大于倍频前的第一时钟信号的频率，因此按照该种实施方式，主控部件在不需要执行主控操作时会在频率较小的第一时钟信号(例如32KHz)下维持存活，而在需要执行主控操作时才会在频率较高的变频后的第一时钟信号(例如184MHz)下执行主控操作，从而该种方式还有助于降低主控部件的功耗。
需要说明的是，上述内容中所述的“通过断开辅控部件对应的频率变换器中的开关来 控制频率变换器不输出时钟信号”只是一种可选地实施方式。在其它可选地实施方式中，控制器还可以通过其它方式控制辅控部件对应的频率变换器不输出时钟信号，例如控制器还可以关闭该辅控部件对应的频率变换器的时钟输出端，或者关闭频率变换器模组上用于连接该辅控部件的时钟输入端的时钟输出端。例如，继续参照图4所示，当图像信号处理器停止工作时，控制器可以关闭时钟输出端d 1，如此，变频器1输出的92KHz的第一时钟信号可以被关闭的时钟输出端d 1封锁在频率变换器模组的内部，而不会输出给图像信号处理器。可能的实现方式有很多，此处不再一一赘述。
下面结合图4所示意出的结构对待机状态下一个周期内的待机唤醒过程进行示例性地介绍。在该示例中，假设一个周期的时长为100ms，控制器在一个周期内只对一张图像进行待机识别。假设多个频率转换器在待机状态下的默认模式为：开关K1、开关K2、开关K5和开关K6断开，转换器3的第二时钟输入端(e 32)连接转换器3的时钟输出端，转换器4的第二时钟输入端(e 42)连接转换器4的时钟输出端。即主控部件对应的频率转换器使用小频率的时钟信号工作，辅控部件对应的频率转换器不输出时钟信号。假设变频器6为图像采集器提供的时钟信号为MCLK。
图5示例性示出图像处理装置在待机状态下一个周期内的待机唤醒过程对应的时序控制图，如图5所示，这一个周期内控制器的控制过程包括：步骤1，在100ms的定时器到时后，控制器先控制转换器3的第一时钟输入端(e 31)连接转换器3的时钟输出端，以使控制器从32KHz的低频时钟信号切换至184MHz的高频时钟信号下工作。
步骤2，控制器导通开关K1和开关K5，以将变频器1输出的92MHz的第一时钟信号提供给图像信号处理器，将变频器5输出的30.7MHz的第一时钟信号提供给接口，使图像信号处理器和接口启动工作。
步骤3，控制器导通开关K6，以将变频器6输出的26.3MHz的第一时钟信号(即MCLK工作在26.3MHz的频率下)提供给图像采集器，并配置图像采集器由待机模式(standby mode)切换至出流模式(streaming mode)。
本申请实施例中，控制器配置图像采集器的工作模式，实际上是控制器向图像采集器发送模式切换指令，由图像采集器根据接收到模式切换指令自行切换自己的工作模式。这种情况下，如果图像采集器上不具有时钟信号，则图像采集器实际上无法执行工作模式的切换操作。基于此，在上述步骤3中，通过控制器先导通开关K6以将MCLK时钟提供给图像采集器再配置图像采集器的工作模式，使得图像采集器能够在MCLK时钟的支持下成功切换至出流模式。相应地，在后续图像采集器结束工作后，如果要将图像采集器再切换回待机模式，则控制器需要先向图像采集器发送模式切换指令，待图像采集器成功切换至待机模式之后，再断开开关K6从而结束为图像采集器提供MCLK时钟。
在上述步骤2和步骤3中，由于图像采集器在出流模式下会一边采集图像一边传输图像，因此如果先启动图像采集器再启动图像信号处理器和接口，则很有可能会在启动图像采集器之后至启动图像信号处理器和接口之前的时延内丢失图像采集器采集到的部分图像信息，导致待机识别不准确。因此，通过先启动图像信号处理器和接口再启动图像采集器，能使图像采集器采集到的图像数据不丢失的传输至图像信号处理器，有助于提高待机识别的准确性。
步骤4，图像采集器在26.3MHz的第一时钟信号的支持下，通过曝光获得一帧图像，并通过接口将该帧图像传输给图像信号处理器。在上述步骤4中，由于一帧图像的数据量 较大，因此一帧图像可以分多次传输，每次只传输一帧图像的部分图像信息。在图像信号处理器启动之后至图像采集器传输第一部分图像信息之前，由于图像信号处理器并没有接收到任何的图像信息，因此图像信号处理器可以处于空闲模式(即Idle)。在图像采集器开始传输第一部分图像信息之后至图像信号处理器接收到最后一部分图像信息之前，图像信号处理器可以对所接收到的图像信息进行处理，因此图像信号处理器可以处于活跃模式(即Active)。相应地，在接口启动之后至图像采集器传输第一部分图像信息之前，由于接口并没有执行任何的传输操作，因此接口可以处于低功耗模式(low power，LP)。在接口开始接收到第一部分图像信息之后至接口将最后一部分图像信息传输给图像信号处理器之前，接口不断向图像信号处理器传输图像采集器发送过来的图像信息，因此接口可以处于传输模式(即Transmit)。
步骤5，控制器控制转换器3的第二时钟输入端(e 32)连接转换器3的时钟输出端，以使控制器使用32KHz的低频时钟信号维持低功耗工作，等待图像采集器的通知。在上述步骤4和步骤5中，由于图像采集器采集图像的过程中不再需要控制器执行其它操作，所以当控制器控制图像采集器切换至26.3MHz的第一时钟信号后，控制器可以立马切换至低功耗下工作，以节省功耗。
步骤6，控制器在接收到图像采集器发送的开始传输图像的通知后，控制转换器3的第一时钟输入端(e 31)连接转换器3的时钟输出端，以使控制器从32KHz的低频时钟信号切换至184MHz的高频时钟信号下工作，在该高频时钟信号下控制转换器4的第一时钟输入端e 41连接转换器4的时钟输出端，以使存储器从32KHz的时钟信号切换至184MHz的时钟信号下工作。
在上述步骤4至步骤6中，图像采集器传输图像信息至图像信号处理器、图像信号处理器处理图像信息以及图像信号处理器传输处理后的图像信息至存储器的过程是并行执行的，因此，通过在图像采集器开始第一部分传输图像信息时将存储器的工作状态切换至高功耗，即使图像信号处理器在接收到第一部分图像信息的当下快速处理了第一部分图像信息并发送给存储器，存储器的高频时钟信号也能支持对该处理后的第一部分图像信息进行及时存储。
在上述步骤6中，存储器在整个待机状态下都存在时钟信号，但是直至开始接收到图像信号处理器发送的第一部分图像信息之前，存储器都处于空闲模式。在接收到图像信号处理器发送的第一部分图像信息开始直至接收完最后一部分图像信息，存储器都处于活跃模式。
步骤7，控制器控制转换器3的第二时钟输入端(e 32)连接转换器3的时钟输出端，以使控制器使用32KHz的低频时钟信号维持低功耗工作，等待图像信号处理器的通知。
步骤8，控制器在接收到图像信号处理器发送的图像接收完毕的通知后，先控制转换器3的第一时钟输入端(e 31)连接转换器3的时钟输出端，以使控制器切换至184MHz的高频时钟信号下工作，并在184MHz的高频时钟信号的支持下配置图像采集器由出流模式切换至待机模式，再断开开关K6以关闭图像采集器的时钟信号MCLK，断开开关K5以关闭接口的时钟信号，断开开关K1以关闭图像信号处理器的时钟信号，以节省功耗。
在上述步骤8的另一种可选地实施方式中，当图像采集器通过接口传输完最后一部分图像信息后，图像信号处理器还需要时间对最后一部分图像信息进行处理和传输，这种情况下，图像采集器和接口先完成工作，图像信号处理器后完成工作。因此，图像采集器在 传输完最后一部分图像信息后还可以向控制器发送图像传输完成的通知，以使控制器根据该通知将图像图像采集器由出流模式配置为待机模式，断开开关K6以关闭图像采集器的时钟信号MCLK，同时断开开关K5以关闭接口的时钟信号，并等待图像信号处理器的通知。当图像信号处理器存储完最后一部分处理后的图像信息后，图像信号处理器还可以向控制器发送图像存储完成的通知，以使控制器根据该通知断开开关K1以关闭图像信号处理器的时钟信号。该种实施方式下各个部件的时钟控制更加精细化，更有助于降低功耗，但是如果各个部件之间完成工作的时差较小，则这种方式在控制上可能不如上一种方式容易实现。
本申请实施例中，接口的功耗随着其工作模式的不同而不同，当接口不传输图像信号时，即使不关闭接口的时钟信号，接口本身的功耗也较小。基于此，在另一种可选地实施方式中，当最后一部分图像信息被成功传输至存储器后，控制器也可以不关闭接口的时钟信号，这种情况下，当接口不再传输图像数据，因此接口可以处于图4所示意出的低功耗模式。
在上述步骤8中，“通过关闭图像采集器、接口和图像信号处理器等辅助部件的时钟信号来节省功耗”只是一种可选地实施方式。在另一种可选地实施方式中，由于该周期内图像采集器、接口和图像信号处理器的工作已完成，且该周期的后续时段内也不再需要这些辅助部件工作，因此控制器也可以直接下电(power down，PD)这些辅助部件。实现辅助部件下电的方式可以有多种，例如可以直接断开辅助部件对应的电压转换器的输出端，或者还可以在辅助部件对应的电压转换器的输出端与辅助部件之间设置开关，并使控制器与开关的控制端连接，当需要下电辅助部件时，控制器断开该辅助部件对应的开关即可。
步骤9，控制器导通开关K2，以将变频器2输出的184MHz的时钟信号提供给人工智能处理器，以使人工智能处理器调用存储器中的AI图像识别算法提取处理后的图像的特征，并将该特征与目标特征进行匹配得到匹配结果。
本申请实施例中，在存储器接收到图像信号处理器发送的最后一部分处理后的图像信息之后直至被人工智能处理器调用之前，不需要存储器执行其它工作。这种情况下，一种可选地实施方式中，为了节省功耗，可以由控制器将存储器切换至低频率时钟信号，以维持存储器在该时段内的低功耗工作。另一种可选地实施方式中，考虑到该时段较短，控制器在将存储器切换至低频率时钟信号后可能立马又要重新切换回高频率时钟信号，因此控制器也可以不切换存储器的时钟信号，如此，存储器在该时段内会处于高频率时钟信号下的空闲模式。
在上述步骤9中，当人工智能处理器获取存储器中的AI图像识别算法和处理后的图像时，存储器会处于活跃模式，当人工智能处理器获取到这些信息执行计算时，存储器会处于空闲模式。因此，在人工智能处理器进行图像识别的过程中，存储器可以处于活跃模式或空闲模式。
步骤10，控制器控制转换器3的第二时钟输入端e 32连接转换器3的时钟输出端，以使控制器使用32KHz的低频时钟信号维持低功耗工作，等待人工智能处理器的通知。
步骤11，控制器接收到人工智能处理器通知的匹配结果后，控制转换器3的第一时钟输入端e 31连接转换器3的时钟输出端，以使控制器切换至184MHz的高频率时钟信号下工作，在该高频率时钟信号下关闭开关K2以关闭人工智能处理器的时钟信号，控制转换器4的第二时钟输入端e 42连接转换器4的时钟输出端，以使存储器切换至32KHz的时钟 信号下低功耗工作。
在上述步骤11的另一种可选地实施方式，当人工智能处理器通知匹配结果后，在该周期的后续时段内不再需要人工智能处理器和存储器工作，因此控制器也可以直接下电人工智能处理器和存储器，直至下一周期启动时刻或正常工作状态时再上电人工智能处理器和存储器，以节省功耗。
步骤12，控制器根据匹配结果确定是否存在人脸或手势，若存在，则向中央处理单元发送触发信息以唤醒图像处理装置，若不存在，则控制器控制转换器3的第二时钟输入端e 32连接转换器3的时钟输出端，以使控制器使用32KHz的低频时钟信号维持低功耗工作，等待下一个100ms的定时器到时后，重复执行上述步骤1至步骤12。
本申请实施例中，中央处理单元唤醒图像控制装置，是指将图像处理装置切换至正常工作状态，例如点亮屏幕和/或唤醒语音交互系统等。在正常工作状态下，各个第二功能部件和图像采集器可以使用第二时钟信号工作，而各个第一功能部件可以使用第一时钟信号和第二时钟信号中的一种工作，具体使用哪个时钟信号则可以根据业务场景来设置。在一种可选地实施方式中，继续参照图3和图4所示，频率变换器模组中与各个第一功能部件对应的各个频率变换器可以是复用的，这种情况下，第一锁相环和第二锁相环使用同一个频率变换器来向同一个第一功能部件提供时钟信号。
在当前的业务场景属于需要频繁识别人脸或手势的第一工作模式下的场景(第一工作模式例如为动态手势检测模式，用户正在动态手势检测模式下玩游戏，这种场景下，图像处理装置需要按照30fps左右的频率识别用户的动态手势，以匹配游戏界面上的手势，确定出用户的游戏分数)时，各个第一功能部件需要使用高频率时钟信号以支持高频率的图像识别工作，因此，图像处理装置可以关闭第一锁相环向各个第一功能部件对应的频率变换器的传输路径，并打开第二锁相环向各个第一功能部件对应的频率变换器的传输路径，以使第二锁相环输出的高频率的第二时钟信号通过频率变换器提供给第一功能部件。在当前的业务场景属于需要偶尔检测人脸或手势的第二工作模式(第二工作模式例如为智能旋转屏模式，用户正在智能旋转屏模式下看视频，这种场景下，图像处理装置需要按照5fps左右的频率识别用户的眼睛，以匹配当前屏幕方向，确定出是否需要旋转屏幕)时，各个第一功能部件需要使用低频率时钟信号以支持低频率的图像识别工作，因此，图像处理装置可以关闭第二锁相环向频率变换器的传输路径，并打开第一锁相环向频率变换器的传输路径，以使第一锁相环输出的低频率的第一时钟信号通过频率变换器提供给第一功能部件。需理解，以上两种工作模式仅用于举例，实际上的第一工作模式和第二工作模式仅仅表示两种不同类型的工作过程或工作状态，在不同工作过程或工作状态下使用的时钟信号频率有差异，本申请实施例对什么是工作模式的具体含义不作限定。
针对于第一锁相环或第二锁相环中的每个锁相环，打开或关闭该锁相环向各个第一功能部件的传输路径的方式可以有多种，例如：一种方式下，该锁相环和各个频率变换器的传输路径上还可以设置有开关，开关的控制端与控制器(或中央处理单元)连接，当控制器(或中央处理单元)导通该开关时，该锁相环向各个第一功能部件的传输路径被打开，当控制器(或中央处理单元)断开该开关时，该锁相环向各个第一功能部件的传输路径被关闭。另一种方式下，该锁相环的输出端具有控制接口，控制接口与控制器(或中央处理单元)连接，当控制器(或中央处理单元)通过控制接口打开该锁相环的输出时，该锁相环向各个第一功能部件的传输路径被打开，当控制器(或中央处理单元)通过控制接口关 闭该锁相环的输出时，该锁相环向各个第一功能部件的传输路径被关闭。
可以理解的，虽然上述步骤11至步骤12中没有介绍总线的时钟控制过程，但是当控制器、图像信号处理器、人工智能处理器和存储器之间存在信息交互时，控制器还可以控制总线对应的频率转换器的第一时钟输入端连接时钟输出端，以使总线在高频率的时钟信号下实现各个部件之间的信息传输。当控制器、图像信号处理器、人工智能处理器和存储器之间的信息交互完成后，控制器可以控制总线对应的频率转换器的第二时钟输入端连接时钟输出端，以使总线在低频率的时钟信号下维持存活，以降低总线的功耗。
根据上述内容描述可知，本申请的上述实施例提供一种精细化的时钟控制方式，该时钟控制方式在控制器统一管理各个部件在待机状态下的操作时，还根据各个部件的工作状态调整各个部件的时钟，例如当某个部件不工作时，控制器可以直接关闭该部件的时钟，或者将该部件切换至较低频率的时钟，以降低该部件的功耗。这种方式在待机唤醒中结合精细化的时钟控制方式调整各个部件的时钟，有助于进一步降低各个部件在待机状态下的功耗。
图5只是示例性示出了图像处理装置在一个周期内的待机唤醒过程，下面介绍图像处理装置待机唤醒的整个实现流程。在该流程中，每个周期内的待机唤醒过程都可以参照图5所示，本申请对此不再重复介绍。
图6示例性示出一种待机唤醒方法的流程示意图，该方法示例性以手势唤醒为例进行介绍，如图6所示，该方法包括：步骤601，图像处理装置确定图像处理装置在待机状态下的工作方式。若工作方式为息屏显示，则执行步骤602；若工作方式为待机唤醒，则执行步骤603。
在一种可选地实施方式中，可以由用户设置待机状态下的工作方式。例如当检测到进入待机状态时，图像处理装置可以主动向用户提供待机配置界面，由用户在该待机配置界面上选择待机状态下的工作方式。或者图像处理装置中初始设置有一个默认的工作方式，用户可以通过设置按键进入待机配置界面，以对默认的工作方式进行修改。
步骤602，图像处理装置在待机状态下将息屏显示对应的显示内容显示在屏幕上。在一种可选地实施方式中，当用户需要在待机状态下时刻监测时钟等常用信息时，用户可以选择息屏显示作为待机状态下的工作方式，且用户还可以设置息屏显示的内容。如此，图像处理装置在待机状态的整个过程中会始终显示用户所设置的息屏显示的内容，以满足用户的需求，提高用户的体验。
步骤603，图像处理装置在待机状态下检测环境光线的亮度变化值。在一种可选地实施方式中，若用户存在待机状态下降低功耗的需求，则可以选择待机唤醒作为待机状态下的工作方式。这种情况下，当图像处理装置进入待机状态时，图像处理装置中的应用处理器可以向控制器发送通知消息，以触发控制器启动待机唤醒监控业务。控制器根据待机唤醒监控业务，可以先将各个频率转换器切换至待机状态下的默认模式。其中，当配置图像采集器对应的频率转换器时，控制器需要先在MCLK时钟的支持下配置图像采集器切换至待机模式，再断开开关K6以关闭MCLK时钟，如此，图像采集器和开关K6都切换至默认模式。此外，控制器(或应用处理器)还可以下电待机下电电源，以使高功耗系统内的各个第二功能部件(包括应用处理器)下电。且，控制器还可以开启第一时钟产生系统并关断第二时钟产生系统，以使低功耗系统内的各个第一功能部件和图像采集器使用低频率的第一时钟信号执行待机唤醒。
本申请实施例中，当用户在屏幕前方摆出手势时，图像处理装置的环境光线会发生变化，因此检测环境光线的变化情况可以作为待机唤醒的一个前提条件。其中，检测环境光线的方式有多种，例如在一种方式下，还可以连接待机非下电电源与环境光传感器(和/或接近光传感器)，由待机非下电电源在待机状态下为环境光传感器供电，如此，控制器可以通过控制环境光传感器来检测待机状态下环境光线的变化情况，以得到环境光线的亮度变化值。又例如另一种方式下，控制器也可以直接控制图像采集器采集至少两帧图像，对比至少两帧图像的亮度，以确定环境光线的亮度变化值。
可以理解的，环境光线的亮度变化值只是体现环境光传感器前方存在物体的一种特征，本申请实施例并不限定只使用该特征检测环境光线的变化情况，凡是可以指示出环境光传感器前方存在物体的特征都在本申请的保护范围之内，例如温度、色差、灰度等。
步骤604，图像处理装置判断环境光线的亮度变化值是否大于预设阈值，若是，则执行步骤605，若否，则执行步骤603。本申请实施例中，图像处理装置检测环境光线的变化大约需要5mW的功耗，而执行一次待机识别则大约需要10mW的功耗。这种情况下，通过在执行待机识别之前先检测环境光线的变化，相当于对待机识别设置了第一级筛选条件，只有满足该筛选条件时才会执行待机识别，而不满足时则不执行待机识别。由于环境光线的检测比待机识别的功耗要小，因此这种方式有助于降低待机状态下的功耗。
步骤605，图像处理装置按照第一周期执行待机识别，在每个第一周期内识别一帧图像；若该帧图像中包括手势，则执行步骤606；若该帧图像中不包括手势，且连续K个第一周期内均未检测到手势，则执行步骤603；若该帧图像中不包括手势，且未检测到人脸的周期数量未达到K，则执行步骤605。
本申请实施例中，K可以取大于或等于2的任意正整数。K的取值可以由本领域技术人员根据经验进行设置，例如考虑到人手从遮挡在环境光传感器开始至人手完全放在屏幕前方，可能还需要耗费1秒的时间，因此如果第一周期的周期时长为500毫秒，则K的取值可以设置为2。当该次没有识别到人手但是识别次数还没有达到2时，可以继续识别，直至2次都没有识别到人手，才确定用户没有执行手势唤醒操作。该种方式通过设置识别次数来给用户足够的时间将完整的人手放在屏幕前，有助于提高识别的准确性。
步骤606，图像处理装置按照第二周期继续识别图像，每个第二周期内识别一帧图像；若识别到手势的次数大于或等于T次，则执行步骤607；若识别到手势的次数小于T次，则执行步骤603。
本申请实施例中，T可以取值为任意正整数。识别到手势的次数大于或等于T次，可以是指连续识别T次都存在手势，也可以是指识别大于T的任意次数而其中的T次存在手势。当识别的次数一定时，T的取值越大，则图像识别越准确，T的取值越小，则图像识别越不准确。
在一种可选地实施方式中，第二周期可以小于第一周期，例如当第一周期为500毫秒时，第二周期可以为300毫秒。这种情况下，图像处理装置会按照5帧/秒(fps)的帧率继续识别图像。或者，第二周期也可以为100毫秒，这种情况下，图像处理装置会按照10帧/秒(fps)的帧率识别图像。按照第一周期识别图像大约需要10mW的功耗，而按照第二周期识别图像则大约需要20mW～30mW的功耗。采用该种实施方式，按照第一周期识别图像相当于为待机唤醒设置了第二级筛选条件，只有在低频率的图像识别中识别到手势后才会切换至高频率的图像识别，以进一步识别确定出是否屏幕前真正存在手势，只有在 高频率的图像识别中也存在手势时才会唤醒图像处理装置。由此可知，这种方式不仅可以降低待机状态下执行图像识别的功耗，还能够提高待机唤醒的准确性。
步骤607，图像处理装置由待机状态切换至正常工作状态。可以理解的，在上述步骤603至步骤607的执行过程中，若图像处理装置接收到其他方式的唤醒指令(例如用户按压电源按键)，则图像处理装置可以结束当前的待机唤醒操作，并由待机状态直接切换至正常工作状态。
下面以一个具体的示例介绍本申请中的待机唤醒方法能够实现的功耗级数，在该示例中，假设按照200毫秒的周期时长执行注视唤醒。
表2示例性示出各个第一功能部件和图像采集器的功耗示意表，其中功耗单位为mW：
Figure PCTCN2020113852-appb-000002
表2
如表2所示，按照本申请提出的图像处理方法，各个第一功能部件和图像采集器执行一个周期内的待机唤醒的总功耗只有17.8mW左右，相比于直接使用图1内容介绍部分所示的各个功能单元执行待机唤醒的方式来说，能够节省几百mW的功耗。
在表2的基础上，假设在一天的时间(即24小时)内，图像处理装置亮屏使用7小时，暗光灭屏(没有闪光灯，因此暗光灭屏时关闭一级检测，即不执行待机唤醒)使用8小时，充电1小时，则亮光灭屏使用的时长为8小时。在亮光灭屏下执行待机唤醒时，若这8小时中光线不变化的时间按照5小时来计算，且光线不变化的每小时内会耗费1.5mA的功耗，则这5小时(单位为H)内的功耗大约为：
1.5mWAx5H＝7.5mAH
若这8小时内光线变化的时长按照3小时计算，假设电源电压是3.8V，则这3小时内的功耗大约为：
17.8mW/3.8Vx3H＝14mAH
由此可知，按照本申请中的方案，在一天内执行待机唤醒所消耗的功耗约为：
7.5mAH+14mAH＝21.5mAH
然而，按照图1内容介绍部分所示的各个功能单元执行待机唤醒的方案，在一天内执行待机唤醒所消耗的功耗则需要几百mAH甚至上千mAH。显然，本申请中的方案能够有效降低图像处理装置的功耗，有助于提高图像处理装置的续航能力。
需要说明的是，本申请实施例中的图像处理装置和图像处理方法不仅可以应用于上述示意出的电子设备中，还可以应用于机器人或其它智能家居产品中，例如洗衣机、液晶电视和微波炉等，具体不作限定。
需理解，以上实施例中涉及的“第一”和“第二”等表达仅为了区分不同的单元，不为了进行数量或用途上的限定；“连接”一次应理解为电性连接或电性耦合，而不应理解为是直接通过导线相连，所述“连接”应理解为可通过其他器件间接相连的情况。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (13)

  1. 一种图像处理装置，其特征在于，包括：
    第一时钟产生系统，用于产生第一频率的第一时钟信号；
    第二时钟产生系统，用于产生第二频率的第二时钟信号；其中，所述第一频率小于所述第二频率；
    低功耗系统，包括多个第一功能部件，用于：
    在所述图像处理装置处于待机状态时，基于所述第一时钟信号处理图像信息并触发所述图像处理装置切换为正常工作状态；且，
    在所述图像处理装置处于所述正常工作状态时，基于所述第一时钟信号和所述第二时钟信号中的一个工作；
    高功耗系统，包括多个第二功能部件，用于：
    在所述图像处理装置处于所述正常工作状态时，基于所述第二时钟信号工作。
  2. 如权利要求1所述的图像处理装置，其特征在于，所述多个第一功能部件包括控制器、图像信号处理器和人工智能处理器；所述多个第二功能部件包括中央处理单元；
    所述图像信号处理器，用于在所述图像处理装置处于所述待机状态时，处理所述图像信息，以得到处理后的图像信息；
    所述人工智能处理器，用于在所述图像处理装置处于所述待机状态时，提取所述处理后的图像信息的特征，并确定所述特征是否匹配目标特征，以得到匹配结果；
    所述控制器，用于在所述图像处理装置处于所述待机状态时，根据所述匹配结果向所述中央处理单元发送触发信号；
    所述中央处理单元，用于响应于所述触发信号，将所述图像处理装置切换至所述正常工作状态。
  3. 如权利要求2所述的图像处理装置，其特征在于，所述将所述图像处理装置切换至所述正常工作状态，包括：控制屏幕点亮。
  4. 如权利要求2或3所述的图像处理装置，其特征在于，所述多个第一功能部件还包括：接口，用于在所述图像处理装置处于所述待机状态时，从图像采集器接收所述图像信息，并将所述图像信息传输给所述图像信号处理器。
  5. 如权利要求2至4中任一项所述的图像处理装置，其特征在于，所述多个第一功能部件还包括：存储器，用于在所述图像处理装置处于所述待机状态时，存储所述处理后的图像信息。
  6. 如权利要求1至5中任一项所述的图像处理装置，其特征在于，所述图像处理装置还包括：频率变换器系统，用于：
    从所述第一时钟产生系统接收所述第一时钟信号，对所述第一时钟信号进行变频产生变频后的第一时钟信号，并向所述低功耗系统提供所述变频后的第一时钟信号；
    从所述第二时钟产生系统接收所述第二时钟信号，对所述第二时钟信号进行变频产生变频后的第二时钟信号，并向所述低功耗系统或所述高功耗系统提供所述变频后的第二时钟信号。
  7. 如权利要求6所述的图像处理装置，其特征在于，所述频率变换系统包括多个频率变换器；
    所述多个频率变换器中的一个频率变换器与所述多个第一功能部件中的一个第一功能部件对应；
    所述频率变换器用于接收所述第一时钟信号并向对应的所述第一功能部件输出所述变频后的第一时钟信号，或接收所述第二时钟信号并向对应的所述第一功能部件输出所述变频后的第二时钟信号。
  8. 如权利要求7所述的图像处理装置，其特征在于，所述多个频率变换器中的至少一个频率变换器，还用于：在所述至少一个频率变换器对应的至少一个第一功能部件停止工作时，关闭所述至少一个频率变换器的输出。
  9. 如权利要求7或8所述的图像处理装置，其特征在于，所述变频后的第一时钟信号的频率高于所述第一频率；
    所述多个频率变换器中的至少一个频率变换器还用于：
    在所述至少一个频率变换器对应的至少一个第一功能部件空闲时，将所述第一频率的第一时钟信号输出给所述至少一个第一功能部件。
  10. 如权利要求1至9中任一项所述的图像处理装置，其特征在于，在所述图像处理装置处于所述正常工作状态时，所述低功耗系统具体用于：在第一工作模式下基于所述第一时钟信号工作，且在第二工作模式下基于所述第二时钟信号工作。
  11. 如权利要求1至10中任一项所述的图像处理装置，其特征在于，在所述图像处理装置处于所述待机状态时，所述第二时钟产生系统被关闭。
  12. 一种电子设备，其特征在于，包括图像采集器和如权利要求1至11中任一项所述的图像处理装置。
  13. 一种图像处理方法，其特征在于，所述方法包括：
    控制第一时钟产生系统产生第一频率的第一时钟信号；
    控制第二时钟产生系统产生第二频率的第二时钟信号；其中，所述第一频率小于所述第二频率；
    在所述图像处理装置处于待机状态时，控制低功耗系统基于所述第一时钟信号处理图像信息并触发所述图像处理装置切换为正常工作状态；其中，所述低功耗系统包括多个第一功能部件；
    在所述图像处理装置处于所述正常工作状态时，控制所述低功耗系统基于所述第一时钟信号和所述第二时钟信号中的一个工作，并控制高功耗系统基于所述第二时钟信号工作；所述高功耗系统包括多个第二功能部件。
PCT/CN2020/113852 2020-09-07 2020-09-07 一种图像处理装置、电子设备及图像处理方法 WO2022047808A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202080006663.8A CN114531905B (zh) 2020-09-07 2020-09-07 一种图像处理装置、电子设备及图像处理方法
EP20952050.1A EP4198688A4 (en) 2020-09-07 2020-09-07 IMAGE PROCESSING APPARATUS, ELECTRONIC DEVICE AND IMAGE PROCESSING METHOD
PCT/CN2020/113852 WO2022047808A1 (zh) 2020-09-07 2020-09-07 一种图像处理装置、电子设备及图像处理方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/113852 WO2022047808A1 (zh) 2020-09-07 2020-09-07 一种图像处理装置、电子设备及图像处理方法

Publications (1)

Publication Number Publication Date
WO2022047808A1 true WO2022047808A1 (zh) 2022-03-10

Family

ID=80492213

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/113852 WO2022047808A1 (zh) 2020-09-07 2020-09-07 一种图像处理装置、电子设备及图像处理方法

Country Status (3)

Country Link
EP (1) EP4198688A4 (zh)
CN (1) CN114531905B (zh)
WO (1) WO2022047808A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130223635A1 (en) * 2012-02-27 2013-08-29 Cambridge Silicon Radio Limited Low power audio detection
CN105094268A (zh) * 2014-04-17 2015-11-25 展讯通信（上海）有限公司 减小系统待机状态下时钟电流的控制系统
CN105302548A (zh) * 2015-09-24 2016-02-03 深圳Tcl数字技术有限公司 安卓设备的待机、唤醒方法及装置
CN105632491A (zh) * 2014-11-26 2016-06-01 三星电子株式会社 用于语音识别的方法和电子装置
CN105700660A (zh) * 2014-12-16 2016-06-22 意法半导体(鲁塞)公司 具有与核域不同的唤醒模块的电子设备

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104375886B (zh) * 2013-08-16 2018-07-06 联想(北京)有限公司 信息处理方法、装置和电子设备
CN105759935B (zh) * 2016-01-29 2019-01-18 华为技术有限公司 一种终端控制方法及终端
KR102135378B1 (ko) * 2018-08-06 2020-07-17 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN111316199B (zh) * 2018-10-16 2022-08-19 华为技术有限公司 一种信息处理方法及电子设备
CN110297665B (zh) * 2019-06-10 2022-07-19 青岛小鸟看看科技有限公司 一种设备工作模式的切换方法和相机
CN111262975B (zh) * 2020-01-08 2021-06-08 华为技术有限公司 亮屏控制方法、电子设备、计算机可读存储介质和程序产品

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130223635A1 (en) * 2012-02-27 2013-08-29 Cambridge Silicon Radio Limited Low power audio detection
CN105094268A (zh) * 2014-04-17 2015-11-25 展讯通信（上海）有限公司 减小系统待机状态下时钟电流的控制系统
CN105632491A (zh) * 2014-11-26 2016-06-01 三星电子株式会社 用于语音识别的方法和电子装置
CN105700660A (zh) * 2014-12-16 2016-06-22 意法半导体(鲁塞)公司 具有与核域不同的唤醒模块的电子设备
CN105302548A (zh) * 2015-09-24 2016-02-03 深圳Tcl数字技术有限公司 安卓设备的待机、唤醒方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4198688A4 *

Also Published As

Publication number Publication date
CN114531905B (zh) 2024-07-30
CN114531905A (zh) 2022-05-24
EP4198688A4 (en) 2023-10-25
EP4198688A1 (en) 2023-06-21

Similar Documents

Publication Publication Date Title
US11416062B2 (en) Terminal control method and terminal
EP3933664A1 (en) Integrated chip and sensor data processing method
US11304143B2 (en) Terminal device, network device, frame format configuration method, and system
EP4093002A1 (en) Always on display method and electronic device
WO2021052170A1 (zh) 马达振动控制方法及电子设备
CN111783375A (zh) 芯片系统及相关装置
CN114498804B (zh) 用于开机或唤醒系统的电子设备和控制电路
CN104918310A (zh) 一种快速省电移动终端及其快速省电方法
CN115714890A (zh) 供电电路和电子设备
WO2022047808A1 (zh) 一种图像处理装置、电子设备及图像处理方法
WO2023142959A1 (zh) 多机位拍摄系统的拍摄方法、设备、存储介质和程序产品
CN114089902A (zh) 手势交互方法、装置及终端设备
WO2023016337A1 (zh) 电子设备的充电控制方法和电子设备
CN116363722A (zh) 目标识别方法、装置及存储介质
CN114816027B (zh) 降低可穿戴设备功耗的方法及相关装置
CN115083400A (zh) 语音助手唤醒方法及装置
WO2022022436A1 (zh) 充电方法和电子设备
CN117134009B (zh) 充电方法及电子设备
WO2023000776A1 (zh) 命令的发送方法、存储介质和设备
CN217543876U (zh) 具有拍摄功能的电子系统及电子设备
CN219609705U (zh) 节能唤醒装置及智能锁
CN115119288A (zh) 通信控制方法、装置及存储介质
CN114258044A (zh) 待机方法、系统及终端设备
CN114744691A (zh) 无线充电的方法、设备以及系统
CN116828295A (zh) 数据处理方法、图像处理芯片及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20952050

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020952050

Country of ref document: EP

Effective date: 20230315

NENP Non-entry into the national phase

Ref country code: DE