WO2022252877A1

WO2022252877A1 - Image processing chip, and abnormality processing method applied to image processing chip

Info

Publication number: WO2022252877A1
Application number: PCT/CN2022/089014
Authority: WO
Inventors: 朱文波
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-06-01
Filing date: 2022-04-25
Publication date: 2022-12-08
Also published as: CN115442586A

Abstract

An image processing chip, and an abnormality processing method applied to an image processing chip. The method comprises: acquiring abnormality information in an image output process, and determining an abnormality type according to the abnormality information (S101); and before reporting the abnormality information, according to the abnormality type, controlling an abnormality function module in an image processing chip to retry and/or controlling the abnormality function module to switch to a bypass mode, so as to perform abnormality self-recovery processing on the image processing chip (S103).

Description

Image processing chip and exception handling method applied to image processing chip

Cross References to Related Applications

This disclosure claims the priority of the Chinese patent application with the application number 202110610683.2 filed on June 1, 2021, entitled "Image Processing Chip and Abnormal Handling Method Applied to Image Processing Chip", the entire contents of which are incorporated herein by reference. In public.

technical field

The present disclosure relates to the technical field of exception processing, and in particular to an image processing chip and an exception processing method applied to the image processing chip.

Background technique

At present, when the underlying image processing chip is abnormal in the process of processing image data, the abnormal information will be directly uploaded to the upper hardware abstraction layer, which will make the user directly feel the abnormal situation in the underlying layer and affect the user experience. Effect.

public content

The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent. Therefore, the first purpose of the present disclosure is to propose an exception handling method applied to an image processing chip.

The second objective of the present disclosure is to provide an image processing chip.

The third object of the present disclosure is to provide an electronic device.

A fourth object of the present disclosure is to provide a computer-readable storage medium.

In order to achieve the above purpose, the embodiment of the first aspect of the present disclosure proposes an exception handling method applied to an image processing chip, including: obtaining abnormal information during the image output process, and determining the abnormal type according to the abnormal information; reporting the abnormal information Before, control the abnormal function module in the image processing chip to retry according to the abnormal type and/or control the abnormal function module to switch to the bypass mode, so as to perform abnormal self-recovery processing on the image processing chip.

According to the abnormality handling method applied to the image processing chip of the embodiment of the present disclosure, the abnormality type is determined according to the abnormality information by acquiring the abnormality information in the image output process, and the abnormality in the image processing chip is controlled according to the abnormality type before reporting the abnormality information The function module retries and/or controls the exception function module to switch to the bypass mode to perform abnormal self-recovery processing on the image processing chip, and then calls the corresponding exception handling strategy to quickly respond without affecting the upper hardware abstraction layer Abnormal adaptive recovery processing, after abnormal processing, the processing results and abnormal information are reported to the hardware abstraction layer, so that the upper hardware abstraction layer has the ability to further judge and process according to the adaptive processing results and abnormal information, so as to better Improve the robustness of the system, reduce the impact of abnormalities in the underlying image processing chip on the user experience, and improve user satisfaction.

In one embodiment, the image processing chip includes a plurality of functional modules, and the abnormality information is obtained by self-testing of each functional module.

In one embodiment, the exception types include recoverable exceptions and non-recoverable exceptions, wherein, according to the exception type, controlling the abnormal function module in the image processing chip to retry and/or controlling the abnormal function module to switch to the bypass mode includes: When the exception type is a recoverable exception, control the exception function module to retry to re-execute the function of the exception function module; when the exception type is an unrecoverable exception, control the exception function module to switch to bypass mode so that the exception function module will receive The received signal is output directly.

In one embodiment, after the retry of the control abnormal function module, if the retry fails, the control abnormal function module switches to the bypass mode and then tries again.

In one embodiment, the abnormality type includes image freezing abnormality, wherein, when it is determined that image freezing abnormality occurs during the image output process, the output image data is also predicted to simulate the current frame image, so that the abnormal information When performing recovery processing, the simulated current frame image is sent to the hardware abstraction layer as an output frame image, so that the hardware abstraction layer displays the simulated current frame image.

In one embodiment, the abnormality type includes content abnormality, wherein, when it is determined that content abnormality occurs during the image output process, the current frame image data is also simulated according to the historical frame image data, and the simulated current frame image data is replaced with the content abnormality. The current frame image data, so that when the exception information is restored, the simulated current frame image data is sent to the hardware abstraction layer as an output frame image, so that the hardware abstraction layer displays the simulated current frame image.

In one embodiment, image preprocessing is performed on the collected current frame image data, wherein the image preprocessing includes automatic exposure control, automatic gain control, automatic white balance control, lens correction, color correction, gamma correction, color space At least one or more of the transformations; determining the difference information of the image parameters between the processed current frame image data and the unprocessed current frame image data; determining the abnormal type is content abnormal according to the difference information.

In order to achieve the above purpose, the embodiment of the second aspect of the present disclosure proposes an image processing chip, including: an abnormality detection module, which is used to obtain abnormality information during the image output process, and determine the abnormality type according to the abnormality information; an abnormality processing module, which uses Before reporting the abnormal information, control the abnormal function module in the image processing chip to retry according to the abnormal type and/or control the abnormal function module to switch to the bypass mode, so as to perform abnormal self-recovery processing on the image processing chip.

According to the image processing chip of the embodiment of the present disclosure, the abnormal information in the image output process is obtained through the abnormal detection module, and the abnormal type is determined according to the abnormal information, and the image processing is controlled according to the abnormal type through the abnormal processing module and before reporting the abnormal information The abnormal function module in the chip retries and/or controls the abnormal function module to switch to bypass mode to perform abnormal self-recovery processing on the image processing chip, and then the image processing chip can call The corresponding exception handling strategy quickly performs adaptive recovery processing corresponding to the exception, and reports the processing results and exception information to the hardware abstraction layer after exception handling, so that the upper hardware abstraction layer can make further judgments and decisions based on the adaptive processing results and exception information. The ability of processing can better improve the robustness of the system, and at the same time reduce the impact of abnormalities in the underlying image processing chip on the user experience and improve user satisfaction.

In one embodiment, the exception type includes a recoverable exception and an unrecoverable exception; when the exception type is a recoverable exception, the exception handling module is specifically used to control the retry of the exception function module to re-execute the function of the exception function module; When the type is an unrecoverable exception, the exception handling module is specifically used to control the exception function module to switch to a bypass mode, so that the exception function module directly outputs the received signal.

In one embodiment, the exception handling module is further configured to control the exception function module to switch to bypass mode and then retry if the retry fails after controlling the exception function module to retry.

In one embodiment, the abnormality type includes an image freezing exception; when the abnormality detection module determines that an image freezing abnormality occurs during the image output process, the abnormality processing module also predicts the output image data to simulate the current frame image, so that When recovering the abnormal information, the simulated current frame image is sent to the hardware abstraction layer as an output frame image.

In one embodiment, the abnormal type includes content abnormality; when the abnormality detection module determines that the content is abnormal during the image output process, the abnormality processing module also simulates the current frame image data according to the historical frame image data, and replaces the simulated current frame image data The current frame image data with abnormal content, so that when the abnormal information is restored, the simulated current frame image data is sent to the hardware abstraction layer as an output frame image, so that the hardware sampling layer displays the simulated current frame image.

In one embodiment, the abnormality detection module is specifically used to: perform image preprocessing on the collected image data of the current frame, wherein the image preprocessing includes automatic exposure control, automatic gain control, automatic white balance control, lens correction, color correction At least one or more of , gamma correction, and color space conversion; determine the difference information of image parameters between the current frame image data after processing and the current frame image data before processing; determine the abnormal type according to the difference information abnormal.

In order to achieve the above purpose, the embodiment of the third aspect of the present disclosure proposes an electronic device, including a memory, a processor, and an exception handling program that is stored in the memory and can be run on the processor and applied to the image processing chip. The processor executes When applied to the exception handling program of the image processing chip, the aforementioned exception handling method applied to the image processing chip is implemented.

According to the electronic device in the embodiment of the present disclosure, through the above-mentioned exception handling method applied to the image processing chip, after detecting the abnormal information, without affecting the upper hardware abstraction layer, the corresponding exception handling strategy can be called to quickly process the corresponding exception. Adaptive recovery processing, after exception processing, the processing results and abnormal information are reported to the hardware abstraction layer, so that the upper hardware abstraction layer has the ability to further judge and process according to the adaptive processing results and abnormal information, so as to better improve The robustness of the system, while reducing the impact of abnormalities in the underlying image processing chip on the user experience, and improving user satisfaction.

To achieve the above purpose, the embodiment of the fourth aspect of the present disclosure proposes a computer-readable storage medium on which is stored an exception handling program applied to an image processing chip, and the exception handling program applied to the image processing chip is executed by a processor , implement the aforementioned exception handling method applied to the image processing chip.

According to the computer-readable storage medium of the embodiment of the present disclosure, through the above-mentioned exception handling method applied to the image processing chip, after abnormal information is detected, the corresponding exception handling strategy can be called quickly without affecting the upper hardware abstraction layer. Corresponding to the adaptive recovery processing of abnormalities, the processing results and abnormal information are reported to the hardware abstraction layer after the abnormality processing, so that the upper hardware abstraction layer has the ability to make further judgments and processing based on the adaptive processing results and abnormal information, so that more Improve the robustness of the system, reduce the impact of abnormalities in the underlying image processing chip on the user experience, and improve user satisfaction.

Additional aspects and advantages of the disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.

Description of drawings

FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;

FIG. 2 is a flowchart of an exception handling method applied to an image processing chip according to an embodiment of the present disclosure;

FIG. 3 is a flow chart of exception handling strategies corresponding to different exception types according to an embodiment of the present disclosure;

4 is a schematic structural diagram of an image anomaly detection and processing module of an image processing chip according to an embodiment of the disclosure;

FIG. 5 is a schematic structural diagram of an image processing chip according to an embodiment of the disclosure.

Detailed ways

Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present disclosure and should not be construed as limiting the present disclosure.

As mentioned in the background art, when an exception occurs in the image processing chip of the current camera, the processing of the exception is mainly to directly return an error number to the hardware abstraction layer of the camera, so that the hardware abstraction layer of the camera handles the exception. Alternatively, when the image processing chip finds an abnormality, it will mark the corresponding functional module that has the abnormality, and directly shut down the functional module that has the abnormality. Alternatively, the image processing chip directly shuts down and throws an exception, so that the hardware abstraction layer of the camera handles the exception. When the image data processed by the image processing chip is abnormal, the image processing chip cannot detect the image abnormality, and directly outputs the abnormal image, so that the user can see the abnormality. Therefore, whether the image processing chip feeds back the abnormal type to the calling function or directly crashes, it will make the upper hardware abstraction layer visible, thus affecting the use of the upper hardware abstraction layer and the user experience effect.

In view of the above technical problems, the present disclosure provides an abnormality processing method applied to an image processing chip, an image processing chip, an electronic device, and a computer-readable storage medium, which can actively initiate detection of abnormalities in the image processing chip and abnormalities in image content. When an exception occurs, it can detect the exception in advance and obtain relevant abnormal information, and then call the corresponding exception handling strategy to quickly perform adaptive recovery processing of the corresponding exception without affecting the upper hardware abstraction layer, improving user experience.

An exception handling method applied to an image processing chip, an image processing chip, an electronic device, and a computer-readable storage medium according to embodiments of the present disclosure will be described below with reference to the accompanying drawings.

As shown in FIG. 1 , the present disclosure provides an electronic device including an image processing chip 10 and a hardware abstraction layer 20 . Wherein, the image processing chip 10 is used for receiving original image data and processing the original image data. In the present disclosure, the image processing chip 10 detects in real time whether an abnormality occurs during the image output process, obtains abnormality information when an abnormality occurs, determines the abnormality type according to the abnormality information, and determines a corresponding abnormality handling strategy according to the abnormality type. After the image processing chip 10 completes the abnormal adaptive processing according to the abnormal processing strategy, it reports the abnormal information and processing results to the hardware abstraction layer 20, so that the underlying abnormalities are invisible to the upper hardware abstraction layer 20, avoiding the impact of the underlying abnormal conditions The use of the upper hardware abstraction layer 20 improves user experience. It should be noted that the electronic device in the present disclosure may be a mobile phone, a tablet computer, a personal computer, a smart camera, and a vehicle-mounted image acquisition device, etc., which have a camera or camera function.

FIG. 2 is a flowchart of an exception handling method applied to an image processing chip according to an embodiment of the disclosure. Referring to Figure 2, the method may include the following steps:

Step S101, acquiring abnormality information during the image output process, and determining the abnormality type according to the abnormality information.

The electronic device includes an image collector, which is used to collect image data for preview or shooting. The image collector sends the collected image data to the image processing chip. The image processing chip is used to process the received image data and output it to the upper hardware abstraction layer after processing. When the image processing chip is abnormal in the process of processing image data, for example, the functional modules in the image processing chip are abnormal or the image content is abnormal, etc., the image processing chip can use its own abnormal detection mechanism to detect the abnormality and obtain abnormal information.

In one embodiment, the image processing chip includes multiple functional modules, and the abnormality information is obtained by each functional module detecting itself.

Specifically, the functional modules of the image processing chip include an image pre-processing module, which is used to process the image data collected by the image collector, such as lens shading correction processing, local tone mapping processing, etc. The image processing chip also includes an initialization sub-module, a communication sub-module, a power management sub-module, a temperature detection sub-module, a scene switching sub-module, a resource disclosure sub-module, etc. When abnormal situations occur in the working process of each functional module, each functional module detects the abnormality and obtains its own abnormality information. Each functional module also packs the module identification and abnormal information and sends them to the abnormal detection module of the image processing chip. The abnormal detection module detects the abnormal information and sends the detection results to the abnormal processing module, so that the abnormal processing module can perform abnormal processing according to the abnormal information .

The abnormality detection module can also detect the image data before and after processing or the parameters of the functional modules, judge whether an abnormality occurs according to the image data before and after processing, or judge whether the parameters of each functional module exceed the preset range to determine whether an abnormality occurs, and When an exception is detected, the abnormal information is obtained and sent to the exception handling module, so that the exception handling module can handle the exception.

In this embodiment, the image processing chip defines different exception types for common abnormal situations in advance according to the functions and scenarios of each functional module, and then formulates corresponding exception handling strategies based on different exception types, and lists the exception types and their corresponding exceptions The handling strategy is pre-stored in the exception handling module. When an exception occurs, the exception handling module comprehensively judges the exception type by combining the exception information of different exception function modules, and then performs adaptive exception handling according to the exception handling strategies of different exception types, and finally realizes the user-unaware Abnormal recovery.

Step S103, before reporting the abnormal information, control the abnormal function module in the image processing chip to retry according to the abnormal type and/or control the abnormal function module to switch to the bypass mode, so as to perform abnormal self-recovery processing on the image processing chip.

After the exception processing module obtains the exception type of the abnormal function module, it controls the abnormal function module to perform self-recovery processing. After the self-recovery processing is completed, the abnormal processing module reports the abnormal information to the camera hardware abstraction layer. When controlling the abnormal function module to perform self-recovery processing, it can control the abnormal function module to retry, that is, re-execute the function of the abnormal function module, for example, control the abnormal function module to restore the default settings and then retry, or control the abnormal function module to restore the factory Try again after setting etc. Or, when controlling the abnormal function module to perform self-recovery processing, the abnormal function module can be controlled to switch to the bypass mode (Bypass), that is, the abnormal function module is controlled not to process the received signal, and directly outputs the signal to the next level functional module. Therefore, the upper camera hardware abstraction layer does not need to process abnormal information, and the underlying image processing chip performs abnormal self-recovery processing according to the abnormal handling strategy when an abnormality is found, and then reports the abnormal information to the upper hardware abstraction layer after the processing is completed, thereby Realize abnormal recovery without user perception.

In one embodiment, the exception types include recoverable exceptions and non-recoverable exceptions, wherein, according to the exception type, the abnormal function module in the image processing chip is controlled to retry and/or the abnormal function module is controlled to switch to the bypass mode, including: When the abnormal type is a recoverable exception, control the abnormal function module to retry to re-execute the function of the abnormal function module; The module outputs the received signal directly.

Specifically, a recoverable exception is an exception that the image processing chip can process and recover by itself, and an unrecoverable exception is an exception that the image processing module cannot process and recover by itself. When the exception type is a recoverable exception, the exception handling module controls the exception function module to retry, such as direct retry, retry after restart, retry after restoring the previous setting, or retry after using the default setting.

Further, after controlling the abnormal function module to retry, if the abnormality has not been recovered, the abnormal processing module controls the abnormal function module to switch to the bypass mode and then retry. Specifically, the exception handling module can control the exception function module to retry multiple times in a row. If the retry fails after multiple consecutive retries, the exception handling module controls the exception function module to switch to the bypass mode, which means that the received signal Direct output, so as to avoid affecting the output of image data, in case the upper hardware abstraction layer senses that the bottom layer is abnormal. After controlling the abnormal function module to switch to the bypass mode, the abnormal function module can continue to be controlled to retry. If the abnormality recovers after retrying, the control abnormality function module is switched to the normal working mode; if the retrying still fails, the abnormality information can be reported to the upper hardware abstraction layer, so that the upper layer hardware abstraction layer can process the abnormality information.

When the abnormality that occurs is an unrecoverable abnormality, the abnormality processing module controls the abnormality function module to directly switch to the bypass mode, so as to avoid affecting the output of image data and prevent the upper layer from sensing the abnormality that occurs at the bottom layer.

In this embodiment, the common exception types in image processing chips and their corresponding exception handling strategies are summarized in the following table:

Specifically, the above table mainly classifies the abnormal state based on the internal and external abnormalities of the image processing chip. Of course, the abnormality can also be classified according to the processing method, such as whether it is a recoverable exception or an unrecoverable exception. For example, That is to say, for scene switching and failure to disclose resources to the camera hardware abstraction layer, you can try again by retrying first, and if it is still unsuccessful, then switch to bypass mode for processing; for temperature rise exceptions, it can be classified as business scene exceptions, For non-self-recoverable exceptions, relevant abnormal information can be fed back to the corresponding functional modules, and the corresponding functional modules will handle them according to their own processing strategies.

Figure 3 shows the exception handling process of common exception types and their exception handling strategies. The corresponding exception function module retries. If the abnormality is recovered after retrying, the abnormality information is reported to the upper hardware abstraction layer, and the system returns to normal operation; if the abnormality is not recovered after retrying, the abnormal function module is controlled to restore the previous settings. If the abnormality is recovered after restoring the previous setting, the abnormality information will be reported to the upper hardware abstraction layer, and the system will resume normal operation; if the previous setting is still unsuccessful, the control abnormality function module will use the default setting. If the abnormality is recovered after using the default settings, the abnormal information will be reported to the upper hardware abstraction layer, and the system will resume normal operation; if the abnormality has not been recovered after using the default settings, the corresponding abnormal function module will be reset. If the abnormality recovers after resetting the abnormal function module, the abnormal information is reported to the upper hardware abstraction layer, and the system returns to normal operation; if the abnormality has not recovered after reset, the corresponding abnormal function module is controlled to switch to the bypass mode, and Report exception information. If the image processing chip detects an abnormal temperature rise according to the temperature parameter, it will send the abnormal temperature rise information to the power management module, so that the power management module can process it according to the abnormal temperature rise information. When the sub-thread in the image processing chip is in the locked state, control the corresponding sub-thread to restart, if the restart is successful, report the abnormal information to the upper hardware abstraction layer; if the restart fails, control the corresponding sub-thread to switch to the bypass mode , and report the exception information to the upper hardware abstraction layer. If the parameter delivered by the external processor is abnormal, an error code is returned to the upper-layer hardware abstraction layer, so that the upper-layer hardware abstraction layer performs exception handling according to the error code. If the image processing chip fails to disclose resources to the upper hardware abstraction layer, or fails to communicate with the upper hardware abstraction layer, it first controls the corresponding abnormal function module to retry. If the abnormality is recovered after retrying, the debugging setting information will be exported, and the abnormality information and debugging setting information will be reported to the upper hardware abstraction layer, and the system will resume normal operation; settings. If the abnormality is restored after restoring the previous setting, the abnormality information will be reported to the upper hardware abstraction layer, and the system will resume normal operation; if the restoration of the previous setting is still unsuccessful, the control abnormality function module will switch to the bypass mode. If the power management chip fails to be powered on, the control system will restart, and if it recovers abnormally after restarting, the debugging setting information will be exported, and the abnormal information and debugging setting information will be reported to the upper hardware abstraction layer, and the system will resume normal operation; Still not restored, control the power management chip to switch to the bypass mode. If wake-up failure, inter-process communication failure or module downtime occurs, the abnormal information will be detected, and after the abnormal function module is controlled to switch to bypass mode, the abnormal information will be reported to the upper hardware abstraction layer.

In one of the embodiments, the abnormality type also includes image freeze abnormality, wherein, when it is determined that image freeze abnormality occurs during the image output process, the output image data is also predicted to simulate the current frame image, so as to When the exception information is restored, the simulated current frame image is sent to the hardware abstraction layer as an output frame image, so that the hardware abstraction layer displays the simulated current frame image.

Specifically, when the abnormal function module performs adaptive abnormal recovery, it will cause the processing of image data to be suspended, which in turn will cause a short-term image freeze abnormality. Therefore, when it is determined that an abnormal image freeze occurs during the image output process, the image data may be pre-judged by the image processing chip to output a simulated current frame image. For example, if the current frame image includes a moving object, the moving object of the current frame image can be extracted as the image subject, and the area other than the moving object is used as the image background. Change trend, combined with the image background to generate a simulated current frame image. When the abnormal function module performs adaptive abnormal recovery, the simulated current frame image can be sent to the hardware abstraction layer as the output frame image, so that the hardware abstraction layer controls the display to display the simulated current frame image, thereby avoiding the output image freeze, so that The user is not aware of the abnormality of the underlying image processing chip, which improves the user experience.

In one of the embodiments, the abnormality type also includes content abnormality. When it is judged that content abnormality occurs during the image output process, the current frame image data is also simulated according to the historical frame image data, and the simulated current frame image data is replaced with the content abnormality. The current frame image data, so that when the exception information is restored, the simulated current frame image data is sent to the hardware abstraction layer as an output frame image, so that the hardware abstraction layer displays the simulated current frame image.

Further, determining the abnormal type according to the abnormal information includes: performing image preprocessing on the collected current frame image data, wherein the image preprocessing includes automatic exposure control, automatic gain control, automatic white balance control, lens correction, color correction, At least one or more of gamma correction and color space conversion; determine the difference information of image parameters between the processed current frame image data and the pre-processed current frame image data; determine that the abnormal type is content abnormal according to the difference information .

Specifically, after the image processing chip performs image preprocessing on the acquired current frame image data, it will compare the processed current frame image data with the pre-processed current frame image data. When comparing, each processing item can be compared one by one. Image parameters before and after processing, such as image white balance parameters, exposure parameters, gain parameters, lens correction parameters, color correction parameters, gamma correction parameters and color space conversion parameters, etc., determine the current frame image data after processing and the current frame before processing The difference information of the image parameters of the frame image data, and determine whether content abnormality occurs according to the difference information, wherein the content abnormality includes image black frame, image tearing and so on. When the difference of image parameters before and after processing is greater than a preset range, it can be determined that the image content is abnormal.

As shown in FIG. 4 , the image processing chip includes an image pre-processing module 11 , an abnormality detection module 12 , an image detection module 13 and an abnormality processing and frame insertion module 14 . Wherein, the image pre-processing module 11 is used to process the received original image data, and send the processed image data to the image detection module 12 . When actually identifying and judging an abnormal picture, the image processing chip can first cache the original image data before processing. After the image is processed, the image detection module 12 compares the output processed current frame image data with the buffered original image data, and analyzes the difference between the pixels or sub-regions between the two images before and after processing, wherein, The selection of pixels or sub-regions can be determined according to the shooting content and scene. Usually, the purpose of image pre-processing is to improve the quality of the image, so the processing of image data is carried out within the preset range. If the difference between the image data before and after processing exceeds the preset range, it can be judged as an error in the image processing process. If the image is abnormal, the image detection module 12 sends the image abnormality information to the abnormality processing and frame insertion module 14 . The exception processing and frame interpolation module 14 needs to intercept the current frame image data, simulate a current frame image according to the historical frame image data, and temporarily send it to the upper hardware abstraction layer for display, so as to avoid affecting the user experience. At the same time, the abnormality processing and frame interpolation module 14 also determines the abnormal function module in the image pre-processing module 11 according to the abnormal information of the image, and controls the abnormal function module to perform abnormal adaptive recovery processing.

When an abnormality occurs in the image pre-processing module 11 , the abnormality detection module 12 is used to obtain the abnormality information of the image pre-processing module 11 , identify the abnormality information to obtain the abnormality type, and send the abnormality type to the image detection module 12 . The image detection module 12 sends the abnormal information of the image pre-processing module 11 to the abnormal processing and frame interpolation module 14, and the abnormal processing and frame interpolation module 14 also starts its own abnormal recovery mechanism according to the abnormal information of the image pre-processing module 11, for example, for the module Restart or reinitialize, etc., for exception adaptive recovery processing.

The abnormality handling method applied to the image processing chip provided by the above embodiment actively initiates the detection of the abnormality of the system and the abnormality of the image. In the case of the abstraction layer, call the corresponding exception handling strategy to quickly perform adaptive recovery processing of the corresponding exception, and report the processing result and exception information to the hardware abstraction layer after the exception handling, so that the upper hardware abstraction layer has the basis for adaptive processing results and The ability to further judge and process abnormal information can better improve the robustness of the system, reduce the impact of abnormalities in the underlying image processing chip on the user experience, and improve user satisfaction.

As shown in FIG. 5 , another embodiment of the present disclosure provides an image processing chip, including an abnormality detection module 51 and an abnormality processing module 52 . Wherein, the abnormality detection module 51 is used for obtaining abnormality information during the image output process, and determining the type of abnormality according to the abnormality information. The exception processing module 52 is used to control the abnormal function module in the image processing chip to retry according to the abnormal type and/or control the abnormal function module to switch to the bypass mode before reporting the abnormal information, so as to perform abnormal self-recovery on the image processing chip deal with.

In one embodiment, the image processing chip includes multiple functional modules, and the abnormality information is obtained by each functional module detecting itself. After each functional module detects its own abnormal information, it sends the abnormal information to the abnormal detection module 51, and then the abnormal detection module 51 sends the abnormal information to the abnormal processing module 52, and the abnormal processing module 52 invokes the corresponding abnormal processing strategy according to the abnormal information And row exception adaptive recovery processing.

In one embodiment, the exception types include recoverable exceptions and unrecoverable exceptions. The exception handling module 52 is specifically used to control the retry of the exception function module when the exception type is a recoverable exception, so as to re-execute the function of the exception function module; channel mode, so that the abnormal function module outputs the received signal directly.

In one of the embodiments, after the abnormality processing module 52 controls the abnormal function module to retry, if the retry fails, it controls the abnormal function module to switch to the bypass mode and then retry.

In one of the embodiments, the abnormality type includes image freeze abnormality. When it is determined that an image freeze abnormality occurs during the image output process, the abnormal processing module 52 also predicts the output image data to simulate the current frame image, so that the simulated current frame image can be used as the The output frame image is sent to the hardware abstraction layer.

In one of the embodiments, the abnormality type includes content abnormality. When it is judged that content abnormality occurs during the image output process, the abnormality processing module 52 also simulates the current frame image data according to the historical frame image data, and replaces the simulated current frame image data. The current frame image data with abnormal content, so that when the abnormal information is restored, the simulated current frame image data is sent to the hardware abstraction layer as an output frame image, so that the hardware sampling layer displays the simulated current frame image.

In one of the embodiments, the abnormality detection module 51 is specifically configured to perform image preprocessing on the collected current frame image data, determine the difference information between the processed current frame image data and the pre-processed current frame image data, according to The difference information determines that the exception type is a content exception.

It should be noted that, for the description of the image processing chip in the present disclosure, please refer to the description of the exception handling method applied to the image processing chip in the present disclosure, and details will not be repeated here.

In the image processing chip provided by the above embodiments, the abnormal information in the image output process is obtained through the abnormal detection module, and the abnormal type is determined according to the abnormal information, and the abnormal information is controlled by the abnormal processing module before reporting the abnormal information. The abnormal function module retries and/or controls the abnormal function module to switch to the bypass mode to perform abnormal self-recovery processing on the image processing chip, and then the image processing chip can call the corresponding The exception handling strategy quickly performs adaptive recovery processing corresponding to the exception, and reports the processing result and exception information to the hardware abstraction layer after exception handling, so that the upper hardware abstraction layer can make further judgment and processing based on the adaptive processing result and exception information ability, so as to better improve the robustness of the system, and at the same time reduce the impact of abnormalities in the underlying image processing chip on the user experience and improve user satisfaction.

Another embodiment of the present disclosure provides an electronic device, including a memory, a processor, and an exception handling program applied to an image processing chip stored on the memory and operable on the processor, and the processor executes the program applied to the image processing chip When the exception handling program is used, the aforementioned exception handling method applied to the image processing chip is implemented.

The above-mentioned electronic device, through the above-mentioned exception handling method applied to the image processing chip, can call the corresponding exception handling strategy to quickly perform adaptive recovery processing corresponding to the exception after detecting the abnormal information without affecting the upper hardware abstraction layer. After exception handling, the processing results and abnormal information are reported to the hardware abstraction layer, so that the upper hardware abstraction layer has the ability to further judge and process according to the adaptive processing results and abnormal information, so as to better improve the robustness of the system , and at the same time reduce the impact of the abnormality of the underlying image processing chip on the user experience, and improve user satisfaction.

Yet another embodiment of the present disclosure provides a computer-readable storage medium, on which is stored an exception handling program applied to an image processing chip. When the exception handling program applied to an image processing chip is executed by a processor, the aforementioned application to An exception handling method of an image processing chip.

The above-mentioned computer-readable storage medium, through the above-mentioned exception handling method applied to the image processing chip, can call the corresponding exception handling strategy to quickly perform adaptive adaptation to the corresponding exception after the abnormal information is detected without affecting the upper hardware abstraction layer Resume processing, and report the processing results and abnormal information to the hardware abstraction layer after exception processing, so that the upper hardware abstraction layer has the ability to make further judgments and processing according to the adaptive processing results and abnormal information, so as to better improve the performance of the system Robustness, while reducing the impact of abnormalities in the underlying image processing chip on user experience and improving user satisfaction.

It should be noted that the logic and/or steps shown in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, apparatus, or device and execute instructions), or in combination with these Instructions are used to execute systems, devices, or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.

It should be understood that various parts of the present disclosure may be implemented in hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

In this disclosure, terms such as "installation", "connection", "connection" and "fixation" should be interpreted in a broad sense, for example, it can be a fixed connection or a detachable connection unless otherwise clearly defined and limited. , or integrated; it may be mechanically connected or electrically connected; it may be directly connected or indirectly connected through an intermediary, and it may be the internal communication of two components or the interaction relationship between two components, unless otherwise specified limit. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present disclosure according to specific situations.

Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present disclosure, and those skilled in the art can understand the above-mentioned embodiments within the scope of the present disclosure. The embodiments are subject to changes, modifications, substitutions and variations.

Claims

An exception handling method applied to an image processing chip, including:

Obtaining abnormal information during the image output process, and determining the abnormal type according to the abnormal information;

Before reporting the abnormal information, control the abnormal function module in the image processing chip to retry according to the abnormal type and/or control the abnormal function module to switch to a bypass mode, so as to control the image processing chip Perform exception self-recovery processing.
The abnormality handling method according to claim 1, wherein the image processing chip includes a plurality of functional modules, and the abnormality information is obtained by self-testing of each functional module.
The exception handling method according to claim 1 or 2, wherein the exception types include recoverable exceptions and unrecoverable exceptions, wherein the abnormal function modules in the image processing chip are controlled according to the exception types to perform retry and /or control the abnormal function module to switch to bypass mode, including:

When the exception type is a recoverable exception, control the abnormal function module to retry, so as to re-execute the function of the abnormal function module;

When the abnormality type is an unrecoverable abnormality, the abnormal function module is controlled to switch to a bypass mode, so that the abnormal function module directly outputs the received signal.
The exception handling method according to claim 3, wherein after controlling the abnormal function module to retry, if the retry fails, then control the abnormal function module to switch to a bypass mode and then retry.
The abnormality handling method according to claim 1, wherein the abnormality type includes an image freeze abnormality, wherein when it is determined that an image freeze abnormality occurs during the image output process, the output image data is also predicted, so as to Simulating the current frame image, so that when the exception information is restored, the simulated current frame image is sent to the hardware abstraction layer as an output frame image, so that the hardware abstraction layer displays the simulated current frame image.
The exception handling method according to claim 1, wherein the exception type includes content exception, wherein, when it is determined that a content exception occurs during the image output process, the current frame image data is also simulated according to the historical frame image data, and the The simulated current frame image data replaces the current frame image data whose content is abnormal, so that the simulated current frame image data is sent to the hardware abstraction layer as an output frame image when the abnormal information is restored, so that the hardware abstraction layer displays the current frame image of the simulation.
The exception handling method according to claim 6, wherein determining the exception type according to the exception information includes:

Perform image preprocessing on the collected current frame image data, wherein the image preprocessing includes at least one of automatic exposure control, automatic gain control, automatic white balance control, lens correction, color correction, gamma correction, and color space conversion or more;

Determine the difference information of image parameters between the processed current frame image data and the pre-processed current frame image data;

It is determined according to the difference information that the exception type is content exception.
Image processing chips, including:

An abnormality detection module, configured to obtain abnormality information during the image output process, and determine an abnormality type according to the abnormality information;

The exception processing module, before reporting the exception information, controls the abnormal function module in the image processing chip to retry according to the exception type and/or controls the abnormal function module to switch to a bypass mode, so as to The above image processing chip performs abnormal self-recovery processing.
The image processing chip according to claim 8, wherein the image processing chip includes a plurality of functional modules, and the abnormality information is obtained by self-testing of each of the functional modules.
The image processing chip according to claim 8 or 9, wherein the exception types include recoverable exceptions and unrecoverable exceptions;

When the exception type is a recoverable exception, the exception handling module is specifically used to control the retry of the exception function module to re-execute the function of the exception function module;

When the exception type is an unrecoverable exception, the exception handling module is specifically configured to control the exception function module to switch to a bypass mode, so that the exception function module directly outputs the received signal.
The image processing chip according to claim 10, wherein the abnormality processing module is further configured to, after controlling the abnormal function module to retry, if the retry fails, control the abnormal function module to switch to the bypass mode Retry.
The image processing chip according to claim 8, wherein the abnormal type includes an abnormal image freeze;

When the abnormality detection module determines that the image freezes abnormally during the image output process, the abnormality processing module also predicts the output image data to simulate the current frame image, so that when the abnormal information is restored Send the simulated current frame image to the hardware abstraction layer as the output frame image.
The image processing chip according to claim 8, wherein the exception type includes content exception;

When the abnormality detection module determines that the content is abnormal during the image output process, the abnormality processing module also simulates the current frame image data according to the historical frame image data, and replaces the current frame with the abnormal content by the simulated current frame image data Image data, so that the simulated current frame image data is sent to the hardware abstraction layer as an output frame image when restoring the abnormal information, so that the hardware sampling layer displays the simulated current frame image.
The image processing chip according to claim 13, wherein the abnormality detection module is specifically used for:

Perform image preprocessing on the collected current frame image data, wherein the image preprocessing includes at least one of automatic exposure control, automatic gain control, automatic white balance control, lens correction, color correction, gamma correction, and color space conversion or more;

Determine the difference information of image parameters between the processed current frame image data and the pre-processed current frame image data;

It is determined according to the difference information that the exception type is content exception.
The electronic equipment includes a memory, a processor, and an exception handling program applied to an image processing chip stored on the memory and operable on the processor. When the processor executes the exception handling program applied to the image processing chip, the The exception handling method applied to an image processing chip according to any one of claims 1-7.
A computer-readable storage medium, on which an exception handling program applied to an image processing chip is stored, and when the exception handling program applied to an image processing chip is executed by a processor, the method described in any one of claims 1-7 is realized. An exception handling method applied to an image processing chip.