CN112822371B - Image processing chip, application processing chip, data statistical system and method - Google Patents
Image processing chip, application processing chip, data statistical system and method Download PDFInfo
- Publication number
- CN112822371B CN112822371B CN202110043784.6A CN202110043784A CN112822371B CN 112822371 B CN112822371 B CN 112822371B CN 202110043784 A CN202110043784 A CN 202110043784A CN 112822371 B CN112822371 B CN 112822371B
- Authority
- CN
- China
- Prior art keywords
- shooting
- processing chip
- camera
- target
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
Abstract
The application provides an image processing chip, an application processing chip, a data statistical system and a method, wherein the image processing chip acquires indication information for indicating target shooting parameters needing to be updated of a camera from the application processing chip through a first processing unit, and the indication information is generated by the application processing chip according to scene state information of a shooting scene of the camera and attitude information of the camera. In addition, the image processing chip also carries out data statistics on the scene images of the shooting scene collected by the camera through the data statistics unit to obtain target data required by updating the target shooting parameters. Therefore, when the image processing chip provided by the application is applied to the electronic equipment, the electronic equipment can determine the target shooting parameters needing to be updated by the camera in real time and update the target shooting parameters as required, so that meaningless parameter updating is avoided, corresponding data statistics work is reduced, the purpose of reducing the occupation of processing resources is achieved, and meanwhile, the power consumption of the electronic equipment is reduced.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processing chip, an application processing chip, a data statistics system and a data statistics method.
Background
At present, users usually use electronic devices (such as digital cameras, smart phones, etc.) with cameras to capture images, thereby recording things happening around, scenes seen, etc. anytime and anywhere. In the related art, in order to more conveniently capture a high-quality image, an electronic device is capable of automatically determining a capturing parameter for capturing without intervention of a user. In the shooting process, the electronic device can update the shooting parameters in real time, and the updating of the shooting parameters requires continuous statistics on the relevant data of the shot images to calculate new shooting parameters, which significantly increases the occupation of processing resources of the electronic device, and the power consumption is increased accordingly.
Disclosure of Invention
The embodiment of the application provides an image processing chip, an application processing chip, a data statistical system and a method, which can reduce the occupation of processing resources of electronic equipment by shooting operation and reduce the power consumption of the electronic equipment.
The application discloses image processing chip includes:
the camera comprises a first processing unit, a second processing unit and a control unit, wherein the first processing unit is used for acquiring indication information for indicating target shooting parameters which need to be updated by a camera from an application processing chip, and the application processing chip generates the indication information according to scene state information of a shooting scene of the camera and attitude information of the camera;
and the data statistics unit is used for carrying out data statistics on the scene image of the shooting scene collected by the camera according to the indication information to obtain target data required by updating the target shooting parameters.
The present application also discloses an application processing chip, which is characterized by comprising:
the third data interface is used for acquiring scene state information of a shooting scene of the camera and attitude information of the camera;
the second processing unit is used for determining target shooting parameters needing to be updated by the camera according to the scene state information and the attitude information;
and the fourth data interface is used for transmitting indication information to an image processing chip, and the image processing chip is indicated by the indication information to perform data statistics on the scene image of the shooting scene acquired by the camera so as to obtain target data required by updating the target shooting parameters.
The application discloses a data statistical system, comprising an image processing chip and an application processing chip, wherein,
the application processing chip is used for acquiring scene state information of a shooting scene of the camera and attitude information of the camera; determining target shooting parameters needing to be updated by the camera according to the scene state information and the attitude information;
the image processing chip is used for carrying out data statistics on the scene image of the shooting scene collected by the camera to obtain target data required by updating the target shooting parameters.
The application discloses a data statistical method, which comprises the following steps:
acquiring scene state information of a shooting scene of a camera and attitude information of the camera;
determining target shooting parameters needing to be updated by the camera according to the scene state information and the attitude information;
and performing data statistics on the scene image of the shooting scene acquired by the camera to obtain target data required by updating the target shooting parameters.
When the image processing chip provided by the application is applied to the electronic equipment, the electronic equipment can determine the target shooting parameters of the camera to be updated in real time and update the target shooting parameters as required, so that meaningless parameter updating is avoided, corresponding data statistics work is reduced, the purpose of reducing occupation of processing resources is achieved, and meanwhile, the power consumption of the electronic equipment is also reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below.
Fig. 1 is a schematic structural diagram of an image processing chip according to an embodiment of the present disclosure.
Fig. 2 is a schematic diagram illustrating an application of a processing chip to determine target shooting parameters in an embodiment of the present application.
Fig. 3 is a schematic structural diagram of an application processing chip according to an embodiment of the present application.
Fig. 4 is a schematic flow chart of a data statistical method according to an embodiment of the present application.
Detailed Description
It is to be appreciated that the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.
Relational terms such as first and second, and the like may be used solely to distinguish one object or operation from another object or operation without necessarily limiting the actual sequential relationship between the objects or operations.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an image processing chip 100 according to an embodiment of the present disclosure, and as shown in fig. 1, the image processing chip 100 includes a first processing unit 110 and a data statistics unit 120, wherein,
a first processing unit 110, configured to acquire instruction information for instructing a target shooting parameter that needs to be updated by a camera from an application processing chip, where the application processing chip generates the instruction information according to scene state information of a shooting scene of the camera and pose information of the camera;
and the data statistics unit 120 is configured to perform data statistics on the scene image of the shooting scene acquired by the camera according to the indication information, so as to obtain target data required by updating the target shooting parameters.
It should be noted that the image processing chip 100 provided in the present application may be configured in an electronic device with a camera, and is used for counting relevant data required for updating shooting parameters of the camera. The electronic device may be a mobile electronic device with a camera, such as a smart phone, a tablet computer, a palm computer, and a notebook computer, or may be a fixed electronic device with a camera, such as a desktop computer and a television.
The embodiment of the present application does not specifically limit the types and the number of the cameras configured for the electronic device, and the cameras configured for the electronic device may be configured by a person of ordinary skill in the art according to actual needs, for example, taking a focal length as a division standard of the camera type, and the cameras configured for the electronic device include, but are not limited to, a standard camera, a wide-angle camera, an ultra-wide-angle camera, a telephoto camera, and the like.
In general, a camera head is composed of a plurality of parts, mainly including a lens, a motor, and an image sensor. The lens is used for projecting an external optical signal to the image sensor; the image sensor is used for performing photoelectric conversion on the optical signal projected by the lens and converting the optical signal into an available electric signal to obtain original image data; the motor is used for driving the lens to move, so that the distance between the lens and the image sensor is adjusted to meet an imaging formula (or a lens imaging formula, a Gaussian imaging formula and the like), and imaging is clear.
Based on the hardware capability of the camera, in the embodiment of the present application, the camera is configured to acquire a scene image of a shooting scene. The shooting scene can be understood as a scene aimed at by the camera after being enabled, that is, a scene in which the camera can convert the optical signal into corresponding image data. For example, after the electronic device enables the camera according to the user operation, if the user controls the camera of the electronic device to align with a scene including a certain object, the scene including the object is a shooting scene of the camera.
From the above description, it will be understood by those skilled in the art that the shooting scene is not specific to a particular scene, but is a scene aligned in real time following the orientation of the camera. In general, a shooting scene includes not only a single object but also various objects. For example, when a person is photographed in a certain photographing scene, the photographing scene of the camera may include not only the photographing object "person who performs person photographing", but also other objects such as lawns, trees, buildings, and the like.
In order to more conveniently shoot high-quality images, the electronic equipment automatically determines shooting parameters for shooting. For example, the electronic device determines the focus parameters using an auto-focus algorithm, determines the white balance parameters using an auto-white balance algorithm, and determines the exposure parameters using an auto-exposure algorithm. Accordingly, in order to determine these shooting parameters, the electronic device needs to perform data statistics on the shot images to obtain the data required by the related algorithm. For example, the electronic device counts contrast data of images shot by a camera, and determines focusing parameters by using the contrast data obtained by counting; for another example, the electronic device counts brightness data of images shot by the camera, and determines exposure parameters by using the counted brightness data; for another example, the electronic device performs statistics on color temperature data of images shot by the camera, and determines a white balance parameter and the like by using the color temperature data obtained through the statistics.
In the embodiment of the application, the shooting parameters of the electronic equipment do not need to be calculated all the time, but are calculated only when the shooting parameters need to be updated. For example, when the distance between the photographic subject in the photographic scene and the camera of the electronic device is not changed, the focusing parameters do not need to be recalculated, and when the distance between the photographic subject in the photographic scene and the camera of the electronic device is changed, the focusing parameters need to be recalculated and updated.
Based on this, in the embodiment of the present application, a parameter determination policy is configured in advance on an original application processing chip of the electronic device (for example, the application processing chip is the original application processing chip of the electronic device, and the application processing chip may integrate devices such as a central processing unit, a graphics processing unit, and an image signal processing unit), and the parameter determination policy is based on scene state information of a shooting scene and pose information of a camera in the electronic device and is used for determining shooting parameters that the camera needs to be updated. It should be noted that the setting of the parameter determination policy is not particularly limited, and may be configured by those skilled in the art according to actual needs.
As described above, the application processing chip determines the strategy by using the pre-configured parameters, and determines the shooting parameters that need to be updated by the camera according to the scene state information of the shooting scene of the camera and the attitude information of the camera, and records the shooting parameters as the target shooting parameters, as shown in fig. 2.
The application processing chip can analyze the scene image of the shooting scene collected by the camera to obtain the scene state information of the shooting scene through analysis, and can also obtain the scene state information of the shooting scene through a sensor which is arranged on the electronic equipment and is related to the scene state. In addition, the application processing chip can acquire the attitude information of the camera through a sensor which is arranged on the electronic equipment and is related to the attitude.
After determining the target shooting parameters needed to be updated by the camera, the application processing chip instructs the image processing chip 100 to count the target data needed to update the target shooting parameters through the indication information.
The image processing chip 100 obtains, through the first processing unit 110, instruction information for instructing a camera to update a target shooting parameter from the application processing chip, and performs data statistics on a scene image of a shooting scene acquired by the camera according to the instruction information through the data statistics unit 120 to obtain target data required by updating the target shooting parameter, which is recorded as target data.
It should be noted that the type of the data counted by the data counting unit 120 depends not only on the target shooting parameters determined by the application processing chip, but also on the related shooting parameter calculation algorithm adopted by the electronic device. For example, if the application processing chip determines the focusing parameters as the target shooting parameters and the adopted automatic focusing algorithm is a contrast focusing algorithm, the data statistics unit 120 performs statistics on the contrast data of the scene image of the shooting scene acquired by the camera; for another example, if the focusing parameters are determined as the target shooting parameters and the adopted automatic focusing algorithm is a phase focusing algorithm, the data statistics unit 120 performs statistics on the phase data of the scene image of the shooting scene collected by the camera.
From the above, the image processing chip provided by the present application is composed of two parts, which are the first processing unit and the data statistics unit respectively. The image processing chip acquires indication information for indicating target shooting parameters needing to be updated by the camera from the application processing chip through the first processing unit, and the indication information is generated by the application processing chip according to scene state information of a shooting scene of the camera and attitude information of the camera. In addition, the image processing chip also carries out data statistics on the scene images of the shooting scene collected by the camera through the data statistics unit to obtain target data required by updating the target shooting parameters. Therefore, when the image processing chip provided by the application is applied to the electronic equipment, the electronic equipment can determine the target shooting parameters needing to be updated by the camera in real time and update the target shooting parameters as required, so that meaningless parameter updating is avoided, corresponding data statistics work is reduced, the purpose of reducing the occupation of processing resources is achieved, and meanwhile, the power consumption of the electronic equipment is reduced.
Optionally, in an embodiment, the first processing unit 110 is configured to receive, through a first data interface with the application processing chip, the indication information transmitted by the application processing chip.
Optionally, in an embodiment, the first processing unit 110 includes a first data interface, and the first processing unit 110 is configured to receive, through the first data interface, the indication information transmitted by the application processing chip.
In the embodiment of the present application, the first processing unit 110 includes a first data interface, which is used for performing interaction of control information with the application processing chip. Correspondingly, after determining the target shooting parameters that the camera needs to update, the application processing chip generates indication information according to a preconfigured data format, and transmits the indication information to the first data interface of the first processing unit 110. On the other hand, the first processing unit 110 receives the indication information transmitted by the application processing chip through the first data interface, and determines the target shooting parameters that the camera needs to update through the indication information.
It should be noted that, in the embodiment of the present application, no specific limitation is imposed on what kind of data Interface is selected as the first data Interface for transmitting the aforementioned indication information, and a person having ordinary skill in the art may select the data Interface according to actual needs, for example, a General-purpose input/output (GPIO) Interface may be selected as the first data Interface, an SPI (Serial Peripheral Interface) may also be selected as the first data Interface, and other data interfaces not listed in the embodiment of the present application may also be selected as the first data Interface.
Optionally, in an embodiment, the first processing unit 110 includes an interrupt pin, the indication information includes an interrupt signal, and the first processing unit 110 is configured to receive the interrupt signal transmitted by the application processing chip through the interrupt pin.
In order to quickly instruct the image processing chip 100 to count the target data required for updating the target shooting parameters, in the embodiment of the present application, the application processing chip instructs the image processing chip 100 in a hardware interrupt manner.
The first processing unit 110 further includes an interrupt pin. After determining the target shooting parameters that the camera needs to update, the application processing chip generates an interrupt signal corresponding to the target shooting parameters, and transmits the interrupt signal as indication information to an interrupt pin of the first processing unit 110. Accordingly, the first processing unit 110 will receive the interrupt signal transmitted by the application processing chip through the interrupt pin.
Optionally, in an embodiment, the first processing unit 110 further includes a second data interface, and the first processing unit 110 is further configured to adjust an interface frequency of the second data interface according to the data amount of the target data; and transmitting the target data to the application processing chip through the second data interface after the interface frequency is adjusted, so that the application processing chip updates the target shooting parameters of the camera according to the target data.
In this embodiment, the first processing unit 110 further includes a second data interface, configured to interact with the application processing chip for data information. After the data statistics unit 120 counts the target data required for updating the target shooting parameter, the first processing unit 110 transmits the counted target data to the application processing chip through the second data interface.
It should be noted that, in the embodiment of the present application, no particular limitation is imposed on what kind of data Interface is selected as the second data Interface for transmitting the aforementioned target data, and a person of ordinary skill in the art may select the data Interface according to actual needs, for example, an MIPI (Mobile Industry Processor Interface) Interface may be selected as the second data Interface, a PCIe (Peripheral Component Interconnect Express) Interface may also be selected as the second data Interface, and other data interfaces not listed in the embodiment of the present application may also be selected as the second data Interface.
In order to transmit the target data more flexibly, the interface frequency of the second data interface is dynamically adjusted in the embodiment of the present application. It will be appreciated that, assuming other operating parameters of the second data interface are unchanged, the bandwidth of the second data interface will correspondingly increase as its interface frequency increases, and will correspondingly decrease as its interface frequency decreases. Based on this, in the embodiment of the present application, a corresponding relationship between the data volume and the interface frequency is established in advance, and is used for determining the interface frequency matched with the data volume of the statistical target data in real time according to the data volume of the statistical target data.
Correspondingly, after the data statistics unit 120 counts the target data required for updating the target shooting parameter, the first processing unit 110 further obtains the data volume of the target data, determines the corresponding interface frequency according to the pre-established correspondence between the data volume and the interface frequency, and further adjusts the interface frequency of the second data interface to the determined interface frequency. Then, the data statistics unit transmits the target data obtained by statistics by the data statistics unit 120 to the application processing chip through the second data interface after adjusting the interface frequency, so that the application processing chip updates the target shooting parameters of the camera according to the target data.
Optionally, in an embodiment, the number of the data statistics units 120 is multiple, and the first processing unit 110 is further configured to determine a target data statistics unit corresponding to the target shooting parameter from the multiple data statistics units 120; enabling the target data statistical unit and disabling the non-target data statistical unit;
the target data counting unit is used for counting target data.
It should be noted that the image processing chip includes the data statistics unit 120 in a number that depends on the shooting parameter calculation algorithm (such as an auto-focus algorithm, an auto-white balance algorithm, and an auto-exposure algorithm) supported by the application processing chip.
Illustratively, it is assumed that the image processing chip 100 includes three data statistics units 120, which are an a data statistics unit, a B data statistics unit, and a C data statistics unit. Wherein, the A data statistical unit is configured to statistically update data required for the focusing parameter, the B data statistical unit is configured to statistically update data required for the white balance parameter, and the C statistical unit is configured to statistically update data required for the exposure parameter.
For example, if the application processing chip determines the focusing parameter as the target shooting parameter, the first processing unit 110 determines the a data statistical unit as the target data statistical unit according to the indication information of the application processing chip, enables the a data statistical unit accordingly, and enables the a data statistical unit to statistically update the target data required for the focusing parameter.
For another example, if the application processing chip determines the white balance parameter and the exposure parameter as the target shooting parameters, the first processing unit 110 determines the B data statistic unit and the C data statistic unit as target data statistic units according to the indication information of the application processing chip, and enables the B data statistic unit and the C data statistic unit accordingly, the B data statistic unit counts target data required for updating the white balance parameter, the C data statistic unit counts target data required for updating the exposure parameter, and the B data statistic unit and the C data statistic unit are enabled.
Optionally, in an embodiment, the target data statistics unit is configured to, when a line of image data in the scene image is received, perform statistics on the target data for the line of image data.
In the embodiment of the present application, for a frame of complete image, the camera does not transmit the whole image to the image processing chip 100 after acquiring a frame of complete image, but performs image acquisition and transmission in units of lines, acquires image data line by line, and transmits the acquired image data to the image processing chip 100. Illustratively, after the camera acquires the first line of image data, the acquired first line of image data is transmitted to the image processing chip 100, meanwhile, the next line of image data is continuously acquired, and the next line of image data is transmitted and acquired again, and the process is repeated until the last line of image data is acquired, and the last line of image data is transmitted to the image processing chip 100, so that the acquisition and transmission of one frame of scene image are completed.
In order to complete the statistics of the target data more efficiently, the target data statistics unit performs the statistics of the target data on one line of image data in the scene image received from the camera, that is, on the line of image data. Accordingly, when a complete scene image is received, the target data statistics unit will complete the statistics of the target data of the scene image accordingly.
Optionally, in an embodiment, the image processing chip 100 further includes:
an image signal processing unit, configured to perform a first optimization processing on the scene image after the data statistics unit 120 completes statistics on target data of the scene image;
and the neural network processing unit is used for carrying out second optimization processing on the scene image subjected to the first optimization processing.
In the embodiment of the present application, the pre-image signal processor 120 further includes an image signal processing unit and a neural network processing unit. After the data statistics unit 120 completes statistics on the target data of the scene image, the image signal processing unit is configured to perform a first optimization process on the scene image, including but not limited to a non-artificial intelligence-based optimization processing manner such as dead pixel correction process, time domain noise reduction process, 3D noise reduction process, linearization process, black level correction process, and the like. Of course, optimization processing modes not listed in the application can be included.
Furthermore, the neural network processing unit is configured to perform the second optimization processing on the scene image after the first optimization processing is performed by the image signal processing unit. The mode of processing the image data by the neural network processing unit may be reading the data block in a line-by-line mode and processing the data block in a line-by-line mode. Such as a neural network processing unit, reads blocks of data in a multi-line fashion and processes the blocks of data in a multi-line fashion. It will be appreciated that a frame of image data may have multiple rows of data blocks, i.e. the neural network processing unit may process a portion of the frame of image data, such as an n row of data blocks, where n is a positive integer, such as 2, 4, 5, etc. When the neural network processing unit does not completely process the frame of image data, the neural network processing unit may store the data of the multiple data blocks processed by the neural network processing unit in the process of processing the frame of image data by a built-in buffer.
It should be noted that, the neural network processing unit may complete the processing according to a preset time in the data stream. The preset time is, for example, 30fps =33ms (milliseconds). Or the preset time for processing one frame of image by the neural network processing unit is 33ms, so that the real-time transmission of data can be realized on the basis of quickly processing image data by the neural network processing unit.
The second optimization processing performed by the neural network processing unit includes, but is not limited to, an artificial intelligence-based optimization processing manner such as a night scene algorithm, an HDR algorithm, a blurring algorithm, a noise reduction algorithm, a super-resolution algorithm, and the like. Of course, optimization processing modes not listed in the application can be included.
As can be seen from the above, the optimization process performed by the pre-image signal processor 120 is divided into two parts, namely, a first optimization process based on non-artificial intelligence performed by the image signal processing unit and a second optimization process based on artificial intelligence performed by the neural network processing unit.
Optionally, in an embodiment, the scene state information includes an ambient brightness of the shooting scene acquired by the application processing chip through the ambient light sensor, an ambient color temperature of the shooting scene acquired by the color temperature sensor, and a current distance between the shooting object and the camera in the shooting scene acquired by the distance sensor.
Optionally, in an embodiment, the indication information includes indication information that is generated by the application processing chip and used for indicating that the exposure parameter is taken as the target shooting parameter when the change of the ambient brightness of the shooting scene is recognized according to the ambient brightness and/or the change of the posture of the camera is recognized according to the posture information; and/or
When the application processing chip identifies that the environmental color temperature of a shooting scene changes according to the environmental color temperature and/or identifies that the posture of the camera changes according to the posture information, the application processing chip generates indication information for indicating that the white balance parameter is used as a target shooting parameter; and/or
And when the application processing chip identifies that the distance between the shooting object and the camera is changed according to the current distance, the application processing chip generates indication information for indicating that the focusing parameter is taken as a target shooting parameter.
Referring to fig. 3, the present application further provides an application processing chip 200, as shown in fig. 3, the application processing chip 200 includes:
a third data interface 210, configured to obtain scene state information of a shooting scene of a camera and pose information of the camera;
the second processing unit 220 is configured to determine target shooting parameters that need to be updated by the camera according to the scene state information and the posture information;
and a fourth data interface 230, configured to transmit the indication information to the image processing chip, and instruct the image processing chip to perform data statistics on a scene image of a shooting scene acquired by the camera through the indication information, so as to obtain target data required for updating the target shooting parameters.
It should be noted that the application processing chip 200 provided in the present application may be configured in an electronic device having a camera and an image processing chip provided in the present application, and is used for statistically updating relevant data required by shooting parameters of the camera in cooperation with the image processing chip. The electronic device may be a mobile electronic device with a camera, such as a smart phone, a tablet computer, a palm computer, and a notebook computer, or a fixed electronic device with a camera, such as a desktop computer and a television.
The type and number of the cameras configured for the electronic device are not specifically limited in the embodiments of the present application, and may be configured by a person of ordinary skill in the art according to actual needs, for example, taking a focal length as a division standard of the camera type, where the cameras configured for the electronic device include, but are not limited to, a standard camera, a wide-angle camera, an ultra wide-angle camera, a telephoto camera, and the like.
Based on the hardware capability of the camera, in the embodiment of the present application, the camera is configured to acquire a scene image of a shooting scene. The shooting scene can be understood as a scene aimed at by the camera after being enabled, that is, a scene in which the camera can convert the optical signal into corresponding image data. For example, after the electronic device enables the camera according to the user operation, if the user controls the camera of the electronic device to align a scene including a certain object, the scene including the object is a shooting scene of the camera.
From the above description, it will be understood by those skilled in the art that the shooting scene is not specific to a particular scene, but is a scene aligned in real time following the orientation of the camera. In general, a shooting scene includes not only a single object but also various objects. For example, when a person is photographed in a certain photographing scene, the photographing scene of the camera may include not only the photographing object "person who performs person photographing," but also other objects such as lawns, trees, buildings, and the like.
In order to more conveniently shoot high-quality images, the application processing chip 200 automatically determines shooting parameters to control the camera to shoot. For example, the application processing chip 200 determines the focusing parameters by using an auto-focusing algorithm, determines the white balance parameters by using an auto-white balance algorithm, and determines the exposure parameters by using an auto-exposure algorithm. Accordingly, in order to determine these shooting parameters, data statistics needs to be performed on the shot images to obtain the data required by the related algorithm. For example, the contrast data of the image shot by the camera is counted, and the focusing parameters are determined by using the contrast data obtained through counting; for another example, the brightness data of the images shot by the camera is counted, and the exposure parameters are determined by using the brightness data obtained by counting; for another example, color temperature data of images shot by a camera is counted, and white balance parameters and the like are determined by using the color temperature data obtained through counting.
In the embodiment of the application, the shooting parameters of the camera are not required to be calculated all the time, but are calculated only when the shooting parameters need to be updated. For example, when the distance between the photographic subject and the camera in the photographic scene is not changed, the focusing parameters do not need to be recalculated, and when the distance between the photographic subject and the camera in the photographic scene is changed, the focusing parameters need to be recalculated and updated.
Based on this, in the embodiment of the present application, a parameter determination policy is configured in advance in the second processing unit 220 of the application processing chip 200, where the parameter determination policy is based on scene state information of a shooting scene and pose information of a camera, and is used to determine shooting parameters that the camera needs to update. It should be noted that the setting of the parameter determination policy is not particularly limited, and may be configured by those skilled in the art according to actual needs.
The third data interface 210 obtains scene state information of a shooting scene through a sensor related to a scene state and arranged by the electronic device, and obtains posture information of the camera through a sensor related to a posture and arranged by the electronic device.
After the third data interface 210 acquires the scene state information of the shooting scene of the camera and the posture information of the camera, the second processing unit 220 determines a target shooting parameter that needs to be updated by using the configured parameter determination policy according to the scene state information and the posture information, and generates indication information for indicating the target shooting parameter.
After the second processing unit 220 generates the indication information indicating the target shooting parameters, the fourth data interface 230 transmits the indication information to the image processing chip, and the image processing chip is instructed by the indication information to perform data statistics on the scene images of the shooting scene collected by the camera, so as to obtain the target data required for updating the target shooting parameters.
It should be noted that the type of the data counted by the image processing chip not only depends on the target shooting parameters determined by the application processing chip 200, but also depends on the related shooting parameter calculation algorithm adopted by the application processing chip 200. For example, if the application processing chip 200 determines the focusing parameters as the target shooting parameters and the automatic focusing algorithm adopted by the application processing chip 200 is a contrast focusing algorithm, the image processing chip counts the contrast data of the scene image of the shooting scene collected by the camera; for another example, if the application processing chip 200 determines the focusing parameters as the target shooting parameters and the automatic focusing algorithm adopted by the application processing chip 200 is a phase focusing algorithm, the image processing chip will perform statistics on the phase data of the scene image of the shooting scene acquired by the camera.
Optionally, in an embodiment, the third data interface 210 is configured to obtain an ambient brightness of the shooting scene through an ambient light sensor; acquiring the ambient color temperature of a shooting scene through a color temperature sensor; acquiring the current distance between a shooting object and a camera in a shooting scene through a distance sensor; taking the environment brightness, the environment color temperature and the current distance as scene state information; and acquiring attitude information through the attitude sensor.
In the embodiment of the application, the electronic device configured by the application processing chip is further configured with an ambient light sensor, a color temperature sensor, a distance sensor and an attitude sensor. The types of the ambient light sensor, the color temperature sensor, the distance sensor, and the attitude sensor are not particularly limited and may be selected by those skilled in the art according to actual needs. For example, the types of distance sensors include, but are not limited to, laser distance sensors, ultrasonic distance sensors, infrared distance sensors, and the like.
In the embodiment of the present application, the third data interface 210 implements collection of scene state information of a shooting scene and posture information of a camera by using the above sensor.
The third data interface 210 obtains the ambient brightness of the shooting scene through an ambient light sensor, obtains the ambient color temperature of the shooting scene through a color temperature sensor, obtains the current distance between the shooting object and the camera in the shooting scene through a distance sensor, and uses the obtained ambient brightness, the obtained ambient color temperature and the obtained current distance as the scene state information of the shooting scene. In addition, the third data interface 210 also acquires the attitude information of the camera through the attitude sensor.
Optionally, in an embodiment, the attitude sensor includes an angular velocity sensing module and an acceleration sensing module, and the third data interface 210 is further configured to obtain an angular velocity of the camera through the angular velocity sensing module, and obtain an acceleration of the camera through the acceleration sensing module; and using the angular velocity and the acceleration as attitude information.
Optionally, in an embodiment, the second processing unit 220 is configured to determine whether to determine the exposure parameter as the target shooting parameter according to the ambient brightness and the pose information; determining whether the white balance parameter is determined as a target shooting parameter according to the environmental color temperature and the posture information; and determining whether the focusing parameter is determined as the target shooting parameter according to the current distance.
In the embodiment of the present application, the configured parameter determination policy includes:
determining whether the exposure parameters are determined as target shooting parameters or not according to the environment brightness and the posture information;
determining whether the white balance parameter is determined as a target shooting parameter according to the environmental color temperature and the posture information;
and determining whether the focusing parameters are determined as target shooting parameters according to the current distance.
In the embodiment of the application, the exposure parameters are mainly sensitive to the ambient brightness, so that whether the ambient brightness of the shooting scene changes or not can be identified according to the acquired ambient brightness, and if the ambient brightness does not change and the posture of the camera does not change, the exposure parameters of the camera do not need to be updated. Accordingly, when determining whether the exposure parameter is determined as the target shooting parameter according to the ambient brightness and the pose information, the second processing unit 220 may obtain the historical ambient brightness recorded when the exposure parameter is updated last time, and calculate a brightness difference between the historical ambient brightness and the previous ambient brightness. If the brightness difference value is smaller than a first preset difference value, it is judged that the ambient brightness of the shooting scene does not change, and if the brightness difference value is larger than or equal to the first preset difference value, it is judged that the ambient brightness of the shooting scene changes. Similarly, the second processing unit 220 further obtains historical attitude information recorded when the exposure parameters are updated last time, and determines whether the attitude of the camera changes according to the difference between the historical attitude information and the state information. And finally, if the ambient brightness of the shooting scene is judged not to be changed and the posture of the camera is also judged not to be changed, determining that the exposure parameters do not need to be updated, otherwise, determining that the exposure parameters need to be updated, and determining the exposure parameters as the target shooting parameters.
The white balance parameters are mainly sensitive to the ambient color temperature, so that whether the ambient color temperature of a shooting scene changes or not can be identified according to the acquired ambient color temperature, and if the ambient color temperature does not change and the posture of the camera does not change, the white balance parameters of the camera do not need to be updated. Correspondingly, when determining whether to determine the white balance parameter as the target shooting parameter according to the ambient color temperature and the posture information, the second processing unit 220 may obtain the historical ambient color temperature recorded when the white balance parameter is updated last time, and calculate a color temperature difference value between the historical ambient color temperature and the ambient color temperature. And if the color temperature difference value is smaller than a second preset difference value, judging that the environmental color temperature of the shooting scene does not change, and if the color temperature difference value is larger than or equal to the second preset difference value, judging that the environmental color temperature of the shooting scene changes. Similarly, the second processing unit 220 further obtains historical attitude information recorded when the white balance parameter is updated last time, and determines whether the attitude of the camera changes according to a difference between the historical attitude information and the state information. And finally, if the environmental color temperature of the shooting scene is judged not to be changed and the posture of the camera is judged not to be changed, determining that the exposure parameters do not need to be updated at the moment, otherwise, determining that the exposure parameters need to be updated, and determining the exposure parameters as the target shooting parameters.
The focusing parameters are mainly sensitive to the distance between the shooting object and the camera, so that whether the distance between the shooting object and the camera changes can be identified according to the acquired current distance between the shooting object and the camera, and if the distance does not change, the focusing parameters of the camera do not need to be updated. Accordingly, when determining whether to determine the focusing parameter as the target shooting parameter according to the current distance, the second processing unit 220 may obtain a historical distance between the shooting object and the camera, which is recorded when the focusing parameter is updated last time, and calculate a distance difference between the historical distance and the current distance. If the distance difference is smaller than a third preset difference, judging that the distance between the shooting object and the camera does not change, and determining that the focusing parameters do not need to be updated; if the distance difference is larger than or equal to a third preset difference, the distance between the shooting object and the camera is judged to be changed, at the moment, the focusing parameters are determined to be required to be updated, and the focusing parameters are determined as the target shooting parameters.
From the above description, it can be understood by those skilled in the art that, in practical applications, the target shooting parameter determined by the second processing unit 220 may be at least one of an exposure parameter, a white balance parameter and a focusing parameter.
It should be noted that, in the embodiment of the present application, values of the first preset difference, the second preset difference, and the third preset difference are not specifically limited, and an experienced value may be obtained by a person skilled in the art according to actual needs.
The application also provides a data statistical system, which comprises an image processing chip and an application processing chip, wherein,
the application processing chip is used for acquiring scene state information of a shooting scene of the camera and attitude information of the camera; determining target shooting parameters needing to be updated by the camera according to the scene state information and the attitude information;
the image processing chip is used for carrying out data statistics on scene images of shooting scenes collected by the camera to obtain target data required by updating target shooting parameters.
It should be noted that, for the image processing chip provided in the present application, please refer to the description of the related embodiments above for specific description, which is described herein in detail. In addition, the application processing chip as provided in the present application refers to the description of the related embodiments above.
It can be understood that the data statistical system provided by the present application can be applied to an electronic device with a camera for counting data required for updating shooting parameters of the camera.
Optionally, in an embodiment, the application processing chip is configured to acquire an ambient brightness of a shooting scene through an ambient light sensor; acquiring the ambient color temperature of a shooting scene through a color temperature sensor; acquiring the current distance between a shooting object and a camera in a shooting scene through a distance sensor; taking the environment brightness, the environment color temperature and the current distance as scene state information; and acquiring attitude information through the attitude sensor.
Optionally, in an embodiment, the application processing chip is configured to determine the exposure parameter as the target shooting parameter when recognizing that the ambient brightness of the shooting scene changes according to the ambient brightness and/or recognizing that the posture of the camera changes according to the posture information; and
when the change of the environmental color temperature of a shooting scene is identified according to the environmental color temperature and/or the change of the posture of the camera is identified according to the posture information, determining the white balance parameter as a target shooting parameter; and
and when the distance between the shooting object and the camera is identified to be changed according to the current distance, determining the focusing parameters as target shooting parameters.
Referring to fig. 4, the present application further provides a data statistical method, which includes:
in 310, acquiring scene state information of a shooting scene of the camera and attitude information of the camera;
in 320, determining target shooting parameters needing to be updated by the camera according to the scene state information and the attitude information;
at 330, data statistics is performed on the scene images of the shooting scene collected by the camera to obtain target data required for updating the target shooting parameters.
Optionally, in an embodiment, performing data statistics on a scene image of a shooting scene acquired by a camera includes:
when a line of image data in a scene image is received, statistics of target data is performed for a line of image data.
Optionally, in an embodiment, the acquiring scene state information of a shooting scene of a camera and pose information of the camera includes:
the method comprises the steps of obtaining the ambient brightness of a shooting scene through an ambient light sensor, obtaining the ambient color temperature of the shooting scene through a color temperature sensor, and obtaining the current distance between a shooting object and a camera in the shooting scene through a distance sensor;
taking the environmental brightness, the environmental color temperature and the current distance as scene state information; and acquiring attitude information through the attitude sensor.
Optionally, in an embodiment, determining target shooting parameters that the camera needs to update according to the scene state information and the pose information includes:
when the change of the environmental brightness of a shooting scene is recognized according to the environmental brightness and/or the change of the posture of the camera is recognized according to the posture information, determining the exposure parameter as a target shooting parameter; and
when the change of the environmental color temperature of a shooting scene is recognized according to the environmental color temperature and/or the change of the posture of the camera is recognized according to the posture information, determining the white balance parameter as a target shooting parameter; and
and when the distance between the shooting object and the camera is identified to be changed according to the current distance, determining the focusing parameters as target shooting parameters.
It should be noted that the data statistics method provided in the embodiment of the present application may be executed by an image processing chip or an application processing chip, and for detailed description, reference is made to the relevant description of the image processing chip and the application processing chip in the above embodiments, and details are not repeated herein.
The image processing chip, the application processing chip, the data statistical system and the method provided by the embodiment of the application are described in detail above. The principles and implementations of the present application are described herein using specific examples, which are presented only to aid in understanding the present application. Meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (6)
1. An image processing chip, comprising:
each data statistical unit corresponds to one type of shooting parameters and is used for carrying out data statistics on scene images of shooting scenes collected by the camera to obtain data required by the application processing chip to update the corresponding shooting parameters;
the first processing unit comprises an interrupt pin and is used for receiving an interrupt signal which is transmitted by the application processing chip and used for indicating target shooting parameters needing to be updated through the interrupt pin, wherein the interrupt signal is generated by the application processing chip when the ambient brightness of the shooting scene changes and indicates that exposure parameters are used as the target shooting parameters; or the interrupt signal is generated by the application processing chip when the environmental color temperature of the shooting scene changes, and a white balance parameter is indicated to be used as the target shooting parameter; or the interrupt signal is generated by the application processing chip when the distance between the shooting object in the shooting scene and the camera changes, and the focusing parameter is indicated to be used as the target shooting parameter; or the interrupt signal is generated by the application processing chip when the posture of the camera changes, and an exposure parameter and a white balance parameter are indicated to be used as the target shooting parameter; and the target data statistical unit is used for determining the target data statistical unit corresponding to the target shooting parameter from the plurality of data statistical units, enabling the target data statistical unit to obtain target data required by the application processing chip for updating the target shooting parameter through statistics, and disabling the non-target data statistical unit.
2. The image processing chip of claim 1, wherein the first processing unit further comprises a second data interface, the first processing unit further configured to adjust an interface frequency of the second data interface according to a data amount of the target data; and transmitting the target data to the application processing chip through a second data interface after the interface frequency is adjusted, so that the application processing chip updates the target shooting parameters of the camera according to the target data.
3. The image processing chip according to claim 1 or 2, wherein the target data statistics unit is configured to perform statistics of the target data for a line of image data in the scene image when the line of image data is received.
4. An application processing chip, comprising:
the third data interface is used for acquiring the ambient brightness and the ambient color temperature of a shooting scene of the camera, the current distance between a shooting object in the shooting scene and the camera and the attitude information of the camera;
a second processing unit configured to generate an interrupt signal for instructing to take the exposure parameter as a target shooting parameter when an ambient brightness of a shooting scene changes; or generating an interrupt signal for indicating that the white balance parameter is taken as the target shooting parameter when the environmental color temperature of the shooting scene changes; or generating an interrupt signal for indicating that the focusing parameter is taken as the target shooting parameter when the distance between the shooting object in the shooting scene and the camera is changed; or generating an interrupt signal for indicating that the exposure parameter and the white balance parameter are taken as target shooting parameters when the posture of the camera changes;
and the fourth data interface is used for transmitting an interrupt signal to an image processing chip, instructing the image processing chip to enable a non-target data statistical unit through the interrupt signal, and determining a target data statistical unit corresponding to the target shooting parameter from a plurality of data statistical units so as to perform data statistics on the scene image of the shooting scene acquired by the camera, so as to obtain target data required by updating the target shooting parameter.
5. A data statistical system is characterized by comprising an image processing chip and an application processing chip, wherein the image processing chip comprises an interrupt pin and a plurality of data statistical units, each data statistical unit corresponds to a type of shooting parameters and is used for carrying out data statistics on scene images of shooting scenes collected by a camera to obtain data required by the application processing chip for updating the corresponding shooting parameters;
the application processing chip is used for generating an interrupt signal for indicating that the exposure parameter is taken as a target shooting parameter needing to be updated when the ambient brightness of a shooting scene changes; or generating an interrupt signal for indicating that the white balance parameter is taken as a target shooting parameter needing to be updated when the ambient color temperature of the shooting scene changes; or when the distance between a shooting object in the shooting scene and the camera is changed, generating an interrupt signal for indicating that the focusing parameter is taken as a target shooting parameter needing to be updated; or generating an interrupt signal for indicating that the exposure parameter and the white balance parameter are used as target shooting parameters needing to be updated when the posture of the camera changes;
the image processing chip is used for receiving the interrupt signal transmitted by the application processing chip through the interrupt pin, determining a target data statistical unit corresponding to the target shooting parameter from the plurality of data statistical units, enabling the target data statistical unit, enabling a non-target data statistical unit, and performing data statistics on the scene image of the shooting scene acquired by the camera through the target data statistical unit to obtain target data required by the application processing chip to update the target shooting parameter.
6. A data statistical method is characterized in that an image processing chip comprises an interrupt pin and a plurality of data statistical units, each data statistical unit corresponds to a type of shooting parameters and is used for carrying out data statistics on scene images of shooting scenes collected by a camera to obtain data required by updating the corresponding shooting parameters by the application processing chip, and the method comprises the following steps:
the method comprises the steps that an application processing chip obtains the ambient brightness, the ambient color temperature, the current distance between a shooting object in a shooting scene and a camera and the posture information of the camera;
the application processing chip generates an interrupt signal for indicating that the exposure parameter is taken as a target shooting parameter needing to be updated when the ambient brightness of a shooting scene changes; or generating a target shooting parameter for indicating that the white balance parameter is required to be updated when the environmental color temperature of the shooting scene changes; or when the distance between the shooting object in the shooting scene and the camera is changed, taking the focusing parameter as a target shooting parameter needing to be updated; or when the posture of the camera changes, taking the exposure parameter and the white balance parameter as target shooting parameters needing to be updated;
the image processing chip receives the interrupt signal transmitted by the application processing chip through the interrupt pin, determines a target data statistical unit corresponding to the target shooting parameter from the plurality of data statistical units in response to the interrupt signal, enables the target data statistical unit, enables a non-target data statistical unit, and performs data statistics on the scene image of the shooting scene acquired by the camera through the target data statistical unit to obtain target data required for updating the target shooting parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110043784.6A CN112822371B (en) | 2021-01-13 | 2021-01-13 | Image processing chip, application processing chip, data statistical system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110043784.6A CN112822371B (en) | 2021-01-13 | 2021-01-13 | Image processing chip, application processing chip, data statistical system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112822371A CN112822371A (en) | 2021-05-18 |
| CN112822371B true CN112822371B (en) | 2022-11-15 |
Family
ID=75869173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110043784.6A Active CN112822371B (en) | 2021-01-13 | 2021-01-13 | Image processing chip, application processing chip, data statistical system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112822371B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115460333A (en) * | 2021-06-08 | 2022-12-09 | Oppo广东移动通信有限公司 | Image signal processing module, chip, electronic device and method |
| CN115883948A (en) * | 2021-09-28 | 2023-03-31 | Oppo广东移动通信有限公司 | Image processing architecture, image processing method, device and storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3797543B2 (en) * | 2001-10-26 | 2006-07-19 | 富士写真フイルム株式会社 | Automatic focus adjustment device |
| JP2003348601A (en) * | 2002-05-27 | 2003-12-05 | Fuji Photo Film Co Ltd | Auto white balance control method and electronic camera |
| CN101577831B (en) * | 2009-03-10 | 2013-08-21 | 北京中星微电子有限公司 | Control method and control device for starting white balance adjustment |
| US8077256B1 (en) * | 2010-06-04 | 2011-12-13 | Apple, Inc. | Scene-aware automatic-exposure control |
| TWI522772B (en) * | 2012-10-17 | 2016-02-21 | Automatic transmission interface device and method for correcting transmission frequency | |
| CN105208360B (en) * | 2015-09-23 | 2017-07-25 | 青岛海信移动通信技术股份有限公司 | Image preview method, device and the terminal of a kind of intelligent terminal |
| US10154198B2 (en) * | 2016-10-28 | 2018-12-11 | Qualcomm Incorporated | Power saving techniques for an image capture device |
| CN107864340B (en) * | 2017-12-13 | 2019-07-16 | 浙江大华技术股份有限公司 | A kind of method of adjustment and photographic equipment of photographic parameter |
| CN109413336A (en) * | 2018-12-27 | 2019-03-01 | 北京旷视科技有限公司 | Image pickup method, device, electronic equipment and computer readable storage medium |
| CN111698493A (en) * | 2020-06-02 | 2020-09-22 | Oppo广东移动通信有限公司 | White balance processing method and device |
-
2021
- 2021-01-13 CN CN202110043784.6A patent/CN112822371B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112822371A (en) | 2021-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109842753B (en) | Camera anti-shake system, camera anti-shake method, electronic device and storage medium | |
| US8823837B2 (en) | Zoom control method and apparatus, and digital photographing apparatus | |
| JP4872797B2 (en) | Imaging apparatus, imaging method, and imaging program | |
| JP5623256B2 (en) | Imaging apparatus, control method thereof, and program | |
| CN111107276B (en) | Information processing apparatus, control method thereof, storage medium, and imaging system | |
| CN110198418B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| WO2022262344A1 (en) | Photographing method and electronic device | |
| CN112822371B (en) | Image processing chip, application processing chip, data statistical system and method | |
| US8648960B2 (en) | Digital photographing apparatus and control method thereof | |
| CN112822370B (en) | Electronic device, pre-image signal processor and image processing method | |
| US9723194B2 (en) | Photographing apparatus providing image transmission based on communication status, method of controlling the same, and non-transitory computer-readable storage medium for executing the method | |
| CN110753182B (en) | Adjusting method and apparatus of image forming apparatus | |
| CN110581957B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN110266967B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20100225777A1 (en) | Image processing apparatus and storage medium | |
| CN110266965B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN115546043B (en) | Video processing method and related equipment thereof | |
| JP5832618B2 (en) | Imaging apparatus, control method thereof, and program | |
| CN113837937A (en) | Multimedia processing chip, electronic equipment image fusion method and image cutting method | |
| CN108259768B (en) | Image selection method and device, storage medium and electronic equipment | |
| JP5182395B2 (en) | Imaging apparatus, imaging method, and imaging program | |
| CN113840075B (en) | Electronic equipment and image fusion method based on electronic equipment | |
| CN113873142A (en) | Multimedia processing chip, electronic device and dynamic image processing method | |
| CN112805991A (en) | Digital zoom imaging method and device, camera and unmanned aerial vehicle system | |
| CN114007009B (en) | Electronic device and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |