CN111698414B - Image signal processing method and device, electronic device and readable storage medium - Google Patents
Image signal processing method and device, electronic device and readable storage medium Download PDFInfo
- Publication number
- CN111698414B CN111698414B CN201910192811.9A CN201910192811A CN111698414B CN 111698414 B CN111698414 B CN 111698414B CN 201910192811 A CN201910192811 A CN 201910192811A CN 111698414 B CN111698414 B CN 111698414B
- Authority
- CN
- China
- Prior art keywords
- data set
- signal data
- processing
- image signal
- signal processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The disclosure relates to an image signal processing method and device, an electronic device and a readable storage medium, wherein the method comprises the following steps: outputting an original signal data set generated by the image sensor after single exposure to an external image signal processor; receiving a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of the built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity; and performing preview processing on the first processed signal data set and image generation processing on the second processed signal data set through the built-in image signal processor.
Description
Technical Field
The present disclosure relates to the field of image signal processing technologies, and in particular, to an image signal processing method and apparatus, an electronic device, and a readable storage medium.
Background
In a camera system, a Sensor (image Sensor) includes a photosensitive area in which each photosensitive pixel generates corresponding raw signal data through photoelectric conversion, and all photosensitive pixels collectively form a corresponding raw signal data set.
Then, an ISP (Image Signal Processor) is responsible for receiving the raw Signal data set output by the Sensor and performing processing such as AEC (automatic exposure control), AGC (automatic gain control), AWB (automatic white balance), etc., which plays a very important role in securing Image quality.
However, the Sensor and ISP in the related art need to ensure performance matching, otherwise normal output of the image may be affected.
Disclosure of Invention
The present disclosure provides an image signal processing method and apparatus, an electronic device, and a readable storage medium to solve the deficiencies in the related art.
According to a first aspect of embodiments of the present disclosure, there is provided an image signal processing method including:
outputting an original signal data set generated by the image sensor after single exposure to an external image signal processor;
receiving a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of the built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity;
and performing preview processing on the first processed signal data set and image generation processing on the second processed signal data set through the built-in image signal processor.
Optionally, the outputting a raw signal data set generated by the image sensor after a single exposure to an external image signal processor includes:
comparing the pixel quantity of the original signal data set with the upper limit of the processing capacity of a built-in image signal processor;
and when the processing capacity upper limit is exceeded, outputting the original signal data set to the external image signal processor.
Optionally, the method further includes:
when the pixel quantity of the original signal data set does not exceed the upper limit of the processing capacity, outputting the original signal data set to the built-in image signal processor for processing to obtain a third processed signal data set;
and performing preview processing and image generation processing on the third processed signal data set.
Optionally, the first processed signal data set is obtained by processing the original signal data set by the external image signal processor in a down-sampling type working mode.
According to a second aspect of the embodiments of the present disclosure, there is provided an image signal processing apparatus including:
a first output unit configured to output a raw signal data set generated by the image sensor after a single exposure to an external image signal processor;
the receiving unit is configured to receive a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of the built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity;
a first processing unit configured to perform preview processing on the first processed signal data set and image generation processing on the second processed signal data set by the built-in image signal processor.
Optionally, the first output unit includes:
a comparison subunit configured to compare the pixel amount of the original signal data set with an upper limit of processing capacity of a built-in image signal processor;
an output subunit configured to output the raw signal data set to the external image signal processor when the processing capability upper limit is exceeded.
Optionally, the method further includes:
a second output unit configured to output the original signal data set to the built-in image signal processor for processing to obtain a third processed signal data set when the pixel amount of the original signal data set does not exceed the processing capacity upper limit;
a second processing unit configured to perform preview processing and image generation processing on the third processed signal data set.
Optionally, the first processed signal data set is obtained by processing the original signal data set by the external image signal processor in a down-sampling type working mode.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to implement the method as described in any of the embodiments of the first aspect above.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions, characterized in that the instructions, when executed by a processor, implement the steps of the method as set forth in any of the embodiments of the first aspect described above.
According to a fifth aspect of the embodiments of the present disclosure, there is provided a terminal, including: the system comprises a camera module comprising an image sensor, a system on chip comprising a built-in image signal processor and an external image signal processor;
after acquiring an original signal data set generated by the image sensor after single exposure, the external image signal processor respectively generates a first processed signal data set of which the pixel quantity does not exceed the upper limit of the processing capacity of the internal image signal processor and a second processed signal data set of which the pixel quantity exceeds the upper limit of the processing capacity;
the built-in image signal processor is used for performing preview processing on the first processed signal data set and performing image generation processing on the second processed signal data set.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating an image signal processing method according to an exemplary embodiment.
FIG. 2 is a schematic diagram illustrating an output preview image according to an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating an output high resolution image according to an exemplary embodiment.
Fig. 4 to 6 are block diagrams illustrating an image signal processing apparatus according to an exemplary embodiment.
Fig. 7 is a schematic diagram illustrating a structure of an apparatus for image signal processing according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Fig. 1 is a flowchart illustrating an image signal processing method according to an exemplary embodiment, which is applied to a terminal, as shown in fig. 1, and may include the steps of:
in step 102, the raw signal data set generated by the image sensor after a single exposure is output to an external image signal processor.
In one embodiment, the terminal comprises a camera module and a System On Chip (SOC), wherein the camera module comprises an image sensor and a built-in image signal processor integrated with the SOC; in addition, the terminal further comprises an external image signal processor which is not integrated in the system on chip, so that the external image signal processor is not limited by the system on chip and can be randomly selected according to actual requirements, and even if the pixel quantity of an original signal data set generated by the image sensor exceeds the upper limit of the processing capacity of the built-in image signal processor, the external image signal processor with matched performance can be still selected for processing, so that the advantages of high resolution and high pixel of the image sensor are fully exerted.
In one embodiment, the internal image signal processor and the external image signal processor may be ISPs; in some cases, the processing function of the ISP may also be realized by a DSP (Digital Signal Processor), which is not limited by the present disclosure.
In one embodiment, the raw signal data set generated by the image sensor after a single exposure can be used to generate a corresponding frame of image; multiple frames of images or a video can be generated by multiple exposures.
In one embodiment, the pixel count of the raw signal data set may be compared to an upper limit of processing power of a built-in image signal processor; when the processing capacity upper limit is exceeded, the raw signal data set can be output to the external image signal processor. For example, when the pixel amount of the original signal data set is 8000 ten thousand and the upper limit of the processing capacity of the built-in image signal processor is 2000 ten thousand pixels, it indicates that the pixel amount of the original signal data set exceeds the upper limit of the processing capacity, and should be output to the external image signal processor for processing, rather than processed by the built-in image signal processor.
In an embodiment, when the pixel amount of the raw signal data set does not exceed the processing capability upper limit, the raw signal data set may be output to the built-in image signal processor for processing to obtain a third processed signal data set, and the preview processing and the image generation processing are performed on the third processed signal data set, which is similar to the processing procedure in the related art. Compared with an external image signal processor, the data transmission speed between the external image signal processor and the built-in image signal processor is higher, the processing efficiency can be improved on the whole, and the delay is reduced.
In step 104, a first processed signal data set that the pixel amount does not exceed the upper limit of the processing capacity of the built-in image signal processor and a second processed signal data set that the pixel amount exceeds the upper limit of the processing capacity are received.
In step 106, the built-in image signal processor performs a preview process on the first processed signal data set and performs an image generation process on the second processed signal data set.
In an embodiment, the first processed signal data set is used to implement image preview, the second processed signal data set is used to generate an image (e.g., a photo or video frame), and both the first processed signal data set and the second processed signal data set can be generated from the original signal data set by the external image signal processor without the need for the internal image signal processor to process the original signal data set, such that only the original signal data set needs to be transmitted to the external image signal processor and not to the internal image signal processor.
In one embodiment, the image sensor need only generate a raw signal data set that typically has a pixel count that is greater than the upper limit of the processing power of the built-in image signal processor; then, the external image signal processor performs normal processing on the original signal data set to obtain a second processed signal data set, and performs processing on the original signal data set to obtain a first processed signal data set in a down-sampling type working mode, for example, the down-sampling type working mode may be a binning mode or a cropping mode in the related art, which is not limited by this disclosure.
FIG. 2 is a schematic diagram illustrating an output preview image according to an exemplary embodiment. As shown in fig. 2, assuming that the resolution of the Sensor in the terminal is 8000 ten thousand pixels, that is, the photosensitive area of the Sensor contains 8000 ten thousand photosensitive pixels, an original signal data set of 8000 ten thousand pixels can be generated at maximum; meanwhile, the processing capacity of the built-in ISP integrated by the system on chip in the terminal is assumed to be up to 2000 ten thousand pixels, that is, the built-in ISP can only process the original signal data set of 2000 ten thousand pixels, and cannot directly process the original signal data set of 8000 ten thousand pixels generated by the Sensor.
When the electronic device is in the preview mode, the Sensor can work in a Binning mode or a skiping mode, so that the Sensor can obtain an original signal data set with a lower pixel quantity through down-sampling, and the original signal data set meets the upper limit of the processing capacity of the built-in ISP. For example, a Sensor may generate a raw signal data set of 2000 ten thousand pixels so that a built-in ISP can directly process the raw signal data set. The processing manner of the original signal data set may refer to a processing function of the ISP in the related technology, such as AEC (Automatic Exposure Control), AGC (Automatic Gain Control), AWB (Automatic white balance), and the like, which is not limited in this disclosure.
After the processing, the built-in ISP can output a processed signal data set with 2000 ten thousand pixels, and the processed signal data set is used for being displayed on a display screen of the electronic device so that a user can preview the signal data set. Of course, the above embodiments may also be applied to generating photos or videos with low pixel requirements, for example, the built-in ISP may generate photos or videos (specifically, video frames included in videos) with 2000 ten thousand pixels according to the above processed signal data set.
FIG. 3 is a schematic diagram illustrating an output high resolution image according to an exemplary embodiment. As shown in fig. 3, the terminal includes a Sensor having a resolution of 8000 ten thousand pixels and an internal ISP having a processing capacity of 2000 ten thousand pixels at the upper limit. When the electronic device generates a shooting instruction, the camera system can switch from the Binning mode or skiping mode described above to a high resolution output mode so that the Sensor can output the full amount of raw signal data set of 8000 ten thousand pixels.
The built-in ISP cannot process a raw signal data set of 8000 thousand pixels. Therefore, the terminal can further add an external ISP which is not integrated in the system on chip and is not limited by the system on chip, so that a user can select and use the external ISP according to the performance of the Sensor. For example, for a Sensor with a resolution of 8000 ten thousand pixels, an external ISP with a processing capability of 8000 ten thousand pixels or even better may be selected, so that the terminal may output the original signal data set of 8000 ten thousand pixels generated by the Sensor to the external ISP for processing by the external ISP.
In one aspect, the external ISP may operate in a Binning mode or a skiping mode to down-sample the raw signal data set of 8000 ten thousand pixels to obtain a processed signal data set 1 with low pixels, for example, the processed signal data set 1 may contain 2000 ten thousand pixels to adapt to the upper limit of the processing capability of the internal ISP. On the other hand, in the normal operation mode, the external ISP may process the original signal data set of 8000 ten thousand pixels into the corresponding processed signal data set 2 of 8000 ten thousand pixels.
After the internal ISP receives the data set returned by the external ISP, the processed signal data set 1 with the pixel amount within the upper limit of its processing capability is processed by determining the pixel amount contained in the data set, for example, 3A calculation (i.e., AEC, AGC, and AWB described above) is performed, and the parameters are sent to the Sensor end for setting the exposure time and the gain. And the built-in ISP outputs the processed signal data set 2 with the pixel amount exceeding the upper limit of the processing capability of the built-in ISP, so that the terminal generates a corresponding high-resolution image (such as a photo or a video) based on the processed signal data set 2, and the generation process is consistent with the processing process in the related art, and is not repeated here.
Corresponding to the foregoing embodiments of the image signal processing method, the present disclosure also provides embodiments of an image signal processing apparatus.
Fig. 4 is a block diagram illustrating an image signal processing apparatus according to an exemplary embodiment. Referring to fig. 2, the apparatus includes:
a first output unit 41 configured to output a raw signal data set generated by the image sensor after a single exposure to an external image signal processor;
a receiving unit 42 configured to receive a first processed signal data set whose pixel amount does not exceed an upper limit of a processing capability of the built-in image signal processor and a second processed signal data set whose pixel amount exceeds the upper limit of the processing capability returned by the external image signal processor;
a first processing unit 43 configured to perform a preview process on the first processed signal data set and perform an image generation process on the second processed signal data set by the built-in image signal processor.
Optionally, the first processed signal data set is obtained by processing the original signal data set by the external image signal processor in a down-sampling type working mode.
As shown in fig. 5, fig. 5 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 4, and the first output unit 41 includes:
a comparison subunit 411 configured to compare the pixel amount of the original signal data set with an upper limit of processing capacity of a built-in image signal processor;
an output subunit 412 configured to output the raw signal data set to the external image signal processor when the processing capability upper limit is exceeded.
As shown in fig. 6, fig. 6 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 5, and further includes:
a second output unit 44 configured to output the original signal data set to the built-in image signal processor for processing to obtain a third processed signal data set when the pixel amount of the original signal data set does not exceed the processing capability upper limit;
a second processing unit 45 configured to perform a preview process and an image generation process on the third processed signal data set.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Correspondingly, the present disclosure also provides an image signal processing apparatus, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the image signal processing method as in any one of the above embodiments, such as the method may include: outputting an original signal data set generated by the image sensor after single exposure to an external image signal processor; receiving a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of the built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity; and performing preview processing on the first processed signal data set and image generation processing on the second processed signal data set through the built-in image signal processor.
Accordingly, the present disclosure also provides a terminal including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and configured to be executed by the one or more processors, the one or more programs include instructions for implementing the image signal processing method according to any of the above embodiments, such as the method may include: outputting an original signal data set generated by the image sensor after single exposure to an external image signal processor; receiving a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of the built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity; and performing preview processing on the first processed signal data set and image generation processing on the second processed signal data set through the built-in image signal processor.
Fig. 7 is a block diagram illustrating an apparatus 700 for image signal processing according to an example embodiment. For example, the apparatus 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 7, apparatus 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.
The processing component 702 generally controls overall operation of the device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operations at the apparatus 700. Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 706 provides power to the various components of the device 700. The power components 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 700.
The multimedia component 708 includes a screen that provides an output interface between the device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a Microphone (MIC) configured to receive external audio signals when apparatus 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.
The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of the apparatus 700. For example, sensor assembly 714 may detect an open/closed state of device 700, the relative positioning of components, such as a display and keypad of device 700, sensor assembly 714 may also detect a change in position of device 700 or a component of device 700, the presence or absence of user contact with device 700, orientation or acceleration/deceleration of device 700, and a change in temperature of device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate wired or wireless communication between the apparatus 700 and other devices. The apparatus 700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (New Radio), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (14)
1. An image signal processing method characterized by comprising:
outputting an original signal data set generated by the image sensor after single exposure to an external image signal processor;
receiving a first processed signal data set and a second processed signal data set, wherein the pixel quantity of the first processed signal data set does not exceed the upper limit of the processing capacity of a built-in image signal processor, and the second processed signal data set exceeds the upper limit of the processing capacity, and the first processed signal data set and the second processed signal data set are generated by the external image signal processor according to the original signal data set;
and performing preview processing on the first processed signal data set and image generation processing on the second processed signal data set through the built-in image signal processor.
2. The method of claim 1, wherein outputting the raw signal data set generated by the image sensor after a single exposure to an external image signal processor comprises:
comparing the pixel quantity of the original signal data set with the upper limit of the processing capacity of a built-in image signal processor;
and when the processing capacity upper limit is exceeded, outputting the original signal data set to the external image signal processor.
3. The method of claim 2, further comprising:
when the pixel quantity of the original signal data set does not exceed the upper limit of the processing capacity, outputting the original signal data set to the built-in image signal processor for processing to obtain a third processed signal data set;
and performing preview processing and image generation processing on the third processed signal data set.
4. The method of claim 1, wherein the first processed signal data set is derived by the external image signal processor processing the raw signal data set in a down-sampling type mode of operation.
5. An image signal processing apparatus characterized by comprising:
a first output unit configured to output a raw signal data set generated by the image sensor after a single exposure to an external image signal processor;
a receiving unit configured to receive a first processed signal data set with a pixel amount not exceeding an upper limit of a processing capability of a built-in image signal processor and a second processed signal data set with a pixel amount exceeding the upper limit of the processing capability returned by the external image signal processor, wherein the first processed signal data set and the second processed signal data set are generated by the external image signal processor according to the original signal data set;
a first processing unit configured to perform preview processing on the first processed signal data set and image generation processing on the second processed signal data set by the built-in image signal processor.
6. The apparatus of claim 5, wherein the first output unit comprises:
a comparison subunit configured to compare the pixel amount of the original signal data set with an upper limit of processing capacity of a built-in image signal processor;
an output subunit configured to output the raw signal data set to the external image signal processor when the processing capability upper limit is exceeded.
7. The apparatus of claim 6, further comprising:
a second output unit configured to output the original signal data set to the built-in image signal processor for processing to obtain a third processed signal data set when the pixel amount of the original signal data set does not exceed the processing capacity upper limit;
a second processing unit configured to perform preview processing and image generation processing on the third processed signal data set.
8. The apparatus of claim 5, wherein the first processed signal data set is derived from processing the raw signal data set by the external image signal processor in a down-sampling type mode of operation.
9. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to implement the method of any one of claims 1-4.
10. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 4.
11. A terminal, comprising: the system comprises a camera module comprising an image sensor, a system on chip comprising a built-in image signal processor and an external image signal processor;
after an original signal data set generated by the image sensor after single exposure is obtained, the external image signal processor respectively generates a first processed signal data set with the pixel quantity not exceeding the upper limit of the processing capacity of the built-in image signal processor and a second processed signal data set with the pixel quantity exceeding the upper limit of the processing capacity, and the first processed signal data set and the second processed signal data set are generated by the external image signal processor according to the original signal data set;
the built-in image signal processor is used for performing preview processing on the first processed signal data set and performing image generation processing on the second processed signal data set.
12. The terminal of claim 11, wherein the raw signal data set is output to the external image signal processor when a pixel count of the raw signal data set exceeds an upper limit of a processing capability of the internal image signal processor.
13. The terminal of claim 12, wherein the raw signal data set is output to the built-in image signal processor when the amount of pixels of the raw signal data set does not exceed the processing capability upper limit;
and the built-in image signal processor generates the original signal data set into a third processed signal data set, and performs preview processing and image generation processing on the third processed signal data set.
14. The apparatus of claim 11, wherein the external image signal processor processes the raw signal data sets in a down-sampling type and a normal type of operation mode, respectively, to obtain the first processed signal data set and the second processed signal data set, respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910192811.9A CN111698414B (en) | 2019-03-14 | 2019-03-14 | Image signal processing method and device, electronic device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910192811.9A CN111698414B (en) | 2019-03-14 | 2019-03-14 | Image signal processing method and device, electronic device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111698414A CN111698414A (en) | 2020-09-22 |
| CN111698414B true CN111698414B (en) | 2021-11-16 |
Family
ID=72475081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910192811.9A Active CN111698414B (en) | 2019-03-14 | 2019-03-14 | Image signal processing method and device, electronic device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111698414B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115484357A (en) * | 2021-05-31 | 2022-12-16 | 北京小米移动软件有限公司 | Image processing method and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202503582U (en) * | 2012-02-08 | 2012-10-24 | 北京思比科微电子技术股份有限公司 | Video processing system of hand-held mobile communication terminal |
| JP2014171203A (en) * | 2013-03-05 | 2014-09-18 | Ricoh Imaging Co Ltd | Imaging apparatus and image display method |
| CN104869381A (en) * | 2014-02-25 | 2015-08-26 | 炬芯（珠海）科技有限公司 | Image processing system, method and device |
| CN106251279A (en) * | 2016-08-18 | 2016-12-21 | 深圳市金立通信设备有限公司 | A kind of image processing method and terminal |
| CN108495043A (en) * | 2018-04-28 | 2018-09-04 | Oppo广东移动通信有限公司 | Image processing method and relevant apparatus |
| CN108769522A (en) * | 2018-06-06 | 2018-11-06 | 中科创达软件科技（深圳）有限公司 | Image processing terminal and image processing method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101887988B1 (en) * | 2012-07-03 | 2018-08-14 | 삼성전자 주식회사 | Image sensor chip, operation method thereof, and system having the same |
| CN205545593U (en) * | 2016-03-31 | 2016-08-31 | 深圳市日多实业发展有限公司 | External ISP technique camera module |
| US10313594B2 (en) * | 2017-01-05 | 2019-06-04 | Qualcomm Incorporated | Dynamically configuring memory bandwidth for image generation |
| CN107277353B (en) * | 2017-06-30 | 2019-02-15 | 维沃移动通信有限公司 | A kind of method taken pictures and mobile terminal |
-
2019
- 2019-03-14 CN CN201910192811.9A patent/CN111698414B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202503582U (en) * | 2012-02-08 | 2012-10-24 | 北京思比科微电子技术股份有限公司 | Video processing system of hand-held mobile communication terminal |
| JP2014171203A (en) * | 2013-03-05 | 2014-09-18 | Ricoh Imaging Co Ltd | Imaging apparatus and image display method |
| CN104869381A (en) * | 2014-02-25 | 2015-08-26 | 炬芯（珠海）科技有限公司 | Image processing system, method and device |
| CN106251279A (en) * | 2016-08-18 | 2016-12-21 | 深圳市金立通信设备有限公司 | A kind of image processing method and terminal |
| CN108495043A (en) * | 2018-04-28 | 2018-09-04 | Oppo广东移动通信有限公司 | Image processing method and relevant apparatus |
| CN108769522A (en) * | 2018-06-06 | 2018-11-06 | 中科创达软件科技（深圳）有限公司 | Image processing terminal and image processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111698414A (en) | 2020-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3032821B1 (en) | Method and device for shooting a picture | |
| CN108419016B (en) | Shooting method and device and terminal | |
| RU2630167C1 (en) | Method and device for switching colour range mode | |
| CN106210496B (en) | Photo shooting method and device | |
| CN106657780B (en) | Image preview method and device | |
| US20170064182A1 (en) | Method and device for acquiring image file | |
| CN108462833B (en) | Photographing method, photographing device and computer-readable storage medium | |
| CN111953904B (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN111343386B (en) | Image signal processing method and device, electronic device and storage medium | |
| CN111953903A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN110876014B (en) | Image processing method and device, electronic device and storage medium | |
| CN111698414B (en) | Image signal processing method and device, electronic device and readable storage medium | |
| CN109922203B (en) | Terminal, screen off method and device | |
| CN110874829B (en) | Image processing method and device, electronic device and storage medium | |
| CN111835977B (en) | Image sensor, image generation method and device, electronic device, and storage medium | |
| CN108769513B (en) | Camera photographing method and device | |
| CN111835941B (en) | Image generation method and device, electronic equipment and computer readable storage medium | |
| CN107707819B (en) | Image shooting method, device and storage medium | |
| CN111343375A (en) | Image signal processing method and device, electronic device and storage medium | |
| CN111225158B (en) | Image generation method and device, electronic equipment and computer readable storage medium | |
| CN109862252B (en) | Image shooting method and device | |
| CN114339017B (en) | Distant view focusing method, device and storage medium | |
| CN110876013B (en) | Method and device for determining image resolution, electronic equipment and storage medium | |
| CN107105182B (en) | Video backup method and device | |
| CN107317977B (en) | Shooting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |