CN111343386B - Image signal processing method and device, electronic device and storage medium - Google Patents

Image signal processing method and device, electronic device and storage medium Download PDF

Info

Publication number
CN111343386B
CN111343386B CN201811558540.6A CN201811558540A CN111343386B CN 111343386 B CN111343386 B CN 111343386B CN 201811558540 A CN201811558540 A CN 201811558540A CN 111343386 B CN111343386 B CN 111343386B
Authority
CN
China
Prior art keywords
data set
signal data
image
image signal
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811558540.6A
Other languages
Chinese (zh)
Other versions
CN111343386A (en
Inventor
武隽
过一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201811558540.6A priority Critical patent/CN111343386B/en
Publication of CN111343386A publication Critical patent/CN111343386A/en
Application granted granted Critical
Publication of CN111343386B publication Critical patent/CN111343386B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The present disclosure relates to an image signal processing method and apparatus, an electronic device, and a storage medium, wherein the method may include: outputting a first original signal data set generated by the image sensor after single exposure to an external image signal processor; and acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set.

Description

Image signal processing method and device, electronic device and storage medium
Technical Field
The present disclosure relates to the field of image signal processing technologies, and in particular, to an image signal processing method and apparatus, an electronic device, and a storage medium.
Background
In a camera system, a Sensor (image Sensor) includes a photosensitive area in which each photosensitive pixel generates corresponding raw signal data through photoelectric conversion, and all photosensitive pixels collectively form a corresponding raw signal data set.
Then, an ISP (Image Signal Processor) is responsible for receiving the raw Signal data set output by the Sensor and performing processing such as AEC (automatic exposure control), AGC (automatic gain control), AWB (automatic white balance), etc., which plays a very important role in securing Image quality.
However, the consistency of performance needs to be ensured between the Sensor and the ISP in the related art, otherwise the normal output of the image may be affected.
Disclosure of Invention
The present disclosure provides an image signal processing method and apparatus, an electronic device, and a storage medium to solve the disadvantages of the related art.
According to a first aspect of embodiments of the present disclosure, there is provided an image signal processing method including:
outputting a first original signal data set generated by the image sensor after single exposure to an external image signal processor;
and acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set.
Optionally, the outputting a first raw signal data set generated by the image sensor after a single exposure to an external image signal processor includes:
comparing the pixel quantity of the first raw signal data set with an upper limit of processing capacity of a built-in image signal processor;
and when the processing capacity upper limit is exceeded, outputting the first original signal data set to the external image signal processor.
Optionally, the method further includes:
and when the pixel quantity of the first original signal data set does not exceed the upper limit of the processing capacity, outputting the first original signal data set to the built-in image signal processor for processing to obtain the first processed signal data set.
Optionally, the method further includes:
configuring the image sensor to a down-sampling type of operating mode when in a preview state;
outputting a second raw signal data set generated by the image sensor to the built-in image signal processor;
and showing a corresponding preview image according to a second processed signal data set output by the built-in image signal processor.
Optionally, the method further includes:
when the first raw signal data set is generated for the image sensor based on a photographing instruction, a corresponding image or video is generated according to the first processed signal data set.
Optionally, the method further includes:
when in a preview state, a corresponding preview image is shown according to the first set of processed signal data.
According to a second aspect of the embodiments of the present disclosure, there is provided an image signal processing apparatus including:
a first output unit configured to output a first raw signal data set generated by the image sensor after a single exposure to an external image signal processor;
an acquisition unit configured to acquire a first processed signal data set corresponding to the first original signal data set output by the external image signal processor.
Optionally, the first output unit includes:
a comparison subunit configured to compare the pixel amount of the first original signal data set with an upper limit of processing capacity of a built-in image signal processor;
an output subunit configured to output the first raw signal data set to the external image signal processor when the processing capability upper limit is exceeded.
Optionally, the method further includes:
a second output unit configured to output the first raw signal data set to the built-in image signal processor for processing to obtain the first processed signal data set when the pixel amount of the first raw signal data set does not exceed the processing capability upper limit.
Optionally, the method further includes:
a configuration unit configured to configure the image sensor in a down-sampling type operation mode when in a preview state;
a third output unit configured to output a second raw signal data set generated by the image sensor to the built-in image signal processor;
a first display unit configured to show a corresponding preview image according to a second processed signal data set output by the built-in image signal processor.
Optionally, the method further includes:
a generating unit configured to generate a corresponding image or video from the first processed signal data set when the first raw signal data set is generated for the image sensor based on a photographing instruction.
Optionally, the method further includes:
a second display unit configured to show a corresponding preview image according to the first processed signal data set when in a preview state.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method as in any of the above embodiments by executing the executable instructions.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions, wherein the instructions, when executed by a processor, implement the steps of the method as in any one of the above embodiments.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating an image signal processing method according to an exemplary embodiment.
FIG. 2 is a schematic diagram illustrating an output preview image according to an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating an output high resolution image according to an exemplary embodiment.
FIGS. 4-9 are block diagrams illustrating an image signal processing apparatus according to an exemplary embodiment.
Fig. 10 is a schematic diagram illustrating a structure of an apparatus for image signal processing according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Fig. 1 is a flowchart illustrating an image signal processing method according to an exemplary embodiment, which is applied to a terminal (e.g., an electronic device) as shown in fig. 1, and may include the following steps:
in step 102, a first raw signal data set generated by the image sensor after a single exposure is output to an external image signal processor.
In one embodiment, the external image signal processor is an image signal processor located outside the terminal and connected to the terminal from the outside, and is different from a built-in image signal processor provided inside the terminal. Because the external image signal processor is not limited by the structure of the terminal and can be selected at will according to actual requirements, even if the pixel quantity of the first original signal data set generated by the image sensor exceeds the upper limit of the processing capacity of the built-in image signal processor, the external image signal processor with matched performance can be still selected for processing, and the advantages of high resolution and high pixel of the image sensor are fully exerted.
In one embodiment, the external image signal processor is an external ISP; in some cases, the processing function of the ISP may also be realized by a DSP (Digital Signal Processor), which is not limited by the present disclosure.
In one embodiment, a first raw signal data set generated by an image sensor after a single exposure can be used to generate a corresponding frame of image; multiple frames of images or a video can be generated by multiple exposures.
In an embodiment, the amount of pixels of the first raw signal data set may be compared to an upper limit of processing power of a built-in image signal processor; when the processing power upper limit is exceeded, the first raw signal data set may be output to the external image signal processor. For example, when the pixel amount of the first raw signal data set is 8000 ten thousand and the upper limit of the processing capability of the built-in image signal processor is 2000 ten thousand pixels, it indicates that the pixel amount of the first raw signal data set exceeds the upper limit of the processing capability and should be output to the external image signal processor for processing, rather than processed by the built-in image signal processor.
In an embodiment, when the pixel amount of the first raw signal data set does not exceed the upper limit of the processing capability, the first raw signal data set may be output to the built-in image signal processor for processing, so as to obtain the first processed signal data set. Compared with an external image signal processor, the data transmission speed between the external image signal processor and the built-in image signal processor is higher, the processing efficiency can be improved on the whole, and the delay is reduced.
In an embodiment, when in the preview state, the image sensor may be configured to operate in a down-sampling type, such as a binning mode or a cropping mode in the related art, which is not limited by the present disclosure; based on the down-sampling type of operation mode, the pixel amount of the second raw signal data set generated by the image sensor is made smaller than the first raw signal data set, for example, it can be controlled to a state not exceeding the upper limit of the processing capability of the built-in image signal processor, so that the second raw signal data set generated by the image sensor can be output to the built-in image signal processor, and then the corresponding preview image is shown according to the second processed signal data set output by the built-in image signal processor. Compared with an external image signal processor, the data transmission speed between the external image signal processor and the built-in image signal processor is higher, the processing efficiency can be improved on the whole, and the delay is reduced, so that the phenomenon that the image signal processor is blocked in the previewing process is avoided.
In step 104, a first processed signal data set corresponding to the first original signal data set output by the external image signal processor is obtained.
In an embodiment, when the first raw signal data set is generated for the image sensor based on a shooting instruction, a corresponding image or video may be generated according to the first processed signal data set, thereby completing shooting of the image or video.
In an embodiment, when in the preview state, a corresponding preview image may be shown according to the first processed signal data set, so that a user may view the preview image on a display screen of the terminal to implement a framing operation; in other words, the external image signal processor may also be configured to implement a preview function, and since the pixel amount of the first processed signal data set is greater than that of the second processed signal data set, a clearer preview image with a greater pixel amount can be shown, so that a user can observe a detailed portion of the preview image.
FIG. 2 is a schematic diagram illustrating an output preview image according to an exemplary embodiment. As shown in fig. 2, assuming that the resolution of the Sensor in the terminal is 8000 ten thousand pixels, that is, the photosensitive area of the Sensor contains 8000 ten thousand photosensitive pixels, an original signal data set of 8000 ten thousand pixels can be generated at maximum; meanwhile, assuming that the processing capacity of the built-in ISP in the terminal has an upper limit of 2000 ten thousand pixels, that is, the built-in ISP can process only the original signal data set of 2000 ten thousand pixels, and cannot directly process the original signal data set of 8000 ten thousand pixels generated by the Sensor.
When the electronic device is in the preview mode, the Sensor can work in a Binning mode or a skiping mode, so that the Sensor can obtain an original signal data set with a lower pixel quantity through down-sampling, and the original signal data set meets the upper limit of the processing capacity of the built-in ISP. For example, a Sensor may generate a raw signal data set of 2000 ten thousand pixels so that a built-in ISP can directly process the raw signal data set. The processing manner of the original signal data set may refer to a processing function of the ISP in the related technology, such as AEC (Automatic Exposure Control), AGC (Automatic Gain Control), AWB (Automatic white balance), and the like, which is not limited in this disclosure.
After the processing, the built-in ISP can output a processed signal data set with 2000 ten thousand pixels, and the processed signal data set is used for being displayed on a display screen of the electronic device so that a user can preview the signal data set.
FIG. 3 is a schematic diagram illustrating an output high resolution image according to an exemplary embodiment. As shown in fig. 3, the terminal includes a Sensor having a resolution of 8000 ten thousand pixels and an internal ISP having a processing capacity of 2000 ten thousand pixels at the upper limit. When the electronic device generates a shooting instruction, the camera system can switch from the Binning mode or skiping mode described above to a high resolution output mode so that the Sensor can output the full amount of raw signal data set of 8000 ten thousand pixels.
The built-in ISP cannot process a raw signal data set of 8000 thousand pixels. Therefore, the terminal may be connected to an external ISP, for example, the terminal may be connected to the external ISP through a wired connection through the preset interface described above, or may even establish a wireless connection through a bluetooth protocol, a ZigBee protocol, a WIFI protocol, or a private protocol, which is not limited by the disclosure. Because the external ISP is not limited by the structure of the terminal, the user can select, connect and replace the external ISP at will according to the performance of the Sensor. For example, for a Sensor with a resolution of 8000 ten thousand pixels, an external ISP with an upper limit of processing capability of 8000 ten thousand pixels or even better performance may be selected, so that the terminal may output the original signal data set of 8000 ten thousand pixels generated by the Sensor to the external ISP for processing, and return the correspondingly obtained processed signal data set of 8000 ten thousand pixels to the inside of the terminal, so that the inside of the terminal generates a corresponding image or video according to the processed signal data set, which is consistent with the processing process in the related art and is not described herein again.
Of course, in addition to using the external ISP to generate images or videos, the processed signal data set generated by the external ISP may also be used to generate preview images, which is not limited by this disclosure.
Corresponding to the foregoing embodiments of the image signal processing method, the present disclosure also provides embodiments of an image signal processing apparatus.
Fig. 4 is a block diagram illustrating an image signal processing apparatus according to an exemplary embodiment. Referring to fig. 4, the apparatus includes:
a first output unit 41 configured to output a first raw signal data set generated by the image sensor after a single exposure to an external image signal processor;
an obtaining unit 42 configured to obtain a first processed signal data set corresponding to the first raw signal data set output by the external image signal processor.
As shown in fig. 5, fig. 5 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 4, and the first output unit 41 may include:
a comparison subunit 411 configured to compare the pixel amount of the first raw signal data set with an upper limit of processing capability of a built-in image signal processor;
an output subunit 412 configured to output the first raw signal data set to the external image signal processor when the processing capability upper limit is exceeded.
As shown in fig. 6, fig. 6 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 5:
a second output unit 43 configured to output the first raw signal data set to the built-in image signal processor for processing to obtain the first processed signal data set when the pixel amount of the first raw signal data set does not exceed the processing capability upper limit.
As shown in fig. 7, fig. 7 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 5:
a configuration unit 44 configured to configure the image sensor in a down-sampling type operation mode when in a preview state;
a third output unit 45 configured to output a second raw signal data set generated by the image sensor to the built-in image signal processor;
a first display unit 46 configured to show a corresponding preview image in accordance with the second processed signal data set output by the built-in image signal processor.
As shown in fig. 8, fig. 8 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 4:
a generating unit 47 configured to generate a corresponding image or video from the first processed signal data set when the first raw signal data set is generated for the image sensor based on a shooting instruction.
It should be noted that the structure of the generating unit 47 in the device embodiment shown in fig. 8 may be included in the device embodiment described in any one of fig. 5 to 7, and the present disclosure is not limited thereto.
As shown in fig. 9, fig. 9 is a block diagram of another image signal processing apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 4:
a second display unit 48 configured to show a corresponding preview image according to the first processed signal data set when in a preview state.
It should be noted that the structure of the second display unit 48 in the device embodiment shown in fig. 9 may also be included in the device embodiment described in any one of fig. 5 to 8, and the disclosure is not limited thereto.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Correspondingly, the present disclosure also provides an image signal processing apparatus, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to: outputting a first original signal data set generated by the image sensor after single exposure to an external image signal processor; and acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set.
Accordingly, the present disclosure also provides a terminal comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured for execution by the one or more processors to include instructions for: outputting a first original signal data set generated by the image sensor after single exposure to an external image signal processor; and acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set.
Fig. 10 is a block diagram illustrating an apparatus 1000 for image signal processing according to an exemplary embodiment. For example, the apparatus 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 10, the apparatus 1000 may include one or more of the following components: processing component 1002, memory 1004, power component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, and communications component 1016.
The processing component 1002 generally controls the overall operation of the device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 1002 may include one or more processors 1020 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.
The memory 1004 is configured to store various types of data to support operations at the apparatus 1000. Examples of such data include instructions for any application or method operating on device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 1006 provides power to the various components of the device 1000. The power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1000.
The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1000 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 1010 is configured to output and/or input audio signals. For example, audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when apparatus 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, audio component 1010 also includes a speaker for outputting audio signals.
I/O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 1014 includes one or more sensors for providing various aspects of status assessment for the device 1000. For example, sensor assembly 1014 may detect an open/closed state of device 1000, the relative positioning of components, such as a display and keypad of device 1000, the change in position of device 1000 or a component of device 1000, the presence or absence of user contact with device 1000, the orientation or acceleration/deceleration of device 1000, and the change in temperature of device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1016 is configured to facilitate communications between the apparatus 1000 and other devices in a wired or wireless manner. The device 1000 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1016 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1004 comprising instructions, executable by the processor 1020 of the apparatus 1000 to perform the image signal processing method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. An image signal processing method characterized by comprising:
comparing the pixel quantity of a first raw signal data set generated by the image sensor after single exposure with the upper limit of the processing capacity of a built-in image signal processor;
when the pixel quantity of the first original signal data set exceeds the upper limit of the processing capacity, outputting the first original signal data set to an external image signal processor; acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set;
and when the pixel quantity of the first original signal data set does not exceed the upper limit of the processing capacity, outputting the first original signal data set to the built-in image signal processor for processing to obtain the first processed signal data set.
2. The method of claim 1, further comprising:
configuring the image sensor to a down-sampling type of operating mode when in a preview state;
outputting a second raw signal data set generated by the image sensor to the built-in image signal processor;
and showing a corresponding preview image according to a second processed signal data set output by the built-in image signal processor.
3. The method of claim 1, further comprising:
when the first raw signal data set is generated for the image sensor based on a photographing instruction, a corresponding image or video is generated according to the first processed signal data set.
4. The method of claim 1, further comprising:
when in a preview state, a corresponding preview image is shown according to the first set of processed signal data.
5. An image signal processing apparatus characterized by comprising:
a comparison subunit configured to compare a pixel amount of a first raw signal data set generated by the image sensor after a single exposure with an upper limit of processing capacity of the built-in image signal processor;
a first output unit configured to output the first raw signal data set to an external image signal processor when a pixel amount of the first raw signal data set exceeds the processing capability upper limit; acquiring a first processed signal data set which is output by the external image signal processor and corresponds to the first original signal data set;
a second output unit configured to output the first raw signal data set to the built-in image signal processor for processing to obtain the first processed signal data set when the pixel amount of the first raw signal data set does not exceed the processing capability upper limit.
6. The apparatus of claim 5, further comprising:
a configuration unit configured to configure the image sensor in a down-sampling type operation mode when in a preview state;
a third output unit configured to output a second raw signal data set generated by the image sensor to the built-in image signal processor;
a first display unit configured to show a corresponding preview image according to a second processed signal data set output by the built-in image signal processor.
7. The apparatus of claim 5, further comprising:
a generating unit configured to generate a corresponding image or video from the first processed signal data set when the first raw signal data set is generated for the image sensor based on a photographing instruction.
8. The apparatus of claim 5, further comprising:
a second display unit configured to show a corresponding preview image according to the first processed signal data set when in a preview state.
9. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of any one of claims 1-4 by executing the executable instructions.
10. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 4.
CN201811558540.6A 2018-12-19 2018-12-19 Image signal processing method and device, electronic device and storage medium Active CN111343386B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811558540.6A CN111343386B (en) 2018-12-19 2018-12-19 Image signal processing method and device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811558540.6A CN111343386B (en) 2018-12-19 2018-12-19 Image signal processing method and device, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN111343386A CN111343386A (en) 2020-06-26
CN111343386B true CN111343386B (en) 2022-03-25

Family

ID=71185410

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811558540.6A Active CN111343386B (en) 2018-12-19 2018-12-19 Image signal processing method and device, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN111343386B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484357A (en) * 2021-05-31 2022-12-16 北京小米移动软件有限公司 Image processing method and electronic device
CN115705614B (en) * 2021-08-05 2024-06-28 北京小米移动软件有限公司 Image processing method, device, electronic equipment and storage medium
CN114640798B (en) * 2022-05-09 2022-10-04 荣耀终端有限公司 Image processing method, electronic device, and computer storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1525774A (en) * 2003-03-19 2004-09-01 北京中星微电子有限公司 Image processing method for mobile communication terminal having pick-up head
CN102495756A (en) * 2011-11-07 2012-06-13 北京中星微电子有限公司 Method and system for switching operating system between different central processing units
CN102843235A (en) * 2012-09-06 2012-12-26 汉柏科技有限公司 Message encrypting/decrypting method
CN103901772A (en) * 2014-04-23 2014-07-02 哈尔滨工业大学 Double-DSP redundancy inertial-platform controller
CN105321495A (en) * 2014-06-25 2016-02-10 深圳Tcl新技术有限公司 High-definition display module and display method thereof
CN108769522A (en) * 2018-06-06 2018-11-06 中科创达软件科技(深圳)有限公司 Image processing terminal and image processing method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004265352A (en) * 2003-03-04 2004-09-24 Seiko Epson Corp Information processor
FI20045445A0 (en) * 2004-11-18 2004-11-18 Nokia Corp A method, hardware, software, and arrangement for editing image data
US9389678B2 (en) * 2012-05-15 2016-07-12 Nvidia Corporation Virtual image signal processor
KR102546474B1 (en) * 2016-04-25 2023-06-22 삼성전자주식회사 Method of operating a mobile device and a mobile device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1525774A (en) * 2003-03-19 2004-09-01 北京中星微电子有限公司 Image processing method for mobile communication terminal having pick-up head
CN102495756A (en) * 2011-11-07 2012-06-13 北京中星微电子有限公司 Method and system for switching operating system between different central processing units
CN102843235A (en) * 2012-09-06 2012-12-26 汉柏科技有限公司 Message encrypting/decrypting method
CN103901772A (en) * 2014-04-23 2014-07-02 哈尔滨工业大学 Double-DSP redundancy inertial-platform controller
CN105321495A (en) * 2014-06-25 2016-02-10 深圳Tcl新技术有限公司 High-definition display module and display method thereof
CN108769522A (en) * 2018-06-06 2018-11-06 中科创达软件科技(深圳)有限公司 Image processing terminal and image processing method

Also Published As

Publication number Publication date
CN111343386A (en) 2020-06-26

Similar Documents

Publication Publication Date Title
CN108419016B (en) Shooting method and device and terminal
US9661223B2 (en) Method and device for photographing including camera shake
CN106657780B (en) Image preview method and device
CN106210496B (en) Photo shooting method and device
KR20170037868A (en) Method and device for shooting control
CN105991930A (en) Zoom processing method and device for dual cameras and mobile terminal
CN108462833B (en) Photographing method, photographing device and computer-readable storage medium
CN105245775A (en) Method and device for camera imaging, and mobile terminal
CN104869308A (en) Picture taking method and device
CN111343386B (en) Image signal processing method and device, electronic device and storage medium
CN104216525B (en) Method and device for mode control of camera application
CN105516587A (en) Method for switching cameras and mobile terminal
CN111953903A (en) Shooting method, shooting device, electronic equipment and storage medium
CN110876014B (en) Image processing method and device, electronic device and storage medium
CN108629814B (en) Camera adjusting method and device
CN111343375A (en) Image signal processing method and device, electronic device and storage medium
CN111698414B (en) Image signal processing method and device, electronic device and readable storage medium
CN108769513B (en) Camera photographing method and device
CN106375744B (en) Information projecting method and device
CN115134511A (en) High dynamic range image photographing method and device and storage medium
CN110874829B (en) Image processing method and device, electronic device and storage medium
CN111835977B (en) Image sensor, image generation method and device, electronic device, and storage medium
CN110876000B (en) Camera module, image correction method and device, electronic equipment and storage medium
CN115733913B (en) Continuous photographing method and device and storage medium
CN111225158B (en) Image generation method and device, electronic equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant