CN106572289A - Image processing module of camera module, and mobile terminal - Google Patents

Image processing module of camera module, and mobile terminal Download PDF

Info

Publication number
CN106572289A
CN106572289A CN201610921798.2A CN201610921798A CN106572289A CN 106572289 A CN106572289 A CN 106572289A CN 201610921798 A CN201610921798 A CN 201610921798A CN 106572289 A CN106572289 A CN 106572289A
Authority
CN
China
Prior art keywords
image
electric
ir
rgb
signal
Prior art date
Application number
CN201610921798.2A
Other languages
Chinese (zh)
Other versions
CN106572289B (en
Inventor
熊晨
刘长建
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Priority to CN201610921798.2A priority Critical patent/CN106572289B/en
Publication of CN106572289A publication Critical patent/CN106572289A/en
Application granted granted Critical
Publication of CN106572289B publication Critical patent/CN106572289B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/2251Constructional details
    • H04N5/2253Mounting of pick-up device, electronic image sensor, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23229Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor comprising further processing of the captured image without influencing the image pickup process

Abstract

The embodiments of the invention provide an image processing module of a camera module, and a mobile terminal. An image sensor is arranged in the camera module. The image sensor is provided with an RGB output channel and an IR output channel. The method comprises the following steps: incoming light is collected; the image sensor senses the incoming light and converts the incoming light into image electrical signals, wherein the image electrical signals include RGB image electrical signals and IR image electrical signals; the image sensor separate the RGB image electrical signals and the IR image electrical signals from the image electrical signals; the RGB output channel outputs the RGB image electrical signals, and the IR output channel outputs the IR image electrical signals; and a target image is obtained according to the RGB image electrical signals and the IR image electrical signals. The embodiments are used to solve the problem that dual cameras take up too much space of a mobile terminal.

Description

A kind of image processing method and mobile terminal of camera module

Technical field

The present invention relates to communication technical field, more particularly to a kind of image processing method of camera module and a kind of shifting Dynamic terminal.

Background technology

As the continuous development of electronic product, the mobile terminal with shoot function are increasingly popularized, user can be at any time Shot with it everywhere.In order to obtain more preferable shooting effect, be provided with some mobile terminals on the market at present it is double after Put camera.

Double post-positioned pick-up heads, refer to and two camera modules are provided with the mobile terminal back side.Two camera modules can To improve the shooting effect of mobile terminal.However, because two camera modules in double post-positioned pick-up heads are independent mutually, performing Shooting mutual when working does not affect, and in other words, two camera modules each need the component of complete set, such as camera lens, figure As sensor (sensor), microscope base, motor, substrate etc..It is appreciated that the camera module of this structure is on mobile terminals The space of occupancy can increase, and some functions of may result in mobile terminal are restricted, or damage mobile terminal It is attractive in appearance.

The content of the invention

The embodiment of the present invention provides a kind of image processing method and mobile terminal of camera module, to solve dual camera The excessive problem for taking mobile terminal space.

First aspect, there is provided a kind of method of the image procossing of camera module, methods described is applied to mobile terminal, The camera module is provided with imageing sensor, described image sensor has RGB output channels and IR output channels, institute The method of stating includes:

Collection incident ray;

Described image sensor senses incident ray and conversion forms electric image signal, and described image electric signal includes RGB image electric signal and IR electric image signals;

Described image sensor isolates RGB image electric signal and IR electric image signals from described image electric signal;

The RGB output channels export the RGB image electric signal, and, the IR output channels export the IR figures As electric signal;

Target image is obtained according to the RGB image electric signal and the IR electric image signals.

A kind of second aspect, there is provided mobile terminal, the mobile terminal includes camera module, in the shooting head mould Group is provided with imageing sensor, and described image sensor has RGB output channels and IR output channels, the mobile terminal bag Include:

Incident ray acquisition module, for gathering incident ray;

Electric image signal modular converter, senses incident ray and conversion forms image telecommunications for described image sensor Number, described image electric signal includes RGB image electric signal and IR electric image signals;

Electric image signal separation module, RGB image is isolated for described image sensor from described image electric signal Electric signal and IR electric image signals;

Electric image signal output module, for the RGB output channels RGB image electric signal is exported, and, it is described IR output channels export the IR electric image signals;

Target image generation module, for obtaining target according to the RGB image electric signal and the IR electric image signals Image.

So, in the embodiment of the present invention, imageing sensor is set in the same camera module of mobile terminal, image is passed Sensor includes RGB output channels and IR output channels, can respectively export RGB image electric signal and IR electric image signals.When entering When penetrating light and projecting camera module, electric image signal can be converted to based on image sensor senses incident ray, from this Electric image signal isolates RGB image electric signal and IR electric image signals, and by corresponding output channel RGB image telecommunications is exported Number and IR electric image signals, finally target image can be obtained based on rgb image data and IR view data.Using the present invention Embodiment, realizes the function of two camera modules in same camera module, can realize on the basis of hardware solely Vertical output image data, it is not necessary to processed by software.Additionally, the embodiment of the present invention just can be with by camera module The function that dual camera module has is realized, this simple structure is not only effectively saved existing dual camera module and moved The space taken in dynamic terminal, and also the function that can have with dual camera module simultaneously.

Description of the drawings

In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by institute in the description to the embodiment of the present invention The accompanying drawing that needs are used is briefly described, it should be apparent that, drawings in the following description are only some enforcements of the present invention Example, for those of ordinary skill in the art, without having to pay creative labor, can be with according to these accompanying drawings Obtain other accompanying drawings.

The step of Fig. 1 is a kind of image processing method embodiment of camera module of the embodiment of the present invention one flow chart;

The step of Fig. 2 is a kind of image processing method embodiment of camera module of the embodiment of the present invention two flow chart;

Fig. 3 is a kind of structured flowchart of mobile terminal of the embodiment of the present invention three;

Fig. 3 a are a kind of one of structured flowcharts of mobile terminal of the embodiment of the present invention three;

Fig. 3 b are the two of the structured flowchart of a kind of mobile terminal of the embodiment of the present invention three;

Fig. 3 c are the three of the structured flowchart of a kind of mobile terminal of the embodiment of the present invention three;

Fig. 4 is a kind of block diagram of mobile terminal of the embodiment of the present invention four;

Fig. 5 is a kind of structural representation of mobile terminal of the embodiment of the present invention five.

Specific embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than the embodiment of whole.Based on this Embodiment in bright, the every other enforcement that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.

Embodiment one

Refer to Fig. 1, be the embodiment of the present invention one a kind of camera module image processing method the step of flow chart.

A kind of image processing method of camera module provided in an embodiment of the present invention, is applied to mobile terminal, described Camera module is provided with imageing sensor, and described image sensor has RGB output channels and IR output channels, the method tool Body may include steps of:

Step 101, gathers incident ray.

In implementing, camera module includes camera lens, when light is reflected from subject and is incided During camera module, the camera lens in the camera module gathers the incident ray of subject, operates for follow-up process.

Step 102, described image sensor senses incident ray and conversion forms electric image signal, described image electric signal Include RGB image electric signal and IR electric image signals.

In the camera module of the embodiment of the present invention, imageing sensor could be arranged to only one of which, will can sense To incident ray be converted to the original image electric signal comprising RGB image electric signal and IR electric image signals.The image sensing Utensil has at least two-way output channel, and one is RGB output channels, and another is IR output channels, and the two passages can divide Shu Chu not RGB image electric signal and IR electric image signals.

Imageing sensor, also referred to as photo-sensitive cell, are a kind of equipment for converting optical signals into electronic signal, are the present invention One of important component part of camera module that embodiment is provided.Imageing sensor provided in an embodiment of the present invention includes CCD (Charge Coupled Device, charge coupled cell) and CMOS (Complementary Metal-Oxide Semiconductor, metal oxide semiconductor device) two big class.Specifically, above-mentioned CCD provides good picture quality, resists Flexibility when ability of making an uproar and camera module are designed;But it needs to increase external circuit so that the becoming large-sized of system, complicated Property improve, need in circuit design more flexibly, to lift the performance of CCD camera module as far as possible.Above-mentioned CCD is more suitable for In and application of to cost control less strict very high to camera module performance requirement, such as astronomical, fine definition Medical X-ray image, other need time exposure and the scientific application strict to picture noise requirement.

Above-mentioned CMOS is, come the imageing sensor for producing, have using contemporary large-scale semiconductive integrated circuit production technology High yield rate, integrated level height, small power consumption, the low feature of price.Levels of the CMOS in terms of image quality can be with CCD technology phases Trial of strength, and they are more suitably applied to require little space, small volume, low in energy consumption and be not special to picture noise and quality requirement High occasion.As major part has industrial detection application, security protection security personnel application and most of consumption-orientation business numbers of filler lighting Code camera applications.

At present on mobile terminals the imageing sensor of camera module mainly uses CMOS, is situated between below for CMOS Continue.

CMOS is a kind of typical solid state image sensor, generally by pel array, line driver, row driver, sequential A few part compositions such as control logic, A/D converter, data/address bus output interface, control interface, this several part is generally all integrated On same silicon chip.

CMOS basic functional principles are:First, there is photoelectric effect, in picture in extraneous incident ray irradiation pel array Corresponding electric charge is produced in the pixel cell of pixel array so as to be converted to electric signal.The row of CMOS selects logical block according to need Will, gate corresponding row pixel cell.Electric image signal in row pixel cell is transmitted by the signal bus of respective column To corresponding analogy signal processing unit and A/D converter, it is converted into after digital picture electric signal logical by corresponding output Road is exported.Row therein selects logical block to progressively scan to pel array also can interlacing scan.Row selects logical block With column selection logical block with the use of the window abstraction function that can realize image.

Certainly, other images in addition to CMOS and ccd image sensor can also be adopted in embodiments of the present invention to pass Sensor, as long as the collection of electric image signal can be realized, the embodiment of the present invention is not any limitation as to this.

Step 103, described image sensor isolates RGB image electric signal and IR images electricity from described image electric signal Signal.

In implementing, can skip and ignore some pixels on imageing sensor.The embodiment of the present invention is using this kind of Mode, so as to can just realize that required RGB image electric signal is isolated from electric image signal using an imageing sensor With IR electric image signals, i.e., the separation of electric image signal can be just realized on hardware, it is not necessary to by way of software is controlled To realize.

Step 104, the RGB output channels export the RGB image electric signal, and, the IR output channels output The IR electric image signals.

In a particular application, imageing sensor can include two output channels, so pass through an imageing sensor RGB output channels and IR output channels, it is possible to export respectively from electric image signal separate RGB image electric signal and IR electric image signals.RGB image electric signal and IR electric image signals these data are saved in respectively in the preservation region specified, can To extract whenever necessary and use.

Step 105, according to the RGB image electric signal and the IR electric image signals target image is obtained.

In the concrete application of the present invention, for the RGB image electric signal and IR electric image signals that obtain, can be according to reality Border demand selects corresponding electric image signal individually to be processed or comprehensively processed, such as by digital to analog converter chip Data signal is changed into, to form required target image.Based on the target image for obtaining, it is possible to achieve such as normal image is clapped Take the photograph, with aware space and the depth of field, iris, make the functions such as 3D rendering.

So, in the embodiment of the present invention, imageing sensor is set in the same camera module of mobile terminal, image is passed Sensor includes RGB output channels and IR output channels, can respectively export RGB image electric signal and IR electric image signals.When entering When penetrating light and projecting camera module, electric image signal can be converted to based on image sensor senses incident ray, from this Electric image signal isolates RGB image electric signal and IR electric image signals, and by corresponding output channel RGB image telecommunications is exported Number and IR electric image signals, finally target image can be obtained based on rgb image data and IR view data.Using the present invention Embodiment, realizes the function of two camera modules in same camera module, can realize on the basis of hardware solely Vertical output image data, it is not necessary to processed by software.Additionally, the embodiment of the present invention just can be with by camera module The function that dual camera module has is realized, this simple structure is not only effectively saved existing dual camera module and moved The space taken in dynamic terminal, and also the function that can have with dual camera module simultaneously.

Embodiment two

Refer to Fig. 2, be the embodiment of the present invention two a kind of camera module image processing method the step of flow chart.

A kind of image processing method of camera module provided in an embodiment of the present invention, is applied to mobile terminal, described Camera module is provided with imageing sensor, and described image sensor has RGB output channels and IR output channels, the method tool Body may include steps of:

Step 201, gathers incident ray.

Step 202, described image sensor senses incident ray and conversion forms electric image signal, described image electric signal Include RGB image electric signal and IR electric image signals.

Because 201-202 is similar with embodiment of the method one the step of embodiment two, therefore the present embodiment is for step 201-202 Description in not detailed part, may refer to the related description in preceding method embodiment one, here is not just repeated.

Step 203, described image sensor isolates RGB image electric signal and IR images electricity from described image electric signal Signal.

In implementing, imageing sensor is capable of achieving for some specific pixels are screened, i.e., in imageing sensor Only screening RGB image electric signal that can be from electric image signal, and, imageing sensor only filters out IR from electric image signal Electric image signal, so as to realize electric image signal in RGB image electric signal and IR electric image signals separation, for example:

In an embodiment of the present invention, IR electric image signals can be filtered out from view data, referring in particular to step 203 sub-steps as follows:

Described image sensor removes line by line RGB image electric signal in described image electric signal.

Described image sensor removes by column RGB image electric signal in described image electric signal.

By the electric image signal for having removed RGB image electric signal, as IR electric image signals.

Sampling can be removed with full line permutation in imageing sensor, in other words with reference to row sampling and sampling can be arranged individually Obtain IR electric image signals.Specifically, the row without IR electric image signals can be first removed from electric image signal, then is removed Row without IR electric image signals so that do not have RGB image electric signal in electric image signal, finally give IR electric image signals.

In an embodiment of the present invention, RGB image electric signal can be filtered out from view data, referring in particular to step 203 sub-steps as follows:

The G components around the IR electric image signals are extracted from described image electric signal;

Average G components are calculated based on the G components around described;

The IR electric image signals of the row are substituted using the average G components;

Using the electric image signal after the replacement as RGB image electric signal.

As above the pixel arrangement of the RGB-IR view data of figure, RGB data is without image of Buddha IR data equally by removing full line The mode of permutation is obtained, but can increase view data device inside sensor, then using image algorithm, IR pixels is replaced Change, the G of such as available surrounding pixel is carried out averagely, the G for obtaining finally gives RGB image electric signal mending the IR pixels.

Step 204, the RGB output channels export the RGB image electric signal, and, the IR output channels output The IR electric image signals.

In embodiments of the present invention, the imageing sensor in camera module can be with only one of which, the image sensing utensil There is multiple-channel output passage, RGB image electric signal and IR electric image signals can be accordingly exported respectively.

When imageing sensor generates electric image signal, and sampling obtains RGB image electric signal and IR from electric image signal During electric image signal, can respectively by corresponding output channel output image electric signal.For example, export from RGB output channels RGB image electric signal, and, IR electric image signals are exported by IR output channels.

Because imageing sensor has at least two output channels to export different image telecommunications in same camera module Number, that is, camera module hardware can realize that two-way is exported, you can to export RGB image electric signal and IR images electricity simultaneously Signal so that same camera module can realize the function of completely self-contained two cameras, and be not required to be carried out by software Process.

Step 205, based on the RGB image electric signal target RGB image of colour is obtained, or, schemed based on the IR As electric signal obtains the target IR image of black and white, or, obtained based on the RGB image electric signal and the IR electric image signals Target mixed image.

The camera module of the embodiment of the present invention can collect two-way electric image signal, i.e. RGB image electric signal and IR Electric image signal, equivalent to there is two cameras, with shooting, apparent, shallow depth of field shooting and more preferably low light performance etc. are excellent Point.

Specifically, the first function of embodiment of the present invention camera module is to support that the shallow depth of field is taken pictures, and realizes that background is empty Change, prominent photograph subject;Second function is that have preferably performance under low luminous environment.By the shooting head mould of the embodiment of the present invention Group can analyze which pixel to scene reduction degree it is higher, this can help mobile terminal effectively to inhibit noise, so as to So that image frame possesses more preferably image quality reduction.

For example, the embodiment of the present invention obtains conventional coloured image using RGB image electric signal, due to eliminating IR images Electric signal so that will not rubescent distortion according to the image of RGB image electric signal;Black and white can also be obtained using IR electric image signals Image, based on ultrared characteristic, the black white image of gained can be with aware space and the depth of field;Further, can also be while profit Mixed image is obtained with RGB image electric signal and IR electric image signals, can reflect sky with reference to the image of both characteristics Between information 3D rendering.

Certainly, for the camera module of the embodiment of the present invention isolates RGB image electric signal and IR electric image signals, can To be applied according to the actual requirements, the embodiment of the present invention is not any limitation as to this.

In embodiments of the present invention, by an imageing sensor in the camera module of mobile terminal, on hardware I.e. be capable of achieving electric image signal in RGB image electric signal and IR electric image signals separation and output, it is not necessary to by software come Process so that can just realize the function of dual camera in a camera module.

Embodiment three

Fig. 3 is refer to, is a kind of structured flowchart of mobile terminal 300 of the embodiment of the present invention three.

A kind of mobile terminal provided in an embodiment of the present invention, the mobile terminal can include camera module, described Camera module is provided with imageing sensor, and described image sensor has RGB output channels and IR output channels, the movement Terminal can include incident ray acquisition module 301, electric image signal modular converter 302, electric image signal separation module 303, Electric image signal output module 304 and target image generation module 305.

Incident ray acquisition module 301, for gathering incident ray.

Electric image signal modular converter 302, senses incident ray and conversion forms image electricity for described image sensor Signal, described image electric signal includes RGB image electric signal and IR electric image signals.

Electric image signal separation module 303, for described image sensor RGB figures are isolated from described image electric signal As electric signal and IR electric image signals.

Electric image signal output module 304, for the RGB output channels RGB image electric signal is exported, and, The IR output channels export the IR electric image signals.

Target image generation module 305, obtains for root according to the RGB image electric signal and the IR electric image signals Target image.

Shown in reference picture 3a, in a kind of mobile terminal 300 of the embodiment of the present invention, described image electric signal separation module 303 remove submodule 3031 including first, and second removes submodule 3032 and IR electric image signals acquisition submodule 3033.

First removes submodule 3031, and for described image sensor RGB figures are removed in described image electric signal line by line As electric signal;

Second removes submodule 3032, and for described image sensor RGB figures are removed in described image electric signal by column As electric signal;

IR electric image signals obtain submodule 3033, for by the electric image signal for having removed RGB image electric signal, As IR electric image signals.

Shown in reference picture 3b, in a kind of mobile terminal 300 of the embodiment of the present invention, described image electric signal separation module 303 include G component extractions submodule 3034, and average G components calculating sub module 3035IR electric image signal substitutes submodule 3036 Submodule 3037 is obtained with RGB image electric signal.

G component extractions submodule 3034, for extracting the G around the IR electric image signals from described image electric signal Component;

Average G components calculating sub module 3035, for calculating average G components based on the G components of the surrounding;

IR electric image signals substitute submodule 3036, for substituting the IR image telecommunications of the row using the average G components Number;

RGB image electric signal obtains submodule 3037, for electric using the electric image signal after the replacement as RGB image Signal.

As above the pixel arrangement of the RGB-IR view data of figure, RGB data is without image of Buddha IR data equally by removing full line The mode of permutation is obtained, but can increase image data processor inside sensor, then using image algorithm, IR pixels is entered Row is replaced, and the G of such as available surrounding pixel is carried out averagely, and the G for obtaining is mending the IR pixels.Finally give RGB image electric signal.

Shown in reference picture 3c, in a kind of mobile terminal 300 of the embodiment of the present invention, the target image generation module 305 Submodule 3051 is obtained including target RGB image, target IR image obtains submodule 3052 and target mixed image obtains submodule Block 3053.

Target RGB image obtains submodule 3051, for obtaining target RGB of colour based on the RGB image electric signal Image;

Target IR image obtains submodule 3052, for obtaining the target IR figure of black and white based on the IR electric image signals Picture;

Target mixed image obtains submodule 3053, for based on the RGB image electric signal and the IR images telecommunications Number obtain target mixed image.

In a kind of mobile terminal 300 of the embodiment of the present invention, the camera module arrange imageing sensor Number is one.

For the embodiment of mobile terminal 300, due to itself and embodiment of the method basic simlarity, so the comparison of description is simple Single, related part is illustrated referring to the part of embodiment of the method.

So, in the embodiment of the present invention, imageing sensor is set in the same camera module of mobile terminal, image is passed Sensor includes RGB output channels and IR output channels, can respectively export RGB image electric signal and IR electric image signals.When entering When penetrating light and projecting camera module, incident ray can be converted to by electric image signal based on imageing sensor, from the figure As electric signal isolates RGB image electric signal and IR electric image signals, RGB image electric signal is exported by corresponding output channel With IR electric image signals, finally target image can be obtained based on rgb image data and IR view data.Using of the invention real Example is applied, equivalent to there are two camera modules in same camera module, independent output can be realized on the basis of hardware View data, it is not necessary to processed by software.Additionally, the embodiment of the present invention just can be realized by camera module it is double The function that camera module has, this simple structure not only effectively saves first dual camera module on mobile terminals The space of occupancy, and also can simultaneously retain the function that dual camera module has.

Example IV

Fig. 4 is the block diagram of the mobile terminal 700 of another embodiment of the present invention.

Mobile terminal 700 shown in Fig. 4 includes:At least one processor 701, memory 702, at least one network interface 704 and other users interface 703.Each component in mobile terminal 700 is coupled by bus system 705.It is understood that Bus system 705 is used to realize the connection communication between these components.Bus system 705 is also wrapped in addition to including data/address bus Include power bus, controlling bus and status signal bus in addition.But for the sake of for clear explanation, various buses are all marked in the diagram For bus system 705.

Wherein, user interface 703 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch-screen etc..

It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read- OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM (ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) dodge Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside slow at a high speed Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory (SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory (DirectRambusRAM, DRRAM).The memory 702 of the system and method for embodiment of the present invention description is intended to include but does not limit In these memories with any other suitable type.

In some embodiments, memory 702 stores following element, can perform module or data structure, or Person their subset, or their superset:Operating system 7021 and application program 7022.

Wherein, operating system 7021, comprising various system programs, such as ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and process hardware based task.Application program 7022, comprising various application programs, such as media Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side The program of method may be embodied in application program 7022.

In embodiments of the present invention, by call memory 702 store program or instruction, specifically, can be application The program stored in program 7022 or instruction, processor 701 is used to gather incident ray;Described image sensor senses incident light Line and conversion form electric image signal, described image electric signal includes RGB image electric signal and IR electric image signals;The figure As sensor isolates RGB image electric signal and IR electric image signals from described image electric signal;The RGB output channels are defeated Go out the RGB image electric signal, and, the IR output channels export the IR electric image signals;According to RGB image electricity Signal and the IR electric image signals obtain target image.

The method that the embodiments of the present invention are disclosed can apply in processor 701, or be realized by processor 701. A kind of possibly IC chip of processor 701, the disposal ability with signal.During realization, said method it is each Step can be completed by the instruction of the integrated logic circuit of the hardware in processor 701 or software form.Above-mentioned process Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), special IC (ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array (FieldProgrammableGateArray, FPGA) either other PLDs, discrete gate or transistor logic Device, discrete hardware components.Can realize or perform disclosed each method in the embodiment of the present invention, step and box Figure.General processor can be microprocessor or the processor can also be any conventional processor etc..With reference to the present invention The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform and complete, or use decoding processor In hardware and software module combination execution complete.Software module may be located at random access memory, and flash memory, read-only storage can In the ripe storage medium in this area such as program read-only memory or electrically erasable programmable memory, register.The storage Medium is located at memory 702, and processor 701 reads the information in memory 702, with reference to its hardware the step of said method is completed Suddenly.

It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or its combination are realizing.For hardware is realized, processing unit can be realized in one or more special ICs (ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor (DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray, FPGA), general processor, controller, microcontroller, microprocessor, other the electronics lists for performing herein described function In unit or its combination.

For software realize, can pass through perform the embodiment of the present invention described in function module (such as process, function etc.) come Realize the technology described in the embodiment of the present invention.Software code is storable in memory and by computing device.Memory can To realize within a processor or outside processor.

Alternatively, processor 701 is additionally operable to:Described image sensor removes line by line RGB figures in described image electric signal As electric signal;Described image sensor removes by column RGB image electric signal in described image electric signal;Remove described The electric image signal of RGB image electric signal, as IR electric image signals.

Alternatively, processor 701 is additionally operable to:The G around the IR electric image signals is extracted from described image electric signal Component;Average G components are calculated based on the G components around described;The IR image telecommunications of the row is substituted using the average G components Number;Using the electric image signal after the replacement as RGB image electric signal.

Alternatively, processor 701 is additionally operable to:The target RGB image of colour is obtained based on the RGB image electric signal;Base The target IR image of black and white is obtained in the IR electric image signals;And, based on the RGB image electric signal and the IR images Electric signal obtains target mixed image.

Mobile terminal 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here Repeat no more.

So, in the embodiment of the present invention, imageing sensor is set in the same camera module of mobile terminal, image is passed Sensor includes RGB output channels and IR output channels, can respectively export RGB image electric signal and IR electric image signals.When entering When penetrating light and projecting camera module, electric image signal can be converted to based on image sensor senses incident ray, from this Electric image signal isolates RGB image electric signal and IR electric image signals, and by corresponding output channel RGB image telecommunications is exported Number and IR electric image signals, finally target image can be obtained based on rgb image data and IR view data.Using the present invention Embodiment, realizes the function of two camera modules in same camera module, can realize on the basis of hardware solely Vertical output image data, it is not necessary to processed by software.Additionally, the embodiment of the present invention just can be with by camera module The function that dual camera module has is realized, this simple structure is not only effectively saved existing dual camera module and moved The space taken in dynamic terminal, and also the function that can have with dual camera module simultaneously.

Embodiment five

Fig. 5 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5 800 can be mobile phone, panel computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer Deng.

Mobile terminal 800 in Fig. 5 includes that radio frequency (RadioFrequency, RF) circuit 810, memory 820, input are single Unit 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply 890。

Wherein, input block 830 can be used for the numeral or character information of receiving user's input, and produce and mobile terminal The signal input that 800 user is arranged and function control is relevant.Specifically, in the embodiment of the present invention, the input block 830 can With including contact panel 831.Contact panel 831, also referred to as touch-screen, can collect user thereon or neighbouring touch operation (such as user uses the operations of any suitable object or annex on contact panel 831 such as finger, stylus), and according to advance The formula of setting drives corresponding attachment means.Optionally, contact panel 831 may include touch detecting apparatus and touch controller Two parts.Wherein, touch detecting apparatus detect the touch orientation of user, and detect the signal that touch operation brings, by signal Send touch controller to;Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, Give the processor 860 again, and the order sent of receiving processor 860 and can be performed.Furthermore, it is possible to using resistance-type, The polytypes such as condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input block 830 can also include other input equipments 832, and other input equipments 832 can include but is not limited to physical keyboard, function key One or more in (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..

Wherein, display unit 840 can be used for display by the information of user input or be supplied to information and the movement of user The various menu interfaces of terminal 800.Display unit 840 may include display floater 841, optionally, can adopt LCD or organic The forms such as optical diode (OrganicLight-EmittingDiode, OLED) are configuring display floater 841.

It should be noted that contact panel 831 can cover display floater 841, touch display screen is formed, when the touch display screen inspection Measure thereon or after neighbouring touch operation, processor 860 is sent to determine the type of touch event, with preprocessor 860 provide corresponding visual output according to the type of touch event in touch display screen.

Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And the arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area be used for show the higher control of utilization rate, for example, Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..

Wherein processor 860 is the control centre of mobile terminal 800, using various interfaces and connection whole mobile phone Various pieces, the software program and/or module being stored in by operation or execution in first memory 821, and call storage Data in second memory 822, perform the various functions and processing data of mobile terminal 800, so as to mobile terminal 800 Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.

In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/ Or the data in the second memory 822, processor 860 be used for gather incident ray;Described image sensor senses incident light Line and conversion form electric image signal, described image electric signal includes RGB image electric signal and IR electric image signals;The figure As sensor isolates RGB image electric signal and IR electric image signals from described image electric signal;The RGB output channels are defeated Go out the RGB image electric signal, and, the IR output channels export the IR electric image signals;According to RGB image electricity Signal and the IR electric image signals obtain target image.

The processor 860 is additionally operable to:Described image sensor removes line by line RGB image electricity in described image electric signal Signal;Described image sensor removes by column RGB image electric signal in described image electric signal;RGB figures have been removed by described As the electric image signal of electric signal, as IR electric image signals.

The processor 860 is additionally operable to:G point around the IR electric image signals is extracted from described image electric signal Amount;Average G components are calculated based on the G components around described;The IR image telecommunications of the row is substituted using the average G components Number;Using the electric image signal after the replacement as RGB image electric signal.

The processor 860 is additionally operable to:The target RGB image of colour is obtained based on the RGB image electric signal;Based on institute State the target IR image that IR electric image signals obtain black and white;And, based on the RGB image electric signal and the IR images telecommunications Number obtain target mixed image.

For the embodiment of mobile terminal 800, due to itself and embodiment of the method basic simlarity, so the comparison of description is simple Single, related part is illustrated referring to the part of embodiment of the method.

So, in the embodiment of the present invention, imageing sensor is set in the same camera module of mobile terminal, image is passed Sensor includes RGB output channels and IR output channels, can respectively export RGB image electric signal and IR electric image signals.When entering When penetrating light and projecting camera module, electric image signal can be converted to based on image sensor senses incident ray, from this Electric image signal isolates RGB image electric signal and IR electric image signals, and by corresponding output channel RGB image telecommunications is exported Number and IR electric image signals, finally target image can be obtained based on rgb image data and IR view data.Using the present invention Embodiment, realizes the function of two camera modules in same camera module, can realize on the basis of hardware solely Vertical output image data, it is not necessary to processed by software.Additionally, the embodiment of the present invention just can be with by camera module The function that dual camera module has is realized, this simple structure is not only effectively saved existing dual camera module and moved The space taken in dynamic terminal, and also the function that can have with dual camera module simultaneously.

Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each The unit and algorithm steps of example, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty Technical staff can use different methods to realize described function to each specific application, but this realization should not Think beyond the scope of this invention.

Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.

In embodiment provided herein, it should be understood that disclosed apparatus and method, can pass through other Mode is realized.For example, device embodiment described above is only schematic, and for example, the division of the unit is only A kind of division of logic function, can there is an other dividing mode when actually realizing, such as multiple units or component can with reference to or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, device or unit Connect, can be electrical, mechanical or other forms.

The unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can according to the actual needs be selected to realize the mesh of this embodiment scheme 's.

In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.

If the function is realized and as independent production marketing or when using using in the form of SFU software functional unit, can be with In being stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention. And aforesaid storage medium includes:USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.

The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, all should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (10)

1. a kind of image processing method of camera module, is applied to mobile terminal, it is characterised in that in the camera module Imageing sensor is provided with, described image sensor has RGB output channels and IR output channels, and methods described includes:
Collection incident ray;
Described image sensor senses incident ray and conversion forms electric image signal, and described image electric signal includes that RGB schemes As electric signal and IR electric image signals;
Described image sensor isolates RGB image electric signal and IR electric image signals from described image electric signal;
The RGB output channels export the RGB image electric signal, and, the IR output channels export the IR images electricity Signal;
Target image is obtained according to the RGB image electric signal and the IR electric image signals.
2. method according to claim 1, it is characterised in that described image sensor is isolated from electric image signal The step of RGB image electric signal and IR electric image signals, includes:
Described image sensor removes line by line RGB image electric signal in described image electric signal;
Described image sensor removes by column RGB image electric signal in described image electric signal;
By the electric image signal for having removed RGB image electric signal, as IR electric image signals.
3. method according to claim 1, it is characterised in that it is described based on described image sensor from electric image signal The step of isolating RGB image electric signal and IR electric image signals includes:
The G components around the IR electric image signals are extracted from described image electric signal;
Average G components are calculated based on the G components around described;
The IR electric image signals of the row are substituted using the average G components;
Using the electric image signal after the replacement as RGB image electric signal.
4. method according to claim 1, it is characterised in that described according to RGB image electric signal and IR images electricity The step of signal obtains target image includes:
The target RGB image of colour is obtained based on the RGB image electric signal;
The target IR image of black and white is obtained based on the IR electric image signals;
And, target mixed image is obtained based on the RGB image electric signal and the IR electric image signals.
5. method according to claim 1, it is characterised in that the imageing sensor arranged in the camera module Number is one.
6. a kind of mobile terminal, it is characterised in that the mobile terminal includes camera module, is arranged in the camera module There is imageing sensor, described image sensor has RGB output channels and IR output channels, and the mobile terminal includes:
Incident ray acquisition module, for gathering incident ray;
Electric image signal modular converter, senses incident ray and conversion forms electric image signal, institute for described image sensor Stating electric image signal includes RGB image electric signal and IR electric image signals;
Electric image signal separation module, for described image sensor RGB image telecommunications is isolated from described image electric signal Number and IR electric image signals;
Electric image signal output module, for the RGB output channels RGB image electric signal is exported, and, the IR is defeated Go out path and export the IR electric image signals;
Target image generation module, for obtaining target image according to the RGB image electric signal and the IR electric image signals.
7. mobile terminal according to claim 6, it is characterised in that described image electric signal separation module includes:
First removes submodule, and for described image sensor RGB image electric signal is removed in described image electric signal line by line;
Second removes submodule, and for described image sensor RGB image electric signal is removed in described image electric signal by column;
IR electric image signals obtain submodule, for by the electric image signal for having removed RGB image electric signal, as IR figures As electric signal.
8. mobile terminal according to claim 6, it is characterised in that stating electric image signal separation module includes:
G component extraction submodules, for extracting the G components around the IR electric image signals from described image electric signal;
Average G component calculating sub modules, for calculating average G components based on the G components of the surrounding;
IR electric image signals substitute submodule, for substituting the IR electric image signals of the row using the average G components;
RGB image electric signal obtain submodule, for using the electric image signal after the replacement as RGB image electric signal.
9. mobile terminal according to claim 6, it is characterised in that the target image generation module includes:
Target RGB image obtains submodule, for obtaining the target RGB image of colour based on the RGB image electric signal;
Target IR image obtains submodule, for obtaining the target IR image of black and white based on the IR electric image signals;
Target mixed image obtains submodule, for obtaining mesh based on the RGB image electric signal and the IR electric image signals Mark mixed image.
10. method according to claim 6, it is characterised in that the imageing sensor arranged in the camera module Number is one.
CN201610921798.2A 2016-10-21 2016-10-21 A kind of image processing method and mobile terminal of camera module CN106572289B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610921798.2A CN106572289B (en) 2016-10-21 2016-10-21 A kind of image processing method and mobile terminal of camera module

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610921798.2A CN106572289B (en) 2016-10-21 2016-10-21 A kind of image processing method and mobile terminal of camera module

Publications (2)

Publication Number Publication Date
CN106572289A true CN106572289A (en) 2017-04-19
CN106572289B CN106572289B (en) 2019-08-20

Family

ID=60414372

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610921798.2A CN106572289B (en) 2016-10-21 2016-10-21 A kind of image processing method and mobile terminal of camera module

Country Status (1)

Country Link
CN (1) CN106572289B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108965654A (en) * 2018-02-11 2018-12-07 浙江宇视科技有限公司 Double spectrum camera systems and image processing method based on single-sensor

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103376617A (en) * 2012-04-16 2013-10-30 索尼公司 Image sensor, control method of image sensor, and imaging apparatus
US20150035961A1 (en) * 2013-08-02 2015-02-05 Qualcomm Incorporated Feature identification using an rgb-nir camera pair
CN104463112A (en) * 2014-11-27 2015-03-25 深圳市科葩信息技术有限公司 Method and system for carrying out biological recognition through RGB+IR image sensor
CN105763848A (en) * 2016-03-03 2016-07-13 浙江宇视科技有限公司 Fish-eye camera rear end access method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103376617A (en) * 2012-04-16 2013-10-30 索尼公司 Image sensor, control method of image sensor, and imaging apparatus
US20150035961A1 (en) * 2013-08-02 2015-02-05 Qualcomm Incorporated Feature identification using an rgb-nir camera pair
CN104463112A (en) * 2014-11-27 2015-03-25 深圳市科葩信息技术有限公司 Method and system for carrying out biological recognition through RGB+IR image sensor
CN105763848A (en) * 2016-03-03 2016-07-13 浙江宇视科技有限公司 Fish-eye camera rear end access method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108965654A (en) * 2018-02-11 2018-12-07 浙江宇视科技有限公司 Double spectrum camera systems and image processing method based on single-sensor

Also Published As

Publication number Publication date
CN106572289B (en) 2019-08-20

Similar Documents

Publication Publication Date Title
CN105100609B (en) The adjusting method of mobile terminal and acquisition parameters
CN105491294B (en) Image processing apparatus, image capturing device and image processing method
US10212377B2 (en) Solid-state image sensing apparatus
US9529444B2 (en) Recording and reproducing apparatus
CN103729160B (en) Multi-display equipment and multi display method
CN102640499B (en) System and method for demosaicing image data using weighted gradients
CN104407760B (en) A kind of In-cell touch panel and display device
CN103531603B (en) A kind of cmos image sensor
US9542044B2 (en) Multi-touch positioning method and multi-touch screen
CN102572265B (en) The auto-focusing with the image statistics data of rough and meticulous auto-focusing mark is used to control
US8648831B2 (en) Touch position detection apparatus and method using multistage scan
CN102736788B (en) There is display floater, drive circuit and the electronic unit touching detection function
CN102736789B (en) Display floater, the method driving it, drive circuit and electronic unit
KR101387404B1 (en) Apparatus of controlling digital image processing apparatus and method thereof
CN105227869B (en) Has the imaging sensor of time-interleaving image output
CN102799306B (en) Display floater, driving method, drive circuit, electronic installation
RU2545519C1 (en) Apparatus for computer-based panoramic television surveillance system and photodetector setup therefor
US20140293066A1 (en) System and method for lens shading image correction
CN107632733A (en) touch detection apparatus
CN103970354B (en) A kind of In-cell touch panel and display device
US9496005B2 (en) Electronic apparatus, display control method and program for displaying an image for selecting a content item to be reproduced
US9538106B2 (en) Image sensor having a uniform digital power signature
CN101355631B (en) Image processor and digital camera
KR20140137738A (en) Image display method, image display apparatus and recordable media
CN104238850A (en) Display device with touch detection function and electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant