CN105100566A - Camera module, photographing device and multispectral imaging method - Google Patents
Camera module, photographing device and multispectral imaging method Download PDFInfo
- Publication number
- CN105100566A CN105100566A CN201510287706.5A CN201510287706A CN105100566A CN 105100566 A CN105100566 A CN 105100566A CN 201510287706 A CN201510287706 A CN 201510287706A CN 105100566 A CN105100566 A CN 105100566A
- Authority
- CN
- China
- Prior art keywords
- imaging lens
- photo
- sensitive cell
- camera module
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Studio Devices (AREA)
Abstract
The invention discloses a camera module, a photographing device and a multispectral imaging method. The camera module comprises an imaging lens and a photosensitive element, wherein the position of the imaging lens corresponds to the position of the photosensitive element, the camera module further comprises a rotatable optical filter assembly arranged between the imaging lens and the photosensitive element, and the optical filter assembly is used for rotating different band pass filters between the imaging lens and the photosensitive element, so as to separate an emergent light beam of the imaging lens into light of corresponding spectral bands through the band pass filters. The camera module disclosed by the invention can improve the utilization rate of light energy of a spectral imaging system and reduce the space occupancy of the system, which is beneficial to the miniaturization of the system.
Description
Technical field
The present invention relates to multi-optical spectrum imaging technology field, particularly relate to a kind of method of camera module, filming apparatus and multispectral imaging.
Background technology
Along with the development of multi-optical spectrum imaging technology, the range of application of multi-optical spectrum imaging system constantly expands.For reaching different testing goals, usually different spectral band imaging is carried out to object at numerous areas such as agricultural, criminal investigation, medical science, different spectral band contains the different shape characteristic information of object, for analysis, detection, monitoring, measurement etc. provide foundation more accurately.As in agriculture field, by the narrow band imaging different from visible ray to infrared ray to crops, the disease and pest of diagnosable crops, the growth conditions etc. of detection crops; In criminal investigation field, by carrying out imaging to the different spectral band of exhibit, can differentiate whether exhibit was once smeared, distorted; At medical domain, by different spectral band imaging, from fused images, the diseased region of human body can be found out intuitively; In photography, the colouring information etc. of scenery can be gone out by accurate reconstruction by multiple spectrum picture.
As shown in Figure 1, traditional multi-optical spectrum imaging system utilizes spectroscope 1 that incident beam is divided into some Shu Guang usually, and respectively through different bandpass filters 2, be incident to different detection channels (camera 3) with the light isolating different spectral bands.Traditional multi-optical spectrum imaging system not only needs multiple passage camera 3 to obtain different spectrum segment image, and incident light divides the light energy that can cause being incident to each passage after 2 light to decline through spectroscope, the system efficiency of light energy utilization declines, can for ensureing that the light energy being incident to each passage can meet detection demand in prior art, usually the clear aperature of system is done larger, make multi-optical spectrum imaging system take very large space like this, be unfavorable for system compact.
Foregoing, only for auxiliary understanding technical scheme of the present invention, does not represent and admits that foregoing is prior art.
Summary of the invention
Main purpose of the present invention is a kind of method providing camera module, filming apparatus and multispectral imaging, and the efficiency of light energy utilization being intended to solve multi-optical spectrum imaging system declines and the large technical problem that takes up room.
For achieving the above object, the invention provides a kind of camera module, described camera module comprises imaging lens and photo-sensitive cell, and the position of described imaging lens is corresponding with the position of described photo-sensitive cell,
Described camera module also comprises that be placed between described imaging lens and photo-sensitive cell, rotatable optical filter box, described optical filter box is used for rotating between described imaging lens and photo-sensitive cell by different bandpass filters, the outgoing beam of described imaging lens to be separated into by described bandpass filter the light of corresponding spectral band.
Preferably, described optical filter box comprise rotated by Electric Machine Control rotating shaft, by the rotating disk of described rotating shaft driven rotary and multiple bandpass filters of being arranged on described rotating disk.
Preferably, described photo-sensitive cell is charge coupled cell or metal oxide semiconductor device.
In addition, for achieving the above object, the present invention also provides a kind of filming apparatus, and described filming apparatus comprises camera module, and described camera module comprises imaging lens and photo-sensitive cell, and the position of described imaging lens is corresponding with the position of described photo-sensitive cell,
Described camera module also comprises that be placed between described imaging lens and photo-sensitive cell, rotatable optical filter box, described optical filter box is used for rotating between described imaging lens and photo-sensitive cell by different bandpass filters, the outgoing beam of described imaging lens to be separated into by described bandpass filter the light of corresponding spectral band.
Preferably, described optical filter box comprise rotated by Electric Machine Control rotating shaft, by the rotating disk of described rotating shaft driven rotary and multiple bandpass filters of being arranged on described rotating disk.
Preferably, described photo-sensitive cell is charge coupled cell or metal oxide semiconductor device.
Preferably, described filming apparatus also comprises integrated unit, for collected image is carried out fusion treatment, obtains fused images.
In addition, for achieving the above object, the present invention also provides a kind of method being applied to the multispectral imaging of above-mentioned filming apparatus, and the method for described multispectral imaging comprises:
Obtain the outgoing beam of imaging lens;
Control optical filter box to rotate, different bandpass filters is rotated between described imaging lens and photo-sensitive cell, described outgoing beam to be separated into by described bandpass filter the light of corresponding spectral band;
Gather the image that the light of the spectral band be isolated to is corresponding.
Preferably, the method for described multispectral imaging also comprises:
Collected image is carried out fusion treatment, obtains fused images.
The method of a kind of camera module of the present invention, filming apparatus and multispectral imaging, only make use of a passage and namely can complete multispectral imaging, the space shared by camera module reduces greatly, is conducive to system compact; Optical filter box is rotated by driven by motor, different bandpass filters is rotated between imaging lens and photo-sensitive cell, the outgoing beam of imaging lens is not needed to carry out light splitting, greatly improve the system efficiency of light energy utilization, cost-saving, automatic switchover bandpass filter can be reached and reach the object of spectral band imaging.
Accompanying drawing explanation
Fig. 1 is the structural representation of multi-optical spectrum imaging system in prior art;
Fig. 2 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention;
Fig. 3 is the hardware configuration schematic diagram of filming apparatus as shown in Figure 2;
Fig. 4 is the schematic flow sheet of camera module one embodiment of the present invention;
Fig. 5 is the high-level schematic functional block diagram of method first embodiment of multispectral imaging of the present invention;
Fig. 6 is the high-level schematic functional block diagram of method second embodiment of multispectral imaging of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix of such as " module ", " parts " or " unit " for representing element only in order to be conducive to explanation of the present invention, itself is specific meaning not.Therefore, " module " and " parts " can mixedly use.
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as mobile terminal of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desktop computer etc.Below, suppose that terminal is mobile terminal.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.
Fig. 2 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention.
Mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) input unit 120, user input unit 130, sensing cell 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190 etc.Fig. 2 shows the mobile terminal with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows the radio communication between mobile terminal 100 and radio communication device or network.Such as, wireless communication unit can comprise at least one in broadcast reception module 111, mobile communication module 112, wireless Internet module 113, short range communication module 114 and positional information module 115.
Broadcast reception module 111 via broadcast channel from external broadcasting management server receiving broadcast signal and/or broadcast related information.Broadcast channel can comprise satellite channel and/or terrestrial channel.Broadcast management server can be generate and send the server of broadcast singal and/or broadcast related information or the broadcast singal generated before receiving and/or broadcast related information and send it to the server of terminal.Broadcast singal can comprise TV broadcast singal, radio signals, data broadcasting signal etc.And broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast related information also can provide via mobile communications network, and in this case, broadcast related information can be received by mobile communication module 112.Broadcast singal can exist in a variety of manners, such as, it can exist with the form of the electronic service guidebooks (ESG) of the electronic program guides of DMB (DMB) (EPG), digital video broadcast-handheld (DVB-H) etc.Broadcast reception module 111 can by using the broadcast of various types of broadcaster Received signal strength.Especially, broadcast reception module 111 can by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video broadcasting-hand-held (DVB-H), forward link media (MediaFLO
) the digital broadcast apparatus receiving digital broadcast of data broadcast device, received terrestrial digital broadcasting integrated service (ISDB-T) etc.Broadcast reception module 111 can be constructed to be applicable to providing the various broadcaster of broadcast singal and above-mentioned digital broadcast apparatus.The broadcast singal received via broadcast reception module 111 and/or broadcast related information can be stored in memory 160 (or storage medium of other type).
Radio signal is sent at least one in base station (such as, access point, Node B etc.), exterior terminal and server and/or receives radio signals from it by mobile communication module 112.Various types of data that such radio signal can comprise voice call signal, video calling signal or send according to text and/or Multimedia Message and/or receive.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be inner or be externally couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can comprise WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.
Short range communication module 114 is the modules for supporting junction service.Some examples of short-range communication technology comprise bluetooth
tM, radio-frequency (RF) identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee
tMetc..
Positional information module 115 is the modules of positional information for checking or obtain mobile terminal.The typical case of positional information module is GPS (global pick device).According to current technology, GPS module 115 calculates from the range information of three or more satellite and correct time information and for the Information application triangulation calculated, thus calculates three-dimensional current location information according to longitude, latitude and pin-point accuracy.Current, the method for calculating location and temporal information uses three satellites and by the error of the position that uses an other satellite correction calculation to go out and temporal information.In addition, GPS module 115 can carry out computational speed information by Continuous plus current location information in real time.
A/V input unit 120 is for audio reception or vision signal.A/V input unit 120 can comprise camera 121 and microphone 122, and the view data of camera 121 to the static images obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display unit 151.Picture frame after camera 121 processes can be stored in memory 160 (or other storage medium) or via wireless communication unit 110 and send, and can provide two or more cameras 121 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by microphone 122.Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when telephone calling model.Microphone 122 can be implemented various types of noise and eliminate (or suppress) algorithm and receiving and sending to eliminate (or suppression) noise or interference that produce in the process of audio signal.
User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and keyboard, the young sheet of pot, touch pad (such as, detecting the touch-sensitive assembly of the change of the resistance, pressure, electric capacity etc. that cause owing to being touched), roller, rocking bar etc. can be comprised.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch-screen can be formed.
Sensing cell 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close state), the position of mobile terminal 100, user for mobile terminal 100 contact (namely, touch input) presence or absence, the orientation of mobile terminal 100, the acceleration of mobile terminal 100 or speed is moved and direction etc., and generate order or the signal of the operation for controlling mobile terminal 100.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing cell 140 can sense this sliding-type phone and open or close.In addition, whether whether sensing cell 140 can detect power subsystem 190 provides electric power or interface unit 170 to couple with external device (ED).Sensing cell 140 can comprise proximity transducer 1410 and will be described this in conjunction with touch-screen below.
Interface unit 170 is used as at least one external device (ED) and is connected the interface that can pass through with mobile terminal 100.Such as, external device (ED) can comprise wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port, audio frequency I/O (I/O) port, video i/o port, ear port etc. of the device with identification module.Identification module can be that storage uses the various information of mobile terminal 100 for authentication of users and can comprise subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc.In addition, the device (hereinafter referred to " recognition device ") with identification module can take the form of smart card, and therefore, recognition device can be connected with mobile terminal 100 via port or other jockey.Interface unit 170 may be used for receive from external device (ED) input (such as, data message, electric power etc.) and the input received be transferred to the one or more element in mobile terminal 100 or may be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it electric power to be provided to the path of mobile terminal 100 from base or can be used as the path that allows to be transferred to mobile terminal by it from the various command signals of base input.The various command signal inputted from base or electric power can be used as and identify whether mobile terminal is arranged on the signal base exactly.Output unit 150 is constructed to provide output signal (such as, audio signal, vision signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can comprise display unit 151, dio Output Modules 152, alarm unit 153 etc.
Display unit 151 may be displayed on the information of process in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display unit 151 can show with call or other communicate (such as, text messaging, multimedia file are downloaded etc.) be correlated with user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern or image capture mode, display unit 151 can the image of display capture and/or the image of reception, UI or GUI that video or image and correlation function are shown etc.
Meanwhile, when display unit 151 and touch pad as a layer superposed on one another to form touch-screen time, display unit 151 can be used as input unit and output device.Display unit 151 can comprise at least one in liquid crystal display (LCD), thin-film transistor LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc.Some in these displays can be constructed to transparence and watch from outside to allow user, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc.According to the specific execution mode wanted, mobile terminal 100 can comprise two or more display units (or other display unit), such as, mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detecting touch input pressure and touch input position and touch and inputs area.
When dio Output Modules 152 can be under the isotypes such as call signal receiving mode, call mode, logging mode, speech recognition mode, broadcast reception mode at mobile terminal, voice data convert audio signals that is that wireless communication unit 110 is received or that store in memory 160 and exporting as sound.And dio Output Modules 152 can provide the audio frequency relevant to the specific function that mobile terminal 100 performs to export (such as, call signal receives sound, message sink sound etc.).Dio Output Modules 152 can comprise pick-up, buzzer etc.
Alarm unit 153 can provide and export that event informed to mobile terminal 100.Typical event can comprise calling reception, message sink, key signals input, touch input etc.Except audio or video exports, alarm unit 153 can provide in a different manner and export with the generation of notification event.Such as, alarm unit 153 can provide output with the form of vibration, when receive calling, message or some other enter communication (incomingcommunication) time, alarm unit 153 can provide sense of touch to export (that is, vibrating) to notify to user.By providing such sense of touch to export, even if when the mobile phone of user is in the pocket of user, user also can identify the generation of various event.Alarm unit 153 also can provide the output of the generation of notification event via display unit 151 or dio Output Modules 152.
Memory 160 software program that can store process and the control operation performed by controller 180 etc., or temporarily can store oneself through exporting the data (such as, telephone directory, message, still image, video etc.) that maybe will export.And, memory 160 can store about when touch be applied to touch-screen time the vibration of various modes that exports and the data of audio signal.
Memory 160 can comprise the storage medium of at least one type, described storage medium comprises flash memory, hard disk, multimedia card, card-type memory (such as, SD or DX memory etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc.And mobile terminal 100 can be connected the memory function of execute store 160 network storage device with by network cooperates.
Controller 180 controls the overall operation of mobile terminal usually.Such as, controller 180 performs the control relevant to voice call, data communication, video calling etc. and process.In addition, controller 180 can comprise the multi-media module 181 for reproducing (or playback) multi-medium data, and multi-media module 181 can be configured in controller 180, or can be configured to be separated with controller 180.Controller 180 can pattern recognition process, is identified as character or image so that input is drawn in the handwriting input performed on the touchscreen or picture.
Power subsystem 190 receives external power or internal power and provides each element of operation and the suitable electric power needed for assembly under the control of controller 180.
Various execution mode described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, execution mode described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such execution mode can be implemented in controller 180.For implement software, the execution mode of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in memory 160 and to be performed by controller 180.
So far, oneself is through the mobile terminal according to its functional description.Below, for the sake of brevity, by the slide type mobile terminal that describes in various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.
With reference to the electrical structure block diagram that Fig. 3, Fig. 3 are camera in Fig. 2.
Phtographic lens 1211 is made up of the multiple optical lens for the formation of shot object image, is single-focus lens or zoom lens.Phtographic lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, lens driver 1221 is according to the control signal from lens driving control circuit 1222, control the focal position of phtographic lens 1211, when zoom lens, also can control focal length.Lens driving control circuit 1222 carries out the drived control of lens driver 1221 according to the control command from microcomputer 1217.
Imaging apparatus 1212 is configured with near the position of the shot object image formed on the optical axis of phtographic lens 1211, by phtographic lens 1211.Imaging apparatus 1212 is for making a video recording to shot object image and obtaining image data.On imaging apparatus 1212 two dimension and be arranged in a matrix the photodiode forming each pixel.Each photodiode produces the opto-electronic conversion electric current corresponding with light income, and this opto-electronic conversion electric current carries out charge accumulation by the capacitor be connected with each photodiode.The front surface of each pixel is configured with the RGB colour filter of Bayer arrangement.
Imaging apparatus 1212 is connected with imaging circuit 1213, this imaging circuit 1213 carries out charge accumulation and controls and picture signal reading control in imaging apparatus 1212, to the picture signal (analog picture signal) of this reading reduce reset noise after carry out waveform shaping, and then carry out gain raising etc. to become suitable signal level.Imaging circuit 1213 is connected with A/D converter 1214, and this A/D converter 1214 pairs of analog picture signals carry out analog-to-digital conversion, to bus 1227 output digital image signal (hereinafter referred to as view data).
Bus 1227 is the transfer paths of the various data that the inside for being transmitted in camera reads or generates.Above-mentioned A/D converter 1214 is connected in bus 1227, be connected to image processor 1215, jpeg processor 1216, microcomputer 1217, SDRAM (SynchronousDynamicrandomaccessmemory in addition, SDRAM) 1218, memory interface (hereinafter referred to as memory I/F) 1219, LCD (LiquidCrystalDisplay, liquid crystal display) driver 1220.
Image processor 1215 carries out OB to the view data of the output based on imaging apparatus 1212 and subtracts each other process, blank level adjustment, color matrix computing, gamma conversion, color difference signal process, noise removal process, changes the various image procossing such as process, edge treated simultaneously.Jpeg processor 1216 by Imagery Data Recording in recording medium 1225 time, according to JPEG compress mode compression from SDRAM1218 read view data.In addition, jpeg processor 1216 carries out the decompression of jpeg image data in order to carry out image reproducing display.When decompressing, read the file that is recorded in recording medium 1225, implement decompression in jpeg processor 1216 after, the view data of decompression to be temporarily stored in SDRAM1218 and to show on LCD1226.H.264 in addition, in the present embodiment, what adopt as image compression decompression mode is JPEG mode, but compressed and decompressed mode is not limited thereto, and certainly can adopt MPEG, TIFF, other the compressed and decompressed mode such as.
Microcomputer 1217 plays the function of the control part as this camera entirety, the unified various process sequences controlling camera.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.
Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key can be the operational controls such as various load button and various enter keies such as power knob, key of taking pictures, edit key, dynamic image button, reproduction button, menu button, cross key, OK button, delete button, large buttons, detect the mode of operation of these operational controls.
Testing result is exported to microcomputer 1217.In addition, be provided with touch panel at the front surface of the LCD1226 as display, detect the touch location of user, this touch location is exported to microcomputer 1217.Microcomputer 1217, according to the testing result of the operating position from operating unit 1223, performs the various process sequences corresponding with the operation of user.
Flash memory 1224 stores the program of the various process sequences for performing microcomputer 1217.Microcomputer 1217 carries out the control of camera entirety according to this program.In addition, flash memory 1224 stores the various adjusted values of camera, and microcomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.
SDRAM1218 is can the electricity volatile memory of rewriting for what carry out view data etc. temporarily storing.This SDRAM1218 temporarily stores the view data that exports from A/D converter 1214 and image processor 1215, jpeg processor 1216 etc., to have carried out the view data after processing.
Memory interface 1219 is connected with recording medium 1225, carries out the control by view data and the first-class data writing recording medium 1225 of file be attached in view data and reading from recording medium 1225.Recording medium 1225 be such as can on camera main-body the recording medium such as memory card of disassembled and assembled freely, but being not limited thereto, also can be the hard disk etc. be built in camera main-body.
Lcd driver 1210 is connected with LCD1226, view data after being processed by image processor 1215 is stored in SDRAM1218, when needing display, read the view data that SDRAM1218 stores also to show on LCD1226, or the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed view data of SDRAM1218, then decompresses, and the view data after decompressing is shown by LCD1226.
Image display is carried out at the back side that LCD1226 is configured in camera main-body.This LCD1226LCD), but be not limited thereto, also can adopt the various display floaters (LCD1226) such as organic EL, but be not limited thereto, also can adopt the various display floaters such as organic EL.
Based on the electrical structure schematic diagram of above-mentioned mobile terminal hardware configuration and camera, each embodiment of the inventive method is proposed.
With reference to Fig. 4, in one embodiment, this camera module comprises imaging lens 10 and photo-sensitive cell 20, the position of imaging lens 10 is corresponding with the position of photo-sensitive cell 20, camera module also comprises that be placed between imaging lens 10 and photo-sensitive cell 20, rotatable optical filter box 30, optical filter box 30 is for rotating different bandpass filters between imaging lens 10 and photo-sensitive cell 20, the outgoing beam of imaging lens 10 to be separated into by bandpass filter the light of corresponding spectral band.
Wherein, a bandpass filter only allows the light of a certain spectral band to pass through, to be separated outgoing beam.
In the present embodiment, photo-sensitive cell 20 can be charge coupled cell (CCD) or metal oxide semiconductor device (COMS).
In the present embodiment, have multiple different bandpass filter in optical filter box 30, optical filter box 30 can be rotated by driven by motor, and different bandpass filters can be made around axially rotating.Different bandpass filters rotates between imaging lens 10 and photo-sensitive cell 20 by optical filter box 30, bandpass filter is aimed at imaging lens 10, and bandpass filter is aimed at photo-sensitive cell 20, like this, the outgoing beam of imaging lens 10 is incident to bandpass filter, bandpass filter is separated the light in outgoing beam, and the light after bandpass filter is separated is essentially the light of narrower spectral band, finally gathers image corresponding to these narrow spectral light by photo-sensitive cell 20.
Compared with prior art, namely the present embodiment only make use of a passage can complete multispectral imaging, and the space shared by camera module reduces greatly, is conducive to system compact; Optical filter box 30 is rotated by driven by motor, different bandpass filters is rotated between imaging lens and photo-sensitive cell, the outgoing beam of imaging lens 10 is not needed to carry out light splitting, greatly improve the system efficiency of light energy utilization, cost-saving, automatic switchover bandpass filter can be reached and reach the object of spectral band imaging.
Continue referring to Fig. 4, in one embodiment, optical filter box 30 comprise controlled to rotate by motor (not shown) rotating shaft 301, by the rotating disk 302 of rotating shaft 301 driven rotary and multiple bandpass filters 303 of being arranged on rotating disk 302.
In the present embodiment, rotating disk 302 can be a plectane, rotating disk 302 is provided with the filter of different central wavelength lambda and half-band width Δ λ, namely different bandpass filters.
The light that in the present embodiment, object sends (or reflection) comprises the spectrum of relative broad range usually, and these light beams are incident on photo-sensitive cell 20 after imaging lens 10, bandpass filter 303, and photo-sensitive cell 20 is responsible for the collecting work of image.During the work of camera module, first rotated by Electric Machine Control rotating shaft 301, the bandpass filter that centre wavelength is λ 1, half-band width is Δ λ 1 is aimed at imaging lens 10, light beam is after the bandpass filter 303 that centre wavelength is λ 1, only narrower near λ 1 spectral band can pass through bandpass filter, then be incident to imaging on photo-sensitive cell 20, now obtain the image 1 corresponding to narrow spectrum lambda 1 ± (Δ λ 1/2).Then rotated by Electric Machine Control rotating shaft 301, make that centre wavelength is λ 2, the bandpass filter of λ 3 is aimed at imaging lens 10 respectively, obtain the image 2 corresponding to narrow spectrum lambda 2 ± (Δ λ 2/2), λ 3 ± (Δ λ 3/2) and image 3 respectively, by that analogy.
Multiple spectral bands of the present embodiment utilize same passage imaging, both can reduce system space, and save system cost again.When obtaining the image of different spectral band, without the need to carrying out light splitting operation to incident beam, only need control rotating shaft automatic switchover bandpass filter, taking full advantage of corresponding spectral coverage light energy in incident beam and carry out imaging, greatly improve the system efficiency of light energy utilization.
The present invention also provides a kind of filming apparatus, described filming apparatus comprises camera module, as shown in Figure 4, this camera module comprises imaging lens 10 and photo-sensitive cell 20, the position of imaging lens 10 is corresponding with the position of photo-sensitive cell 20, camera module also comprises that be placed between imaging lens 10 and photo-sensitive cell 20, rotatable optical filter box 30, optical filter box 30 is for rotating different bandpass filters between imaging lens 10 and photo-sensitive cell 20, the outgoing beam of imaging lens 10 to be separated into by bandpass filter the light of corresponding spectral band.
Wherein, a bandpass filter only allows the light of a certain spectral band to pass through, to be separated outgoing beam.
In the present embodiment, photo-sensitive cell 20 can be charge coupled cell (CCD) or metal oxide semiconductor device (COMS).
In the present embodiment, have multiple different bandpass filter in optical filter box 30, optical filter box 30 can be rotated by driven by motor, and different bandpass filters can be made around axially rotating.Different bandpass filters rotates between imaging lens 10 and photo-sensitive cell 20 by optical filter box 30, bandpass filter is aimed at imaging lens 10, and bandpass filter is aimed at photo-sensitive cell 20, like this, the outgoing beam of imaging lens 10 is incident to bandpass filter, bandpass filter is separated the light in outgoing beam, and the light after bandpass filter is separated is essentially the light of narrower spectral band, finally gathers image corresponding to these narrow spectral light by photo-sensitive cell 20.
Compared with prior art, namely the present embodiment only make use of a passage can complete multispectral imaging, and the space shared by camera module reduces greatly, is conducive to system compact; Optical filter box 30 is rotated by driven by motor, different bandpass filters is rotated between imaging lens and photo-sensitive cell, the outgoing beam of imaging lens 10 is not needed to carry out light splitting, greatly improve the system efficiency of light energy utilization, cost-saving, automatic switchover bandpass filter can be reached and reach the object of spectral band imaging.
Continue referring to Fig. 4, in one embodiment, optical filter box 30 comprise controlled to rotate by motor (not shown) rotating shaft 301, by the rotating disk 302 of rotating shaft 301 driven rotary and multiple bandpass filters 303 of being arranged on rotating disk 302.
In the present embodiment, rotating disk 302 can be a plectane, rotating disk 302 is provided with the filter of different central wavelength lambda and half-band width Δ λ, namely different bandpass filters.
The light that in the present embodiment, object sends (or reflection) comprises the spectrum of relative broad range usually, and these light beams are incident on photo-sensitive cell 20 after imaging lens 10, bandpass filter 303, and photo-sensitive cell 20 is responsible for the collecting work of image.During the work of camera module, first rotated by Electric Machine Control rotating shaft 301, the bandpass filter that centre wavelength is λ 1, half-band width is Δ λ 1 is aimed at imaging lens 10, light beam is after the bandpass filter 303 that centre wavelength is λ 1, only narrower near λ 1 spectral band can pass through bandpass filter, then be incident to imaging on photo-sensitive cell 20, now obtain the image 1 corresponding to narrow spectrum lambda 1 ± (Δ λ 1/2).Then rotated by Electric Machine Control rotating shaft 301, make that centre wavelength is λ 2, the bandpass filter of λ 3 is aimed at imaging lens 10 respectively, obtain the image 2 corresponding to narrow spectrum lambda 2 ± (Δ λ 2/2), λ 3 ± (Δ λ 3/2) and image 3 respectively, by that analogy.
Multiple spectral bands of the present embodiment utilize same passage imaging, both can reduce system space, and save system cost again.When obtaining the image of different spectral band, without the need to carrying out light splitting operation to incident beam, only need control rotating shaft automatic switchover bandpass filter, taking full advantage of corresponding spectral coverage light energy in incident beam and carry out imaging, greatly improve the system efficiency of light energy utilization.
In a preferred embodiment, this filming apparatus also comprises integrated unit, and this integrated unit is used for collected image to carry out fusion treatment more, obtains fused images.
In a preferred embodiment, above-mentioned filming apparatus can be built in a camera or in the camera of terminal.
The present invention also provides a kind of method being applied to the multispectral imaging of above-mentioned filming apparatus, and as shown in Figure 5, in one embodiment, the method for this multispectral imaging comprises:
Step S101, obtains the outgoing beam of imaging lens;
Step S102, controls optical filter box and rotates, and is rotated by different bandpass filters between described imaging lens and photo-sensitive cell, described outgoing beam to be separated into by described bandpass filter the light of corresponding spectral band;
Step S103, gathers the image that the light of the spectral band be isolated to is corresponding.
In the present embodiment, outgoing beam is obtained by the imaging lens in filming apparatus, this outgoing beam comprises the light of the spectrum of relative broad range, multiple different bandpass filter is had in optical filter box, optical filter box can be rotated by driven by motor, and different bandpass filters can be made around axially rotating.Different bandpass filters rotates between imaging lens and photo-sensitive cell by optical filter box, bandpass filter is aimed at imaging lens, and bandpass filter is aimed at photo-sensitive cell, like this, the outgoing beam of imaging lens is incident to bandpass filter, bandpass filter is separated the light in outgoing beam, and the light after bandpass filter is separated is essentially the light of narrower spectral band, finally gathers image corresponding to these narrow spectral light by photo-sensitive cell.
In a preferred embodiment, optical filter box rotated by Electric Machine Control rotating shaft, by the rotating disk of rotating shaft driven rotary and multiple bandpass filters of being arranged on rotating disk.The light that object sends (or reflection) comprises the spectrum of relative broad range usually, and these light beams are incident on photo-sensitive cell after imaging lens, bandpass filter, and photo-sensitive cell is responsible for the collecting work of image.During filming apparatus work, first by Electric Machine Control axis of rotation, the bandpass filter that centre wavelength is λ 1, half-band width is Δ λ 1 is aimed at imaging lens, light beam is after the bandpass filter that centre wavelength is λ 1, only narrower near λ 1 spectral band can pass through bandpass filter, then be incident to imaging on photo-sensitive cell, now obtain the image 1 corresponding to narrow spectrum lambda 1 ± (Δ λ 1/2).Then rotated by Electric Machine Control rotating shaft 301, make that centre wavelength is λ 2, the bandpass filter of λ 3 is aimed at imaging lens 10 respectively, obtain the image 2 corresponding to narrow spectrum lambda 2 ± (Δ λ 2/2), λ 3 ± (Δ λ 3/2) and image 3 respectively, by that analogy.
Multiple spectral bands of the present embodiment utilize same passage imaging, both can reduce system space, and save system cost again.When obtaining the image of different spectral band, without the need to carrying out light splitting operation to incident beam, only need control rotating shaft automatic switchover bandpass filter, taking full advantage of corresponding spectral coverage light energy in incident beam and carry out imaging, greatly improve the system efficiency of light energy utilization.
In a preferred embodiment, as shown in Figure 6, on the basis of the embodiment of above-mentioned Fig. 5, the method for described multispectral imaging also comprises:
Step S104, carries out fusion treatment by collected image more, obtains fused images.
In the present embodiment, the image collected at least two or more, after these images are carried out fusion treatment, can draw the fused images with certain object features information, these fused images with certain object features information can provide foundation accurately for analyze, detect, monitor or measurement etc.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computer, server, air conditioner, or the network equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (9)
1. a camera module, described camera module comprises imaging lens and photo-sensitive cell, and the position of described imaging lens is corresponding with the position of described photo-sensitive cell, it is characterized in that,
Described camera module also comprises that be placed between described imaging lens and photo-sensitive cell, rotatable optical filter box, described optical filter box is used for rotating between described imaging lens and photo-sensitive cell by different bandpass filters, the outgoing beam of described imaging lens to be separated into by described bandpass filter the light of corresponding spectral band.
2. camera module as claimed in claim 1, is characterized in that, described optical filter box comprise rotated by Electric Machine Control rotating shaft, by the rotating disk of described rotating shaft driven rotary and multiple bandpass filters of being arranged on described rotating disk.
3. camera module as claimed in claim 1 or 2, it is characterized in that, described photo-sensitive cell is charge coupled cell or metal oxide semiconductor device.
4. a filming apparatus, described filming apparatus comprises camera module, and described camera module comprises imaging lens and photo-sensitive cell, and the position of described imaging lens is corresponding with the position of described photo-sensitive cell, it is characterized in that,
Described camera module also comprises that be placed between described imaging lens and photo-sensitive cell, rotatable optical filter box, described optical filter box is used for rotating between described imaging lens and photo-sensitive cell by different bandpass filters, the outgoing beam of described imaging lens to be separated into by described bandpass filter the light of corresponding spectral band.
5. filming apparatus as claimed in claim 4, is characterized in that, described optical filter box comprise rotated by Electric Machine Control rotating shaft, by the rotating disk of described rotating shaft driven rotary and multiple bandpass filters of being arranged on described rotating disk.
6. the filming apparatus as described in claim 4 or 5, is characterized in that, described photo-sensitive cell is charge coupled cell or metal oxide semiconductor device.
7. filming apparatus as claimed in claim 4, it is characterized in that, described filming apparatus also comprises integrated unit, for collected image is carried out fusion treatment, obtains fused images.
8. be applied to a method for the multispectral imaging of the filming apparatus described in any one of claim 4-7, it is characterized in that, the method for described multispectral imaging comprises:
Obtain the outgoing beam of imaging lens;
Control optical filter box to rotate, different bandpass filters is rotated between described imaging lens and photo-sensitive cell, described outgoing beam to be separated into by described bandpass filter the light of corresponding spectral band;
Gather the image that the light of the spectral band be isolated to is corresponding.
9. the method for multispectral imaging as claimed in claim 8, it is characterized in that, the method for described multispectral imaging also comprises:
Collected image is carried out fusion treatment, obtains fused images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510287706.5A CN105100566A (en) | 2015-05-29 | 2015-05-29 | Camera module, photographing device and multispectral imaging method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510287706.5A CN105100566A (en) | 2015-05-29 | 2015-05-29 | Camera module, photographing device and multispectral imaging method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105100566A true CN105100566A (en) | 2015-11-25 |
Family
ID=54580029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510287706.5A Pending CN105100566A (en) | 2015-05-29 | 2015-05-29 | Camera module, photographing device and multispectral imaging method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105100566A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107147832A (en) * | 2017-05-31 | 2017-09-08 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107222593A (en) * | 2017-05-31 | 2017-09-29 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107222594A (en) * | 2017-05-31 | 2017-09-29 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107911692A (en) * | 2017-11-05 | 2018-04-13 | 信利光电股份有限公司 | A kind of calibration method of multispectral multi-cam module |
| CN107976856A (en) * | 2017-12-22 | 2018-05-01 | 西北农林科技大学 | A kind of multispectral agricultural camera of four mesh |
| CN108344694A (en) * | 2018-02-26 | 2018-07-31 | 长光禹辰信息技术与装备(青岛)有限公司 | A kind of multispectral instrument of multi-mode multiplexing |
| CN110278358A (en) * | 2019-06-17 | 2019-09-24 | 北京精英系统科技有限公司 | A kind of target detection video camera |
| CN111901501A (en) * | 2019-05-05 | 2020-11-06 | 深圳光启高端装备技术研发有限公司 | Full-color panoramic imaging device |
| CN112461833A (en) * | 2020-11-23 | 2021-03-09 | 广东弓叶科技有限公司 | Multispectral image acquisition method and system based on intermittent optical filter wheel mechanism |
| CN112637466A (en) * | 2020-12-22 | 2021-04-09 | 维沃移动通信有限公司 | Camera module and electronic equipment |
| CN114402579A (en) * | 2019-12-19 | 2022-04-26 | Oppo广东移动通信有限公司 | Light filtering device, camera module, mobile terminal and image acquisition method |
| CN114466122A (en) * | 2022-01-25 | 2022-05-10 | 江西绿萌科技控股有限公司 | Multispectral camera device and method thereof |
| CN111901501B (en) * | 2019-05-05 | 2024-07-09 | 深圳光启高端装备技术研发有限公司 | Full-color panoramic imaging device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6642955B1 (en) * | 2000-01-10 | 2003-11-04 | Extreme Cctv Inc. | Surveillance camera system with infrared and visible light bandpass control circuit |
| CN101127837A (en) * | 2006-08-16 | 2008-02-20 | 鸿富锦精密工业（深圳）有限公司 | Video module |
| CN102075683A (en) * | 2009-11-20 | 2011-05-25 | 三星电子株式会社 | Digital image processing apparatus and photographing method of digital image processing apparatus |
| CN102346358A (en) * | 2010-07-29 | 2012-02-08 | 罗技欧洲公司 | Optimized movable ir filter in cameras |
| CN102890337A (en) * | 2012-09-26 | 2013-01-23 | 福建福光数码科技有限公司 | Varifocal pick-up lens with high zoom ratio, high resolution rate and strong fog penetration function |
-
2015
- 2015-05-29 CN CN201510287706.5A patent/CN105100566A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6642955B1 (en) * | 2000-01-10 | 2003-11-04 | Extreme Cctv Inc. | Surveillance camera system with infrared and visible light bandpass control circuit |
| CN101127837A (en) * | 2006-08-16 | 2008-02-20 | 鸿富锦精密工业（深圳）有限公司 | Video module |
| CN102075683A (en) * | 2009-11-20 | 2011-05-25 | 三星电子株式会社 | Digital image processing apparatus and photographing method of digital image processing apparatus |
| CN102346358A (en) * | 2010-07-29 | 2012-02-08 | 罗技欧洲公司 | Optimized movable ir filter in cameras |
| CN102890337A (en) * | 2012-09-26 | 2013-01-23 | 福建福光数码科技有限公司 | Varifocal pick-up lens with high zoom ratio, high resolution rate and strong fog penetration function |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222593B (en) * | 2017-05-31 | 2020-06-12 | Oppo广东移动通信有限公司 | Camera assembly of electronic equipment and electronic equipment |
| CN107222593A (en) * | 2017-05-31 | 2017-09-29 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107222594A (en) * | 2017-05-31 | 2017-09-29 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107147832A (en) * | 2017-05-31 | 2017-09-08 | 广东欧珀移动通信有限公司 | The CCD camera assembly and electronic equipment of electronic equipment |
| CN107222594B (en) * | 2017-05-31 | 2020-07-10 | Oppo广东移动通信有限公司 | Camera assembly of electronic equipment and electronic equipment |
| CN107147832B (en) * | 2017-05-31 | 2020-06-12 | Oppo广东移动通信有限公司 | Camera assembly of electronic equipment and electronic equipment |
| CN107911692A (en) * | 2017-11-05 | 2018-04-13 | 信利光电股份有限公司 | A kind of calibration method of multispectral multi-cam module |
| CN107911692B (en) * | 2017-11-05 | 2020-02-14 | 信利光电股份有限公司 | Multispectral multi-camera module calibration method |
| CN107976856A (en) * | 2017-12-22 | 2018-05-01 | 西北农林科技大学 | A kind of multispectral agricultural camera of four mesh |
| CN108344694A (en) * | 2018-02-26 | 2018-07-31 | 长光禹辰信息技术与装备(青岛)有限公司 | A kind of multispectral instrument of multi-mode multiplexing |
| CN111901501A (en) * | 2019-05-05 | 2020-11-06 | 深圳光启高端装备技术研发有限公司 | Full-color panoramic imaging device |
| CN111901501B (en) * | 2019-05-05 | 2024-07-09 | 深圳光启高端装备技术研发有限公司 | Full-color panoramic imaging device |
| CN110278358A (en) * | 2019-06-17 | 2019-09-24 | 北京精英系统科技有限公司 | A kind of target detection video camera |
| CN114402579A (en) * | 2019-12-19 | 2022-04-26 | Oppo广东移动通信有限公司 | Light filtering device, camera module, mobile terminal and image acquisition method |
| CN112461833A (en) * | 2020-11-23 | 2021-03-09 | 广东弓叶科技有限公司 | Multispectral image acquisition method and system based on intermittent optical filter wheel mechanism |
| CN112461833B (en) * | 2020-11-23 | 2024-04-19 | 广东弓叶科技有限公司 | Multispectral image acquisition method and multispectral image acquisition system based on intermittent optical filter wheel mechanism |
| CN112637466A (en) * | 2020-12-22 | 2021-04-09 | 维沃移动通信有限公司 | Camera module and electronic equipment |
| CN112637466B (en) * | 2020-12-22 | 2022-07-08 | 维沃移动通信有限公司 | Camera module and electronic equipment |
| CN114466122A (en) * | 2022-01-25 | 2022-05-10 | 江西绿萌科技控股有限公司 | Multispectral camera device and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100566A (en) | Camera module, photographing device and multispectral imaging method | |
| CN105430295B (en) | Image processing apparatus and method | |
| CN105262951A (en) | Mobile terminal having binocular camera and photographing method | |
| CN105100481A (en) | Shooting method and apparatus, and mobile terminal | |
| CN104767941A (en) | Photography method and device | |
| CN105096241A (en) | Face image beautifying device and method | |
| CN104683697A (en) | Shooting parameter adjusting method and device | |
| CN104660903A (en) | Shooting method and shooting device | |
| CN105578056A (en) | Photographing terminal and method | |
| CN104639837A (en) | Method and device for setting shooting parameters | |
| CN105245777A (en) | Method and device for generating video image | |
| CN105516423A (en) | Mobile terminal, data transmission system and mobile terminal shoot method | |
| CN105187724B (en) | A kind of mobile terminal and method handling image | |
| CN105120164B (en) | The processing means of continuous photo and method | |
| CN104811554A (en) | Method and terminal for switching camera modes | |
| CN105163035A (en) | Mobile terminal shooting system and mobile terminal shooting method | |
| CN104796625A (en) | Picture synthesizing method and device | |
| CN104902185A (en) | Shooting method and shooting device | |
| CN105681894A (en) | Device and method for displaying video file | |
| CN105335458A (en) | Picture previewing method and apparatus | |
| CN104811624A (en) | Infrared shooting method and infrared shooting device | |
| CN104933102A (en) | Picturing storage method and device | |
| CN104751488A (en) | Photographing method for moving track of moving object and terminal equipment | |
| CN104822099A (en) | Video packaging method and mobile terminal | |
| CN105120145A (en) | Electronic equipment and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151125 |