CN108718393A - A kind of cmos image sensor and its monitoring method - Google Patents
A kind of cmos image sensor and its monitoring method Download PDFInfo
- Publication number
- CN108718393A CN108718393A CN201810876068.4A CN201810876068A CN108718393A CN 108718393 A CN108718393 A CN 108718393A CN 201810876068 A CN201810876068 A CN 201810876068A CN 108718393 A CN108718393 A CN 108718393A
- Authority
- CN
- China
- Prior art keywords
- movement
- alarm
- image sensor
- cmos image
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 63
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000033001 locomotion Effects 0.000 claims abstract description 164
- 238000001514 detection method Methods 0.000 claims abstract description 46
- 238000004458 analytical method Methods 0.000 claims abstract description 41
- 230000008569 process Effects 0.000 claims abstract description 18
- 239000012141 concentrate Substances 0.000 claims abstract description 17
- 230000009471 action Effects 0.000 claims description 33
- 238000012545 processing Methods 0.000 claims description 32
- 239000000463 material Substances 0.000 abstract description 3
- 238000012850 discrimination method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000007123 defense Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 241000256844 Apis mellifera Species 0.000 description 1
- 206010037660 Pyrexia Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N25/772—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Image Analysis (AREA)
Abstract
The present invention provides a kind of cmos image sensor and monitoring methods.The cmos image sensor has low-power mode and general mode；It includes：Pel array；Storage unit stores the picture element signal for every frame image that pel array exports under low-power mode, forms picture frame collection；Image process and analysis unit, detection image frame concentrates the movement of one or more objects, judges the picture frame concentrates the movement for whether belonging to alarm, and will determine that result feeds back to control unit；Control unit, according to the judging result of image process and analysis unit, control pel array switches to low-power mode output pixel signal or general mode output pixel signal；Image output unit handles the Pixel Information that pel array exports under general mode and exports image.The cmos image sensor realizes the motion detection and pattern switching of scene.The power consumption of monitoring system is not only reduced, and reduces the consumptive material and spatial volume of image pickup part.
Description
Technical field
The present invention relates to field of image sensors, particularly a kind of cmos image sensor and its monitoring method.
Background technology
Present many public arenas and private site are fitted with safety defense monitoring system, using monitoring system to specific region
It is monitored, when finding that someone enters monitoring area or artificial abnormal monitoring area appearance, alarm occurs, reminds relevant people
Member needs to check monitoring area.
Currently, almost all of safety defense monitoring system is required for scene of the image pickup part for shooting monitoring area, catch
Obtain high-definition picture.But if the camera of image pickup part is constantly in open state, on the one hand can cause largely to consume electric energy,
At this time if camera is battery powered, a large amount of power consumption will cause the service life of battery substantially to shorten, and then influence camera shooting
The use in portion；On the other hand, due to continuing a large amount of power consumptions, the fever of phase chance causes some elements in image pickup part to be susceptible to event
Barrier or accelerated ageing.In particular, some monitoring systems detect movement using pyroelectric infrared sensor motion detector is released, if phase
Machine is constantly in the stage of booting heat production, can seriously affect the result of motion detection.In addition, if camera is constantly in opening state
State will also result in the waste in video-tape or digital record space.
There is the company of some protection and monitor fields to have begun research and development and video camera progress is triggered by the result of motion detection
The technology of video recording, but need additional motion detection apparatus mostly or analysis control is carried out by the unit module of external circuit
The supplement of system and other functions.It is larger that it be easy to cause image pickup part volume in this way, takes up space, influences appearance.
Invention content
For problems of the prior art, the purpose of the present invention is to provide a kind of cmos image sensor and its prisons
Prosecutor method.The cmos image sensor can not be by additional outer gang mould module unit, itself can realize motion detection and work
The switching of operation mode.
In order to realize aforementioned invention purpose, the present invention provides a kind of cmos image sensor, with low-power mode and
General mode；The cmos image sensor includes：
Pel array, including the pixel unit that is arranged in rows and columns；
Storage unit stores the picture element signal for every frame image that pel array exports under low-power mode, forms picture frame
Collection；
Image process and analysis unit, detection described image frame concentrate the movement of one or more objects, judge the image
Frame concentrates the movement for whether belonging to alarm, and will determine that result feeds back to control unit；
Control unit controls the pel array and switches to according to described image processing and the judging result of analytic unit
Low-power mode output pixel signal or general mode output pixel signal；
Image output unit handles the Pixel Information that pel array exports under general mode and exports image.
Image process and analysis unit is arranged in inside, at the image in cmos image sensor as described above
Reason and analytic unit carry out exercise data analysis and judgement to the moving target in scene, judging result input control unit,
And then control the operating mode of pel array.Without additional outer gang mould module unit, the cmos image sensor itself is realized
To the motion detection of scene and the switching of operating mode, the power consumption of monitoring system is not only greatly reduced, but also greatly reduce
The consumptive material and spatial volume of image pickup part, are conducive to safety monitoring equipment to miniaturization, integrated direction is developed.And low
Under power mode, the image in the cmos image sensor not output monitoring region, but the pixel of pel array output is believed
Form the picture frame collection of small size, low frame per second low resolution in number storage storage unit inside it, and by image procossing and
Whether occur belonging to the movement of alarm in analytic unit detection monitoring area.When image process and analysis unit detects in scene
When alarm movement has occurred in (picture frame concentration in other words), the cmos image sensor just exports full-scale, high frame per second high score
Resolution image, and monitoring system is prompted to send out alarm, this further greatly reduces the power consumption of cmos image sensor.
Cmos image sensor as described above, the storage unit include but not limited to that SRAM memory or SDRAM are deposited
Reservoir.
Cmos image sensor as described above, it is preferable that described image is handled and analytic unit includes target detection mould
Block and motion analysis module, the module of target detection detection described image frame concentrate the position of one or more objects, according to
Position judgment picture frame of the same target in each frame image, which is concentrated, whether there is moving target；The motion analysis module is to institute
The action for stating moving target is analyzed, and judges whether the movement of the moving target belongs to the movement for generating alarm.
Cmos image sensor as described above, it is preferable that the module of target detection further includes according to moving target
Shape and/or size judge whether the moving target is to belong to the target individual for generating alarm.
Cmos image sensor as described above, it is preferable that the motion analysis module further includes being existed according to moving target
Movement locus in continuous 5-30 frame images and/or shift length in one direction, judge the movement of the moving target
Whether the movement that generates alarm is belonged to.For example, when the movement locus of moving target is the regularity such as up-down vibration or side-to-side vibrations
When movement, judge that the movement of the moving target is not belonging to generate the movement of alarm；Alternatively, when moving target in one direction
When shift length does not reach standard value, judge that the movement of the moving target is not belonging to generate the movement of alarm.The action point
Analysis module can judge the fortune of the moving target in conjunction with the movement locus of moving target and shift length in one direction
It is dynamic whether to belong to the movement for generating alarm.The determination of described a direction and standard value can be preset in motion analysis module.
Cmos image sensor as described above, it is preferable that the motion analysis module is provided with action alarm library, described
Motion analysis module matches the action of moving target with the action in action alarm library, judges the moving target
Action whether belong to the movement of alarm.
Above-mentioned motion detection can specifically include following steps：It detects storage unit image frame and concentrates one or more objects
Position, position of the same target in each frame image is compared, judges whether the object moves, the position versus
It is set with a threshold value, is then judged as that the object moves more than the threshold value, belongs to moving target, conversely, the object does not have
It moves, is classified as background；Judged whether to belong to the mesh for generating alarm class according to the shape of the moving target or size
Mark individual, if so, then by image process and analysis unit by picture frame in the storage unit concentrate each target individual respectively into
Row is cut, and forms the picture frame subset of target individual, then carries out action identifying to the picture frame subset of each target individual, instead
It, moving target is not belonging to target individual, and the movement for being classified as moving target is classified as non-alarm movement.The movement of target individual
Identification process carries out operation just for single target individual, can significantly reduce computational load and power consumption；By eliminating in scene
Background and non-alarm movement, computational load and power consumption can be further decreased.The method of the action identifying may include but
It is not limited to image processing algorithm, is based on space/context discrimination method or time discrimination method etc..Space discrimination method packet
The various modes classified to the posture in static image (or single image frame) are included, time discrimination method is related to event chain
Assessment, for example, posture in a series of images frame assessment etc..By the kinematical identification to target individual, class can be moved to it
Type is classified, and judges whether the movement of the target individual belongs to the movement of alarm, can substantially reduce false alarm in this way
Probability.The above-mentioned movement for belonging to alarm includes forcing open the door, plundering, escaping, colliding；Above-mentioned background includes being rocked similar to branch
Deng, the non-alarm movement include toy fly or headlight it is mobile etc..The movement of the non-alarm can be with root
According to User Defined, such as specific database is set to provide comparison.
If described image processing and analytic unit detect the movement for belonging to alarm, switching switch is triggered, control is single
The output mode of pel array is switched to general mode by member by low-power mode, and image output unit exports the figure of certain time length
Picture；, whereas if described image processing and analytic unit do not detect the movement for belonging to alarm, then control unit continues to control
Pel array keeps low-power mode to carry out motion detection to monitoring area.Under low-power mode, image output unit does not export
Image, under general mode, storage unit does not store picture element signal.
Cmos image sensor as described above, further includes row driving unit, row driving unit row A/D converting units etc.,
Described control unit is handled according to described image and the judging result of analytic unit output controls row driving unit and row driving is single
The drive mode of member, low-power motion detection mode or general mode output pixel signal are switched to by the pel array, and
The port for controlling the row A/D converting unit output digit signals, to storage unit output signal, common mould under low-power mode
To image output unit output signal under formula.Specifically, under general mode, whole pixel unit output pixels in pel array
Signal；Under low-power mode, pixel unit output pixel signal in part in pel array.
Cmos image sensor as described above, it is preferable that described control unit controls the storage unit and image is defeated
Go out the operating mode of unit.Under low-power mode, control unit controls the Pixel Information of storage unit storage pel array output,
Control image output unit does not work；Under general mode, control unit control storage unit does not work, and controls image output unit
Handle the Pixel Information of simultaneously output pixel array output.
The present invention also provides a kind of monitoring method of cmos image sensor, the cmos image sensor has low-power
Pattern and general mode；The cmos image sensor includes：
Pel array, including the pixel unit that is arranged in rows and columns；
Storage unit stores the picture element signal for every frame image that pel array exports under low-power mode, forms picture frame
Collection；
Image process and analysis unit, detection described image frame concentrate the movement of one or more objects, judge the image
Frame concentrates the movement for whether belonging to alarm, and will determine that result feeds back to control unit；
Control unit controls the pel array and switches to according to described image processing and the judging result of analytic unit
Low-power mode output pixel signal or general mode output pixel signal；
Image output unit handles the Pixel Information that pel array exports under general mode and exports image,
Wherein, the monitoring method includes the following steps：
The cmos image sensor carries out motion detection to monitoring area at low power modes, and judges monitoring area
In whether belong to the movement of alarm；
If it is determined that the movement for belonging to alarm has occurred in monitoring area, then the cmos image sensor switches to commonly
Pattern exports the image of preset duration；
If it is determined that not having to belong to the movement of alarm in monitoring area, then the cmos image sensor keeps low work(
Rate pattern carries out motion detection to monitoring area；
At low power modes, the cmos image sensor does not export image.
In motion detection process under above-mentioned low-power mode, cmos image sensor lights the part in pel array
Pixel unit, the partial pixel unit also form a pel array, export complete scene pixel signal, but are storing
The frame per second and resolution ratio of the image formed in unit export the frame per second of image much smaller than general mode hypograph output unit and divide
Resolution.Such as under low-power motion detection mode, the frame per second of storage image is 10fps hereinafter, pixel is 24 in the memory unit
× 32, and in the normal mode, the frame per second which exports image is 30fps, exports full size image, output
The pixel of image is both full-pixel, and full figure array size is much larger than 24 × 32.
The monitoring method of cmos image sensor as described above, it is preferable that in the normal mode, described image output is single
The when a length of 1-10s of member output image is more than after the duration, and the cmos image sensor is switched to low-power mode to monitoring
Region carries out motion detection；Alternatively, after user eliminates alarm, the cmos image sensor is switched to low-power mode to monitoring
Region carries out motion detection.Further, in the normal mode, the when a length of 1-3s of described image output unit output image.
Compared with existing monitoring system, cmos image sensor of the present invention can automatically control the duration of output image, and export image
Duration it is shorter, greatly reduce the power consumption exported due to image.
The monitoring method of cmos image sensor as described above, it is preferable that described image processing and analytic unit detection
Described image frame concentrates the position of one or more objects, according to position judgment picture frame collection of the same target in each picture frame
In whether there is moving target；
If it is determined that there are moving target, then described image processing and analytic unit carry out action point to the moving target
Analysis；
If it is determined that moving target is not present, then described image processing and analytic unit will determine that result feeds back to the control
Unit processed, control unit control the pel array and low-power mode are kept to be monitored monitoring area.
The monitoring method of cmos image sensor as described above, it is preferable that described image processing and analytic unit also wrap
The shape and/or size according to moving target are included, judges whether the moving target is to belong to the target individual for generating alarm；
If it is determined that belonging to the target individual for generating alarm, then described image processing and analytic unit are to the target individual
Carry out motion analysis；
If it is determined that being not belonging to generate the target individual of alarm, then described image processing and analytic unit will determine that result is anti-
It is fed to described control unit, control unit controls the pel array and low-power mode is kept to be monitored monitoring area.
The monitoring method of cmos image sensor as described above, it is preferable that described image processing and analytic unit according to
Movement locus of the moving target in continuous 5-30 frames image and/or shift length in one direction, judge the movement
Whether the movement of target belongs to the movement for generating alarm；
Alternatively, the action in the action and a preset alarm library of described image processing and analytic unit by the moving target
It is matched, judges whether the action of the moving target belongs to the movement of alarm.
The monitoring method of cmos image sensor as described above, it is preferable that described image processing and analytic unit according to
Movement locus of the target individual in continuous 5-30 frames image and/or shift length in one direction, judge the target
Whether the movement of individual belongs to the movement for generating alarm；
Alternatively, the action in the action and a preset alarm library of described image processing and analytic unit by the target individual
It is matched, judges whether the action of the target individual belongs to the movement of alarm.
The 5-30 frames image is the continuous picture frame collection that stores in storage unit, it is preferable that described image processing and
Analytic unit judges to move mesh according to the movement locus in continuous 10-15 frames image and/or shift length in one direction
Whether the movement of mark or target individual belongs to the movement for generating alarm.
Compared with prior art, cmos image sensor provided by the invention and its monitoring method have below beneficial to effect
Fruit：The cmos image sensor of the present invention can not be by the auxiliary of additional control unit or motion detection unit, itself is just
Motion detection can be carried out to scene, not only realize the AI intellectual analysis of cmos image sensor chip, but also substantially reduce
The volume of image pickup part is conducive to monitoring device and develops to the direction of miniaturization micromation；Secondly, cmos image of the invention sensing
Device can also be according to motion detection as a result, the switching of automatic realization operating mode, not only greatly reduces energy consumption, but also reduce
The waste for recording space only exports scheduled duration image in the normal mode by control, further reduced cmos image biography
The power consumption of sensor.
Description of the drawings
In the following, the preferred embodiment of the present invention will be described in more detail in conjunction with attached drawing, wherein：
Fig. 1 is the structural schematic diagram of cmos image sensor shown in first embodiment of the invention；
Fig. 2 is the method flow diagram that cmos image sensor of the present invention is monitored.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
The every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In the following detailed description, the specific embodiment for being used for illustrating the application as the application part may refer to
Each Figure of description.In the accompanying drawings, similar reference numeral describes substantially similar component in different drawings.This Shen
Each specific embodiment please has carried out description detailed enough following so that has the general of ability domain-dependent knowledge and technology
Logical technical staff can implement the technical solution of the application.It should be appreciated that other embodiments can also be utilized or to the application
Embodiment carry out structure, logic or electrical change.
Term " pixel " word refers to containing sensor devices or other devices for converting electromagnetic signal into electric signal
Electronic component.For illustrative purposes, Fig. 1 describes a kind of representative cmos image sensor 100, and it includes a pixel battle arrays
Row 110, the pel array 110 have the multiple pixels for being arranged to row and column.In the pel array 110, each row own
Pixel is all gated by a column selection line simultaneously, and all pixels per a line are selectively defeated by a row select line respectively
Go out.There are one row address and a column address for each pixel.The column address of pixel corresponds to is driven by row decoding driving circuit 120
Dynamic row select line, and the row address of pixel corresponds to the row select line driven by row decoding driving circuit 130.Control circuit
140 control row decoding driving circuits 120 and row decoding driving circuit 130 selectively read suitable row and column in pel array
Corresponding pixel output signal.The pixel output signal of reading (is usually analog-digital converter by row A/D converting units 150
ADC digital signal) is converted to, is then further processed by image output unit 180 or storage unit 160.Low-power mould
Under formula, control unit 140 controls 110 partial pixel unit of pel array and exports low frame per second picture element signal, and control row A/D conversions are single
For member 150 by digital data transmission to storage unit 160, the digital signal that storage unit 160 stores output forms monitoring scene
Picture frame collection is stored in the SRAM in it.Image process and analysis unit 170 reads present frame figure from storage unit 160
Picture and preceding frame image, and by the position of one or more object in current frame image respectively with corresponding objects in preceding frame image
Position compared, judge that picture frame is concentrated with the presence or absence of the object that moves, if it is determined that certain an object moves
It is then that moving target further judges the movement then according to the row shape and/or size of the moving target the object categorization
Whether target belongs to the target individual of alarm；Such as the target individual for judging to belong to alarm, then the movement of the target individual is tracked,
Judge whether the movement of the target individual belongs to the movement of alarm, if image process and analysis unit 170 finally judges prison
The movement for belonging to alarm has occurred in control scene, then control unit 140 controls cmos image sensor and switches to general mode, drives
Dynamic whole row decoding driving circuit 130 and row decoding driving circuit 120, the whole pixel units for controlling pel array 110 are defeated
Go out picture element signal, control row A/D converting units 150 are transferred to image output unit after converting picture element signal to digital signal
180, and pass through the full-scale high frame per second high-definition picture of the image output unit 180 output scheduled duration；If at image
Reason and analytic unit 170 finally judge the movement for not having to belong to alarm in monitoring scene, then control unit 140 controls CMOS
Imaging sensor keeps low-power mode, continues to monitor.
Further, module of target detection and motion analysis module are provided in described image processing and analytic unit 170
(not identified in Fig. 1), module of target detection concentrates the position of one or more objects for detection image frame, according to same target
Position judgment picture frame in each frame image, which is concentrated, whether there is moving target, then according to the row shape of the moving target
And/or size, further judge whether the moving target belongs to the target individual of alarm；Motion analysis module is used for target
The action of body is analyzed, and judges whether the movement of target individual belongs to the movement for generating alarm.Specifically, motion analysis module
According to movement locus of the target individual in continuous 5-30 frames image and/or shift length in one direction, described in judgement
Whether the movement of target individual belongs to the movement for generating alarm.For example, when the movement locus of target individual is up-down vibration or a left side
When the regularity movement such as right vibration, judge that the movement of the target individual is not belonging to generate the movement of alarm；Alternatively, working as target individual
When shift length in one direction does not reach standard value, judge that the movement of the target individual is not belonging to generate the fortune of alarm
It is dynamic, if instead the movement locus of target individual meets the position of the standard trajectory or target individual of alarm movement on preset direction
Shifting reaches preset standard value, then judges that the movement of target individual belongs to the movement for generating alarm.Above-mentioned motion analysis module can be with
The movement locus and the shift length on preset direction of combining target individual judge whether the movement of the target individual belongs to production
The movement of raw alarm.
Alternatively, alarm library is provided in above-mentioned image process and analysis unit 170, described image processing and analytic unit
170 by tracking the movement of target individual, and is matched with the type of sports in alarm library, to judge the target individual
Movement whether belong to the movement of alarm.By the processing and analysis of above-mentioned image process and analysis unit 170, cmos image passes
Sensor can intelligently identify the movement that alarm occurs in scene, and eliminate background, background motion movement and non-alarm automatically
Movement, persistently target individual is monitored.Above-mentioned background motion includes the movement for being similar to branch and rocking etc., non-alarm
Movement include toy fly or headlight it is mobile etc..Specific number can be respectively set in the movement of the non-alarm
According to library to provide comparison.
Above-mentioned cmos image sensor 100 is monitored by following steps：
Cmos image sensor 100 carries out the motion detection in scene at low power modes, and the low frame per second of small size is low
The image information of resolution ratio is stored in formation picture frame collection in storage unit 160, such as frame per second is 10fps, and pixel is 24 × 32
Image information；Then image process and analysis unit 170 is utilized to be judged in scene with the presence or absence of movement mesh according to picture frame collection
Mark, and further judge the movement whether moving target is alarmed；If it is judged that being had occurred for the moving target
The movement of alarm, then the cmos image sensor 100 be switched to general mode, it is default that image output unit 180 exports 1-10s
The full-scale full frame rate full resolution pricture of duration, such as frame per second are 30fps, and pixel is 1280 × 960 image, while prompting to supervise
The terminal of control system sends out alarm；, whereas if judging the movement for not having to alarm in scene, then the cmos image senses
Device 100 continues the motion detection under low progress power mode.
Specifically, cmos image sensor 100 is monitored by monitoring method as shown in Figure 2：
S1：Carry out the motion detection of scene at low power modes using cmos image sensor 100, it will be per frame small size
Low frame per second low-resolution image information storage does not export in storage unit 160；
S2：The multiple images frame stored to storage unit 160 using image process and analysis unit 170 carries out movement inspection
It surveys, judges the movement for belonging to alarm whether has occurred in monitoring area；S201- in specific judgment step such as Fig. 2 dotted line frames
Shown in S203；
S201：Image process and analysis unit 170 is respectively compared picture frame and concentrates each object in present frame and previous frame
Position judge that the object belongs to moving target if the position movement of certain an object is more than given threshold, carry out S202 and sentence
Disconnected step；, whereas if judging that picture frame concentration moving target does not occur and is then back to step S1；
S202：The shape and size for analyzing each moving target judge in moving target with the presence or absence of belonging to alarm
Target individual then carries out S203 judgment steps if it is determined that there is the target individual for belonging to alarm in moving target；Conversely, such as
Fruit judges then to be back to step S1 there is no the target individual for belonging to alarm in moving target；
S203：The movement for tracking target individual, cuts the target individual of picture frame collection, forms picture frame of target individual
Then collection carries out action identifying to the picture frame subset of target individual, by analyzing target individual in continuous 5-30 frames image
Movement locus and/or the shift length on preset direction judge whether the movement of target individual belongs to the movement of alarm, alternatively,
The action of target individual is matched with the action in actuation of an alarm library, judges whether the movement of target individual belongs to the fortune of alarm
It is dynamic, if it is determined that belonging to the movement of alarm, then S3 steps are carried out, switches the operating mode of cmos image sensor；, whereas if
Judge that the movement for being not belonging to alarm is then back to step S1；
S3：Will determine that result is transferred to control unit 140, imaging sensor is switched to general mode by control unit 140,
The full resolution pricture in output monitoring region, and the terminal of monitoring system is prompted to send out alarm, the image of scheduled duration is exported, then
Cmos image sensor switches to low-power mode and continues to monitor, and is back to step S1；Alternatively, user eliminates alarm
Afterwards, cmos image sensor switches to low-power mode and continues to monitor, and is back to step S1.
Cmos image sensor provided by the invention itself realizes the fortune to scene without additional outer gang mould module unit
The switching of dynamic detection and operating mode.Not only can motion detection persistently be carried out to monitoring area, can also identify monitoring scene
In movement, greatly reduce it is non-artificial movement cause false alarm occur probability (such as honeybee flight, headlight shifting
Move), make cmos image sensor while realizing that converting optical imagery to digital picture exports, is also equipped with intelligence point
The function of analysis.Further, since the cmos image sensor of the present invention can realize operating mode according to the result of intellectual analysis
Automatic switchover, not only greatly reduce the power consumption of monitoring system, but also greatly reduce the consumptive material and spatial volume of image pickup part,
Be conducive to safety monitoring equipment to miniaturization, integrated direction is developed.
Above-described embodiment is used for illustrative purposes only, and is not limitation of the present invention, in relation to the general of technical field
Logical technical staff can also make a variety of changes and modification without departing from the present invention, therefore, all equivalent
Technical solution should also belong to scope disclosed by the invention.
Claims (12)
1. a kind of cmos image sensor, which is characterized in that the cmos image sensor has low-power mode and common mould
Formula；The cmos image sensor includes：
Pel array, including the pixel unit that is arranged in rows and columns；
Storage unit stores the picture element signal for every frame image that pel array exports under low-power mode, forms picture frame collection；
Image process and analysis unit, detection described image frame concentrate the movement of one or more objects, judge the picture frame collection
In whether belong to the movement of alarm, and will determine that result feeds back to control unit；
Control unit controls the pel array and switches to low work(according to described image processing and the judging result of analytic unit
Rate pattern output pixel signal or general mode output pixel signal；
Image output unit handles the Pixel Information that pel array exports under general mode and exports image.
2. cmos image sensor according to claim 1, which is characterized in that described image processing and analytic unit include
Module of target detection and motion analysis module, the module of target detection detection described image frame concentrate one or more objects
Position concentrates according to position judgment picture frame of the same target in each frame image and whether there is moving target；The action point
Analysis module analyzes the action of the moving target, judges whether the movement of the moving target belongs to the fortune for generating alarm
It is dynamic.
3. cmos image sensor according to claim 2, which is characterized in that the module of target detection further includes basis
The shape and/or size of moving target, judge whether the moving target belongs to the target individual for generating alarm.
4. cmos image sensor according to claim 2, which is characterized in that the motion analysis module further includes basis
Movement locus of the moving target in continuous 5-30 frames image and/or shift length in one direction, judge the movement
Whether the movement of target belongs to the movement for generating alarm.
5. cmos image sensor according to claim 2, which is characterized in that the motion analysis module is provided with action
The action of moving target is matched with the action in action alarm library, is judged by alarm library, the motion analysis module
Whether the action of the moving target belongs to the movement of alarm.
6. cmos image sensor according to claim 1, which is characterized in that it is single that described control unit controls the storage
The operating mode of member and image output unit.
7. a kind of monitoring method of cmos image sensor, the cmos image sensor has low-power mode and common mould
Formula；The cmos image sensor includes：
Pel array, including the pixel unit that is arranged in rows and columns；
Storage unit stores the picture element signal for every frame image that pel array exports under low-power mode, forms picture frame collection；
Image process and analysis unit, detection described image frame concentrate the movement of one or more objects, judge the picture frame collection
In whether belong to the movement of alarm, and will determine that result feeds back to control unit；
Control unit controls the pel array and switches to low work(according to described image processing and the judging result of analytic unit
Rate pattern output pixel signal or general mode output pixel signal；
Image output unit handles the Pixel Information that pel array exports under general mode and exports image,
Wherein, the monitoring method includes the following steps：
The cmos image sensor at low power modes to monitoring area carry out motion detection, and judge be in monitoring area
The no movement for belonging to alarm；
If it is determined that the movement for belonging to alarm has occurred in monitoring area, then the cmos image sensor switches to common mould
Formula exports the image of preset duration；
If it is determined that not having to belong to the movement of alarm in monitoring area, then the cmos image sensor keeps low-power mould
Formula carries out motion detection to monitoring area；
At low power modes, the cmos image sensor does not export image.
8. the monitoring method of cmos image sensor according to claim 7, which is characterized in that in the normal mode, institute
The when a length of 1-10s for stating image output unit output image, is more than after the duration, the cmos image sensor is switched to low work(
Rate pattern carries out motion detection to monitoring area；Alternatively, after user eliminates alarm, the cmos image sensor is switched to low work(
Rate pattern carries out motion detection to monitoring area.
9. the monitoring method of cmos image sensor according to claim 7, which is characterized in that at low power modes,
Described image processing and analytic unit detection described image frame concentrate the position of one or more objects, according to same target each
Position judgment picture frame in picture frame, which is concentrated, whether there is moving target；
If it is determined that there are moving target, then described image processing and analytic unit carry out motion analysis to the moving target；
If it is determined that moving target is not present, then it is single to will determine that result feeds back to the control for described image processing and analytic unit
Member, control unit control the pel array and low-power mode are kept to be monitored monitoring area.
10. the monitoring method of cmos image sensor according to claim 9, which is characterized in that described image processing and
Analytic unit further includes the shape and/or size according to moving target, judges whether the moving target is to belong to generation alarm
Target individual；
If it is determined that belonging to the target individual for generating alarm, then described image processing and analytic unit carry out the target individual
Motion analysis；
If it is determined that being not belonging to generate the target individual of alarm, then described image processing and analytic unit will determine that result is fed back to
Described control unit, control unit control the pel array and low-power mode are kept to be monitored monitoring area.
11. the monitoring method of cmos image sensor according to claim 9, which is characterized in that
Described image processing and analytic unit are according to movement locus of the moving target in continuous 5-30 frames image and/or a certain
Shift length on direction, judges whether the movement of the moving target belongs to the movement for generating alarm；
Alternatively, described image processing and analytic unit carry out the action of the moving target with the action in a preset alarm library
Matching, judges whether the action of the moving target belongs to the movement of alarm.
12. the monitoring method of cmos image sensor according to claim 10, which is characterized in that
Described image processing and analytic unit are according to movement locus of the target individual in continuous 5-30 frames image and/or a certain
Shift length on direction, judges whether the movement of the target individual belongs to the movement for generating alarm；
Alternatively, described image processing and analytic unit carry out the action of the target individual with the action in a preset alarm library
Matching, judges whether the action of the target individual belongs to the movement of alarm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810876068.4A CN108718393B (en) | 2018-08-03 | 2018-08-03 | CMOS image sensor and monitoring method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810876068.4A CN108718393B (en) | 2018-08-03 | 2018-08-03 | CMOS image sensor and monitoring method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108718393A true CN108718393A (en) | 2018-10-30 |
| CN108718393B CN108718393B (en) | 2024-04-05 |
Family
ID=63913778
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810876068.4A Active CN108718393B (en) | 2018-08-03 | 2018-08-03 | CMOS image sensor and monitoring method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108718393B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113870529A (en) * | 2021-08-23 | 2021-12-31 | 湖北工程学院 | Garden monitoring method, device and equipment for dealing with strong wind and storage medium |
| CN114374797A (en) * | 2019-06-05 | 2022-04-19 | 原相科技股份有限公司 | Camera device with two output interfaces |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004320281A (en) * | 2003-04-15 | 2004-11-11 | Nippon Avionics Co Ltd | Circuit for detecting motion of object |
| CN101820533A (en) * | 2010-03-26 | 2010-09-01 | 吴丽娟 | Video monitoring method and device |
| CN102158689A (en) * | 2011-05-17 | 2011-08-17 | 无锡中星微电子有限公司 | Video monitoring system and method |
| CN102695042A (en) * | 2012-05-28 | 2012-09-26 | 昆山锐芯微电子有限公司 | Monitoring system and monitoring method for image sensors |
| CN103404125A (en) * | 2011-02-21 | 2013-11-20 | 派视尔株式会社 | Image sensor and photographing apparatus including same |
-
2018
- 2018-08-03 CN CN201810876068.4A patent/CN108718393B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004320281A (en) * | 2003-04-15 | 2004-11-11 | Nippon Avionics Co Ltd | Circuit for detecting motion of object |
| CN101820533A (en) * | 2010-03-26 | 2010-09-01 | 吴丽娟 | Video monitoring method and device |
| CN103404125A (en) * | 2011-02-21 | 2013-11-20 | 派视尔株式会社 | Image sensor and photographing apparatus including same |
| CN102158689A (en) * | 2011-05-17 | 2011-08-17 | 无锡中星微电子有限公司 | Video monitoring system and method |
| CN102695042A (en) * | 2012-05-28 | 2012-09-26 | 昆山锐芯微电子有限公司 | Monitoring system and monitoring method for image sensors |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374797A (en) * | 2019-06-05 | 2022-04-19 | 原相科技股份有限公司 | Camera device with two output interfaces |
| CN113870529A (en) * | 2021-08-23 | 2021-12-31 | 湖北工程学院 | Garden monitoring method, device and equipment for dealing with strong wind and storage medium |
| CN113870529B (en) * | 2021-08-23 | 2023-06-09 | 湖北工程学院 | Garden monitoring method, device and equipment for coping with strong wind and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108718393B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7643055B2 (en) | Motion detecting camera system | |
| CN100487739C (en) | Multi-layer real time forewarning system based on the intelligent video monitoring | |
| KR102633876B1 (en) | Low-power always-on face detection, tracking, recognition and/or analysis using events-based vision sensor | |
| Guo et al. | Low cost and latency event camera background activity denoising | |
| US20160093273A1 (en) | Dynamic vision sensor with shared pixels and time division multiplexing for higher spatial resolution and better linear separable data | |
| TWI482123B (en) | Multi-state target tracking mehtod and system | |
| CN108718393A (en) | A kind of cmos image sensor and its monitoring method | |
| US11843760B2 (en) | Timing mechanism to derive non-contaminated video stream using RGB-IR sensor with structured light | |
| KR101262745B1 (en) | Image sensor and photographing apparatus having the same | |
| US11146747B1 (en) | Dynamic driver mechanism for rolling shutter sensor to acquire the structured light pattern | |
| US11336869B2 (en) | Motion detection methods and motion sensors capable of more accurately detecting true motion event | |
| US20240073359A1 (en) | Motion detection methods and image sensor devices capable of generating ranking list of regions of interest and pre-recording monitoring images | |
| CN112947838B (en) | Control method and device and electronic equipment | |
| US11721257B2 (en) | Image display device and motion detection method of image display device | |
| CN109963046A (en) | Movement detection device and related mobile detection method | |
| US8934013B2 (en) | Video camera and event detection system | |
| US20100141769A1 (en) | Image sensor and image sensor system | |
| JP3846410B2 (en) | Image processing apparatus and method, recording medium, and program | |
| CN100589135C (en) | Automatic door bell and its implementation | |
| US6807360B1 (en) | Digital image recording system | |
| US11336870B2 (en) | Smart motion detection device and related determining method | |
| Wang et al. | A learning-based prediction model for baby accidents | |
| CN114079709A (en) | Driver mechanism for rolling shutter sensor to obtain structured light pattern | |
| CN111523350B (en) | Image recognition method and device, storage medium, terminal and image recognition system | |
| JP2001148845A (en) | Intruder supervisory system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 612, 6th floor, No. 111 Building, Xiangke Road, Shanghai Pudong New Area Free Trade Pilot Area, 201203 Applicant after: Siteway (Shanghai) Electronic Technology Co.,Ltd. Address before: Room 612, 6th floor, No. 111 Building, Xiangke Road, Shanghai Pudong New Area Free Trade Pilot Area, 201203 Applicant before: SHANGHAI YE XIN ELECTRONIC TECHNOLOGY CO.,LTD. |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 612, 6th floor, No. 111 Building, Xiangke Road, Shanghai Pudong New Area Free Trade Pilot Area, 201203 Applicant after: Starway (Shanghai) Electronic Technology Co.,Ltd. Address before: Room 612, 6th floor, No. 111 Building, Xiangke Road, Shanghai Pudong New Area Free Trade Pilot Area, 201203 Applicant before: Siteway (Shanghai) Electronic Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |