KR101357659B1 - Apparatus for monitoring edge - Google Patents

Abstract

An apparatus for monitoring an outline is disclosed. The apparatus comprises: a motion sensor to sense a movement of a sensing object; an image capturing unit to capture a first still image for a certain region which includes the sensing object; a storage unit to store the first still image; and a control unit which controls the image capturing unit to capture the first still image if a movement of the sensing object is sensed, and detects an outline of the sensing object by determining if the sensing object is included within the certain region by analyzing the first still image. Thus, the apparatus is able to perform a continuous real-time detection. [Reference numerals] (2100) Motion sensor; (2200) Illuminance sensor; (2300) Lighting unit; (2400) Infrared sensor; (2500) Image capturing unit; (2600) Storage unit; (2700) DMA unit; (2800) Time information receiving unit; (2900) Control unit

Description

Contour monitoring device {APPARATUS FOR MONITORING EDGE}

The present invention relates to a contour monitoring apparatus, and more particularly, to a contour monitoring apparatus for detecting and monitoring the contour of a moving object.

With the development of technology in various electronic fields, such as sensor technology, image processing technology, and signal processing technology, the technology of the object monitoring device is also getting new day by day. In such an object monitoring apparatus, various types of sensors are used to detect the movement of a sensing object such as an object, a person, or an animal.

The object monitoring device detects the human body moving without a separate switch in places where people cannot pass or use it, such as elevators, corridors, toilets, warehouses, stairs, etc. It is adopted. The object monitoring device is useful when it is difficult to find a switch in a dark place or when people move irregularly, such as a staircase or a porch of a multi-family house.

The general object monitoring device is fixed to the pyroelectric infrared sensor and the microwave sensor to a part of the main body of the lamp or heater, and turn on the lamp or heater when a person enters the detection range of each sensor.

However, as each of these sensors is installed in a fixed state, if a person entering the sensing range is not moving, each sensor does not continuously detect the human body, and even if there is a person, the operating time of the set device has elapsed. Or there was a problem that the heater is OFF.

In particular, even if there is a person within the detection range of each sensor, if the person does not move, the human body does not detect and the lamp or electric heater is automatically turned off, so a delay time of about 20 to 60 seconds is set to compensate for this problem. The way appeared.

However, such a scheme is that even if a person passes by for a while, the lamp or the heater is turned on during the delay time, causing unnecessary waste of energy.

Alternatively, based on pyroelectric infrared sensors, infrared light emitted by the human body responds to initial motion for a short time and uses a rotating plate and a driving motor, optical shutter, piezoelectric chopper, and thermopile to intermittently emit infrared light. A variety of methods have emerged, including sensor, all-in-one shutter, motor and hinge brackets, and additional modules.

However, these various methods are actually a lot of problems to be easily implemented and commercialized, there is no groundbreaking solution in this field yet.

The present invention has been made to solve the above-described problem, an object of the present invention is to provide a monitoring device that detects the contour of the object using a variety of sensors including an image sensor and continuously monitoring it.

In addition, the present invention employs one image sensor corresponding to a small chip of a relatively low specification, and can be miniaturized and reduced cost, and there is another object to produce a commercialized product for mass production.

An apparatus for monitoring a contour according to an embodiment of the present invention may include a motion sensor sensing a motion of a sensing object, an image capturing unit capturing a first still image of a predetermined area including the sensing object, and storing the first still image. And a storage unit to control the image capturing unit to capture the first still image when the motion of the sensing object is sensed, and analyze the first still image to determine whether the sensing object is included in the predetermined region. It includes a control unit for detecting the contour of the sensing object.

The storage unit stores a default image for the predetermined area, and when it is determined that the sensing object is included, the storage unit compares the default image and the first still image captured according to the sensing of the motion to detect the detection. The contour of the water can be detected.

The controller may control the image capturing unit to repeatedly capture a still image for the preset time even if the motion of the sensing object is not sensed for a preset time, and the contour of the sensing object included in the repeatedly captured still image. Can be detected.

The controller may divide the first still image and the repeatedly captured still image into a plurality of areas and detect an outline of the sensing object in each of the divided areas.

The apparatus may further include a direct memory access (DMA) unit, and the controller may control the DMA unit to perform a direct access process on the images stored in the storage unit.

And an illuminance sensor and an illuminator, wherein the controller controls the illuminator to turn on the illuminator if the ambient brightness sensed by the illuminance sensor is smaller than a threshold value, and then captures the image to capture the first still image. You can control wealth.

The storage unit stores a plurality of basic images divided by various categories, and the controller detects contours of the sensing object and determines similarity between the detected contours and contours included in the stored plurality of basic images. can do.

The controller may identify the type of the sensing object by checking a category to which the calculated basic image belongs, when the basic image having the highest similarity is calculated among the plurality of basic images.

The sensing object may be any one of a human, an animal, a plant, and an inanimate object.

The controller may detect an outline of a second still image captured after a predetermined time elapses, and calculate an amount of change in the outline between the first still image and the second still image.

The controller may divide the first still image and the second still image into a plurality of regions, and calculate an amount of contour change for each divided region.

The storage unit may include time information in which the first still image and the second still image are captured, and the controller may store the contour change amount in the storage unit according to the time information.

The sensor may further include an infrared sensor, and when the motion of the sensing object is sensed, before the image capturing unit captures the first still image, the controller first checks the type of the sensing object through the infrared sensor. The image capturing unit may control the image capturing unit to capture the first still image based on the identified type.

On the other hand, the contour monitoring apparatus according to another embodiment of the present invention, a motion sensor for sensing the motion of the sensing object, an image capturing unit for capturing a first still image of a predetermined region including the sensing object, the first still image And a storage unit storing a plurality of basic images classified by various categories, and controlling the image photographing unit to capture the first still image when the motion of the sensing object is sensed, and analyzing the first still image to analyze the predetermined region. And a controller configured to detect an outline of the sensing object by determining whether the sensing object is included in the sensing unit, and the control unit repeatedly generates a still image for the predetermined time even if the motion of the sensing object is not sensed for a predetermined time. Control the image capturing unit to capture and repeat the captured still It said detecting detects a contour of water containing Jie.

The controller detects an outline of the sensing object, determines a similarity between the detected outline and an outline included in the stored plurality of base images, and when a base image having the highest similarity is calculated among the plurality of base images. The type of the sensing object may be identified by checking a category to which the calculated basic image belongs.

According to various embodiments of the present disclosure, the contour of an object may be detected and continuously monitored using various sensors including an image sensor, and real time continuous detection may be performed.

In addition, the present invention can perform high-speed memory processing through the DMA unit, and by employing one image sensor corresponding to a small chip of a relatively low specification, it is possible to miniaturize and reduce the cost.

1 is a block diagram showing a contour monitoring apparatus according to an embodiment of the present invention.
Figure 2 is a block diagram showing a contour monitoring apparatus according to another embodiment of the present invention.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a contour monitoring apparatus according to an exemplary embodiment.

Referring to FIG. 1, the contour monitoring apparatus 1000 may include a motion sensor 100, an illuminance sensor 200, an infrared LED 300, an image sensor 400, an SDRAM 500, a central processing unit 600, and And a DMA unit 700 included in the central processing unit 600.

The motion sensor 100 senses the sensing object. The motion sensor 100 may be implemented as at least one of an ultrasonic sensor and a microwave sensor. The signal sensed by the motion sensor 100 is transmitted to the CPU 600. Alternatively, the motion sensor 100 may be implemented as a pyroelectric infrared sensor (PIR).

Since the motion sensor 100 is difficult to continuously detect a subject such as a stationary human body after the movement occurs in the subject, the motion sensor 100 of the present invention is used for initial motion detection (trigger). desirable.

The illuminance sensor 200 detects brightness information of the surroundings. The signal sensed by the illuminance sensor 200 is transmitted to the CPU 600.

The infrared LED 300 senses a sensing object around it. If it is determined that the ambient brightness sensed by the illuminance sensor is dark, the infrared LED 300 is driven under the control of the central processing unit 600, and thus, even in the dark, the surrounding sensing object may be sensed. Meanwhile, the infrared LED 300 may be replaced with LED lights, LCD lights, and various other types of lights.

The image sensor 400 captures a photographed image, for example, a still image when a subject such as a person, an animal, a plant, an object, or the like is photographed through a photographing module (not shown).

The image sensor 400 converts a still image into an electrical signal. The converted signal is transferred to the DMA 700 or stored in the SDRAM 500. The image sensor 114 may be implemented as any one of a CCD image sensor and a CMOS image sensor. Among them, CMOS image sensor has simpler driving method than CCD image sensor used in most CCTVs, and it is possible to integrate the module in one chip, so that the module can be miniaturized and the manufacturing cost can be lowered. .

The SDRAM 500 stores a still image sensed by the image sensor 400. That is, the SDRAM 500 may be a memory device capable of storing and inquiring frame data of the image sensor 400.

 The SDRAM 500 may be conceptually divided into an area A, an area B, and an area C. FIG. SDRAM 500 is preferred, but other various forms and / or types of storage devices may be applied.

The central processing unit 600 controls overall various configurations of the contour monitoring apparatus 1000. The central processing unit 600 receives a signal from the motion sensor 100 and the illumination sensor 200, and transmits a control command to the infrared LED 300.

The CPU 600 may receive signals from the image sensor 400 and the SDRAM 500, or may transmit control commands to the image sensor 400 and the SDRAM 500. As one example, the central processing unit 600 may be a microprocessor.

The central processing unit 600 includes a direct memory access (DMA) unit 700, and the DMA unit 700 receives the converted signal from the image sensor 400. The DMA unit 700 may process an image stored in the SDRAM 500.

Referring to FIG. 1, the operation of the contour monitoring apparatus 1000 will be described in more detail. The central processing unit 600 incorporates a DMA unit 700 to process image data at high speed.

When the motion, that is, motion, of the sensing object is detected by the motion sensor 100, the sensing data is transmitted to the CPU 600. The CPU 600 receiving the sensing data from the motion sensor 100 receives the data from the illuminance sensor 200. The central processing unit 600, based on the data received from the illuminance sensor 200, when the surrounding is determined to be night, first turn on the infrared LED.

The CPU 600 controls the image sensor 400 to scan one image frame and stores the image frame in the area A of the SDRAM 500. The central processing unit 600 drives the image sensor 400 at regular time intervals to scan new image frames, and stores the newly scanned image frames in the area B of the SDRAM 500. In this case, the image frames stored in the areas A and B are preferably stored in the form of data.

Next, the CPU 600 compares each pixel of the image frame stored in the region A of the SDRAM 500 and the image frame stored in the region B of the SDRAM 500 with each other. Specifically, an Exclusive-OR operation is performed on each pixel corresponding to each other, and the resulting comparison values are stored in the area C of the SDRAM 500 in units of corresponding pixels. By performing an exclusive-OR operation, the calculated comparison values have a result value of 0 if they are equal to each other and 1 if they are different from each other. Preferably, known algorithms of methods for comparing the outlines or edges of moving objects can be used. In this case, the comparison may be performed in pixel block units having a predetermined size. Of course, various well-known methods can be applied.

The data stored in the area A of the SDRAM 500 is an image frame sensed by the first primary trigger motion sensor 100, and the data stored in the area B of the SDRAM 500 is secondary to the image sensor 400. It may be an image frame captured by.

On the other hand, in order to more precisely the motion of the detected object initially detected in the present invention, an algorithm for verifying this can be performed. The CPU 600 may determine whether the motion is caused by poor surroundings caused by minute movements of an animal, the wind, or the curtain, or the motion of the human body or the subject.

The central processing unit 600 analyzes the data of the area C of the SDRAM 500 and proceeds to the next processor only when it is determined that the human body or the moving object is entered. If it is a movement caused by poor surroundings such as a small movement of an animal, a wind, a curtain, or the like, then the prosensor does not proceed.

Here, the next process may be a program routine for the CPU 600 to analyze the data of the region C of the SDRAM 500 to shape a subject such as a human body in two dimensions. Then, through the process, the 2D center coordinates are finally calculated from the normalized model such as a human body composed of 2D coordinate values, and are stored in the SDRAM 500.

The central processing unit 600 deletes data stored in the areas A, B, and C of the SDRAM 500 except for the two-dimensional center coordinates calculated for the next process, and waits for the next process. Enter.

The central processing unit 600 controls the image sensor 400 to scan two new image frames, and stores the scanned two image frames in the area A and the area B of the SDRAM 500, respectively. And the two-dimensional center coordinates of the sensing object are again calculated in the SDRAM region C in which the comparison value is stored.

The central processing unit 600 manages a series of two-dimensional center coordinate sets obtained by such a repetitive process, so as to track the position of the sensing object in real time until the sensing object leaves the monitoring radius of the image sensor 400. have.

Conventional monitoring device has a good initial detection, but there was a difficulty in detecting a fine moving object and a stationary object moving, the present invention can continuously detect a fine moving object, and move The detection of the stationary object can be continuously and accurately performed. Accordingly, the real-time continuous detection process can be realized by continuously detecting the position value without stopping until the moving object enters and exits the detection radius.

2 is a block diagram illustrating a contour monitoring apparatus according to another exemplary embodiment. The components described in FIG. 1 perform the same or similar operations and / or functions in FIG. 2, and may additionally perform the operations and / or functions described in FIG. 2.

Referring to FIG. 2, the contour monitoring apparatus 2000 may include a motion sensor 2100, an illuminance sensor 2200, an illumination unit 2300, an infrared sensor 2400, an image photographing unit 2500, a storage unit 2600, The DMA unit 2700, a time information receiver 2800, and a controller 2900 are included.

The motion sensor 2100 senses the motion of the sensing object.

The illuminance sensor 2200 senses the brightness around the contour monitoring apparatus 200.

The lighting unit 2300 may use infrared LEDs, LED lights, LCD lights, and various other types of lights to identify the sensing object.

The infrared sensor 2400 may detect an object by using infrared rays emitted from the sensing object. Using the infrared sensor 2400, organisms such as humans or animals can be more easily identified as compared to surrounding background objects such as curtains, walls, and the like.

The image capturing unit 2500 captures a first still image of a predetermined area including a sensing object. Here, the still image may be a frame image. The image capturing unit 250 preferably includes a lens, an image sensor, a driving module, and the like.

The storage unit 2600 may store at least one of a default image for a certain area including a sensing object, a first still image, a second still image captured after a predetermined time elapsed, and a still image repeatedly captured for a predetermined time. Can be stored.

The storage unit 2600 stores a plurality of basic images divided by various categories, respectively. As one example, various categories may include humans, animals, plants, and inanimate objects. In this case, a male and a female subcategory may be included, and a dog, a cat, a bird, etc. may be included as a subcategory of an animal. There may be no subcategories of plants and inanimate objects, but subcategories of plants may include subcategories according to size, subcategories according to color, and subcategories of inanimate objects include curtains, walls, and doors. Further, each of the men and women can be categorized under the face, height, appearance, and the like.

The storage unit 2600 may be categorized and stored in advance by a manufacturer at the time of manufacturing the contour monitoring apparatus 2000. In addition, the basic image may be installed or updated in the storage unit 2600 through a removable portable memory device.

The storage unit 2600 may store time information received through the time information receiver 2800. The time information is information about a time at which the image was captured, and in this case, data identifying the captured image may also be stored. As a result, the storage unit 2600 may store the contour change amount according to the time information at which the image is captured.

The storage unit 2600 may store various pieces of information such as the amount of change of the contour, the contour information, the plurality of area information, the two-dimensional coordinate information, and the like. The storage unit 2600 may be various types of storage media such as an HDD, a RAM, and a flash memory.

The DMA unit 2700 processes images stored in the storage unit 2600 at high speed. The DMA unit 2700 may be disposed in the controller 2900, and the storage unit 2600 may be implemented in an SRAM form for high speed data processing.

The time information receiver 2800 receives current time information. As an example, the time information receiver 2800 may receive current time information from the outside. As another example, the time information receiver 2800 may be implemented as a GPS receiver. In this case, the time information receiver 2800 may receive current time information from an external GPS.

The controller 2900 performs overall control of the components.

The controller 2900 may be implemented as a microprocessor, and the microprocessor is a small chip having a relatively low specification, and preferably includes a DMA unit 2700. The operation corresponding to the central processing unit 600 of FIG. 1 may be performed.

When the motion of the sensing object is sensed, the controller 2900 controls the image capturing unit 2500 to capture the first still image, and analyzes the first still image to determine whether the sensing object is included in a predetermined area, and thus the contour of the sensing object. Is detected.

As an example, if it is determined that the sensing object is included, the controller 2900 may detect the outline of the sensing object by comparing the default image with the first still image captured according to the sensing of the motion.

In detail, since the constant area in which the contour monitoring apparatus 2000 captures an image is fixed, the contour monitoring apparatus 2000 stores the default image including only the fixed fixed area in the storage unit 2600. Then, a sensing object such as a person appears and the captured image is compared with the default image, so that the outline of the sensing object can be easily detected.

Here, the first still image is an image captured when the motion of the sensing object is detected. In order to detect the contour of the sensing object, various well-known algorithms may be applied.

The controller 2900 controls the image capturing unit 2500 to repeatedly capture a still image for a preset time even if the motion of the sensing object is not sensed for a preset time, and the contour of the sensing object included in the repeatedly captured still image. Can be detected.

As described above, after the first still image is captured, the controller 2900 may operate the image capturing unit 2500 to continuously monitor the outline of the sensing object for a preset time even if the sensing object does not move.

The controller 2900 may divide the first still image and the repeatedly captured still image into a plurality of regions, and detect the contour of the sensing object in each of the divided regions. The plurality of areas may be set on a unit pixel basis of a still image composed of a plurality of pixels or on a block basis having an appropriate size.

The controller 2900 may control the DMA unit 2700 to perform high-speed image processing on the images stored in the storage 2600.

If the ambient brightness sensed by the illuminance sensor 2200 is less than the threshold, the controller 2900 first controls to turn on the lighting unit 2300 and then controls the image capturing unit 2500 to capture the first still image. can do.

In detail, when it is determined that the ambient brightness is dark based on the brightness sensed by the illuminance sensor 2200, the controller 2900 drives the lighting unit 2300 before the image capturing unit 2500 to obtain an image capturing unit ( The lighting unit 2300 may be driven to perform image capture well at 2500.

The controller 2900 may detect the contour of the sensing object and determine a similarity between the detected contour and the contour included in the stored plurality of basic images.

When the basic image having the highest similarity is calculated among the plurality of basic images, the controller 2900 may identify the type of the sensing object by checking a category to which the calculated basic image belongs.

As an example, if the detected contour is a human face shape, the controller 2900 sequentially compares previously stored basic images to search for a basic image representing the human face shape. After identifying the upper category in the lower category in order of face, man, and person, the searched basic image may identify the type of the sensing object.

Here, the type of sensing object may be any one of a human, an animal, a plant, and an inanimate object.

The controller 2900 detects an outline of the second still image captured after a preset time elapses, and calculates an amount of change in the outline between the first still image and the second still image. In this case, the controller 2900 may divide the first still image and the second still image into a plurality of regions, and calculate an amount of contour change for each divided region. Accordingly, the controller 2900 may calculate whether the sensing object is still present in the predetermined region.

The controller 2900 controls the storage unit 2600 to store the amount of change in the contour change from the first still image to the second still image. Accordingly, it is possible to calculate the change amount of the contour according to the time information.

When the motion of the sensing object is sensed, the controller 2900 first checks the type of the sensing object sensed by the infrared sensor 2400 before the image capturing unit 2500 captures the first still image. Based on the type, the image capturing unit 2500 may control the image capturing unit 2500 to capture the first still image.

According to the present invention, the present invention can first determine whether a living thing such as a human is moving or a background curtain included in a certain area is moved by wind, and as a result, the image photographing unit 2500 when the background curtain is moved. Can reduce the error of driving).

This contour monitoring device (1000, 2000) detects inside and outside of the facility, intruder detection outside the base, entrance and exit detection of the parking lot, traffic detection direction, moving vehicle detection, coast guard monitoring, parking lot accident detection, illegal garbage dumping, discarded objects It can be applied in various fields such as detection, illegal parking detection, presence or absence of human, automatic detection of lighting / heater human body.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. However, it is not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be practiced without departing from the scope of the invention disclosed herein.

100, 2100: motion sensor 200, 2200: illuminance sensor
300: infrared LED 400: image sensor
500: SRAM 600: Central Processing Unit
700, 2700: DMA unit 1000, 2000: contour monitoring device
2300: lighting unit 2400: infrared sensor
2500: Image capturing unit 2600: Storage unit
2800: time information receiving unit 2900: control unit

Claims (15)

A motion sensor for sensing a motion of the sensing object;
An image capturing unit capturing a first still image of a predetermined area including the sensing object;
A storage unit to store the first still image; And
When the motion of the sensing object is sensed, the image capturing unit is controlled to capture the first still image, and the contour of the sensing object is detected by analyzing the first still image to determine whether the sensing object is included in the predetermined area. A control unit;
The controller may be further configured to detect an outline of a second still image captured after a preset time elapse and calculate an amount of change of the contour between the first still image and the second still image, wherein the first still image and the second still image are included in the control unit. Contour monitoring device, characterized in that to divide the image into a plurality of areas and calculate the amount of contour change for each divided area. The method of claim 1,
The storage unit stores a default image for the predetermined area,
If it is determined that the sensing object is included, the controller monitors the contour of the sensing object by comparing the default image with the first still image captured according to the sensing of the motion. 3. The method of claim 2,
The control unit,
Although the motion of the sensing object is not sensed for a predetermined time, controlling the image capturing unit to repeatedly capture a still image for the predetermined time, and detecting the contour of the sensing object included in the repeatedly captured still image. Contour monitoring device characterized in that. The method of claim 3,
The control unit,
And dividing the first still image and the repeatedly captured still image into a plurality of regions and detecting an outline of the sensing object in each divided region. 5. The method of claim 4,
Further comprising a DMA (Direct Memory Access) unit,
And the controller controls the DMA unit to perform direct access processing on the images stored in the storage unit. 6. The method of claim 5,
Illuminance sensor; And
It further comprises a lighting unit;
If the ambient brightness sensed by the illuminance sensor is less than the threshold value, the controller first controls to turn on the lighting unit, and then controls the image capturing unit to capture the first still image. . The method of claim 1,
The storage unit stores a plurality of basic images each classified into various categories,
The controller may detect the contour of the sensing object and determine a similarity between the detected contour and the contour included in the stored plurality of basic images. 8. The method of claim 7,
The control unit,
And calculating a category to which the calculated basic image belongs, and identifying the type of the sensing object when the basic image having the highest similarity is calculated among the plurality of basic images. 9. The method of claim 8,
The sensing object type,
Contour monitoring device, characterized in that any one of human, animal, plant, and inanimate. delete delete The method of claim 1,
The storage unit includes time information at which the first still image and the second still image are captured,
The controller may be configured to store the contour change amount in the storage unit according to the time information. The method of claim 1,
It further comprises an infrared sensor,
When the motion of the sensing object is sensed, the controller checks the type of the sensing object first through the infrared sensor before the image capturing unit captures the first still image. And the image capturing unit controls the image capturing unit to capture the first still image based on the image capturing unit. delete delete

Images