KR101167605B1 - Intelligent controller using camera and method thereof - Google Patents

Abstract

PURPOSE: An intelligent multi function control apparatus and method a camera are provided to enhance monitoring capability by installing a camera or voice notification device and to execute field guide broadcasting in real time. CONSTITUTION: An intelligent multi function control apparatus(200) comprises a camera unit(210), an image analyzing unit(220), a condition determining unit(230), a voice transmitting unit(240), and a control unit(250). The camera unit creates image information by taking a photograph of external objects. The image analyzing unit analyzes the image information and distinguishes a moving object among the external objects. The image analyzing unit determines whether the moving object is man or not through the shape of the moving object. The condition determining unit determines whether the moving object enters into a fixed domain or not. The voice transmitting unit transfers set voice toward the moving body in case the moving object enters into the fixed domain.

Description

Intelligent multi-function control device and method with a camera {Intelligent controller using camera and method

The present invention relates to an intelligent multifunctional control apparatus and method having a camera.

In modern society, closed-circuit television (CCTV) is often used to prevent crime or to detect certain dangerous situations. CCTV can capture certain areas to leave evidence of crime or to make the relevant information available to managers in real time.

The following prior art document provides a technique for transmitting an image of a CCTV camera to the management server to notify the outside of the danger of the elevator occupants. However, the prior art does not propose a way to prevent or actively solve the risk in the field.

That is, according to the prior art, there is no technology that can determine the situation in which the crime is likely to occur in advance to avoid the situation or prevent the situation where the crime continues to occur at the scene where the crime occurs.

The above-described background technology is technical information that the inventor holds for the derivation of the present invention or acquired in the process of deriving the present invention, and can not necessarily be a known technology disclosed to the general public prior to the filing of the present invention.

Republic of Korea Patent No. 1023163

The present invention installs a camera and a voice notification device in a place where an object to be monitored or a crime prevention and safety prevention is required to increase the monitoring capability and intelligently equipped with a camera capable of broadcasting the field system in real time. To provide a multifunctional control device and method.

In addition, the present invention is to provide an intelligent multi-function control device and method having a camera that can be sent to the control server or the administrator in real time the situation in real time to rectify the dangerous situation.

In addition, the present invention is to provide an intelligent multi-function control device and method having a camera capable of implementing a connection delay function and a continuous connection function by implementing a circuit unit for interworking with an external device as a two-stage relay circuit.

The technical problems other than the present invention can be easily understood from the following description.

According to an aspect of the present invention, a method performed by an intelligent multi-function control device, comprising: generating image information by photographing an external object in a camera unit; Analyzing the generated image information to identify a moving object among the photographed external objects; Determining whether the identified moving object enters a preset area; And sending a pre-stored voice toward the external object when the identified moving object enters into the preset area.

The present embodiment may further include transmitting the image information and the alarm message to a control server or dispatching agency server connected to the intelligent multifunction control device via a wired or wireless network when the identified moving object enters into the preset area. Can be.

The present invention may further include transmitting an alarm message to a log server when the identified moving object enters the predetermined area, but the log server may record the alarm messages in a date order.

The present invention may further include transmitting a notification text message to a manager portable terminal using a wired or wireless network when the identified moving object enters the preset area.

The camera unit may include a plurality of cameras having different identification information, and the image information may be generated corresponding to the identification information of each camera.

In the sending step, the pre-stored voice may be sent only at a preset time, and the preset time may be a non-business time.

In addition, the sending step may include: first sending a first stored first voice to the external object when the identified moving object enters into the preset area; And sending the second pre-stored second voice toward the external object when the moving object continues to be located within the preset area after a preset time after the first sending.

According to another aspect of the present invention, a method performed by an intelligent multi-function control device, comprising: generating image information by photographing an external object in a camera unit; Analyzing the generated image information to identify a moving object among the photographed external objects; Determining whether the moving object is a human using the identified shape of the moving object; Determining whether the identified moving object enters a preset area when the moving object is a human; And sending a pre-stored voice toward the external object when the identified moving object enters into the preset area.

The determining of whether the identified moving object enters a predetermined area further includes determining whether the moving object's attire is a security guard's attire if the moving object is a human. If not, it may be determined whether the identified moving object enters a preset area.

In addition, according to another aspect of the invention, the camera unit for photographing the external object to generate the image information; An image analyzer for analyzing the generated image information to identify a moving object among the photographed external objects; A condition determining unit determining whether the identified moving object enters a preset area; And when the identified moving object enters into the predetermined area is provided an intelligent multi-function control device having a camera including a voice transmitter for transmitting a pre-stored voice toward the external object.

The present embodiment may further include a message transmitter for transmitting the image information and the alarm message to a control server or dispatching agency server connected through a wired or wireless network when the identified moving object enters into the preset area.

Here, the message transmitter may further transmit an alarm message to a log server when the identified moving object enters into the preset area, but the log server may record the alarm messages in a date order.

The message transmitter may transmit a notification text message to a manager portable terminal using a wired or wireless network when the identified mobile object enters into the preset area.

In addition, the present embodiment includes a first relay circuit for delaying the connection to the message transmission unit when the voice transmission unit sends the voice toward the external object; And a second relay circuit for continuously connecting an electrical signal so that the operation of the message transmitter is continued.

The voice transmitter may first transmit a pre-stored first voice to the external object when the identified moving object enters the preset area, and after the preset time passes after the first sending, the moving object. If is still located within the preset area may be sent to the second object second secondary stored in advance.

The image analyzer may determine whether or not the moving object is a human using the shape of the identified moving object, and the condition determining unit may determine whether the identified moving object enters a preset area when the moving object is a human. .

The image analyzing unit may determine whether the clothing of the moving object is a security guard's clothing when the moving object is a person, and the condition determining unit determines an area in which the identified moving object is preset when the clothing of the moving object is not the security guard's clothing. You can determine if you are entering.

Other aspects, features, and advantages will become apparent from the following drawings, claims, and detailed description of the invention.

Intelligent multi-function control device and method with a camera according to the present invention by installing the camera and the voice notification device in the place where the object to be monitored or the crime prevention and safety prevention is required to increase the monitoring ability as well as in real time The field system also has the effect of broadcasting.

In addition, the intelligent multi-function control apparatus and method with a camera according to the present invention has the effect of transmitting the field situation to the control server or the administrator in real time to quickly rectify the dangerous situation.

In addition, the intelligent multi-function control apparatus and method with a camera according to the present invention has the effect of implementing the function of delaying the connection drive and the continuous connection function by implementing a circuit unit for interworking with an external device as a two-stage relay circuit.

1 is an intelligent multi-function control system implementation with a camera according to an embodiment of the present invention.
Figure 2 is a block diagram of an intelligent multi-function control device having a camera according to an embodiment of the present invention.
3 is a flowchart of an intelligent multifunction control method having a camera according to an embodiment of the present invention.
Figure 4 is a block diagram of an intelligent multi-function control device having a camera according to another embodiment of the present invention.
5 is a block diagram illustrating a message transmission unit according to another embodiment of the present invention.
6 is a flowchart of an intelligent multifunction control method having a camera according to another embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The term " part, "" module," " means, "or the like, which is described in the specification, refers to a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software .

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is an implementation diagram of an intelligent multifunction control system having a camera according to an embodiment of the present invention. Referring to FIG. 1, an external object 100, an intelligent multifunction control apparatus 200, a network 300, a control server 400, and an administrator portable terminal 500 are illustrated.

The present invention installs a camera and a voice notification device at a specific external object, for example, a place where an object to be monitored or a crime prevention and safety prevention is required to increase the monitoring capability and to broadcast the field system in real time. There are features that can be done.

The external target 100 is to be monitored, for example, to restrict a person's access at a specific time such as a dangerous goods handling facility, a restricted area, a military dangerous area, a civilian access control area, a school alley, a place requiring crime prevention, and the like. It can be a place to be. In the case of a military unit, the external target 100 may be a troop fence, an oil tank, a mine and a dangerous area, a building roof and a fall danger area, and the captured image is transmitted to a monitor installed in the unit situation room and / or a sleeping room and output. Can be.

The intelligent multi-function control apparatus 200 continuously photographs the external object 100 to determine whether there is a specific moving object, and when it detects the moving object, determines that the alarm message is generated and sends a pre-stored voice message to the moving object.

Conditions under which the intelligent multifunction control device 200 generates the above events may be variously set. For example, when a moving object enters a specific area, when the moving object exits a specific area, when the moving object suddenly appears in a specific area, when the moving object disappears from a specific area, when the moving object stays in a specific area, the moving object is specified In the case of a lingering distance in an area, when an event occurs such as when the moving object passes a designated line of a specific area with a predetermined direction, the intelligent multifunction control apparatus 200 causes the moving object of the external object 100 to listen to the above-mentioned voice message. Can ship.

In this case, the intelligent multi-function control device 200 measures the size of the moving object, the viewing direction, the angle and the separation distance, and generates a 2D or 3D image using such data to determine what kind of moving object is the moving object. You can identify the type.

If the identified moving object is a moving object corresponding to previously stored data, the above-described event may not occur. For example, the event itself may not occur when the system broadcast is not required, such as when the identified moving object is an animal or a guard. In order to determine whether the moving object is an animal, the shape of the moving object is identified from the photographed image, and when it is determined that the shape of the moving object is not a human shape as a result of the comparison, the moving object is judged as an animal or the identified moving object If the shape is compared with a pre-stored animal shape and the comparison result matches the specific animal shape, the moving object may be determined as an animal. In addition, the mobile may be determined as a security guard by referring to a specific hat, color of clothes, and the like, such as the clothes of a previously stored security guard.

Here, a method of determining whether a mobile object entering a restricted access area is a consumer or an authorized seller enters may be implemented in various ways. For example, a mobile object wearing a predetermined uniform may be recognized as a seller of a store. If not, the mobile can be recognized as a consumer. Alternatively, the moving object that normally passes the lock device of the access control device installed in the restricted access area may be identified as a seller. That is, when the seller releases the lock device in the restricted access area by a predetermined means, for example, when the tag is attached to a means with identification information, such as RFID, or when an access code is input, the moving object is recognized as the seller and described later. The voice transmitter 240 may not transmit the voice.

The intelligent multifunction control apparatus 200 may transmit image information or an alarm message to the control server 400, the manager portable terminal 500, or the dispatching engine server (not shown) through the network 300.

2 is a block diagram of an intelligent multi-function control device having a camera according to an embodiment of the present invention. 2, the intelligent multifunction control apparatus 200 may include a camera unit 210, an image analyzer 220, a condition determiner 230, a voice transmitter 240, and a control unit 250. have.

The camera unit 210 generates image information by photographing an external object. The camera unit 210 may generate visual information about at least an external object by recording a moving picture, a still image, and the like, and may also generate information including auditory information such as sound. The image information may refer to only visual information or may be referred to as information including auditory information.

The camera unit 210 may include a plurality of cameras having different identification information. That is, the camera unit 210 may include a plurality of cameras that capture the same surveillance region or different surveillance regions. Here, the image information may be generated corresponding to the identification information of each camera.

The image analyzer 220 analyzes the generated image information to identify a moving object among the captured external objects. Image analysis can be implemented in various ways. For example, by comparing a previous frame with a current frame to determine whether there is an object moving effectively for each pixel, and if there is a moving object, it can be identified as a moving object.

The condition determiner 230 determines whether the identified moving object enters a preset area. The preset area may be designated as a specific area included in an external object or may be an entire screen captured by the camera unit 210.

In addition, the condition determination unit 230 may generate a specific event according to the characteristics of the moving object identified as described above. For example, the image analyzer 220 determines whether the moving object is a human using the shape of the identified moving object, and the condition determining unit 230 determines whether the identified moving object enters a preset area when the moving object is a human. can do. The image analyzer 220 may compare the shape of the identified moving object with the shape of the person stored in advance, and determine whether the moving object is a person according to the similarity. The condition determining unit 230 may determine whether the moving object is a human, as described above. The next step of determining whether the identified moving object is entered may be performed to generate an event indicating whether the moving object is a person or not.

Further, according to another embodiment, when the moving object is a person, the image analyzer 220 may determine whether the clothes of the moving object are the clothes of the security guard, and the condition determination unit 230 may not determine the clothes of the moving object. In this case, it may be determined whether the identified moving object enters a predetermined area.

When the identified moving object enters the preset area, the voice transmitter 240 transmits the prestored voice to the external object so that the moving object can hear it.

Here, the voice transmitter 240 may broadcast different voices step by step. For example, when the identified moving object enters the preset area, the voice sending unit 240 first sends the pre-stored first voice to an external object, and after the predetermined time passes after the first sending, If it is still within the preset area, the second pre-stored second voice may be sent to the external object. Here, the first voice and the second voice may include the same voice information or may include different voice information. In the latter case, the warning level of the second voice may be higher than that of the first voice. For example, the first voice information may be simply information indicating that the area is restricted from access, and the second voice information may be information to warn of a dangerous situation that occurs when entering the restricted area.

The control unit 250 controls each function unit so that the above-described camera unit 210, the image analyzer 220, the condition determiner 230, and the voice transmitter 240 perform each function effectively.

3 is a flowchart of an intelligent multifunctional control method having a camera according to an embodiment of the present invention. The flow chart below may be performed by the intelligent multifunction control apparatus 200 as a subject.

In operation S310, the camera unit 210 may photograph the external object 100 to generate image information including external sound information. The camera unit 210 may operate only from 6 pm to 6 am after a specific time of day or a specific time, for example, non-business hours, afternoon and night. In the latter case, crime prevention and safety prevention may be necessary.

In operation S320, the generated image information may be analyzed to identify a moving object among the captured external objects. As described above, the identification of the moving object may determine whether the moving object is present in the image information through the inter-frame comparison, and the shape of the moving object may be specifically identified by comparing the previously stored shape data with the currently extracted shape data.

In step S330, it is determined whether the identified moving object enters a preset area. When the moving object enters the specific area designated by the external object 100 or the entire area photographed by the camera unit 210, it may be determined that the identified moving object enters the preset area.

In step S340, when the identified moving object enters the preset area, the prestored voice is sent toward the external object. Such voice transmission may be a measure for preventing a crime or a safety accident in advance by inducing a moving object to move out of a predetermined area in the field.

4 is a block diagram of an intelligent multi-function control device having a camera according to another embodiment of the present invention. Referring to FIG. 4, the intelligent multifunction control apparatus 200 includes a camera unit 210, an image analyzer 220, a condition determiner 230, a voice transmitter 240, a control unit 250, and a message transmitter. 260 may include. Hereinafter, the differences from the above-described embodiment will be mainly described.

The message transmitter 260 may transmit image information and an alarm message to a control server 400 or an dispatching agency server (not shown) connected through a wired or wireless network when the identified moving object enters a predetermined area.

The control server 400 is located at a remote location to monitor one or more sites, and receives information about the acoustic information, the image information, the current situation, and the like from the intelligent multifunction control apparatus 200 through the message transmitter 260. When the administrator monitors the contents of the control server 400 while monitoring, the manager broadcasts the necessary action, for example, the control server 400 directly to the mobile vehicle via the intelligent multifunction control device 200, or You can also go to the site where the vehicle is located for inspection and safety protection.

A dispatch server is a server of an agency waiting to go to the scene in a dangerous situation, and can be a server of an agency such as a police station, a fire station, or a private security company.

In addition, the message transmitter 260 may further transmit an alarm message to the log server when the identified moving object enters a preset area. Here, the log server may be a server that records the alarm messages in date order. The alarm message may include information of the moving object found at the photographing place. For example, an alarm signal indicating a time when the moving object is found, image information on a moving path of the moving object, a time when the moving object is outside a preset area, and a danger And the like.

In addition, the message transmitter 260 may transmit a notification text message to the manager portable terminal by using a wired or wireless network when the identified moving object enters a preset area. In this case, the message transmitter 260 may transmit a message such as a short message, a long message, a multimedia message, or the like to the manager portable terminal using the CDMA signal and the mobile communication network.

In addition, according to the present embodiment, the voice transmitter 240 may include a first relay circuit to delay the connection to the message transmitter 260 when the voice transmitter 240 transmits the voice to an external object. In this case, the present embodiment may further include a second relay circuit that continuously connects the electrical signal to continue the operation of the message transmitter 260.

Since the relay circuit can be integrated with the amplifier and the voice module interworking with the voice transmitter 240, since it is operated as a single device, there is an advantage of easy management and easy maintenance.

5 is a block diagram of a message transmission unit according to another embodiment of the present invention. Referring to FIG. 5, the message transmitter 260 may include an alarm message transmitter 261, a text message transmitter 263, and an image transmitter 265.

The alarm message transmitting unit 261 may control the alarm server 400 and / or the alarm message which is one or more of the time when the moving object is found, the information on the moving path of the moving object, the time when the moving object disappears, and the alarm signal indicating the danger. Can be sent to dispatch server.

As described above, the text message transmission unit 263 may transmit a text message corresponding to a dangerous situation to a mobile terminal of a predetermined administrator or security guard. Even in a normal situation other than a dangerous situation such as when the moving object enters a specific area or continues to be located in a specific area, the text message transmitter 263 may send a text message indicating that there is no abnormality at a predetermined period.

6 is a flowchart of an intelligent multi-function control method having a camera according to another embodiment of the present invention. The flow chart below may be performed by the intelligent multifunction control apparatus 200 as a subject.

In operation S310, as described above, the camera unit 210 operates only from 6 pm until 6 am, which is a specific time of day or day, for example, afternoon and night, to photograph the external object 100 by external sound. Image information including the information may be generated.

In step S320, the generated image information is analyzed to identify a moving object among the captured external objects, and in step S330, it is determined whether the identified moving object enters into a preset area, and in step S340, the identified moving object enters into a preset area. When entering, the prestored voice is sent to an external object.

In operation S350, when the identified moving object enters the preset area, the image information and the alarm message may be transmitted to the control server 400 or the dispatching agency server connected to the intelligent multifunction control apparatus 200 through a wired or wireless network. In this case, the alarm message may be further transmitted to the log server, or the notification text message may be transmitted to the manager mobile terminal using a wired or wireless network.

100: external target 200: intelligent multifunction control device
210: camera unit 220: image analysis unit
230: condition determination unit 240: voice transmission unit
250: control unit 260: message transmission unit
261: alarm message transmitter 263: text message transmitter
265: image transmission unit 300: network
400: control server 500: administrator mobile terminal

Claims (19)

delete delete delete delete delete delete delete delete delete delete A camera unit for photographing an external object to generate image information;
The generated image information is analyzed to identify a moving object among the photographed external objects, and to determine whether the moving object is a human by using the identified shape of the moving object. An image analyzer to determine whether the image is detected;
A condition determining unit that determines whether the moving object enters a predetermined area when the moving object is a human being and the clothes of the moving object are not the clothes of a security guard;
A voice transmitter for transmitting a prestored voice toward the external object when the identified moving object enters into the preset area;
A message transmitter to transmit the image information and an alarm message to a control server or dispatching agency server connected through a wired or wireless network when the identified moving object enters into the preset area;
A first relay circuit for delaying the connection to the message transmitter when the voice transmitter sends the voice to the external object; And
Including a second relay circuit for continuously connecting the electrical signal so that the operation of the message transmission unit,
The voice sending unit, the intelligent multi-function control device with a camera, characterized in that for transmitting the pre-stored voice only at a predetermined time, the preset time is a time set to non-business hours.
delete The method of claim 11,
The message transmitter further transmits an alarm message to a log server when the identified moving object enters into the preset area.
The log server is an intelligent multi-function control device having a camera, characterized in that for recording the alarm messages in date order.
The method of claim 11,
And the message transmitter transmits a notification text message to a manager portable terminal using a wired or wireless network when the identified moving object enters the preset area.
The method of claim 11,
The camera unit includes a plurality of cameras having different identification information,
And the image information is generated corresponding to the identification information of each camera.
The method of claim 11,
The voice sending unit,
When the identified moving object enters into the preset area, the first stored first voice is first sent to the external object,
Intelligent multifunction control with a camera, characterized in that the second transmission of the second voice stored in advance to the external object when the moving object continues to be located within the predetermined area after a predetermined time after the first transmission Device.
delete delete delete

Images