KR102203902B1 - Video monitoring system of distribution board and automatic controlling panel - Google Patents

Abstract

Disclosed is an image photographing system including an administrator terminal for diagnosing a state in an enclosed space by learning sensor data for an event occurring in an enclosed space. Therefore, the image photographing system helps an administrator diagnose a state of an enclosed space by outputting a state scenario.

Description

Video monitoring system of switchboard and automatic control panel {VIDEO MONITORING SYSTEM OF DISTRIBUTION BOARD AND AUTOMATIC CONTROLLING PANEL}

The present invention relates to an image capturing system, and more particularly, to an image capturing system for diagnosing conditions in the enclosed space by deep learning modeling sensor data for an event occurring in an enclosed space.

Recently, a number of photographing apparatuses capable of recording image information or simultaneously recording image information and audio information have been widely used.

These photographing devices are not only personal portable products such as digital cameras, camcorders, and camera phones, but also in general houses, department stores, banks, factories, exhibition halls, etc. to prevent theft or to easily check the operation status and process flow of machinery. It is widely used as far as possible surveillance systems.

Conventional photographing devices can only record image information or audio information, but if they can simultaneously record environmental information such as temperature, humidity, and wind speed of the filming area at the time of filming, the recorded image information, audio information, and environmental information can be simultaneously reproduced. In this case, the situation at the time of filming may be felt more vividly, and depending on the purpose of the photographing device, not only image and audio information, but also environmental information may be required.

For example, in a conventional surveillance system, a plurality of surveillance areas to be managed are photographed with one or a plurality of photographing devices, and the surveillance areas can be managed by displaying them through a monitor installed in a central management room. Apart from such a monitoring system, an environmental management system for controlling an indoor environment such as temperature or humidity is often installed.

For this reason, it is inconvenient that the monitoring functions such as process management through the monitoring system or the management of accessors and intruders and the management functions such as indoor environment management through the environmental management system are separately performed.

Therefore, the need for a photographing device capable of simultaneously recording environmental information such as temperature and humidity of the region at the time of filming as well as image information or audio information has been raised.

An aspect of the present invention provides an imaging system for diagnosing a condition in an enclosed space by deep learning modeling sensor data for an event occurring in an enclosed space.

Another aspect of the present invention provides an image capturing system including a sensor verification module for verifying the accuracy of a sensor device by generating an artificial motion in an enclosed space.

Another aspect of the present invention provides an image capturing system including a capturing module for acquiring a capturing image in an enclosed space and a coupling auxiliary unit for installation between inner walls.

The technical problem of the present invention is not limited to the technical problem mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

An imaging system according to an aspect of the present invention includes a manager terminal for diagnosing a state in the confined space by learning sensor data about an event occurring in the confined space.

Meanwhile, a sensor module installed in the closed space to detect occurrence of a pre-stored event in the closed space; A photographing module installed in the closed space to obtain an image of the closed space; And installed in the enclosed space, receiving an output signal of the sensor module, connected to the photographing module by wire or wirelessly, applying an operation signal to the photographing module, obtaining a photographed image from the photographing module, and through an internet network. A control module for transmitting the output signal of the sensor module and the captured image to the manager terminal; further comprising,

The sensor module may include a PIR sensor implemented as a passive infrared sensor and transmitting a signal change to the control module when detecting movement in the enclosed space; And when a temperature change of more than a preset temperature occurs in a thermal image that is provided to take a thermal image in the enclosed space and displays a heat distribution according to a change in brightness and saturation, the change in brightness and a change in saturation are displayed at a corresponding location. Including; a thermal image camera for transmitting the thermal image to the control module,

The control module includes: a motion monitoring unit configured to receive an output waveform from the PIR sensor and determine that motion has occurred in the enclosed space when a change in the output waveform of the PIR sensor exceeds a preset threshold; A temperature monitoring unit configured to receive a thermal image from the thermal imaging camera, and determine that a temperature change has occurred in the enclosed space when the brightness or saturation in the thermal image is changed beyond a preset threshold; An image acquisition unit for acquiring an image of the enclosed space by controlling the photographing module according to a monitoring result of the motion monitoring unit and the temperature monitoring unit; And an image storage unit that temporarily stores an image received from the photographing module, and transmits an image received from the photographing module to the manager terminal together with an output signal from the PIR sensor and the thermal imaging camera at a corresponding photographing time. Including,

The manager terminal stores the captured image received from the control module, the output signal of the PIR sensor, and the thermal image of the thermal imaging camera as learning data in a database, and stores the captured image, the output signal, and the thermal image in a database. Defined as a segment, and built a deep learning model in which learning data is learned by targeting a plurality of state scenarios in the confined space for each defined segment, and a photographed image received from the control module, an output signal from a PIR sensor, and a thermal imaging camera The thermal image of and the state scenario that is the output of the deep learning model are output together,

A sensor verification module installed in the sealed space and generating movement into the sealed space so as to check the operation of the sensor module; further comprising,

The sensor verification module may include a case formed in a box shape of a rectangular parallelepiped and having an opening at one side; A supply unit for loading inspection means of a styrofoam material to be drawn out into the closed space; A driving unit that pushes the lowermost inspection means of the inspection means loaded on the supply unit; And a sliding part having an inclined surface for guiding the inspection means drawn out from the supply part by the driving part to slide and move to the opening.

The supply unit includes: a vertical frame in which an inspection means is loaded from an upper to a lower direction, an outlet through which the inspection means is drawn out is formed in a lower direction, and a loading guide groove is formed in a vertical direction in the other direction; And a bottom frame extending in the direction of the other side of the lower portion of the vertical frame and on which the driving unit is installed,

The driving unit includes: a push block having an inclined surface formed in one direction and movable forward and backward, and pushing the inspection means loaded in the supply unit toward the outlet when moving forward; And a screw to which the push block is coupled and a motor for rotating the screw, and a motor unit for moving the psi block forward and backward according to the rotation of the screw.

According to an aspect of the present invention described above, if the manager has the manager terminal, it is possible to immediately check whether an event occurs in the confined space anytime, anywhere, and take quick action, thus allowing the confined space to maintain a safe state. In addition, by outputting a state scenario that is an output of the deep learning model together, it is possible to help the administrator diagnose the state of the confined space.

In addition, according to another aspect of the present invention, it is possible to verify whether the sensor module operates properly, including the sensor verification module, and as a result, it is possible to ensure the accuracy of diagnosis of the condition of the enclosed space.

In addition, according to another aspect of the present invention, a plurality of photographing modules may be installed in an enclosed space to obtain a photographed image without blind spots, and at this time, the photographing module is prevented from shaking and a solid coupling is achieved.

1 is a conceptual diagram of an image capturing system according to an embodiment of the present invention.
2 is a detailed block diagram of the sensor module shown in FIG. 1
3 is a control block diagram of the control module shown in FIG. 1.
4 is a diagram illustrating an example of application of the image capturing system shown in FIG. 1.
5 to 7 are diagrams for explaining a sensor verification module according to an embodiment of the present invention.
8 is a diagram illustrating an example of an image capturing system according to an embodiment of the present invention.
9 is a view for explaining a coupling auxiliary unit according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms different from each other, and only these embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention belongs It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same components throughout the specification.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements, steps, and actions to the mentioned elements, steps, and actions.

1 is a conceptual diagram of an image capturing system according to an embodiment of the present invention.

Referring to FIG. 1, an image capturing system 1000 according to an embodiment of the present invention captures an image of an enclosed space 1, and outputs the captured image through a manager terminal 400 to obtain an enclosed space 1 Allows remote diagnosis of the status of

The image photographing system 1000 according to an embodiment of the present invention may include a sensor module 100, a photographing module 200, and a control module 300 provided in the enclosed space 1, and the control module 300 ) And a manager terminal 400 connected to the Internet network.

The sensor module 100 is installed in the closed space 1 and may detect the occurrence of a predetermined event in the closed space 1. For example, the sensor module 100 may detect movement occurring in the enclosed space 1 and a temperature change in the enclosed space 1.

The photographing module 200 is installed in the closed space 1 to obtain an image of the closed space 1.

A plurality of such photographing modules 200 may be provided, and a plurality of photographed images may be acquired so that a blind spot does not occur with respect to the enclosed space 1.

The control module 300 may be installed in the enclosed space 1 and may receive an output signal from the sensor module 100. That is, the control module 300 may receive an output signal by detecting the occurrence of an event in the enclosed space 1 from the sensor module 100.

The control module 300 may be connected to the photographing module 200 by wired or wirelessly to apply an operation signal to the photographing module 200 and obtain a photographed image from the photographing module 200.

When receiving an output signal from the sensor module 100, the control module 300 may acquire a photographed image of the enclosed space 1 by applying an operation signal to the photographing module 200.

The control module 300 may be configured to be connected to an Internet network with a modem. The control module 300 may transmit an output signal of the sensor module 100 and a photographed image of the enclosed space 1 acquired from the photographing module 200 to the manager terminal 400 through an Internet network.

Meanwhile, the control module 300 may be integrally configured with the photographing module 200. In this case, the photographing module 200 will be implemented as an IP camera.

The manager terminal 400 is a device capable of communication and input/output of information, and may be implemented as, for example, a PC, a smartphone, a tablet, etc., and a software (application) that provides an image capture platform according to the present embodiment. Can be installed and run.

The manager terminal 400 may receive and output a sensor output and a captured image transmitted from the control module 300 through a mobile application driven by software in which a unique address is set to communicate with the control module 300.

Here, the manager terminal 400 may guide and manage the state of the enclosed space 1 to the manager through a mobile application. The manager terminal 400 may provide a function of setting a criterion for determining whether an event occurs in the enclosed space 1 through a mobile application, and transmits a sensor output signal and a captured image according to the event occurrence from the control module 300. If received, it can trigger an alert. Accordingly, if the manager has the manager terminal 400, it is possible to immediately check whether an event has occurred in the confined space (1) anytime, anywhere, and take quick action, thus allowing the confined space (1) to maintain a safe state. .

2 is a detailed block diagram of the sensor module shown in FIG. 1

Referring to FIG. 2, the sensor module 100 may include a Passive Infrared Ray (PIR) sensor 110 and a thermal imaging camera 120.

The PIR sensor 110 may be implemented as a passive infrared sensor, and may detect movement in the enclosed space 1.

When the PIR sensor 110 detects motion, the output waveform changes, and the signal change may be transmitted to the control module 300.

The thermal imaging camera 120 may be provided to take a thermal image in the enclosed space 1. The thermal imaging camera 120 may capture a thermal image to detect a displayed portion by displaying a thermal distribution in which heat changes in a captured image as a change in brightness or a change in saturation.

The thermal imaging camera 120 is displayed so that the brightness or saturation rapidly changes at the location where a sudden temperature change occurs above a preset temperature while the heat distribution according to the change in brightness and saturation is displayed, and the displayed position is controlled by the control module. The photographed thermal image may be transmitted so that it can be recognized by 300. The control module 300 may transmit the received thermal image to the manager terminal 400.

3 is a control block diagram of the control module shown in FIG. 1.

Referring to FIG. 3, the control module 300 may include a motion monitoring unit 310, a temperature monitoring unit 320, an image acquisition unit 330, and an image storage unit 340.

The motion monitoring unit 310 may receive an output signal from the PIR sensor 110 and monitor whether a motion of the enclosed space 1 has occurred.

For example, the motion monitoring unit 310 may receive an output waveform of the PIR sensor 110. When the change in the output waveform of the PIR sensor exceeds a preset threshold, the motion monitoring unit 310 may determine that motion has occurred.

The temperature monitoring unit 320 may receive an output signal from the thermal imaging camera 120 and monitor whether a movement of the enclosed space 1 occurs.

For example, the temperature monitoring unit 320 may receive a thermal image, which is an image captured by the thermal imaging camera 120. The temperature monitoring unit 320 may determine that a rapid temperature change has occurred when the brightness or saturation in the thermal image is changed beyond a preset threshold.

The image acquisition unit 330 may acquire an image of the enclosed space 1 by controlling the photographing module 200 according to the monitoring results of the motion monitoring unit 310 and the temperature monitoring unit 320.

The image acquisition unit 330 determines that movement has occurred in the enclosed space through the motion monitoring unit 310 or when it is determined that a sudden temperature change has occurred in the enclosed space through the temperature monitoring unit 320, the photographing module 200 ) To receive a photographing control signal to receive an image of the enclosed space (1).

The image storage unit 340 may temporarily store the image received from the photographing module 200 in a predetermined storage space and transmit it to the manager terminal 400.

The image storage unit 340 may transmit an image received from the photographing module 200 and an output signal from the PIR sensor 110 and the thermal imaging camera 120 together to the manager terminal 400.

On the other hand, the manager terminal 400 outputs a captured image received from the control module 300, an output signal of the PIR sensor 110, and a thermal image of the thermal imaging camera 120 together, so that the manager Make it easier to diagnose the condition.

At this time, the manager terminal 400 is a closed space 1 according to a photographed image received from the control module 300 using a deep learning model, an output signal of the PIR sensor 110 and a thermal image of the thermal imaging camera 120 The state scenario of can be modeled. For example, the manager terminal 400 may adopt a Deep Belief Network (DBN) model as a deep learning model. The deep trust neural network is a generative deep learning model, built by stacking the Restricted Boltzmann Machine (RPM) and the sigmoid belief network. The deep trust neural network is a deep learning model that is widely used because it has the advantage of faster processing speed compared to other deep learning models because it takes a short time for actual training because it performs pre-learning.

The manager terminal 400 may store a captured image received from the control module 300, an output signal of the PIR sensor 110, and a thermal image of the thermal imaging camera 120 as learning data in a database.

The manager terminal 400 defines a captured image, an output signal, and a thermal image as one segment, and targets the state scenario of the confined space 1 for each defined segment to build a deep learning model that learns the training data. have. Here, the target may include state scenarios such as fire occurrence, temperature decrease, falling of a loaded object, and damage of a loaded object. Such a deep learning model may output a state scenario for an input captured image, an output signal, and a thermal image.

The manager terminal 400 outputs the captured image received from the control module 300, the output signal of the PIR sensor 110, the thermal image of the thermal imaging camera 120, and a state scenario that is the output of the deep learning model. It can help diagnose the condition of the confined space.

Meanwhile, FIG. 4 is a diagram illustrating an example of application of the image capturing system shown in FIG. 1.

Referring to FIG. 4, the image capturing system 1000 according to an embodiment of the present invention may be applied to the distribution box 1. That is, the enclosed space (1) means the inner space of the distribution box (1). The image capturing system 1000 according to an embodiment of the present invention is applied to the distribution box 1 to minimize the cost and risk required for the monitoring operation, maximize the convenience of the manager, and at the same time Make it possible to respond quickly.

Meanwhile, the image capturing system according to an embodiment of the present invention may further include a sensor verification module.

The sensor verification module may be installed in the enclosed space 1 and may cause movement into the enclosed space 1 so as to check whether the sensor module 100 operates properly. This will be described with reference to FIG. 5 below.

5 to 7 are diagrams for explaining a sensor verification module according to an embodiment of the present invention.

Referring to FIG. 5, a sensor verification module 500 according to an embodiment of the present invention may include a case 510, a supply unit 520, a driving unit 530, and a sliding unit 540.

The case 510 is formed in a rectangular box shape, and an opening 511 may be formed at one side.

The supply unit 520 may load inspection means to be withdrawn into the closed space 1. For example, the inspection means (T) may be formed of a styrofoam material so as not to damage objects loaded in the closed space.

The driving unit 530 pushes the lowermost inspection means of the inspection means loaded in the supply unit 520 toward the sliding unit 540 one by one so that they are drawn out to the closed space 1 through the opening 511.

The sliding part 540 is formed with an inclined surface 541 that guides the test means drawn out from the supply part 520 by the driving part 530 to move to the opening 511, and is configured to move while the test means slides. Can be.

Referring to FIG. 6, the supply unit 520 may include a vertical frame 511 and a bottom frame 512.

The vertical frame 511 is to be loaded with the inspection means from the top to the bottom direction, the inspection means may be drawn out in one side direction of the lower outlet 511b may be formed.

In the other direction of the vertical frame 511, a loading guide groove 511a may be formed in the vertical direction.

The bottom frame 512 may be extended in the direction of the other side below the vertical frame 511, and the driving part 530 may be installed in the extended portion.

The driving unit 530 may include a push block 531 and a motor unit 533.

The push block 531 may have an inclined surface 531a formed in one direction. Even if the push block 531 pushes the inspection means by the inclined surface 531a, it is possible to prevent the inspection means from being damaged.

The motor unit 533 reciprocates the push block 531 and may include a motor and a screw rotated by the motor. At this time, as the push block 531 is coupled to the screw, the push block 531 may move forward and backward according to the forward and reverse rotation of the motor.

The sliding portion 540 is formed to be inclined from the outlet 511b to the opening 511, so that the inspection means drawn through the outlet 511b slides into the opening 511 to fall from the closed space 1.

For example, referring to FIG. 7, when the push block 531 moves in one direction of the vertical frame 511 along the bottom frame 512, the inspection means T can be pushed to the outlet 511b. In addition, the inspection means T will slide along the sliding part 540 and be discharged to the opening 511.

Such a sensor verification module 500 can verify whether the PIR sensor 110 operates properly by generating movement in the enclosed space 1, and as a result, it will ensure the accuracy of diagnosis of the condition of the enclosed space 1 Make it possible.

Meanwhile, FIG. 8 is a diagram illustrating an example of an image capturing system according to an embodiment of the present invention.

Referring to FIG. 8, a plurality of photographing modules 200 are installed in the enclosed space 1 to obtain a photographed image without a blind spot. In this case, the photographing module 200 may be installed on the inner wall of the enclosed space 1, and may include a coupling auxiliary unit for preventing the photographing module 200 from shaking and establishing a solid coupling.

9 is a view for explaining a coupling auxiliary unit according to an embodiment of the present invention.

Referring to FIG. 9, the coupling auxiliary unit may include a coupling auxiliary housing 610, a vertical moving part 620, a sliding part 630, and an installation plate 640.

The coupling auxiliary housing 610 may be installed on the inner wall of the enclosed space 1.

The vertical moving part 620 may be accommodated in the coupling auxiliary housing 610. The vertical moving part 620 may move in the vertical direction within the coupling auxiliary housing.

At this time, the coupling auxiliary housing 610 may be formed in a cylindrical shape, providing a vertical movement space 614 of the vertical movement unit 620 inside, and forming a guide groove 616 for guiding the vertical movement. I can.

The vertical movement part 620 may vertically move in the vertical movement space 624 through the guide protrusion 624 coupled to the guide groove 616.

In this case, the coupling auxiliary housing 610 may have a hydraulic line insertion port 6111 for supplying hydraulic pressure into the guide groove 616. That is, the vertical movement unit 620 can be vertically moved by hydraulic pressure supplied to the guide groove 616 through the hydraulic line insertion port 6111.

When the photographing module 200 is installed on the inner wall of the enclosed space 1, the vertical moving part 620 presses the photographing module 200 while moving upward to the inner wall of the enclosed space 1 and the photographing module ( 200) to strengthen the bond.

Meanwhile, the vertical moving part 620 may form a recessed part 622 that is recessed in the upper portion.

The sliding part 630 may be seated and installed in the recessed part 622. To this end, the sliding part 630 may be formed to have a predetermined curvature so as to be seated in close contact with the recessed part 622.

The installation plate 640 may be installed on the photographing module 200.

The installation plate 640 may form a sliding protrusion 642 downward. In this case, the sliding part 630 may form a sliding groove 632 corresponding to the sliding protrusion 642 on the upper side.

Accordingly, when the photographing module 200 is installed in the enclosed space 1, the sliding groove 632 and the sliding protrusion 642 are aligned and coupled to guide the coupling position. At this time, the sliding part 630 moves in the vertical, left and right directions along the recessed part 622 so that the sliding groove 632 and the sliding protrusion 642 are easily fitted.

Meanwhile, the sliding part 630 may include an elastic member 633 on the upper side. The elastic member 633 may be formed of a material having elasticity such as rubber, and may elastically support the bottom surface of the installation plate 640 disposed on the upper side.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You can understand. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting.

1: confined space
100: sensor module
200: shooting module
300: control module
400: manager terminal
1000: video recording system

Claims (1)

Including; a manager terminal for diagnosing a state in the confined space by learning sensor data for an event occurring in the confined space,
A sensor module installed in the closed space to detect occurrence of an event previously stored in the closed space;
A photographing module installed in the closed space to obtain an image of the closed space; And
It is installed in the enclosed space, receives the output signal of the sensor module, is wired or wirelessly connected to the photographing module to apply an operation signal to the photographing module, obtains a photographed image from the photographing module, and obtains the photographed image from the photographing module, and the A control module for transmitting the output signal and the captured image of the sensor module to the manager terminal; further comprising,
The sensor module,
A PIR sensor implemented as a passive infrared sensor and transmitting a signal change to the control module when detecting motion in the enclosed space; And
When a temperature change of more than a preset temperature occurs in a thermal image that is provided to take a thermal image in the enclosed space and displays a heat distribution according to a change in brightness and saturation, a change in brightness and a change in saturation are displayed at a corresponding location, Including; a thermal imaging camera for transmitting the thermal image to the control module,
The control module,
A motion monitoring unit configured to receive an output waveform from the PIR sensor, and determine that motion has occurred in the enclosed space when a change in the output waveform of the PIR sensor exceeds a preset threshold;
A temperature monitoring unit configured to receive a thermal image from the thermal imaging camera, and determine that a temperature change has occurred in the enclosed space when the brightness or saturation in the thermal image is changed beyond a preset threshold;
An image acquisition unit for acquiring an image of the enclosed space by controlling the photographing module according to the monitoring result of the motion monitoring unit and the temperature monitoring unit; And
And an image storage unit that temporarily stores an image received from the photographing module, and transmits an image received from the photographing module to the manager terminal together with an output signal from the PIR sensor and the thermal imaging camera at a corresponding photographing time. and,
The manager terminal,
The captured image received from the control module, the output signal of the PIR sensor, and the thermal image of the thermal imaging camera are stored in a database as learning data, and the captured image, the output signal, and the thermal image are each defined as one segment, By targeting a plurality of state scenarios in the enclosed space for each defined segment, a deep learning model is constructed, and a photographed image received from the control module, an output signal from the PIR sensor, and a thermal image of the thermal imager The state scenario, which is the output of the deep learning model, is output together,
A sensor verification module installed in the sealed space and generating movement into the closed space so as to check the operation of the sensor module; further comprising,
The sensor verification module,
A case formed in a box shape of a rectangular parallelepiped and forming an opening on one side;
A supply unit for loading inspection means of a styrofoam material to be drawn out into the closed space;
A driving unit that pushes the lowermost inspection means among the inspection means loaded in the supply unit; And
And a sliding unit having an inclined surface for guiding the inspection means drawn out from the supply unit by the driving unit to slide and move to the opening.

Images