KR20200030784A - Real time multi-image information providing system - Google Patents

Abstract

The present invention relates to a real-time multi-image information provision system which captures and provides an image step by step with a voice guidance. According to the present invention, the system comprises: a camera mounted on a helmet or clothing of a worker; a user terminal wired to the camera, collecting images captured at every predetermined time, and providing the collected images to a server; and a management server outputting the images received from the user terminal in real time or classifying and storing the captured images according to each stage of construction. As described above, according to the present invention, an image of a work site taken by a worker according to a construction progress stage is delivered to the management server to be stored and managed in the management server, and the stored image is provided in real time according to a request of the worker or the manager. In addition, the present invention provides a problem, occurring in a field, as a video so that the manager can manage and supervise the construction site even in the outside of the site, quickly grasps problems on the site, advises or instructs about the problem to achieve smooth facility construction and management, and prevents the field work from being performed outside the design plan.

Description

Real time multi-image information providing system for step-by-step application to a construction site

The present invention relates to a real-time multi-image information providing system for step-by-step application to a construction site, and more specifically, a construction capable of efficiently and systematically performing construction site management by transmitting an image of a construction site step by step. It relates to a real-time multi-image information providing system for step-by-step application to a site.

Currently, it has been developed to transmit real-time images in accordance with the spread of smartphones. In addition, the camera video can be processed through the app through the input terminal of the smartphone and transmitted to the server, so that facility inspection and management can be recorded.

On the other hand, managers who want to manage the site due to frequent accidents that do not reflect the design values during safety accidents and construction due to inadequate construction and management of facilities, are required to manage the site work situation in the form of video or image by daily unit or work case. It is a situation that wants to leave management data.

However, on-site management data in the form of images or images has a problem of managing and editing, and in particular, if the image does not have a certain management system, there are many unnecessary images, and there is a problem in that frequent re-taking is required.

The technology that is the background of the present invention is disclosed in Republic of Korea Patent Publication No. 1858455 (announced on June 28, 2018).

The technical problem to be achieved by the present invention is to provide a real-time multi-image information providing system capable of efficiently and systematically performing construction site management by transmitting an image of a construction site step by step.

According to an embodiment of the present invention for achieving such a technical problem, in a real-time multi-image information providing system for recording and providing images step by step with voice guidance, a camera mounted on a worker's helmet or clothing, and wired connection with the camera The user terminal collects the captured images at predetermined times, outputs the collected images to the server, and outputs the images received from the user terminals in real time, or classifies and stores the captured images at each stage of construction. It includes a management server, and the user terminal generates a voice comment step by step through a preset time or an external input, and transmits the captured image to the management server.

The user terminal includes a setting unit capable of setting a site location and a worker's personal information and an image transmission time, an image transmission unit transmitting an image of a situation occurring in a field operation step according to a preset time, and the management server It may include an image output unit for outputting one selected image data from the stored image data, and an audio output unit for transmitting a voice message according to a preset image transmission time.

The user terminal may sequentially transmit a snapshot or video type image to a server according to a construction progress step including safety, preparation, construction, and construction completion.

The user terminal may transmit a voice message to the beginning and end of the time set by the operator according to the construction progress stage.

The user terminal is connected to a sensor disposed at a construction site, and when an abnormal signal is detected from the sensor, a control unit that photographs the surrounding environment of the sensor where the abnormal signal is generated and transmits it to the management server regardless of the construction progress step It may further include.

The sensor may include at least one sensor among an acceleration sensor, a geomagnetic sensor, a gyro sensor, a temperature sensor, an illuminance sensor, a proximity sensor, and a sound sensor.

The user terminal may continuously transmit the image photographing the area around the sensor where the abnormal signal is generated to the server for a period of time.

The management server, the image collection unit for collecting the image received from the user terminal, distinguishes whether the video collected in the image collection unit is a snapshot or a video, and if the video converts the start frame or the last frame of the video to the image The image conversion unit, a report generation unit that matches the image converted by the image conversion unit and field information, and generates a report, and classifies and stores the data generated by the report generation unit in stages that occur according to photographic rows. It may include a data management unit.

The on-site information may include GPS location information of the user terminal, personal information of a worker corresponding to the user terminal, and photographed time information.

The data management unit, in the image taken in the safety stage and the preparatory stage during the public photographing stage, when a plurality of workers perform a joint operation, and the GPS location information received from a plurality of user terminals is the same, a plurality of When an image photographed for a corresponding zone is first received from an operator, it is possible to prevent the remaining workers from requesting transmission of the photographed image for the zone.

When an abnormal signal is detected from the sensor, the data management unit may request transmission of photographed images for a corresponding area to all of the respective workers, even if the GPS position signals of the respective workers are the same.

As described above, according to the present invention, an operator uses a user terminal to photograph an on-site construction situation or transmits an image of a surrounding environment, that is, construction equipment or facility facilities, etc. to a management server, and the management server that receives it receives the management server By transmitting the video, the manager can supervise and supervise the construction site from outside the site, grasp the problems occurring in the site in real time, and advise or instruct the problems to facilitate the construction and management of facilities, and work on the site. It has the effect of preventing work from deviating from this design value.

In addition, the present invention is divided into a safety stage, a preparatory stage, a construction progress stage, and a construction completion stage according to the construction progress, and photographs the images in stages and transmits the captured images to the management server to cause the management server to field according to the construction stage. It enables the situation to be saved as video and image data on a daily basis or by work, and the saved video does not require separate editing and can be systematically managed to solve the hassle of deleting or re-taking unnecessary images. I can plan it.

In addition, the present invention enables interlocking with sensors installed in the vicinity of the construction site, and when an abnormal signal is detected from the sensor, the site around the sensor that generated the abnormal signal is output in real time to prompt the manager to cope with the risk. It has the effect of being able to do.

1 is a block diagram of a real-time multi-image information providing system according to an embodiment of the present invention.
FIG. 2 is a configuration diagram of the user terminal illustrated in FIG. 1.
FIG. 3 is a configuration diagram of the management server shown in FIG. 1.
4 is a flowchart schematically showing an information providing method using the real-time multi-image information providing system shown in FIG. 1.
5 is a flowchart schematically showing a method of detecting an abnormal signal of a peripheral sensor using the real-time multi-image information providing system shown in FIG. 1.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this process, the thickness of the lines or the size of components shown in the drawings may be exaggerated for clarity and convenience.

In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to a user's or operator's intention or practice. Therefore, the definition of these terms should be made based on the contents throughout the present specification.

First, a real-time multi-image information providing system according to an embodiment of the present invention will be described with reference to FIG. 1.

1 is a block diagram of a real-time multi-image information providing system according to an embodiment of the present invention.

As shown in FIG. 1, a real-time multi-image information providing system according to an embodiment of the present invention collects a camera 100 photographing a construction site, a user terminal 200 interworking with the camera 100, and a photographed image It includes a management server 300 to store.

First, the camera 100 is mounted on a worker's clothing or helmet to photograph a construction site, and photographs a construction site according to a signal transmitted from the user terminal 200 while power is applied. Then, the photographed image is transmitted to the management server 300 through the use terminal 200 and stored as matching field information.

In addition, the camera 100 is connected to the user terminal 200 by wire and transmits and receives data, and the image captured through the camera 100 is transmitted to the user terminal 200. In order to turn on / off the camera 100 or to instruct photographing other than a preset time, the operator drives the camera 100 using a specific button of Bluetooth or through the user terminal 200.

The user terminal 200 is a terminal used by an operator, and may be a personal mobile phone or a terminal installed in the field. The user terminal 200 may automatically transmit a photographing request signal to the camera 100 according to a preset time by an operator, or receive a photographed image by transmitting a photographing request according to the needs of the operator.

In addition, the user terminal 200 transmits and stores the image received from the camera 100 to the management server 300. The management server 300 generates data in the form of a report by matching the image received from the user terminal 200 with pre-stored field information, and stores the generated data according to the construction progress stage.

The worker or the administrator accesses the management server 300 through the corresponding user terminal 200, and requests and receives an image to be checked from data stored in the management server 300.

The received data is reproduced in the form of an image through the user terminal 200, and the worker or manager who has confirmed the reproduced image checks whether the construction site is proceeding according to the design plan.

In addition, the management server 300 transmits the photographed image to the manager terminal or the expert terminal (not shown) to present an alternative to the problem that occurs during construction even if the manager is located outside the site, or to work orders. In this case, the expert can be advised on the technology requested by the field worker.

FIG. 2 is a configuration diagram of the user terminal illustrated in FIG. 1.

The user terminal 200 allows the camera 100 or a plurality of sensors 400 installed at a construction site to be interlocked, and the user terminal 200 is a time or site location that a worker wants to shoot through a corresponding web or application. Make it possible to set the back.

In addition, as shown in FIG. 2, the user terminal 200 includes a setting unit 210, an image transmission unit 220, an image output unit 230, an audio output unit 240, and a control unit 250.

The setting unit 210 collects data input by the operator through the input device of the user terminal 200 and stores it. At this time, the data input by the operator includes the location of the site to be photographed through the camera 100, the time to be photographed, and the personal information of the worker who is to transmit the photographed image.

On the other hand, when the operator inputs the location information for the construction site, the user terminal 200 compares the location information data input by the operator with the GPS location signal measured by the user terminal 200.

At this time, when the location information data input by the operator and the GPS location signal measured by the user terminal 200 are the same, the user terminal 200 transmits a shooting start signal to the camera 100 according to the time set by the operator. do.

If it is determined that the location information data input by the operator and the GPS location signal measured by the user terminal 200 are inconsistent, the user terminal 200 transmits a voice message. The worker who recognizes the transmitted voice comment checks the site location information input to the user terminal 200 and re-enters it.

In addition, the data for the shooting time stored in the setting unit 210 includes different time zones according to the construction progress stage.

The image transmission unit 220 collects the image received from the camera 100 and transmits the collected image to the management server 300. The image collected by the image transmission unit 200 is collected for a certain period of time, temporarily stored, and then deleted.

In addition, the image transmission unit 220 transmits the image captured by the camera in the form of a snapshot or video, and sequentially transmits the situation occurring in each construction progress step to the management server 300 according to a preset time. .

The image output unit 230 requests an image temporarily stored in the image transmission unit 220 or an image stored in the management server 300 and receives and plays the requested image.

Therefore, when there is an image to be checked, the operator inputs image information to be played through the input device of the user terminal 200. Then, the image output unit 230 receiving the information outputs a matched image so that the operator can check the image.

 Meanwhile, an image provided through the image output unit 230 can be captured, so that an operator captures a required frame from each frame of the reproduced image.

When the operator inputs the captured frame and the content to seek advice to the user terminal 200, the user terminal 200 transmits data on the received frame and the consultation content to the management server 300.

The management server 300 transmits the received data to a terminal of a manager or a technical expert, so that a work instruction can be received from the manager or a technical expert.

The voice output unit 240 outputs each voice comment at the beginning and the end of the preset time. In addition, the operator may drive the camera 100 according to the voice comment that the photographing is started, and the construction site may be photographed through the camera 100, and the camera 100 may be stopped when the voice comment indicating that the photographing is finished.

If, the operator inputs the shooting time through the user terminal 200, the user terminal 2200 automatically transmits a shooting instruction signal to the camera 100 according to the input shooting time. Then, the operator can recognize that the camera 100, which is linked to the user terminal 200, is started and terminated through a voice message indicating the start and end of shooting.

Meanwhile, the user terminal 200 outputs a voice comment about the start and end of shooting through the voice output unit 240 included in the user terminal 200, or an earphone (not shown) connected through Bluetooth. Voice comments are output through.

Accordingly, when the user terminal 200 arrives at a preset time, it transmits information on the voice comment output through the voice output unit 240 to the earphone (not shown), and receives information on the voice comment One earphone outputs a voice comment. The control unit 250 receives a signal generated from the sensor 400 installed around the construction site, and transmits a driving signal to the interlocked camera 100 when the received signal is an abnormal signal.

The control unit 250 receiving the abnormal signal transmits a driving signal to the camera 100 interworking with the user terminal 200, and the camera 100 receiving the driving signal transmits a feedback signal to the control unit 250. Start shooting at the same time.

At this time, when the user terminal 200 does not receive a feedback signal from the camera 100 with respect to the driving signal transmitted through the control unit 250, the control unit 250 transmits a sound transmission through the voice output unit 240. Output. An operator who recognizes a voice comment can manually take a picture of the surrounding environment by pressing the start button on the one side of the camera 100.

Meanwhile, the sensor 400 interlocked with the control unit 250 includes at least one sensor among an acceleration sensor, a geomagnetic sensor, a gyro sensor, a temperature sensor, an illuminance sensor, a proximity sensor, and a sound sensor, so that there is no fire around the construction site. In the event of an accident, such as an abnormality in power, gas leakage or flooding, video information on the accident site is provided so that measures against the accident can be quickly determined.

As described above, when an abnormal signal is generated from a sensor installed around the construction site, and it is determined that an accident has occurred as a result of confirmation, the operator continuously photographs the accident generating area for a certain period of time separately from the work step through the user terminal 200. And transmits the captured image to the management server 300.

FIG. 3 is a configuration diagram of the management server shown in FIG. 1.

As shown in FIG. 3, the management server 300 receives an image of a construction site through the user terminal 200, matches the received image with the site information, and stores and manages it according to the construction progress stage.

The management server 300 according to an embodiment of the present invention includes an image collection unit 310, an image conversion unit 320, a report generation unit 330, and a data management unit 340.

The image collection unit 310 receives the image through the user terminal 200 used by the worker and collects it. The image received through the user terminal 200 is received in the form of a snapshot or video. At this time, the snapshot is transmitted to the report generation unit 330, which will be described later, to match the field information, and the video is transmitted to the image conversion unit 320.

The image conversion unit 320 receives a video from the image collection unit 310, extracts a start frame and a last frame of the received video, and converts it into an image in the form of a snapshot. As described above, the reason for converting a video to an image is to reduce the capacity of data stored in the form of a report.

The report generation unit 330 receives the image in the form of a snapshot through the image collection unit 310 and the image conversion unit 320, and matches the received image with the field information to generate data in the form of a report.

The field information includes GPS location information of the user terminal 100, personal information of a worker corresponding to the user terminal 100, and time information of the photographing.

The data management unit 340 classifies and stores the data generated by the report generation unit according to steps generated according to a blank photograph row. The stored data can be output as needed to check whether the construction site is proceeding according to the design, and to promote the effect of systematically managing the progress of the construction along with the video.

4 is a flowchart schematically showing an information providing method using the real-time multi-image information providing system shown in FIG. 1.

As shown in FIG. 4, first, the operator inputs field information including location information of the site and personal information of the operator using the user terminal 200 (S410).

At this time, the user terminal 200 determines whether the location information input by the operator matches the location signal measured by the GPS module included in the user terminal 200 (S420).

At this time, when the field location information input by the operator and the location signal measured by the GPS module included in the user terminal 200 match, the user terminal 200 provides a menu for the operator to input a time to be photographed. do.

If the site location information input by the operator and the location signal measured by the GPS module included in the user terminal 200 are inconsistent, a voice message indicating that the site location information is incorrect is transmitted.

The operator checks the location information of the construction site previously input through the user terminal 200 according to the transmitted voice comment, and re-enters the accurate location information.

The operator sets the shooting start time and the shooting end time according to the shooting time setting menu provided by the user terminal 200 (S430).

The construction progress phase is divided into a safety phase, a preparation phase, a construction progress phase, and a construction completion phase, and each phase proceeds at different times. Therefore, the operator sets the time to be photographed according to the time zone in which each step is performed.

For example, assuming that work is performed on the safety level between 9 am and 10 am, the operator sets the time from 9:30 to 9:40 to be photographed through the user terminal 200.

Accordingly, the user terminal 200 determines whether or not to start shooting according to a preset shooting start time by the operator (S440), and transmits a start voice message when the preset shooting start time arrives (S450).

For example, for a safety step in which a safety fence is installed around a construction site so that construction can proceed safely, the operator sets the shooting start time to 9:30 and the shooting end time to 9:40, the user When the terminal 200 arrives at a preset shooting start time, it transmits a voice message, "Start shooting in step 1".

At this time, the camera 100 interlocked with the user terminal 200 is in a state in which power is applied, and according to the transmitted voice comment, an operator presses a start button included in the camera 100 or the user terminal 200 Through the transmission of the start signal, the camera 100 photographs the construction site according to the received signal (S460).

When the worker arrives at a preset end time of shooting, the user terminal 200 transmits an end voice message (S470).

According to the transmitted voice comment, the operator presses a stop button included in the camera 100 or sends a stop signal through the user terminal 200 to stop the camera 100 from taking a picture.

Upon completion of the photographing, the user terminal 200 transmits the image received from the camera 100 to the management server 300, and the management server 300 stores the received image (S480).

As described above, all workers input to the construction site input site information through the user terminal 200, and the camera 100 linked with the user terminal 200 photographs the construction site surroundings at the set time. The image captured by the camera 100 is transmitted to the management server 300 through the user terminal 200.

Therefore, a plurality of workers input information about the work site using each user terminal 200, and set the time according to the time to be worked and the inputted step during the construction progress step.

On the other hand, during the construction stage, the safety stage of installing the fence around the construction site, or the preparation stage of injecting tools or equipment necessary for the construction, is performed by a plurality of workers being put into the same construction site. The probability that the images received from the user terminal 200 are overlapping images increases.

Accordingly, if it is determined that the image of the area photographed by a worker from among a plurality of workers is first received, the data management unit 340 of the management server 300 does not receive the captured image for the area from the remaining workers. Through the user terminal 200 of each worker, it is possible to transmit a notice saying that "the image of the construction site according to the first or second stage has already been received".

The operator who recognizes the above-mentioned guide message presses a stop button located on one side of the camera 100 or transmits a stop sign signal through the user terminal 200.

5 is a flowchart schematically showing a method of detecting an abnormal signal of a peripheral sensor using the real-time multi-image information providing system shown in FIG. 1.

As shown in FIG. 5, the user terminal 200 can detect an external signal, and according to an embodiment of the present invention, receives the detected signal from the sensor 400 installed around the construction site (S510).

At this time, the sensor 400 includes at least one of an acceleration sensor, a geomagnetic sensor, a gyro sensor, a temperature sensor, an illuminance sensor, a proximity sensor, and a sound sensor. Fire, flooding, ground tilt, electric power, gas Detects accidents caused by problems such as

Accordingly, the user terminal 200 detects a signal generated by the sensor 400, and when an abnormal signal is generated from the sensor 400 (S520), the voice output unit 240 detects a voice message indicating that an abnormal signal is generated from the sensor. Send it out (S530). Then, the worker who recognizes this moves to the periphery of the sensor that generated the abnormal signal, and then photographs the surrounding environment using the camera 100 (S540).

The shooting is made in real time, and the camera 100 transmits the captured image to the management server 300 through the user terminal 200 (S550).

That is, since the user terminal 200 is interlocked with the sensor 400 installed around the construction site, it detects a signal generated from the interlocked sensor 400.

When the signal generated by the sensor 400 is an abnormal signal, the user terminal 200 transmits a voice message, transmits a driving signal to the camera 100 interlocked with the user terminal 200, and receives a driving signal. The camera 100 photographs surrounding construction where an abnormal signal is generated.

For example, when a fire occurs in the field and the sensor detects it and sends an abnormal signal, the user terminal 200 transmits a voice message, "A fire has occurred in the western part of the field."

As described above, the worker moves to the scene where the fire has occurred and uses the camera 100 to photograph the accident site, and transmits the captured image to the management server 300 through the user terminal 200.

A plurality of workers who are working in the same site detects an accident through a corresponding user terminal 200 and photographs the accident site using a camera 100 that is linked to each user terminal 200. The image of the accident scene is transmitted to the management server 300 through the user terminal 200.

The management server 300 receives an image of an accident scene from a plurality of workers, matches the received image with the field information, and stores the data in a report format.

At this time, the user terminal 200 of the workers located in the same accident site can transmit the same GPS location signal at the same time, but the site of the accident is an important object of interest for workers, so that multiple users corresponding to multiple workers Even if the terminal 200 generates the same time zone and the same GPS location signal, a plurality of workers photograph the accident scene using each camera 100, and the captured image is managed server 300 through the user terminal 200 Send to

As described above, according to an embodiment of the present invention, an operator photographs a construction site using a camera interlocked with a user terminal, delivers the captured image to the management server through the user terminal, and causes the management server to receive the received image. It should be systematically managed together with field information.

The management server provides the stored video at the request of the operator or manager, and allows the received video to be played through the manager terminal. The manager who has checked the video through the manager terminal can manage and supervise the construction site from the outside, not from the site, and the worker has the effect of leaving the construction progress as video data.

Therefore, it is possible to provide a problem that occurs in the field as a video, so that the manager can quickly grasp the problem on the site, and can advise or direct the problem, so that construction and management of facilities are smooth, and that the field work is carried out outside the design plan. It has the effect of preventing it.

The present invention has been described with reference to the embodiment shown in the drawings, but this is merely exemplary, and those skilled in the art to which the art belongs understand that various modifications and other equivalent embodiments are possible therefrom. will be. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the following claims.

100: camera 200: user terminal
210: setting unit, 220: video transmission unit
230: video output unit 240: audio output unit
250: control unit 300: management server
310: image collection unit 320: image conversion unit
330: report generation unit 340: data management unit

Claims (11)

In a real-time multi-image information providing system that provides video by step by step with audio guidance,
A camera mounted on a worker's helmet or clothing,
A user terminal that is wired to the camera, collects images taken at predetermined times, and provides the collected images to a server, and
It includes a management server that outputs the image transmitted from the user terminal in real time, or classifies and stores the captured image at each stage of construction,
The user terminal,
A real-time multi-image information providing system that generates a voice comment step by step through a preset time or external input, and transmits the image being captured to the management server. According to claim 1,
The user terminal,
The setting unit that can set the location of the site and the time of transmission of personal information and video of the worker,
An image transmission unit that transmits the image of the situation occurring in the field work stage according to a preset time,
An image output unit for outputting one image data selected from the image data stored in the management server, and
A real-time multi-image information providing system including an audio output unit that transmits an audio message according to a preset video transmission time. According to claim 2,
The user terminal,
A real-time multi-image information providing system that sequentially transmits snapshot or video images to the server according to the construction progress steps including safety, preparation, construction, and construction completion. According to claim 2,
The user terminal,
A real-time multi-image information providing system that transmits voice comments at the beginning and end of a preset time according to the construction progress stage. According to claim 2,
The user terminal,
It is interlocked with sensors placed on the construction site,
When the abnormal signal is detected from the sensor, regardless of the progress of the construction, a real-time multi-image information providing system further comprising a control unit that photographs the surrounding environment of the sensor where the abnormal signal is generated and transmits it to the management server. The method of claim 5,
The sensor,
A real-time multi-image information providing system including at least one of an acceleration sensor, a geomagnetic sensor, a gyro sensor, a temperature sensor, an illuminance sensor, a proximity sensor, and a sound sensor. The method of claim 5,
The user terminal,
Real-time multi-image information providing system that continuously transmits the image of the sensor's surrounding area to the server for a certain period of time. According to claim 1,
The management server,
Image collection unit for collecting the image received from the user terminal,
An image converting unit that distinguishes whether a video collected in the video collection unit is a snapshot or a video, and in the case of a video, converts the start frame or the last frame of the video into an image,
Report generation unit for generating a report by matching the image information and the field information converted by the image conversion unit, and
A real-time multi-image information providing system including a data management unit that classifies and stores the data generated by the report generation unit in steps generated according to a blank photograph row. The method of claim 8,
The site information,
A real-time multi-image information providing system including GPS location information of a user terminal, personal information of a worker corresponding to a user terminal, and photographed time information. The method of claim 8,
The data management unit,
In the image taken in the safety and preparatory stages during the public photographing stage,
When a plurality of workers perform a joint operation, and when the GPS location information received from a plurality of user terminals is the same, when an image photographed for a corresponding zone is first received from a plurality of workers, the remaining workers are in a corresponding zone A real-time multi-image information providing system that does not request transmission of a captured image. The method of claim 8,
The data management unit,
When an abnormal signal is detected from the sensor, even if the GPS position signals of each worker are the same, a real-time multi-image information providing system for requesting transmission of a captured image for a corresponding area to all of each worker.

Images