JP7472517B2 - Surveillance system and on-site monitoring device - Google Patents

Description

The present invention relates to a monitoring system and a site monitoring device.

Patent Document 1 discloses an inspection system for measuring the length and width of cracks in concrete under a floor. This inspection system includes a robot and a computer that remotely controls the robot. The robot is equipped with a video camera and a pair of laser pointers mounted on a crawler-type running body. The video signal from the video camera is wirelessly transmitted to the computer, and the image captured by the video camera is displayed on the computer's display. When the user remotely controls the running body via the computer, the running body moves to a specified location under the floor. When the user then turns on the pair of laser pointers via the computer, two bright spots are incident on the concrete. An image containing these bright spots is transmitted to the computer, and the distance between the bright spots is calculated by the computer's image analysis.

On the other hand, supervisors must frequently visit construction sites to carry out daily construction management, such as on-site inspections, instructions and guidance for workers, progress checks, end-of-work checks, and safety checks. This makes supervisors extremely busy and makes it difficult for them to find time to perform tasks other than construction management.

JP 2012-18073 A

Therefore, it is conceivable to use the inspection system described in Patent Document 1 so that construction management can be carried out in parallel with other tasks. However, with the inspection system described in Patent Document 1, although the supervisor can check the situation of the construction site by viewing the video on a computer, he or she cannot give accurate instructions to the workers on site.
The present invention has been made in consideration of the above circumstances, and has an object to provide a monitoring system and a site monitoring device that enable a supervisor to give instructions to workers on site from a remote location.

In order to solve the above problems, a monitoring system is provided that includes a site monitoring device at a site, a terminal computer, and a server capable of communicating with the terminal computer, wherein the site monitoring device includes a headlight, a laser range finder that measures the distance to a surrounding object , a laser light emitting indicator, an imaging device, a pan-tilt mechanism that includes the headlight, the laser light emitting indicator, the laser range finder, and the imaging device, and a computer capable of communicating with the server, the computer includes a video transmission means that transmits video captured by the imaging device to the server, the server transmits the video transmitted by the video transmission means to the terminal computer, and the terminal computer receives the video transmitted by the server. a display means for displaying a command for a laser beam emitting indicator based on the command data received by the terminal computer, the server means transmitting command data to the computer based on the command data transmitted by the terminal computer, the computer having an instruction receiving means for receiving the command data transmitted by the server, and an indicator control means for controlling the laser beam emitting indicator based on the command data received by the instruction receiving means to cause the laser beam emitting indicator to perform an instruction operation based on the command data, and wherein when the computer recognizes that an object in the surrounding area is an obstacle based on the measurement results of the laser rangefinder, it controls the movement of the on-site monitoring device so as to avoid the obstacle .

Also provided is a site monitoring device comprising a headlight, a laser rangefinder that measures the distance to surrounding objects , a laser light emitting indicator, an imaging device, a pan-tilt mechanism that is equipped with the headlight, the laser light emitting indicator, the laser rangefinder, and the imaging device, and a computer capable of communicating with a server, wherein the computer has an image transmitting means that transmits an image captured by the imaging device to the server, an instruction receiving means that receives instruction data transmitted by the server, and an indicator control means that controls the laser light emitting indicator based on the instruction data received by the instruction receiving means to cause the laser light emitting indicator to perform an instruction operation in accordance with the instruction data , and when the computer recognizes that the surrounding object is an obstacle based on the measurement results of the laser rangefinder, it controls the movement of the site monitoring device so as to avoid the obstacle .

According to the above, when the supervisor operates the terminal computer while watching the image displayed by the terminal computer, the laser light emitting indicator performs the instruction action according to the instruction data, so the worker at the site can visually understand the supervisor's instructions by seeing it. In other words, the supervisor can give instructions to the worker from a remote location away from the site.

Preferably, the laser light emitting indicator is a laser pointer, and the indicator control means lights up the laser pointer in accordance with the instruction data.

According to the above, when a supervisor operates the terminal computer and turns on the laser pointer, the laser beam emitted from the laser pointer is incident on the target object, and a bright dot appears on the target object's surface. This allows the supervisor to point out an object from a remote location away from the work site, and on-site workers can recognize the object pointed out by the supervisor.

Preferably, the on- site monitoring device further comprises a display device, the server captures the image transmitted by the image transmission means as a video or a still image, and combines a mark or text or both with the video or still image in accordance with the operation data transmitted by the terminal computer, transmits the combined video or still image to the computer as the instruction data, and the indicator control means displays the video or still image on the display device.

According to the above, a supervisor operates a terminal computer to synthesize a mark or text, or both, into a video or still image, so that an object in the video or still image is indicated by the mark or text. When the synthesized video or still image is displayed on a display device, a worker on-site can recognize the object indicated by the mark or text.

Preferably, the on-site monitoring apparatus includes a moving body on which the pan-tilt mechanism, the display device and the computer are mounted.

As a result of the above, a wide area of the construction site is displayed on the terminal computer as the mobile object moves, allowing the supervisor to grasp the situation over a wide area of the construction site. In addition, as the mobile object moves, the number of objects that the supervisor can point to increases.

According to the present invention, a supervisor can give instructions to workers on-site by operating a terminal computer at a remote location away from the site.

FIG. 1 illustrates a monitoring system. FIG. FIG. 13 is a diagram showing a screen displayed on a display device of a terminal computer.

Below, an embodiment of the present invention will be described with reference to the drawings. However, the embodiment described below has various limitations that are technically preferable for implementing the present invention, but the scope of the present invention is not limited to the following embodiment and illustrated examples.

1. Overview of the Monitoring System FIG. 1 is a diagram showing a monitoring system 1. The monitoring system 1 includes a site monitoring device 10 at a construction site, a cloud server 40 installed at a location far away from the construction site, and a terminal computer 60 operated by a supervisor at a location far away from the construction site. The cloud server 40 and the terminal computer 60 can communicate with each other via the Internet 90, and the cloud server 40 and the site monitoring device 10 can communicate with each other via the Internet 90. Note that a local area network may be used instead of the Internet 90, or a VPN (Virtual Private Network) using the Internet 90 may be used. Also, an on-premise server may be used instead of the cloud server 40.

A supervisor can monitor a construction site using the monitoring system 1. Specifically, the situation at the construction site is photographed by the site monitoring device 10, the video is transmitted to the cloud server 40, and the video is recorded in the cloud server 40 as a video or still image as necessary. Meanwhile, the supervisor can log in to the cloud server 40 using the terminal computer 60 and remotely access the cloud server 40. Then, the video photographed by the site monitoring device 10 is transferred to the terminal computer 60, and the video is displayed on the terminal computer 60. This allows the supervisor to monitor the situation at the construction site in real time.

In addition, the supervisor can remotely operate the site monitoring device 10 using the terminal computer 60. Specifically, the supervisor can remotely access the cloud server 40 using the terminal computer 60, and can remotely operate the site monitoring device 10 on the cloud server 40 using the terminal computer 60.

In addition, a supervisor can use the terminal computer 60 to give instructions to workers at the construction site. Specifically, when the supervisor uses the terminal computer 60 to remotely access the cloud server 40 and inputs instructions on the cloud server 40 using the terminal computer 60, instruction data representing the instructions is transmitted from the cloud server 40 to the site monitoring device 10, and instructions according to the instruction data are displayed by the site monitoring device 10. The instructions are displayed as an image by a dot matrix display indicator, or are pointed out by being irradiated by a laser light emitting indicator. This allows the supervisor to give instructions to workers at the construction site, and the workers can intuitively understand the instructions.

The supervisor may use both the monitoring system 1 and a mobile phone. In other words, the supervisor may use the monitoring system 1 to give visual instructions to workers at the construction site while also giving auditory instructions by talking on the mobile phone.

In addition, multiple site monitoring devices 10 may be installed at multiple construction sites, and a supervisor may remotely operate these site monitoring devices 10 using a terminal computer 60.

2. Cloud Server The cloud server 40 is a computer equipped with a CPU, a GPU, a RAM, a storage, an interface, a communication device, etc. A server operating system such as UNIX (registered trademark), Linux (registered trademark), or Windows (registered trademark) is installed on the cloud server 40.

A program executed by the cloud server 40 is installed in the server operating system. The program is for enabling the cloud server 40 to realize the function of remotely operating the site monitoring device 10 and communicating with the site monitoring device 10 by being remotely accessed from the terminal computer 60. The program is resident.

3. Terminal Computer The terminal computer 60 is a notebook computer, tablet computer, or smartphone equipped with a CPU, a GPU, a RAM, a storage device, a display device, an input device, a communication device, etc. An operating system such as Windows (registered trademark), macOS (registered trademark), Linux (registered trademark), or Android (registered trademark) is installed in the terminal computer 60. An application program is installed in the operating system to remotely access the cloud server 40 and to communicate with the site monitoring device 10 on the cloud server 40 to remotely operate the site monitoring device 10 in the terminal computer 60.

4. Site Monitoring Device FIG. 2 is a side view of the site monitoring device 10.
The site monitoring device 10 has a mobile body 11 , a pan/tilt mechanism 12 , a headlamp 13 , a laser range finder 14 , a laser light projection indicator 15 , an imaging device 16 , a computer 17 , a dot matrix display indicator 18 and a wireless communication device 19 .

The computer 17 is mounted on the mobile object 11. The computer 17 has a CPU, a GPU, a RAM, storage, a control panel, etc. An operating system (hereinafter referred to as OS) is stored in the storage of the computer 17 and installed in the computer 17. A program that the computer 17 can execute on the OS is stored in the storage of the computer 17 and installed in the OS. The program realizes the functions of the computer 17 to control the mobile object 11, the pan-tilt mechanism 12, the headlights 13, the laser rangefinder 14, the laser light projection indicator 15, the imaging device 16, the dot matrix display indicator 18, and the wireless communication device 19. The program is resident.

The mobile unit 11 is, for example, a crawler-type mobile unit. The mobile unit 11 travels on a floor or ground surface and turns to change direction. The mobile unit 11 is connected to a computer 17 and is controlled by the computer 17.

The pan-tilt mechanism 12 is provided at the front of the moving body 11. The pan-tilt mechanism 12 swings up and down and left and right. The pan-tilt mechanism 12 is connected to a computer 17 and is controlled by the computer 17.

The headlights 13 are connected to the pan-tilt mechanism 12 in a pair on the left and right. The headlights 13 are, for example, LED lamps, halogen lamps, or discharge lamps. The headlights 13 project light forward of the moving body 11 to illuminate the area ahead of the moving body 11. The direction of illumination by the headlights 13 is deflected up, down, left, and right by the pan-tilt mechanism 12. The headlights 13 are connected to a computer 17, and are turned on and off by the computer 17.

The laser range finder 14 is connected to the pan-tilt mechanism 12. The laser range finder 14 is a phase difference type light wave range finder. The laser range finder 14 emits a laser beam and receives the reflected light to measure the distance from the point where the laser beam is incident on a surrounding object to the laser range finder 14. The orientation of the laser range finder 14 is deflected up, down, left and right by the pan-tilt mechanism 12. The laser range finder 14 is connected to the computer 17 and is controlled by the computer 17. When the laser range finder 14 is controlled by the computer 17, it performs a distance measurement operation and outputs a measurement result signal indicating the measured distance to the computer 17. Note that the laser range finder 14 may be a two-dimensional scanning type or three-dimensional scanning type light wave range finder.

The laser light emitting indicator 15 is connected to the pan-tilt mechanism 12. The laser light emitting indicator 15 is also called a laser pointer. The laser light emitting indicator 15 points to an object in front of the moving body 11 by emitting a laser beam in the visible light band to the object. The direction of irradiation by the laser light emitting indicator 15 is deflected up, down, left, right and left by the pan-tilt mechanism 12. The laser light emitting indicator 15 is connected to the computer 17 and is turned on and off by the computer 17.

The imaging device 16 is connected to the pan-tilt mechanism 12. The imaging device 16 captures an image in front of the moving body 11 by photoelectric conversion and converts the image into a video signal. The imaging device 16 is connected to a computer 17, and the video signal is transferred from the imaging device 16 to the computer 17. The orientation of the imaging device 16 is deflected up, down, left, and right by the pan-tilt mechanism 12. Here, the orientation of the imaging device 16 is the same as the direction of irradiation by the laser light projection type indicator 15, and the optical axis of the lens of the imaging device 16 is parallel to the laser beam of the laser light projection type indicator 15. The orientation of the imaging device 16 is also the same as the orientation of the laser range finder 14, and the optical axis of the lens of the imaging device 16 is parallel to the laser beam of the laser range finder 14.
The imaging device 16 may be an omnidirectional camera. The omnidirectional camera has multiple imaging elements and wide-angle or fisheye lenses that form images on the imaging elements, and generates an omnidirectional image from the images of the imaging elements. In this case, the imaging device 16 is not mounted on the pan-tilt mechanism 12 but is mounted directly on the moving body 11.
In addition, camera-equipped mobile terminals (e.g., mobile phones, tablet computers, smartphones, smart glasses, etc.) carried by workers at the construction site may be able to communicate with computer 17 wirelessly or via cable, and images captured by the camera of the mobile terminal may be transferred from the mobile terminal to computer 17.

The dot-matrix display indicator 18 is, for example, a liquid crystal display device or an organic EL display device, and is mounted on the upper surface of the moving body 11. The dot-matrix display indicator 18 is connected to a computer 17. When a video signal output from the computer 17 is input to the dot-matrix display indicator 18, the dot-matrix display indicator 18 displays a screen according to the video signal. The dot-matrix display indicator 18 may be a projection device using a DMD (Digital Mirror Device) or a liquid crystal display element.
If the dot-matrix display indicator 18 is a large-screen display device, the dot-matrix display indicator 18 does not need to be mounted on the mobile body 11. In this case, the computer 17 transfers the video signal to the dot-matrix display indicator 18 by wire or wirelessly.
In addition, a mobile terminal with a display (e.g., a mobile phone, tablet computer, smartphone, smart glasses, etc.) carried by a worker at the construction site may be able to communicate with computer 17 wirelessly or via a wired connection, and computer 17 may output a video signal to the mobile terminal, with the video being displayed on the display of the mobile terminal.

A transparent touch panel is provided on the display surface of the dot matrix display indicator 18. The touch panel is connected to the computer 17, and when an operator touches the touch panel to operate it, an operation signal corresponding to the operation is transferred from the touch panel to the computer 17. Note that in addition to or instead of the touch panel, input devices such as a keyboard, mouse, and buttons may be connected to the computer 17.

The wireless communication device 19 is a mobile modem that connects to a wireless communication line. The wireless communication device 19 is connected to the computer 17, and when the computer 17 controls the wireless communication device 19, the wireless communication device 19 connects to the wireless communication line. This allows the computer 17 to communicate with the cloud server 40 via the Internet 90. Note that a wired communication device may be adopted in addition to or instead of the wireless communication device 19, and the computer 17 may connect to the Internet 90 via the wired communication device.

5. Video storage The computer 17 of the site monitoring device 10 encodes the video signal input from the imaging device 16 into storable video data, and records the converted video data in storage. When the video data recorded in the storage exceeds a predetermined capacity, the computer 17 records new video data while deleting the oldest video data from the storage.

The computer 17 also encodes the video signal input from the imaging device 16 into streaming video data and transmits the video data to the cloud server 40. Such a transmission function of the computer 17 corresponds to a video transmission means.

Cloud server 40 converts the video data received from computer 17 into storable video data, and records the converted video data in storage. Cloud server 40 captures still image data from the video data at a predetermined cycle or at a predetermined timing, and records the still image data in storage.

6. Remote Operation by Terminal Computer The supervisor operates the input device of the terminal computer 60 to cause the terminal computer 60 to execute an application program in a GUI (Graphical User Interface) on the OS of the terminal computer 60. Then, the terminal computer 60 executes a login process to the cloud server 40. After the login is completed, the cloud server 40 transmits screen data to the terminal computer 60 in real time, and the terminal computer 60 displays a screen according to the screen data received from the cloud server 40. Furthermore, when the supervisor operates the input device of the terminal computer 60, the terminal computer 60 transmits operation data according to the operation content to the cloud server 40 in real time, and the cloud server 40 performs processing according to the operation data. Through such real-time mutual communication between the terminal computer 60 and the cloud server 40, the terminal computer 60 remotely accesses the cloud server 40.

The screen data that the cloud server 40 transmits to the terminal computer 60 includes images that the cloud server 40 generates by playing back the image data from the computer 17. Therefore, the images captured by the imaging device 16 are displayed on the display device of the terminal computer 60. Therefore, the supervisor can grasp the situation at the construction site through the display screen of the terminal computer 60.

Remote access allows remote operation of the site monitoring device 10 on the cloud server 40 using the terminal computer 60. The remote operation of the site monitoring device 10 is described in detail below.

When the supervisor operates the input device of the terminal computer 60 to input a command to move forward, the terminal computer 60 transmits operation data to the cloud server 40 to that effect, and the cloud server 40, upon receiving the command, transmits command data to the effect of moving forward to the computer 17 of the site monitoring device 10. As a result, the computer 17 controls the moving body 11 to move forward, and the moving body 11 moves forward.

Similarly, if the supervisor inputs a command to reverse, the mobile unit 11 will reverse. If the supervisor inputs a command to turn left, the mobile unit 11 will turn left. If the supervisor inputs a command to turn right, the mobile unit 11 will turn right.

As the mobile unit 11 moves, a wide area of the construction site is displayed on the display device of the terminal computer 60, allowing the supervisor to grasp the situation over a wide area of the construction site.

The computer 17 may be installed with map data of the construction site (position data of multiple points on the surface of obstacles) and an autonomous driving program, and the mobile unit 11 may drive autonomously under the control of the computer 17. In this case, when the supervisor operates the input device of the terminal computer 60 to input the position of the destination at the construction site, the terminal computer 60 transmits operation data indicating the input of the position data to the cloud server 40, and the cloud server 40, receiving the data, transmits the position data to the computer 17 of the site monitoring device 10. As a result, the computer 17 controls the mobile unit 11 according to the autonomous driving program while referring to the map data, and moves the mobile unit 11 to the destination represented by the position data. While the mobile unit 11 is moving, the laser range finder 14 (preferably a two-dimensional scanning or three-dimensional scanning type light wave range finder) or the satellite positioning system outputs the measurement results to the computer 17, and the computer 17 recognizes the position of the mobile unit 11 or surrounding obstacles based on the measurement results, and controls the mobile unit 11 so that the mobile unit 11 avoids the obstacles.

When the supervisor operates the input device of the terminal computer 60 to input a command to swing to the right, the terminal computer 60 transmits operation data to the cloud server 40 to swing to the right, and the cloud server 40, receiving the data, transmits command data to swing to the right to the computer 17. This causes the computer 17 to control the pan-tilt mechanism 12, which swings to the right.

Similarly, if the supervisor inputs a command to swing left, the pan-tilt mechanism 12 swings to the left. If the supervisor inputs a command to swing up, the pan-tilt mechanism 12 swings up. If the supervisor inputs a command to swing down, the pan-tilt mechanism 12 swings down.

By turning the pan-tilt mechanism 12, a wide area of the construction site is displayed on the display device of the terminal computer 60, allowing the supervisor to grasp the situation over a wide area of the construction site.

6-3. Turning the headlights on and off When the supervisor operates the input device of the terminal computer 60 to input a command to turn the headlights on, the terminal computer 60 transmits operation data to the cloud server 40 to turn the headlights on, and the cloud server 40, receiving the data, transmits command data to turn the headlights on to the computer 17. This causes the computer 17 to turn on the headlights 13, illuminating the area in front of the mobile unit 11. Therefore, even if the construction site is in a dark place, the supervisor can grasp the situation at the construction site through the display screen of the terminal computer 60.

Similarly, if the supervisor inputs a command to turn off the headlights, the headlights 13 will be turned off.

6-4. Distance measurement When the supervisor operates the input device of the terminal computer 60 to input distance measurement, the terminal computer 60 transmits operation data to the cloud server 40 to the effect of distance measurement, and the cloud server 40, receiving the data, transmits command data to the effect of distance measurement to the computer 17. This causes the computer 17 to control the laser range finder 14, and the laser range finder 14 measures the distance from the laser range finder 14 to the object. Then, a measurement result signal indicating the measured distance is transferred from the laser range finder 14 to the computer 17, and the computer 17 records the measured distance data in storage and transmits it to the cloud server 40. The cloud server 40 records the measured distance data in storage. In addition, the cloud server 40 transmits the measured distance data to the terminal computer 60, which receives it. The terminal computer 60 displays the measured distance according to the measured distance data on the display device. This allows the supervisor to measure the distance from the site monitoring device 10 to the object from a location away from the construction site.

6-5. Pointing to an object (part 1)
When the supervisor operates the input device of terminal computer 60 to input an instruction, terminal computer 60 transmits operation data of the instruction to cloud server 40. Cloud server 40 receives the operation data and transmits the instruction data to computer 17, which receives the instruction data. Such a receiving function of computer 17 corresponds to an instruction receiving means.

The computer 17 then functions as an indicator control means and turns on the laser light projection indicator 15 in accordance with the instruction data. The laser light projection indicator 15 then projects a laser beam onto the object, thereby pointing out the object. Workers at the construction site can recognize the pointed-out object by visually recognizing the bright spot of the laser beam that has entered the object.

When the supervisor remotely controls the moving body 11 or the pan-tilt mechanism 12, or both, using the terminal computer 60 while the laser light projection indicator 15 is on, the direction of the laser light projection indicator 15 changes, and therefore the object pointed to by the laser beam also changes.

When the supervisor operates the input device of the terminal computer 60 to input an instruction to cancel the instruction, the terminal computer 60 transmits operation data to the cloud server 40 to cancel the instruction, and the cloud server 40, receiving the data, transmits the data to the computer 17 to cancel the instruction. This causes the computer 17 to turn off the laser light emitting indicator 15.

6-6. Pointing to an object (part 2)
By operating the input device of the terminal computer 60, the supervisor can add any mark 93 or text 94, or both, to an image 92 (the image 92 is a real-time image captured by the imaging device 16) on a display screen 91 of the display device of the terminal computer 60 as shown in Fig. 3. In this way, an object 95 in the image 92 is pointed out by the mark 93 and/or the text 94. A more specific description will be given below.

When the supervisor operates the input device of the terminal computer 60 to input the mark 93 and/or text 94 and its position (the position refers to the position of the mark 93 and/or text 94 in the image 92) on the GUI according to the screen data received from the cloud server 40 (the screen data includes the real-time image captured by the imaging device 16), the terminal computer 60 transmits operation data representing the mark 93 and/or text 94 and its position. The cloud server 40 that receives the operation data captures video data or still image data from the video data received from the computer 17, and synthesizes the mark and/or text into the video data or still image data according to the operation data. The terminal computer 60 may also capture video data or still image data from the screen data and synthesize the mark and/or text.

After inputting the mark or text, the supervisor operates the input device of the terminal computer 60 to input a transmission command, and the terminal computer 60 transmits operation data indicating transmission to the cloud server 40. The cloud server 40 receives this data and records the combined video data or still image data in storage. The cloud server 40 then transmits the combined video data or still image data as instruction data to the computer 17, which receives the video data or still image data and records it in storage. This receiving function of the computer 17 corresponds to the instruction receiving means.

The computer 17 functions as an indicator control means. That is, the computer 17 plays a video according to the video data or a still image according to the still image data, and outputs a video signal including the video or still image to the dot-matrix display indicator 18. This causes the video or still image to be displayed on the dot-matrix display indicator 18. By displaying the video or still image, objects in the video or still image are indicated by marks and/or text. Workers at the construction site can recognize the objects indicated by the marks and/or text by visually checking the dot-matrix display indicator 18.

When a worker at the construction site operates the touch panel, the terminal computer 60 may read video data or still image data previously recorded in storage and play it back. This causes the past video or still image to be displayed on the dot-matrix display indicator 18. Therefore, by visually checking the dot-matrix display indicator 18, the worker at the construction site can recognize the object previously indicated by the mark and/or text.

In the above description, the cloud server 40 captures the video data or still image data and synthesizes the mark and/or text. This process may be performed by the terminal computer 60. In other words, the terminal computer 60 may capture the video data or still image data from the image in the screen data received from the cloud server 40 (the image is a real-time image captured by the imaging device 16) and synthesize the mark and/or text. In this case, when the supervisor operates the input device of the terminal computer 60 to input the transmission, the terminal computer 60 transmits the synthesized video data or still image data to the cloud server 40. The cloud server 40, which receives it, records the synthesized video data or still image data in storage. Furthermore, the cloud server 40 transmits the synthesized video data or still image data to the computer 17 as instruction data. Then, the computer 17 receives the video data or still image data, plays a video according to the video data or a still image according to the still image data, and outputs a video signal including the video or still image to the dot matrix display type indicator 18.

6-7. Display of Drawings, etc. When the supervisor operates the input device of the terminal computer 60, the terminal computer 60 reads image data of drawings, etc. from the storage and displays an image based on the image data on the display device. In addition, when the terminal computer 60 transmits the image data to the cloud server 40, the cloud server 40 transmits the image data to the computer 17. The computer 17 then causes the dot-matrix display indicator 18 to display an image based on the image data. By visually recognizing the image of the drawing, etc. and the dot-matrix display indicator 18, workers at the construction site can recognize the object pointed out by the mark and/or text.

7. Utilization of Data The cloud server 40 may perform deep learning type machine learning on the video data, still image data, and measured distance data recorded in the storage of the cloud server 40 as described above to construct a convolutional or recurrent neural network. The neural network is used to determine the danger of the object. That is, when the cloud server 40 newly records the video data, still image data, or measured distance data in the storage as described above, the cloud server 40 inputs the new video data, still image data, or measured distance data into the neural network and obtains the danger level as the output of the neural network. This danger level represents the danger of the object. When obtaining the danger level, the cloud server 40 deepens the intermediate layer of the neural network using the result of determining the danger level from the video data, still image data, or measured distance data. This allows the danger evaluation process and deep learning to be performed in parallel.

8. Effects When a supervisor remotely operates the site monitoring device 10 via the terminal computer 60 and turns on the laser beam projector 15, an object can be pointed out by the laser beam of the laser beam projector 15. On-site workers can recognize the pointed out object by visually recognizing the bright spot of the laser beam incident on the object.

A supervisor can operate the terminal computer 60 to synthesize marks or text onto video or still images showing the construction site. This allows the mark or text to point out objects in the video or still images. When the synthesized video or still image is displayed by the dot-matrix display indicator 18 of the site monitoring device 10, workers on site can recognize the objects pointed out by the mark or text. Thus, the supervisor can point out objects to workers.

By observing the video of the construction site displayed on the terminal computer 60, the supervisor can check the work at the construction site, manage progress, and manage construction, etc. The supervisor can manage construction and other tasks in parallel. This also reduces the number of times the supervisor needs to travel to the construction site.

The cloud server 40 collects video data, still image data, and measured distance data, which can be used as training data for machine learning. In addition, the cloud server 40 performs deep learning-type machine learning, allowing even those with low levels of proficiency to accurately assess risk.

9. Modifications The above embodiment may be modified to at least one of the following modifications (1) to (4). The following modifications (1) to (4) may be applied in combination with two or more of the following modifications.

(1) The terminal computer 60 and the site monitoring device 10 may be provided with a microphone and a speaker, so that the worker and the supervisor can talk to each other and the supervisor can give instructions to the worker by voice. That is, the terminal computer 60 encodes the voice signal input from the microphone into voice data and sends the voice data to the computer 17. The computer 17 then decodes the voice data into a voice signal and outputs the voice signal to the speaker. This allows the worker to hear the supervisor's voice. The computer 17 also encodes the voice signal input from the microphone into voice data and sends the voice data to the terminal computer 60. The terminal computer 60 then decodes the voice data into a voice signal and outputs the voice signal to the speaker. This allows the supervisor to hear the worker's voice.

(2) The current monitoring device 10 may be fixed. In this case, the pan-tilt mechanism 12, computer 17, dot matrix display indicator 18, and wireless communication device 19 are mounted on a fixed object (e.g., a pole), and the headlight 13, laser rangefinder 14, laser light projection indicator 15, and imaging device 16 are mounted on the pan-tilt mechanism 12 as described above.

(3) When a worker on-site inputs a mark and/or text by operating the input device of the site monitoring device 10, the computer 17 may synthesize the mark and/or text into streaming video data (encoded from the video signal input from the imaging device 16). Therefore, the image captured by the imaging device 16 is displayed on the display device of the terminal computer 60 together with the mark and/or text. Therefore, the supervisor can visually understand the contents of the worker's input through the display screen of the terminal computer 60.

(4) The mobile unit 11 may be equipped with an instruction device (e.g., a light-emitting diode, a light-emitting diode type indicator, a buzzer unit), and the computer 17 may operate the instruction device according to the instruction data at a predetermined timing (e.g., the timing when the supervisor operates the input device of the terminal computer 60 to input instructions, as in the case of the laser light projection type 15).

REFERENCE SIGNS LIST 1 monitoring system 10 on-site monitoring device 11 mobile body 15 laser light emitting indicator 16 imaging device 17 computer 18 dot matrix display indicator 40 cloud server 60 terminal computer

Claims (7)

A monitoring system comprising a site monitoring device at a site, a terminal computer, and a server capable of communicating with the terminal computer,
the on-site monitoring device comprises a headlight, a laser range finder for measuring the distance to a surrounding object , a laser light projection type indicator, an imaging device, a pan-tilt mechanism having the headlight, the laser light projection type indicator, the laser range finder, and the imaging device mounted thereon, and a computer capable of communicating with the server;
the computer has a video transmission means for transmitting a video captured by the imaging device to the server, the server transmits the video transmitted by the video transmission means to the terminal computer, and the terminal computer displays the video transmitted by the server,
The terminal computer transmits operation data according to the operation of a supervisor to the server, and the server transmits instruction data according to the operation data transmitted by the terminal computer to the computer;
said computer has an instruction receiving means for receiving instruction data transmitted by said server, and an indicator control means for controlling said laser beam emitting indicator based on said instruction data received by said instruction receiving means to cause said laser beam emitting indicator to perform an instruction operation in accordance with said instruction data ;
A monitoring system in which, when the computer recognizes that the surrounding object is an obstacle based on the measurement results of the laser rangefinder, it controls the movement of the site monitoring device so as to avoid the obstacle . 2. The surveillance system according to claim 1, wherein said laser light emitting indicator is a laser pointer, and said indicator control means turns on said laser pointer in accordance with said instruction data. The site monitoring apparatus further comprises a display device;
The server captures the image transmitted by the image transmission means as a moving image or a still image, synthesizes a mark or text or both of them with the moving image or the still image according to the operation data transmitted by the terminal computer, and transmits the synthesized moving image or the still image to the computer as the instruction data;
The surveillance system according to claim 1 , wherein the indicator control means causes the video or still image to be displayed on the display device. The monitoring system according to claim 3 , wherein the on-site monitoring apparatus comprises a mobile body on which the pan-tilt mechanism, the display device and the computer are mounted. A site monitoring device comprising: a headlight; a laser range finder for measuring a distance to a surrounding object ; a laser light projection type indicator; an imaging device; a pan-tilt mechanism having the headlight, the laser light projection type indicator, the laser range finder, and the imaging device mounted thereon; and a computer capable of communicating with a server,
The computer,
a video transmission means for transmitting a video captured by the imaging device to the server;
An instruction receiving means for receiving instruction data transmitted by the server;
and indicator control means for controlling the laser beam projection type indicator based on the instruction data received by the instruction receiving means to cause the laser beam projection type indicator to perform an instruction operation in accordance with the instruction data ,
When the computer recognizes that the surrounding object is an obstacle based on the measurement results of the laser rangefinder, it controls the movement of the site monitoring device so as to avoid the obstacle . The monitoring system of claim 1, wherein the server has a neural network constructed therein, and when recording video data, still image data, or measured distance data relating to the distance to the object measured by the laser rangefinder, the server determines the danger of the object from the video data, the still image data, or the measured distance data. 6. The site monitoring device according to claim 5, wherein the server has a neural network configured to determine a danger of the object from the video data, the still image data, or the measured distance data when recording video data, still image data, or measured distance data, relating to the image of the object captured by the imaging device, or the distance to the object measured by the laser rangefinder.

Images