JP3234061U - Remote on-site inspection supervision system and equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To support remote presence, reduce opportunities for contact with people, eliminate labor shortage, reduce man-hours for both orderer and contractor, and improve efficiency and labor saving of witness work. Provide a supervision system. SOLUTION: A field terminal 20 having a photographing unit, a display unit and an input unit, and a supervisor terminal 30 of a supervisor having a photographing unit, a display unit 32 and an input unit and presenting remotely are connected via a network 90. In the remote presence inspection supervision system 100 that communicates with each other, the server 70 displays the screen for creating the witness book / form on the display units of the supervisor terminal 30 and the site terminal 20, and the site terminal 20. Alternatively, when the video relay means for relaying the moving image taken by the shooting unit of the supervisor terminal 30 in real time and displaying it on the display unit of the on-site terminal 20 and the supervisor terminal 30, and the relayed moving image are captured, the captured image is obtained. Is provided with a captured image display means for displaying the above on the display units of the on-site terminal 20 and the supervisor terminal 30. [Selection diagram] Fig. 1

Description

The present invention relates to a remote on-site inspection and supervision system and device for performing inspection and supervision by remote presence.

In fields such as civil engineering and construction, it may be necessary for a supervisor to travel to the site and witness the confirmation of the actual site. For example, the method and system for determining the presence or absence of attendance of civil engineering and construction work in Patent Document 1 below are a means for inputting a civil engineering and construction work form that has already been converted into an electronic file, and information used for determining the presence or absence of attendance from the information on the form. A means for extracting the location, a means for comparing the extracted information with the contents of the database registered / saved by weighting the existing attendance judgment information with the default points, and a means for adding the default points when they match. It consists of a means for making a witness judgment by comparing the value obtained by adding points to the extracted information with a reference value for presence / absence of witness, and a means for outputting the witness judgment result.

Japanese Unexamined Patent Publication No. 2008-117232

By the way, the Ministry of Land, Infrastructure, Transport and Tourism provides "remote presence" for work that requires witnessing, including fields such as civil engineering and construction. In particular, when contact with a person due to an infectious disease is restricted, such as a new type of coronavirus infection, the remote presence becomes an extremely effective witnessing means. However, the above-mentioned Patent Document 1 does not correspond to such a remote presence.

In view of the above problems, the present invention reduces the chances of contact with people, eliminates the man-hour shortage, shortens the time required for movement and the time on hand by performing inspection and supervision by remote presence, and the ordering party and The purpose is to provide a remote on-site inspection and supervision system and equipment that can reduce man-hours for both contractors and improve the efficiency and labor saving of witnessing work.

The first device is to communicate with each other between a field terminal having a photographing unit, a display unit and an input unit, and a supervisor terminal having a photographing unit, a display unit and an input unit and being remotely present. A remote on-site inspection and supervision system that displays a screen for creating a witness book / form on the display unit of the site terminal and the supervisor terminal, and a witness book / form creation means of the site terminal or the supervisor terminal. The moving image taken by the shooting unit is relayed in real time by the moving image relay means for relaying the moving image in real time and displaying it on the display unit of the site terminal and the supervisor terminal, and the site terminal or the supervisor terminal. When a moving image is captured, a captured image display means for displaying the captured image on the display units of the on-site terminal and the supervisor terminal, a screen for creating the attendance book / form, a moving image relay screen, and a screen arrangement of the captured image. Provide a remote on-site inspection and supervision system equipped with a control means for controlling the image.

The second device is the first device, in which the control means displays a screen for inputting the signature of the supervisor on the display unit of the supervisor terminal and / or at the site when the witness is completed. A remote on-site inspection and supervision system that displays a screen for inputting a worker's signature on the display unit of the site terminal and ends the witness when the signature is input by the supervisor terminal and / or the input unit of the site terminal. offer.

The third device is the first or second device, wherein the control means selects the attendance book, the photograph, and the moving image selected by the input unit of the supervisor terminal or the field terminal. Provide a remote on-site inspection supervision system that transmits to a supervisor terminal or a field terminal.

The fourth device is to communicate with each other between a field terminal having an imaging unit, a display unit and an input unit, and a supervisor terminal of a supervisor who has an imaging unit, a display unit and an input unit and is present remotely. A remote on-site inspection and supervision device that displays a screen for creating a witness book / form on the display unit of the supervisor terminal and the supervisor terminal, and a witness book / form creation means, and the site terminal or the supervisor terminal. The moving image taken by the shooting unit is relayed in real time and displayed on the display units of the site terminal and the supervisor terminal, and is relayed in real time by the site terminal or the supervisor terminal. When a moving image is captured, the captured image is displayed on the display units of the site terminal and the supervisor terminal, a screen for creating the attendance book / form, a video relay screen, and a captured image screen. Provided is a remote on-site inspection and supervision device including a control means for controlling the arrangement.

According to the present invention, the on-site terminal having the photographing unit, the display unit and the input unit and the supervisor terminal of the supervisor having the photographing unit, the display unit and the input unit and presenting remotely communicate with each other. A remote on-site inspection supervision system or device that displays a screen for creating a witness book / form on the supervisor terminal and the display unit of the supervisor terminal, and a witness book / form creation means, and the site terminal or the supervisor. The moving image taken by the shooting unit of the member terminal is relayed in real time and displayed on the display unit of the site terminal and the supervisor terminal, and relayed in real time by the site terminal or the supervisor terminal. When the captured video is captured, the captured image display means for displaying the captured image on the display units of the site terminal and the supervisor terminal, the screen for creating the witness book / form, the video relay screen, and the captured image. It was decided to provide a control means for controlling the screen arrangement of the above.

For this reason, in response to remote presence promoted by the Ministry of Land, Infrastructure, Transport and Tourism, on-site witnessing can be realized while in the office, reducing opportunities for contact with people, eliminating man-hour shortages, and reducing travel time and hand-held time. By shortening the time, both the ordering party and the contractor can reduce the man-hours and improve the efficiency and labor saving of the witnessing work.

It is a conceptual diagram which shows the whole structure of the remote presence inspection supervision system of one Embodiment of this invention. It is a block diagram which shows the structure of the field terminal of the said embodiment. It is a block diagram which shows the structure of the supervisor terminal of the said embodiment. It is a block diagram which shows the structure of the server of the said embodiment. It is a flowchart which shows an example of the remote presence inspection supervision processing flow by the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows an example of the display screen of the said embodiment. It is a figure which shows the other use example of the field terminal of the said embodiment. It is a figure which shows the other use example of the field terminal of the said embodiment.

The present invention is a remote location using a PC or tablet terminal on the desk of the office without a business trip in operations that require witnessing (a supervisor visits the site to check the actual site), including the civil engineering and construction fields. It is possible to witness with. For example, teleworking has been recommended these days, but by using the system of the present invention, teleworking becomes possible, the time required for movement is reduced, and problems such as labor shortages in the civil engineering and construction fields are solved. In particular, it is an extremely effective witnessing means when contact with a person due to an infectious disease is restricted, such as a new type of coronavirus infection (COVID-19).

<Overall configuration> ... FIG. 1 is a conceptual diagram showing an overall configuration of a remote on-site inspection supervision system (or device) according to an embodiment of the present invention. The remote on-site inspection supervision system 100 is composed of a site terminal 20 at the site 10, a supervisor terminal 30, and a server 70. The field terminal 20, the supervisor terminal 30, and the server 70 can send and receive data to and from each other via the network 90. The windows of the witness book / form creation screen 40, the video relay screen 50, and the captured image 60 in the figure can be maximized and displayed.

<Structure of field terminal> ... FIG. 2 is a block diagram showing the configuration of the field terminal of the present embodiment. The site terminal 20 photographs the site 10, and as shown in FIG. 2, includes a photographing unit 21, a display unit 22, an input unit 24, a communication unit 26, and a control unit 28. The photographing unit 21 photographs the site 10 and has a function of capturing the captured moving image. The display unit 22 and the input unit 24 are touch panels in this embodiment. The input unit 24 may include a touch pen or the like. The communication unit 26 transmits the moving image captured by the photographing unit 21 and the captured image to the server 70 via the network 90. The control unit 28 controls the operations of the photographing unit 21, the display unit 22, the input unit 24, the communication unit 26, and the field terminal 20 itself. The field terminal 20 may be a smartphone, a tablet terminal, or the like, as will be described later. The photographing unit 21 may be configured to be able to switch between the inside and the outside, and when relaying the site 10, the outside camera is used.

<Structure of Supervisor Terminal> ... FIG. 3 is a block diagram showing the configuration of the supervisor terminal of the present embodiment. The supervisor terminal 30 basically has the same configuration as the on-site terminal 20, and includes a photographing unit 31, a display unit 32, an input unit 34, a communication unit 36, and a control unit 38. In the present embodiment, the supervisor terminal 30 is a tablet, but may be a notebook PC, a smartphone, or the like. The shooting unit 31 captures, for example, the face (facial expression) of the supervisor, and has a function of capturing the captured moving image. The display unit 32 and the input unit 34 are touch panels in this embodiment. The input unit 34 may include a touch pen or the like. The communication unit 36 receives a real-time image from the server 70 via the network 90, and receives a form, a moving image, a captured image, and the like after the end of the witness. The control unit 38 controls each unit of the photographing unit 31, the display unit 32, the input unit 34, the communication unit 36, and the supervisor terminal 30 itself. The photographing unit 31 may be configured to be able to switch between the inside and the outside, and the supervisor may use the camera inside to relay the face (facial expression) of the supervisor.

<Server Configuration> ... FIG. 4 is a block diagram showing a server configuration of the present embodiment. The server 70 includes a witness book / form creation means 72, a video relay means 74, a captured image display means 76, a storage means 77, a control means 78, and a communication unit 80.

The witness book / form creating means 72 displays a screen for creating a witness book / form on the display unit 22 of the site terminal 20 and the display unit 32 of the supervisor terminal 30. For example, text can be input on both the field terminal 20 and the supervisor terminal 30, and the input text is displayed and shared on both screens in real time. The entered text is shared, but the displayed page is not shared. For example, in a witness where 10 witness books are registered, even if the site displays the first one, the supervisor can display any page from 1 to 10 pages. That is, the on-site terminal 20 and the supervisor terminal 30 cannot share the displayed page so that they can read an arbitrary page.

The video relay means 74 relays the moving image shot by the shooting unit 21 of the site terminal 20 or the shooting unit 31 of the supervisor terminal 30 in real time via the network 90, and the display unit 22 of the site terminal 20 and the video relay means 74. It is displayed on the display unit 32 of the supervisor terminal 30. When the captured image display means 76 captures the moving image relayed in real time by the site terminal 20 or the supervisor terminal 30, the captured image is displayed on the display unit 22 of the site terminal 20 and the supervisor terminal 30. It is displayed on the display unit 32. Here, the maximum number of participants in the witness is four, and it is also possible to divide the four into four on the video relay screen and display them on the site terminal 20, the previous term supervisor terminal 30, and two other terminals. For saving the moving image and the captured image, it is possible to save four people divided into four at the same time, or to save each participant individually.

The storage means 77 stores a moving image taken by the on-site terminal 20 and / or the supervisor terminal 30, a captured image, and a created witness book / form on the cloud. The control means 78 controls the screen arrangement of the witness book / form creation screen, the video relay screen, and the video capture screen, and also controls the server 70 itself. For example, when the two persons displayed in the small window of the video relay screen 50 of FIG. 1 are a field worker and a supervisor, by selecting either one, the site and the supervisor can be switched in the video relay. It may be displayed large on the screen.

Further, as will be described later, when the witness is completed, the control means 78 displays a screen for inputting the signature of the supervisor (which may be a worker at the site 10) on the display unit 32 of the supervisor terminal 30 or the site terminal. When the signature is displayed on the display unit 22 of 20 and the signature is input by the input unit 34 of the field terminal 20 or the input unit 34 (touch pen or the like) of the supervisor terminal 30, the witness ends. Further, the control means 78 transmits the witness book, the photograph, and the moving image selected by the input unit 24 of the field terminal 20 and the input unit 34 of the supervisor terminal 30 to the selected terminal. The transmission and reception of data of each of the above units is realized via the communication unit 80 and the network 90.

<Remote presence inspection supervision process> ... Next, an example of the remote presence inspection supervision process by the remote presence inspection supervision system 100 of the present embodiment will be described with reference to FIGS. 5 to 16. FIG. 5 is a flowchart showing an example of a remote presence inspection supervision processing flow according to the present embodiment, and FIGS. 6 to 16 are views showing an example of a display screen of the present embodiment. The display screens shown in FIGS. 6 to 16 are basically displayed in the same manner on the display unit 22 of the field terminal 20 and the display unit 32 of the supervisor terminal 30, but here, the supervisor terminal 30 The screen displayed on the display unit 32 is taken as an example. It is assumed that the site terminal 20 is located at the site 10 and the supervisor terminal 30 is located at a place other than the site 10 (for example, an office or a home). Further, in the following processing, the display and arrangement of various screens displayed on the display unit 22 of the site terminal 20 and the display unit 32 of the supervisor terminal 30 are controlled by the control means 78 of the server 70.

First, in step S10, the site 10 uses the site terminal 20, and the supervisor logs in to the system using the supervisor terminal 30. FIG. 6 is a diagram showing an example of a login screen, and the login screen 41 is displayed on the display unit 32 of the supervisor terminal 30 (the same applies to the field terminal 20). Here, the supervisor inputs the user name and password using the input unit 34, and presses "login".

Next, in step S12, at the site 10, a new site is created using the site terminal 20. FIG. 7 is a diagram showing an example of a new site creation screen, in which the worker 12 inputs the site name, description, password, person in charge, etc. using the input unit 24 on the screen 42 of FIG. 7, and finally. Press "Create" to complete the creation of the new site.

Next, in step S14, the supervisor enters the site using the supervisor terminal 30. FIG. 8 is a diagram showing an example of the site entrance screen, and the supervisor inputs the password set for each site using the input unit 34 on the screen 43 of FIG. 8 and presses “authenticate”. ..

Next, in step S16, at the site 10, a new witness is created using the site terminal 20. FIG. 9 is a diagram showing an example of a screen for creating a new witness, in which the worker 12 at the site 10 uses the input unit 24 on the screen 44 of FIG. 9 to input the work type and select the witness PDF. Select the witness date, enter the witness name, and finally press "Create". This completes the creation of the witness.

Next, in step S18, the supervisor enters the witness using the supervisor terminal 30. FIG. 10 is a diagram showing an example of the entrance screen for the witness, and the supervisor presses the witness name using the input unit 34 on the screen 45 of FIG. 10 to enter the witness.

Upon entering the witness, the witness screen opens, and the screen shown in FIG. 11 is displayed on the display unit 32 of the supervisor terminal 30. In the illustrated example, the witness book / form creation means 72 of the server 70 displays the witness book / form creation screen 40 on the right side of the screen, and the video relay means 74 displays the video relay screen 50 on the upper left of the screen. (Step S20). When the two persons displayed in the small windows 50A and 50B of the video relay screen 50 of FIG. 11 are the worker 12 and the supervisor of the site 10, the site 10 and the supervisor can be switched by selecting either one. It may be displayed large on the screen in the video relay. Although two small windows 50A and 50B have been exemplified, two or more (for example, four) small windows may be provided. The captured moving image is stored in the cloud by the storage means 77 of the server 70. Further, although not shown, a captured image described later is displayed at the lower left of the screen (the same display is also displayed on the field terminal 20).

Next, in step 22, the worker 12 at the site 10 captures a moving image using the site terminal 20. A screen for capturing a moving image is displayed in FIG. 12, and when the camera mark 52 on the moving image relay screen 50 is pressed, the moving image is captured by the control unit 28 of the field terminal 20, and the captured image 60 is used as a server. It is displayed at the lower left of the screen by the captured image display means 76 of 70. In this case, the capture is performed on the site 10 side, but the supervisor may perform the capture. The captured image is stored in the cloud by the storage means 77 of the server 70.

Next, in step S24, the supervisor creates a witness book / form using the supervisor terminal 30. For example, by pressing the "+" button on the upper right of the witness book / form creation screen 40 of FIG. 12, text can be input to the witness book imported in PDF format. For example, after pressing the "+" button, you can edit the text by enclosing the area you want to enter with a touch pen.

FIG. 13 is a diagram showing an example of the display unit 32 of the supervisor terminal 30, and the text in the box can be edited by pressing the text box 46 on the right side attendance book / form creation screen 40 with a touch pen. FIG. 13 shows a state in which the numerical value in the text box 46 is edited so as to reflect the contents of the captured image screen 60 at the lower left. Such text editing can be performed in the field terminal 10 in the same manner, and is shared in real time.

Next, in step S26, the supervisor completes the signature / witness using the supervisor terminal 30. FIG. 14 shows an example of the signature / witness completion screen. In the figure, a signature line 62 is displayed next to the video capture screen 60 at the lower left. Here, the supervisor signs using the input unit (touch pen or the like) 34. Then, if there is no correction in the content, the "approve" button 64 is pressed, and if there is a correction, the "return" button 66 is pressed. When the "Approve" button 64 is pressed, the signature / witness is completed. The signature is often done by the supervisor, but it does not prevent the signature from being done on the site side.

Next, in step S28, the supervisor downloads the witness book, the photograph, and the video using the supervisor terminal 30. FIG. 15 shows an example of a screen for downloading a witness book, a photograph (captured image), and a moving image. When you press the "Download file" button 67 at the bottom right of the screen in the figure, a confirmation button 68 is displayed in the center of the screen, and when you press "Download", the attendance book, photos, and videos are displayed on the supervisor terminal 30. It will be downloaded to. Downloading of these files may be performed by the field terminal 20. FIG. 16 shows the downloaded witness book and image 69 of the photograph. Of course, if you download a video in addition to these, you may display the thumbnail.

<Effect> ... According to the embodiment described above, a field terminal 20 having a photographing unit 21, a display unit 22 and an input unit 24, and a remote presence having a photographing unit 31, a display unit 32 and an input unit 34. The remote on-site inspection and supervision system 100, which communicates with the supervisor terminal 30 of the supervisor via the network 90, displays a screen for creating a witness book / form on the display unit 22 of the on-site terminal 20 and the display unit 22 of the on-site terminal 20. The witness book / form creating means 72 displayed on the display unit 32 of the supervisor terminal 30 and the moving image taken by the photographing unit 21 of the site terminal 20 or the photographing unit 31 of the supervisor terminal 30 are relayed in real time. The video relay means 74 displayed on the display unit 22 of the site terminal 20 and the display unit 32 of the supervisor terminal 30, and the video relayed in real time by the site terminal 20 or the supervisor terminal 30 are captured. Then, the captured image display means 76 for displaying the captured image on the display unit 22 of the site terminal 20 and the display unit 32 of the supervisor terminal 30, the screen for creating the witness book / form, the video relay screen, and the capture. A control means 78 for controlling the screen arrangement of images is provided.

For this reason, in response to remote presence promoted by the Ministry of Land, Infrastructure, Transport and Tourism, on-site witnessing can be realized while in the office, reducing opportunities for contact with people, eliminating man-hour shortages, and reducing travel time and hand-held time. By shortening the time, both the ordering party and the contractor can reduce the man-hours and improve the efficiency and labor saving of the witnessing work.

The above-described embodiment is an example, and can be appropriately changed within a range in which the same effect is obtained. For example, in the above-described embodiment, the terminal 20 at the site 10 is used as an imaging device having a communication function, but a smartphone or tablet may be used. FIG. 17 shows an example in which a smartphone is used as the field terminal 20, and is attached to the helmet 14 of the worker 12 by the holder 15. Further, as shown in FIG. 18, in a place where the worker 12 cannot directly see (or is dangerous), a smartphone can be attached to the holder 17 at the tip of the bar 16 to take a picture of the inside of the pipe in the soil, for example. can. Further, the various screens shown in the above-described embodiment are examples, and may be appropriately changed so as to obtain the same effect. The present invention may also be provided as a device.

According to the present invention, the on-site terminal having the photographing unit, the display unit and the input unit and the supervisor terminal of the supervisor having the photographing unit, the display unit and the input unit and presenting remotely communicate with each other. At the same time, the screen for creating the witness book / form was photographed by the witness book / form creation means for displaying the screen for creating the witness book / form on the display unit of the supervisor terminal and the supervisor terminal, and the photographing unit of the site terminal or the supervisor terminal. When the video relay means for relaying the moving image in real time and displaying it on the display unit of the on-site terminal and the supervisor terminal and the moving image being relayed in real time by the on-site terminal or the supervisor terminal, the moving image is captured. A capture image display means for displaying the captured image on the display units of the site terminal and the supervisor terminal, a screen for creating the attendance book / form, a video relay screen, and a control means for controlling the screen arrangement of the captured image. And, it was decided to prepare.

For this reason, in response to remote presence promoted by the Ministry of Land, Infrastructure, Transport and Tourism, on-site witnessing can be realized while in the office, reducing opportunities for contact with people, eliminating man-hour shortages, and reducing travel time and hand-held time. By shortening the time, both the ordering party and the contractor can reduce the man-hours and improve the efficiency and labor saving of the witnessing work.

10: On-site 12: Worker 14: Helmet 15: Holder 16: Bar 17: Holder 20: On-site terminal 21: Imaging unit 22: Display unit 24: Input unit 26: Communication unit 28: Control unit 30: Supervisor terminal 31: Shooting unit 32: Display unit 34: Input unit 36: Communication unit 38: Control unit 40: Witness book: Form creation screen 41-45: Screen 46: Text box 47: Button 50: Video relay screen 50A, 50B: Small window 52 : Camera mark 60: Video capture screen 62: Signature line 64, 66, 67, 68: Button 69: Image 70: Server 72: Witness book / form creation means 74: Video relay means 76: Captured image display means 77: Saving means 78: Control means 80: Communication unit 90: Network 100: Remote on-site inspection and supervision system

Claims (4)

A remote on-site inspection and supervision system that communicates with each other between a field terminal having a photographing unit, a display unit, and an input unit and a supervisor terminal of a supervisor who has a photographing unit, a display unit, and an input unit and is present remotely. And
A witness book / form creation means for displaying a screen for creating a witness book / form on the display unit of the supervisor terminal and the supervisor terminal, and
A video relay means for relaying a moving image taken by a shooting unit of the field terminal or the supervisor terminal in real time and displaying it on the display unit of the field terminal and the supervisor terminal.
When the moving image relayed in real time is captured by the on-site terminal or the supervisor terminal, the captured image display means for displaying the captured image on the display unit of the on-site terminal and the supervisor terminal, and
A screen for creating the witness book / form, a video relay screen, a control means for controlling the screen arrangement of the captured image, and the like.
A remote on-site inspection and supervision system characterized by being equipped with. The control means
Upon completion of the witness, a screen for inputting the signature of the supervisor is displayed on the display unit of the supervisor terminal, and / or a screen for inputting the signature of the worker at the site is displayed on the display unit of the site terminal. death,
The remote on-site inspection and supervision system according to claim 1, wherein when the signature is input by the input unit of the supervisor terminal and / or the on-site terminal, the witness is terminated. The control means
The invention according to claim 1 or 2, wherein the attendance record / photograph / video selected by the input unit of the supervisor terminal or the site terminal is transmitted to the supervisor terminal or the site terminal that has made the selection. Remote on-site inspection supervision system. A remote on-site inspection and supervision device that communicates with each other between a field terminal having a photographing unit, a display unit, and an input unit and a supervisor terminal of a supervisor who has a photographing unit, a display unit, and an input unit and is present remotely. And
A witness book / form creation means for displaying a screen for creating a witness book / form on the display unit of the supervisor terminal and the supervisor terminal, and
A video relay means for relaying a moving image taken by a shooting unit of the field terminal or the supervisor terminal in real time and displaying it on the display unit of the field terminal and the supervisor terminal.
When the moving image relayed in real time is captured by the on-site terminal or the supervisor terminal, the captured image display means for displaying the captured image on the display unit of the on-site terminal and the supervisor terminal, and
A screen for creating the witness book / form, a video relay screen, a control means for controlling the screen arrangement of the captured image, and the like.
A remote on-site inspection and supervision device characterized by being equipped with.

Images