JP2023037364A - Site management system and site management method - Google Patents

Abstract

To provide a technique of efficiently performing management about a construction site.SOLUTION: An application 200 moves a view point in a 3D animation in conjunction with movement of a worker carrying a tablet terminal and changes the display contents of a screen following the movement (S400). When the worker selects an analysis button by adjusting the position and direction of the tablet terminal such that a work spot falls within a displayed photograph region by selecting a camera menu, an image at the time point is transmitted as a photograph to a server 100 and analyzed (S410 to S450). An analysis result of the photograph (identification result of a subject) is transmitted to the application 200 and displayed on the screen. When the worker confirms the result and selects a registration button after correction if necessary, the registration contents are transmitted to the server 100 (S460 to S490). The server 100 specifies an object corresponding to the subject, displays the object at a position in the 3D animation corresponding to the position of the work spot and updates the 3D animation (S500).SELECTED DRAWING: Figure 8

Description

The present invention relates to a site management system and its method, and more particularly to a site management system and its method for managing the progress of work and space at a construction site.

Construction sites (architecture, civil engineering, tunnels, bridges, roads, dams, river maintenance, embankments, ports, airports, landfills, parks, urban development, agricultural land, forest maintenance, forest maintenance, electricity (elevated lines, high-voltage underground service lines) etc.), starting with preparation, for example, excavation, earth retaining, pile driving, foundation, underground, framework, exterior, interior, exterior structure, etc., and then inspection. In addition, the progress of the work for each of these processes is managed by taking photographs of the site and keeping them in a photo book after the workers carry out the work according to the process management table decided by the site supervisor. is common.

On the other hand, conventionally, various ideas have been attempted to facilitate grasping of the progress. For example, after the worker operates the operation unit to select information indicating the content of the work process of the work site to be photographed from among the displayed candidates, the landscape of the work site is photographed, and the work process is displayed in the photographed image. A system is known in which information (floor number, work place, work object, etc.) is added and the photographed image is registered by transmitting it to a management server (see, for example, Patent Document 1).

JP 2013-37684 A

According to the prior art described above, it is considered that the progress of work can be easily grasped compared to management using a photo book. However, in the prior art described above, the worker has to operate and select the work process corresponding to the work site to be photographed and the information related thereto, which takes time and effort for registration. In addition, when repetitive work is photographed in a similar background, the photographed images are similar, and it is difficult to distinguish them unless position information is included in the images. In addition, if the worker selects the wrong content and registers the photographed image, incorrect progress information that does not match the information associated with the photographed image will be registered. is difficult.

Space management is also important at construction sites. Construction machinery, trucks for carrying out earth and sand, and construction materials used at construction sites vary depending on the processes described above. It is necessary to properly manage the placement and to share information among the workers concerned.

Accordingly, an object of the present invention is to provide a technique for efficiently managing construction sites.

In order to solve the above problems, the present invention employs the following site management system and site management method. It should be noted that the following expressions in parentheses are merely examples, and the present invention is not limited thereto.

That is, the site management system of the present invention has an object storage unit that stores objects that can be displayed in a virtual space in a 3D animation representing a construction site, and a position in the real space that is associated with a position in the 3D animation. a location management unit that manages, a specification unit that specifies an object corresponding to a predetermined target existing at the construction site, and a specified object that is displayed at a position in the 3D animation corresponding to the position of the predetermined target in the real space. an updating unit for updating the 3D animation using the

According to this aspect of the site management system and its method, since changes occurring at the actual construction site (for example, use of space, progress of work process, etc.) are represented as objects in the 3D animation, the 3D animation can be It is possible to visually grasp the situation of the construction site easily through the system, and to efficiently share information on the situation of the construction site.

Preferably, in the site management system described above, the 3D animation is generated based on the 3D model of the building, and the objects include those generated based on the component parts of the 3D model.

According to the site management system and method of this aspect, some of the objects displayed in the 3D animation are generated based on the components of the 3D model of the building (inherited from the 3D model), Compared to creating these objects from scratch, the amount of work required to create a 3D animation can be reduced.

More preferably, in the site management system described above, the position management unit manages the position in the real space of the moving object including the construction machine and the transport vehicle brought into the construction site in association with the position in the 3D animation, The identifying unit identifies an object corresponding to the moving body, and the updating unit displays the identified object corresponding to the moving body at a position within the 3D animation corresponding to the position of the moving body in the real space to reproduce the 3D animation. Update.

According to this aspect of the site management system and its method, since the object corresponding to the moving object that entered the construction site and parked is displayed at the position in the 3D animation corresponding to the parking place, which space is available at the construction site? From the display of 3D animation, it is possible to easily confirm whether the space is in use (whether a mobile body is actually parked) and which space is vacant.

Preferably, the site management system described above further comprises a photograph storage unit for storing a photograph of a subject taken at the construction site in association with position information thereof, and an analysis unit for analyzing the photograph and identifying the subject. The identifying unit identifies an object corresponding to the subject identified by the analyzing unit, and the updating unit displays the object corresponding to the identified subject at a position in the 3D animation corresponding to the position of the subject in the real space. to update the 3D animation.

According to this aspect of the site management system and its method, the object corresponding to the subject of the photograph taken at the construction site is displayed at the position in the 3D animation corresponding to the position of the subject. Changes that occur at the construction site can be easily reflected in the 3D animation, making it possible to more efficiently manage the situation of the construction site.

More preferably, in the site management system described above, the photo store stores a photo of the material being unloaded from the transport vehicle, and the updating unit stores a photo of the material being unloaded from the transport vehicle, and the update unit stores the image at a location in the 3D animation corresponding to the location at which the material was unloaded. Display the object corresponding to the material and update the 3D animation. Alternatively, in the site management system described above, the photo storage unit stores photographs taken of the work process, and the update unit stores the work process corresponding to the position in the 3D animation corresponding to the position where the work process was performed. The 3D animation is updated by displaying the object to be processed in a manner in which the worked parts are identifiable.

According to this aspect of the site management system and its method, it is possible to display an object corresponding to the unloaded material at a position in the 3D animation corresponding to the unloading destination position via a photograph of the unloaded material. In addition, objects corresponding to the work process can be displayed at positions in the 3D animation corresponding to the positions of the work locations through photographs taken of the work process. The progress can be easily reflected in the 3D animation, making it possible to manage the situation of the construction site more efficiently.

More preferably, the site management system described above further includes a display processing unit that displays that the photograph of the subject has been registered at the position in the 3D animation corresponding to the position indicated by the position information.

According to the on-site management system and method of this aspect, since a display indicating that a photograph has been registered for a position in the 3D animation corresponding to the position of the subject is displayed, the photograph registered via this display is displayed. can be easily verified.

Preferably, in the site management system described above, the photo storage unit stores a photo of a subject taken at a construction site using a camera mounted on a terminal displaying a 3D animation. Alternatively, in the site management system described above, the position management unit acquires information indicating the position in the real space using a sensor mounted on a terminal on which the 3D animation is displayed.

According to the site management system and method of this aspect, a photograph is taken using a camera mounted on a terminal that displays a 3D animation (a dedicated application is started), and a Since location information is acquired using a sensor, it is easier to operate 3D animations (applications) and register photos than when using an external device equivalent to a camera or sensor attached to the terminal. It is possible to register photos without burdening on-site workers and drivers.

ADVANTAGE OF THE INVENTION According to this invention, management regarding a construction site can be performed efficiently.

It is a figure showing an example of a construction site. 1 is a block diagram showing the configuration of a site management system 1; FIG. FIG. 11 is a series of diagrams showing display examples of the application 200 when guiding a material delivery vehicle; FIG. 4 is a sequence diagram showing an operation example of the site management system 1 when guiding a material delivery vehicle; FIG. 10 is a sequence diagram showing an example display of application 200 when unloaded materials are registered. FIG. 10 is a sequence diagram showing an operation example of the site management system 1 when unloaded materials are registered; FIG. 11 is a series of diagrams showing display examples of the application 200 at the time of registering the work process of pile driving; FIG. 4 is a sequence diagram showing an operation example of the site management system 1 when registering a work process; 4 is a diagram for explaining a screen related to process management displayed by the application 200; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiments, a suitable example of the site management system is given, but the form of the present invention is not limited to the example.

[Outline of the on-site management system]
FIG. 1 is a diagram showing the state of work in the process of piling as an example of a construction site.
At the construction site of a building or civil engineering, there is a work target area SW, a parking lot SM where a transport vehicle MT for carrying out earth and sand and carrying in materials, etc. waits, and temporary storage of excavated earth and sand, carried-in materials, etc. Various spaces such as a storage area SP are provided, and a part of the aisle is also used as a temporary parking space when unloading or loading. In addition to these, a warehouse BW for housing construction machines MB such as a backhoe and a pile driver, and an administration building BA for use by site supervisors and workers are provided.

The site management system 1 uses a 3D animation representing a construction site to manage the use of various spaces and the progress of work at the construction site, and allows related parties to share information in real time. It is a system that allows visual confirmation of changes in In the site management system 1, as a work schedule for the day, which process is to be carried out and how to use which space (for example, when and where to park the material delivery vehicle, which storage place to unload, etc.) etc.) is determined in advance by the site supervisor or the construction management center. Then, the information on the results of the daily work schedule is registered in the 3D animation by the worker or the driver via the tablet terminal.

The 3D animation used by the site management system 1 means that the viewpoint provided in the internal space moves in synchronization with the movement of the user in the real space, and is displayed as if the user were moving in the internal space. may change, or the work schedule and work results for the day may be displayed chronologically like a frame-by-frame moving image in response to a predetermined operation (hereinafter, such a display is referred to as a "time-lapse display"). ) is a three-dimensional animation that The display of the 3D animation is stopped when there is no movement or operation by the user, and unlike general animation, the display is not constantly changing. Also, the point of view provided in the internal space of 3D animation corresponds to the point of view of the avatar placed in the internal space as the user's alter ego. However, if necessary, it is possible to display the avatar in the approximate center of the screen so that the internal space can be seen from behind the avatar.

The 3D animation in this embodiment is created based on a 3D model of a building (eg, BIM model, CAD model). Specifically, after converting the 3D model of the building using a commercial game engine, a 3D animation in the initial state in which all the objects forming the building are hidden is created. The 3D animation of the initial state corresponds to the state before the start of construction at the construction site. As work progresses at the construction site, performance information (work process progress, materials, etc.) is registered in the 3D animation, the 3D animation is updated accordingly, and the object is gradually displayed. Become. Note that when converting a 3D model into a 3D animation, other tools or an independently developed conversion tool may be used in place of the game engine.

Objects displayed in 3D animations are also classified into two types: inherited objects and created objects. An inherited object is an object corresponding to a component of the 3D model obtained by transforming the 3D model (inherited from the 3D model). On the other hand, created objects do not exist in the 3D model but are newly created because they need to be displayed in the 3D animation. This is the corresponding object.

[Configuration of on-site management system]
FIG. 2 is a block diagram showing the configuration of the site management system 1. As shown in FIG.
The site management system 1 includes a cloud server 100 responsible for process management, 3D animation management, etc., and a tablet terminal TB installed with an application 200 responsible for displaying 3D animation and registering information in the 3D animation. It operates in an environment connected to a communication line such as

The cloud server 100 has, for example, a database 110, a user authentication section 120, a process control section 130, a data distribution section 140, an image analysis section 150, an object identification section 160, an update section 170, and the like.

The database 110 includes a plurality of databases (DB) according to usage. For example, the user DB 112 stores information about users of the site management system 1, the process management DB 114 stores information about each construction process, and the 3D animation management DB 116 stores information about 3D animation. The 3D animation management DB 116 also includes an object storage unit 116A that stores information about the inherited object and the creation object described above, a photograph transmitted from the application 200 and related information (date and time of photography, position information of the camera (tablet terminal TB)). , subject position information, etc.), the actual data and update data of the 3D animation, information registered in the 3D animation and related information (registrant, registration date and time, registration destination position and an update information storage unit 116C for storing information (coordinates in 3D animation, etc.).

The user authentication unit 120 refers to the user DB 112 to perform authentication processing for the user of the site management system 1, and grants access rights according to the category of the authenticated user (for example, worker, driver, manager, etc.). do.

The process management unit 130 stores and manages information such as the initially set schedule for each process of construction, the number of labor, construction machinery, the type and number of materials, and the storage location in the process management DB 114. Manage change.

The data distribution unit 140 not only distributes the actual data of the 3D animation and update data, but also sends a notification (hereinafter referred to as an "instruction notification") to the driver to instruct the time and place to move the transportation vehicle or the like. To deliver.

The image analysis unit 150 analyzes the photograph transmitted from the application 200 to identify the subject, and returns the analysis result to the application 200 . For example, the image analysis unit 150 inputs photographs to a trained model trained in advance using a data set in which photographs of various work processes and various materials at a construction site are labeled. The subject is identified based on the prediction result of the trained model as to what the subject corresponds to (which work process, which material). In addition, when the image analysis unit 150 identifies that the subject is materials, it also identifies and quantifies the number of materials in the photograph.

The object identifying unit 160 identifies objects associated with moving objects such as construction machines and transportation vehicles existing at a construction site, and objects (work processes, materials, etc.) identified from photographs by the image analysis unit 150. identify the object

The updating unit 170 displays the object identified by the object identifying unit 160 at a position in the virtual space (3D animation) corresponding to the position in the real space (construction site) of the object corresponding to the object, thereby generating a 3D animation. to update. At this time, if the object specified by the object specifying unit 160 is an object corresponding to the work process, the updating unit 170, for example, makes the part of the object that has been worked opaque, while the other parts are semi-transparent. The parts that have been worked on are displayed in an identifiable manner, such as by displaying them transparently. The update unit 170 also stores information registered in the 3D animation via the application 200 in the 3D animation management DB 116 .

The application 200 has, for example, a position management unit 210, a display processing unit 220, a registration reception unit 230, a form processing unit 240, etc., and uses the position sensor LS, the atmospheric pressure sensor PS, and the camera CA mounted on the tablet terminal TB. It is used appropriately for processing.

The position management unit 210 uses the point P (see FIG. 1) in front of the administration building BA as a reference point, and based on the information from the position sensor LS and the atmospheric pressure sensor PS, the position of the tablet terminal TB (user) in the real space and the 3D space. The position of the viewpoint in the virtual space in the animation is managed in association with the position of the viewpoint in the virtual space according to the change of the information from the position sensor LS and the atmospheric pressure sensor PS (synchronized with the movement of the user in the real space). move. In addition, the position management unit 210 identifies the relative position (distance and direction) from the tablet terminal TB of the subject appearing in the center of the photograph taken by the camera CA, and identifies the position of the tablet terminal TB in the physical space. Identify the absolute position of the object from the relationship.

The position sensor LS is GPS, for example, and is used to specify the position of the tablet terminal TB. If use in an environment with poor radio wave conditions is assumed, a gyro sensor may be used instead of GPS to calculate the relative position from the reference point. Further, when the position management unit 210 identifies the relative position of the subject, for example, the direction of the subject is detected by a magnetic sensor, and the distance to the subject is detected using light. ) to specify the distance to the subject. The atmospheric pressure sensor PS is a sensor that detects atmospheric pressure, and is used to identify the position (floor number) of the tablet terminal TB in the height direction.

The display processing unit 220 performs overall processing related to the display of 3D animation, displays the 3D animation distributed from the cloud server 100 (data distribution unit 140) on the screen of the tablet terminal TB, and reproduces the viewpoint provided in the 3D animation. Change the position and orientation displayed on the screen according to the movement. In addition, the display processing unit 220 displays an operation menu according to the authority of the user who has logged in to the site management system 1 at a predetermined position on the display screen. The operation menu includes, for example, a camera menu used when registering information via photos, an update menu used when updating 3D animation to the latest state, and a time-lapse display of the work schedule before the start of work on the day. Also, it includes a work confirmation menu and the like used when time-lapse display of work results is performed after work is completed. Furthermore, the display processing unit 220 displays a tag icon for the position in the 3D animation where the information is registered, and when the tag icon is selected, the history of the information registered at that position (for example, at each step registered photos, etc.) are displayed in chronological order.

The registration reception unit 230 provides a photo registration form that is displayed when the camera menu is selected, transmits and receives data to and from the cloud server 100 according to the operation on the photo registration form, and photographs with the camera CA. Accepts information registration via photos. The registration reception unit 230 has a camera mode in which registration is received via a photograph, and a code input mode in which registration is received via a QR code (registered trademark) prepared in advance or an RFID attached to the material. , and the user can change the mode according to the situation. As a result, information registration can be performed smoothly even in a situation where it is difficult to take a picture. Details of specific processing performed via the photo registration form will be described later in detail with reference to other drawings.

The form processing unit 240 provides a form management form related to process management that is displayed when the form menu is selected. In the management form of the form, it is possible to display information initially set for each process of construction and to register changes thereto. The use of the report menu is restricted to users who fall under the category of managers, such as site supervisors and construction management center personnel. In this case, the report menu is not displayed on the screen.

[Operation at the time of guidance of moving body]
FIG. 3 is a series of diagrams showing a display example of the application 200 when guiding a moving object. In order to facilitate understanding of the invention, FIG. 3 will be described by exemplifying a case where the moving body to be guided is a material carrying-in vehicle.

(A) in FIG. 3: Prior to the delivery of materials, an instruction notification is sent by e-mail or the like to the driver of the delivery vehicle. When the driver starts the application 200 in response to this, the screen of the application 200 displays large characters indicating the specified time and specified place regarding the movement of the delivery vehicle, and the 3D animation makes it easy to visually recognize the specified place. is displayed. In the illustrated example, the "road shoulder in front of the first material storage area" is specified, and the road shoulder portion adjacent to the area SP1 _V in the 3D animation corresponding to the first material storage area is surrounded by a thick broken line and indicated by a black arrow. pointed out. Such highlighting allows the driver to easily grasp where the specified location is on the construction site. It should be noted that the application 200 is preferably capable of detecting whether the engine of the loading vehicle is on or off.

(B) in Fig. 3: When the designated time comes and the driver drives the delivery vehicle and enters the construction site, the viewpoint in the 3D animation moves in synchronization with the movement of the delivery vehicle (tablet terminal TB) at the construction site. Then, the screen of the application 200 is displayed like a car navigation system. As the driver progresses through the construction site according to the screen display of the application 200, at a certain point, for example, "30m ahead, park on the right side of the road shoulder" is displayed in large characters, and the right front side of the road is indicated by a thick dashed line. A boxed display is made.

(C) in FIG. 3: When the driver parks the delivery vehicle on the right side of the road surrounded by the thick dashed line, the screen of the application 200 displays, for example, "Movement completed. Please." is displayed in large size, and at the parking position in the 3D animation, the thick dashed line that had been displayed until just before disappears, and an object _MTV corresponding to the delivery vehicle MT in the real space is displayed. be done. With such a display, it is possible to clearly instruct the driver what to do after parking.

Transportation vehicles and construction machines other than the materials carrying-in vehicles are also guided to the specified location along the same flow as described above. Although not shown, the driver performs a predetermined operation to display the 3D animation from a bird's-eye view of the construction site, a first-person view from the avatar's line of sight with the avatar hidden, and an avatar. You can switch to any of the third-person views from behind the avatar as appropriate.

FIG. 4 is a sequence diagram showing an operation example of the site management system 1 when guiding a mobile object. The display of the application 200 illustrated in FIG. 3 is made as a result of the operation example of the site management system 1 illustrated in FIG. In addition, an abbreviation line is attached to a part where the processing before and after is executed asynchronously. The following is a description in chronological order.

Step S10: The cloud server 100 sends an instruction notification and the latest 3D animation to the driver in advance.

Steps S12 to S18: In response to this, the driver activates the application 200 on the tablet terminal TB and logs into the site management system 1 before entering the construction site. When the application 200 is used for the first time, or if the login information is not saved in the application 200, the driver enters the login information (user ID and password) and transmits it to the cloud server 100 (step S12). Attempt to log in to management system 1 . The cloud server 100 performs user authentication based on the transmitted login information (step S14), and if there is no problem, grants authority according to the driver, and notifies the application 200 that the user has logged into the site management system 1. (step S16). In response to this, the application 200 displays an operation menu according to the authority of the driver (step S18).

Note that if the login information is stored in the application 200, the above steps S12 to S18 are automatically executed based on the stored login information, so the driver does not need to enter the login information. be.

Step S20: When the driver drives the mobile body and enters the construction site, the application 200 is interlocked with the movement of the mobile body (more precisely, the tablet terminal TB on which the application 200 is installed) at the construction site. By moving the viewpoint in the 3D animation, the content (position and orientation) displayed on the screen is changed accordingly.

Step S30: When the driver moves the moving body to the specified location according to the screen display of the application 200, the application 200 notifies the cloud server 100 of the completion of the movement.

Steps S40 to S60: In response to this, the cloud server 100 selects an object corresponding to the moving object (step S40), and places the object selected in step S40 in the position within the 3D animation corresponding to the position of the destination of movement. is displayed to update the 3D animation (step S50), and the update data of the 3D animation is transmitted to the application 200 (step S60).

Step S70: Then, the update data received by the application 200 is reflected in the display of the 3D animation. As a result, the moving object is displayed at a position in the 3D animation corresponding to the destination position at the construction site.

After this, when the driver finishes necessary work (unloading, etc.) and drives the moving body again, the moving body deviates from the designated place. At this time, the application 200 notifies the cloud server 100 of the leaving of the moving body, and in response to this, the cloud server 100 hides the moving body object displayed in the 3D animation in the above step S50, The animation will be updated again and the updated data of the 3D animation will be sent to the application 200 .

[Operation when registering materials]
FIG. 5 is a sequence diagram showing an example display of application 200 when unloaded materials are registered. For convenience of explanation, it is assumed that nothing was placed in the designated material storage area before unloading. When the application 200 detects that the engine of the loading vehicle is turned off, the application 200 fixes the position of the loading vehicle in the 3D animation. The position and orientation displayed in the 3D animation thereafter correspond to the position and orientation of the tablet terminal TB in the real space.

(A) in FIG. 5: After the driver unloads the materials brought in by the carry-in vehicle to the first material storage site _SP1R , the driver checks the screen of the application 200 while facing the first material storage site _SP1R . At this time, the screen shows that nothing is placed in the area SP1- _V in the 3D animation corresponding to the actual first material storage site SP1- _R . Also, in the center of the screen, a tag icon TG indicating that information is registered for this location (first material storage area) is displayed, and in the upper left part of the screen, a camera menu CM is displayed. ing.

(B) in FIG. 5: When the driver selects the camera menu CM, a photo registration form is displayed on the screen of the application 200 . The photograph registration form includes a photograph area 222 for displaying an image captured by the lens of the camera CA, an [Analysis] button selected when the image displayed in the photograph area 222 is photographed and analyzed, a photograph The information area 224 that displays the analysis results of , the [Register] button that is selected when registering a photo and related information, and the currently displayed analysis result that is discarded (takes a new photo) In addition to the [Cancel] button, the [Mode selection] button that is selected when changing to an input mode other than camera mode, the [Back] button that is selected when discarding the photo registration form and returning to the 3D animation display, etc. is provided.

For example, when the driver adjusts the position and orientation of the camera CA so that the entire material _MAR piled up in the first material storage site SP1 _R fits in the photograph area 222 and selects the [Analysis] button, the photograph area is displayed at that timing. The image contained in 222 is photographed. Along with this, the photograph is analyzed, and the analysis result is displayed in the information area 224 . If the displayed analysis result is appropriate (matches the type (item name) and number of materials actually unloaded), the driver selects the [Register] button.

(C) in FIG. 5: When the [Register] button is selected, the photograph and detailed information on the material based on the photograph are registered for the position in the 3D animation corresponding to the position where the material was unloaded. Since the coordinates of the tablet terminal TB are also registered at the same time, it is possible to easily confirm that the unloaded coordinates are correct. Then, the object MA _V corresponding to the material MA _R is displayed in the area SP1 _V in the 3D animation in the same manner as the material MA _R unloaded in the first material storage site SP1 _R (the number of pieces, the number of stacked stages, etc.). be done. Also, although illustration is omitted, if the tag icon TG is selected here, the information registered so far for the first material storage area is displayed in chronological order. Thereby, it is possible to check the history of the materials placed in the first material storage area.

In the above example, the appropriate analysis result is displayed in the information area 224 and the information is registered as it is. It is also possible to register it by correcting it by, etc.). In addition, in the column of [product name (type of material)] in the information area 224, only the result with the highest reliability (possibility of relevance) in image analysis may be displayed, or multiple results may be displayed with high reliability. They may be displayed in order as selection candidates so that they can be corrected as appropriate before registration.

FIG. 6 is a sequence diagram showing an operation example of the site management system 1 when unloaded materials are registered. The display of the application 200 illustrated in FIG. 5 is made as a result of the operation example of the site management system 1 illustrated in FIG. The following is a description in chronological order.

Step S100: When the driver moves around the construction site while carrying the tablet terminal TB, the application 200 moves the viewpoint in the 3D animation in conjunction with the movement of the driver, and accordingly changes the content to be displayed on the screen. change.

Steps S110-S140: When the driver selects the camera menu (step S110), the application 200 displays a photo registration form on the screen (step S120). Then, when the driver adjusts the position and orientation of the tablet terminal TB (more precisely, the camera CA) so that the entire unloaded material fits within the photo area 222 and selects the analysis button (step S130), the application 200 takes a photograph of the image contained in the photograph area 222 at that timing and transmits the photograph to the cloud server 100 (step S140). It is preferable that the coordinates of the tablet terminal TB are also transmitted.

Steps S150, S160: In response to this, the cloud server 100 analyzes the photograph to identify what the subject corresponds to, and if it corresponds to the material, identifies the type of material and the number of items. (Step S150), the photograph analysis result is transmitted to the application 200 (Step S160).

Steps S170-S190: The application 200 displays the analysis results in the information area 224 of the photo registration form (step S170). When the driver confirms the displayed content, corrects the information as necessary, and selects the registration button (step S180), the application 200 transmits the registered content to the cloud server 100 (step S190). .

Steps S200 to S220: In response to this, the cloud server 100 identifies an object corresponding to the material to be registered (step S200), and places the object in the 3D animation corresponding to the position of the unloaded material in step S200. 3D animation is updated by displaying the material object specified in (step S210), and the update data of the 3D animation is transmitted to the application 200 (step S220).

Step S230: Then, the update data received by the application 200 is reflected in the display of the 3D animation. As a result, an object corresponding to the type and quantity of the material to be registered is displayed at the position in the 3D animation corresponding to the position of the unloading destination of the material.

In addition, when moving materials by vehicle, take a picture of the materials placed in the material storage area before moving and register the information, and after loading the materials into the vehicle, take a picture of the material storage area again. By registering the information as a The Rukoto.

In the example shown in the figure, the driver registers the information about the unloaded materials. However, if it is difficult for the driver to register the information (for example, if the tablet terminal TB used by the driver is insufficiently charged, 200 cannot be activated immediately), another worker may use his/her own tablet terminal TB to register information instead of the driver. In this case, the worker who registered the information is recorded in the 3D animation management DB 116 as a registrant.

[Operation when registering a work process]
FIG. 7 is a series of diagrams showing display examples of the application 200 when a work process is registered. In each process of construction, completion is achieved by accumulating different works on the same place. For example, in the pile (cast-in-place pile) process, the casing is installed and excavated, a stabilizer is injected to prevent the inner wall from collapsing, and the supporting ground is further excavated. It is completed after a series of operations, such as setting it up, pouring concrete, pulling out the casing and filling it with earth and sand, are done in order for the same place. Therefore, as an example of registration of work processes, an example of registering the last work process for cast-in-place piles will be described with reference to FIG.

(A) in Fig. 7: It is assumed that the work on the previous day had completed up to placing concrete, and on the day of work, the casing was pulled out and backfilled with earth and sand (the final work process for cast-in-place piles was carried out). Suppose. In this case, if you check the screen of the application 200 at the stage before registering the work process performed on the day, the screen will show the results of the information registration made at the end of the work on the previous day. An object _WCV corresponding to the casing is displayed for the work location where the is installed, and a tag icon TG indicating that information is registered in this location is displayed so as to overlap it. ing.

(B) in FIG. 7: When the worker selects the camera menu CM, a photo registration form is displayed on the screen of the application 200 . At this time, the worker adjusts the position and orientation of the camera CA so that the work site WP _R where the casing is pulled out and filled with earth and sand fits within the photograph area 222, and when the [Analysis] button is selected, a photograph is taken at that timing. The image that fell within region 222 is photographed. Along with this, the photograph is analyzed, and the analysis result is displayed in the information area 224 . If the displayed analysis result is appropriate (matches the content of the work process performed on the day), the worker selects the [Register] button.

(C) in FIG. 7: When the [Register] button is selected, the photograph and work process information are registered for the position in the 3D animation corresponding to the position of the work place WP _R , and the work place WP _R is registered at this position. An object WP _V corresponding to is displayed. Also, although illustration is omitted, if the tag icon TG is selected here, all the information registered in the process of the pile process is displayed in chronological order.

With the above information registration, the registration of information for the pile process is completed, and from the next day onwards, information registration for another process will be performed. What was explained in FIG. 7 is the final work process in the pile (cast-in-place pile) process, but for other work processes in the pile process, not only in the pile process but also in other construction processes Also, following the same flow as above, information is registered via photographs at the end of daily work and at the completion of each work process.

For example, at a building construction site, progress information is registered for various work processes in each process of construction, and as a result, the objects that make up the building are gradually assembled in the 3D animation as the work progresses. When a framework (columns and beams) is constructed on site, an object corresponding to the framework is displayed, and when a wall is installed on site, an object corresponding to the wall is displayed. Also, if the work of the day ends in the middle of the work of constructing the framework, as a result of registering the information via photos at the end of the day, the objects corresponding to the installed pillars and beams will be displayed opaquely. On the other hand, the objects to be assembled in the 3D animation are displayed in a state in which the progress of the work can be identified, for example, the objects corresponding to the columns and beams that have not been installed are displayed translucent.

In the above example, an appropriate analysis result is displayed in the information area 224 and the information is registered as it is, but it is also possible to modify and register a part of the displayed analysis result. In addition, in the columns of [process] and [work content] in the information area 224, the result with the highest reliability (possibility of relevance) in image analysis may be displayed, or multiple results may be displayed in descending order of reliability. They may be displayed as selection candidates so that they can be corrected as appropriate before registration.

Also, in the above example, the progress information of the work process is registered via the photograph, but a moving image of the work process may be registered together with the photograph or in place of the photograph. In addition, an input form for material information is provided in the photo registration form, and it is possible to input how much of the material stored in which storage location was used in the work process to be registered, etc., and it is linked to the registration of information. material information managed in the process management DB 114 may be updated.

FIG. 8 is a sequence diagram showing an operation example of the site management system 1 when registering a work process. The display of the application 200 illustrated in FIG. 7 is made as a result of the operation example of the site management system 1 illustrated in FIG. Note that in FIG. 8, the description of the operation related to the login to the site management system 1 performed after the application 200 is activated is omitted. In addition, an abbreviation line is attached to a place where the processing before and after is executed asynchronously. The following is a description in chronological order.

Steps S300 to S330: When the worker activates the application 200, the cloud server 100 transmits updated data of the 3D animation (difference data from the downloaded 3D animation) (step S300), and the application 200 displays the 3D animation. The update data is reflected (step S310). This allows the worker to check the 3D animation in the latest state. For example, when the worker selects the work confirmation menu before starting work (step S320), the work scheduled for the day is displayed in a time-lapse display (step S330). You can start working after you have an image inside. It should be noted that the 3D animation can be updated at any timing other than when the application 200 is activated by selecting the update menu.

Step S400: When the worker moves around the construction site while carrying the tablet terminal TB, the application 200 moves the viewpoint in the 3D animation in conjunction with the movement of the worker, and accordingly changes the content to be displayed on the screen. change.

Steps S410-S440: When the operator selects the camera menu (step S410), the application 200 displays a photo registration form on the screen (step S420). Then, when the worker adjusts the position and orientation of the tablet terminal TB (more precisely, the camera CA) so that the work location fits within the photo area 222 and selects the analysis button (step S430), the application 200 At the timing, the image contained in the photograph area 222 is photographed and transmitted to the cloud server 100 (step S440).

Steps S450, S460: In response to this, the cloud server 100 analyzes the photograph to identify what the subject corresponds to (step S450), and includes the coordinate information of the tablet terminal TB to determine which work process to the application 200 (step S460).

Steps S470-S490: The application 200 displays the analysis results in the information area 224 of the photo registration form (step S470). When the worker confirms the displayed contents, corrects the information as necessary, and selects the registration button (step S480), the application 200 transmits the registered contents to the cloud server 100 (step S490). .

Steps S500 to S520: In response to this, the cloud server 100 identifies the object corresponding to the work process to be registered (step S500), and identifies the position in the 3D animation corresponding to the position of the work location in step S500. The 3D animation is updated by displaying the objects of the created work process (step S510), and the update data of the 3D animation is sent to the application 200 (step S520).

Step S530: Then, the update data received by the application 200 is reflected in the display of the 3D animation. As a result, the work process object is displayed at a position in the 3D animation corresponding to the position of the work location in a state in which the progress can be identified.

[Form screen related to process management]
FIG. 9 is a diagram for explaining a form screen related to process management displayed by the application 200. As shown in FIG.

As described above, information initially set for each process of construction is stored in the process management DB 114 in advance. The initially set information includes, for example, the cost of work required to complete the process (work type NET), the type of construction method to be adopted, the construction machine used in the construction method, the type and quantity of materials required for the construction method, etc. This applies to the construction period and the number of labor, etc., which are determined after estimating the man-hours based on the information in . On the form screen, it is possible to check the initially set information, estimate changes, and confirm changes.

(A) in FIG. 9: When a user who can access the form menu selects the form menu from the operation menu of the application 200 and selects [Pile] from among the plurality of process tabs displayed, A form screen is displayed. For the pile process, detailed tabs such as [Pile work], [Area information], [Material information], [Daily schedule], etc. are installed. You can check various information set for the process. The names and contents of the detailed tabs set up for each process vary, but the screen structure of the report menu is common to all processes. By selecting the details tab, a specific form screen is displayed.

When you select the [Pile work] details tab, on the left side of the screen, the work type NET initially set for the pile process, type, construction machine, specified information on piles (pile tip, pile diameter and number) etc. In addition, the construction period and the number of labors initially set based on these are displayed. An input form corresponding to each item on the left side is displayed on the right side of the screen. In the input form, multiple options are automatically set in advance for each item except work type NET, construction period, and number of labor. Item choices are automatically reset.

(B) in FIG. 9: A table summarizing types of piles, construction machines, and required days for cast-in-place piles. This table is referenced when options are automatically set in the input form displayed on the form screen of [Piling]. Specifically, in the [type] of the input form, each name described in the [pile type] of the list is displayed as an option. When the user selects, for example, "Earth Drill Pile" for "Type", the options for the next item "Construction Machine" are reset to four options corresponding to "Earth Drill Pile". Then, if the user selects, for example, "pile diameter 2000φ or less, no phase number" for [construction machine], the number of days for assembly and dismantling will be set to "4", the number of days for setup change will be set to "1", and the required number of days will automatically be set to "5". is automatically specified, and [Construction period] is automatically set with the content calculated based on the specified number of days. By appropriately changing the options in the input form in this way, the user can easily estimate the man-hours required to change the initially set information. Then, based on this estimate, when the user manually inputs [work type NET] and [number of labor] and selects the [confirm change] button, the contents of the input form are stored in the process control DB 114 .

Note that camera buttons are provided for items such as materials and construction machines in the input form on the form screen of any of the process tabs. For items with a camera button, in addition to selecting one of the options that are automatically set, select the camera button to display a form to take a picture, take a picture of the actual object with the camera, and perform image recognition. It is also possible to set the identified object as an option. As for the construction machine, it is also possible to enter the management number (license plate number) and set the construction machine associated with the management number as an option.

Management of the construction period of a construction site has a problem that is difficult to be shared among different construction sites. By using the site management system of the present embodiment, the period from the start of work to the completion of work in each process can be calculated from the work history. Construction sites are often affected by the weather, the number of workers, and the like. By using the data accumulated in the site management system, it is possible to perform highly accurate budget and actual management of work progress.

According to this embodiment, the following advantages are obtained.
(1) Use of 3D animation representing the construction site is used to manage the use of various spaces at the construction site and the delivery and movement of materials in real time. In comparison, the immediacy of information can be improved, and information can be efficiently shared among related parties. In addition, 3D animation manages height information in addition to horizontal information, and space allocation can be performed based on the height of the moving object, so space management can be performed more appropriately. . As a result, for example, it is possible to prevent mistakes such as erroneously assigning a certain construction machine to a warehouse space that cannot be accommodated due to height restrictions, and the stagnation of work that may occur at the site due to this. Effective utilization becomes possible.

(2) The progress of the work process is managed using a 3D animation showing the construction site, and the progress of the work process is registered based on the photograph of the work place for the position in the 3D animation corresponding to the work place. Therefore, it is possible to easily register information and manage the registered information as compared with the case of performing progress management using a photo book. Also, for example, at the construction site of a high-rise building, there is not much difference in appearance regardless of which floor the same work is performed, and at a vast civil engineering site, there is not much difference in appearance regardless of where the same work is performed. Therefore, in either case, it is impossible to distinguish the place just by taking a picture, so in order to properly manage the progress, further work such as sorting the photos and adding classification information is required, which is very troublesome. hangs. In contrast, according to the present embodiment, the position in the horizontal direction is specified using the position sensor, and the position in the height direction (floor number) is automatically specified using the atmospheric pressure sensor. Based on this, the progress of the work process is registered at the position in the 3D animation corresponding to the position where the work was actually performed. can be managed.

(3) When information related to performance (work process progress, material delivery, movement of moving objects, etc.) is registered in the 3D animation, an object corresponding to the content of the information is displayed at the position where the information was registered. Since the 3D animation is updated according to the state, the situation of the construction site (work progress, space usage, etc.) can be visually grasped easily.

(4) The objects that make up the building displayed in the 3D animation were obtained by converting the 3D model of the building when the 3D animation was created (inherited from the 3D model). Compared to creating a new object from scratch, the amount of work required to create a 3D animation can be reduced.

(5) If you select a tag icon displayed in the 3D animation, you can display the information registered so far in that part in chronological order, so you can view the history of the work performed for that part and , it is possible to check the history of the materials placed at that location, and if a problem occurs, it is possible to trace the cause of the problem by tracing the history.

(6) By using the work confirmation menu, the work schedule for the day can be displayed in 3D animation time-lapse before the start of work. You can start working after you have an image inside. In addition, since the work results of the day can be displayed in a 3D animation time-lapse after the work is completed, the content of the work carried out on the day (changes over time) can be visually grasped and easily grasped by site supervisors. can be done.

(7) By using the report menu, it is possible to easily estimate the number of man-hours when materials, construction machines, etc. are changed while checking the information initially set for each process of construction. You can enter the type of work NET and the number of labor by using the same screen, and confirm the changes on the same screen. Therefore, the on-site supervisor can perform schedule and actual management of the work process as well as change management of the process through the same application, thereby improving the efficiency of work necessary for on-site management.

The present invention is not limited to the above-described embodiments, and can be implemented in various modifications.

In the embodiment described above, the application 200 is installed on the tablet terminal TB, but the installation destination of the application 200 is not limited to the tablet terminal TB, and may be an information terminal such as a smart phone or a mobile PC. In addition, if the information terminal is not equipped with a position sensor, barometric pressure sensor, or camera due to the specifications of the information terminal, or if it is equipped but you want to use another device, you may separately attach a device equivalent to these to the information terminal. It may be used by attaching it externally.

In the above-described embodiment, when guiding the moving body, the position sensor mounted on the tablet terminal TB used by the driver is used to identify the position of the moving body. A device corresponding to a position sensor such as a GPS transmitter may be separately arranged inside and used to specify the position.

In the above-described embodiment, multiple pieces of information registered for the same location (process, place) are displayed in chronological order via one tag icon, but the display mode of the registered information is limited to this. not. For example, different tag icons may be assigned to individual pieces of registered information, and only tag icons corresponding to processes selected by the user may be extracted and displayed.

In the above-described embodiment, the absolute position of the subject is specified by specifying the relative position of the subject from the tablet terminal TB, and the performance information is registered at the position in the 3D animation corresponding to this absolute position. Alternatively, the user may select a position in the 3D animation for which the performance information is to be registered, and register the performance information for this position.

In the above-described embodiment, the driver drives the mobile object at the construction site. Body control driving may be performed.

In addition, it goes without saying that all of the examples shown in the drawings in the embodiments are merely preferable examples, and can be appropriately modified when implementing the present invention.

1 Field management system 100 Cloud server 110 Database 200 Application 222 Photo area 224 Information area CM Camera menu TB Tablet terminal TG Tag icon

Claims (11)

an object store for storing objects that can be displayed in a virtual space within a 3D animation representing a construction site;
a position management unit that associates and manages a position in the real space with a position in the 3D animation;
an identification unit that identifies an object corresponding to a predetermined target existing at the construction site;
an updating unit that updates the 3D animation by displaying the identified object at a position in the 3D animation that corresponds to the position of the predetermined target in the physical space. In the field management system according to claim 1,
The 3D animation is
It is generated based on the 3D model of the building,
The object is
An on-site management system, including one generated based on the component parts of the 3D model. In the site management system according to claim 1 or 2,
The location management unit
managing a position in the real space of a moving object including construction machines and transport vehicles brought into the construction site in association with a position in the 3D animation;
The identification unit
identifying an object corresponding to the moving object;
The updating unit
A site management system, wherein an object corresponding to the specified moving body is displayed at a position within the 3D animation corresponding to a position of the moving body in the real space to update the 3D animation. In the field management system according to any one of claims 1 to 3,
a photo storage unit that associates and stores a photo of a subject taken at the construction site and its position information;
an analysis unit that analyzes the photograph and identifies the subject,
The identification unit
identifying an object corresponding to the subject identified by the analysis unit;
The updating unit
A site management system, wherein an object corresponding to the identified subject is displayed at a position within the 3D animation corresponding to the position of the subject in the real space to update the 3D animation. In the field management system according to claim 4,
The photo storage unit
store pictures of materials being unloaded from transport vehicles,
The updating unit
A site management system, wherein the 3D animation is updated by displaying an object corresponding to the material at a position in the 3D animation corresponding to a position where the material was unloaded. In the site management system according to claim 4 or 5,
The photo storage unit
Memorize the photos taken of the work process,
The updating unit
The 3D animation is updated by displaying an object corresponding to the work process at a position in the 3D animation corresponding to the position where the work process is performed in a manner that allows identification of the worked part. on-site management system. In the field management system according to any one of claims 4 to 6,
A site management system, further comprising: a display processing unit that displays that the photograph of the subject has been registered at a position in the 3D animation corresponding to the position indicated by the position information. In the field management system according to any one of claims 4 to 7,
The photo storage unit
A site management system characterized by storing a photograph of the subject taken at a construction site using a camera mounted on a terminal displaying the 3D animation. In the site management system according to any one of claims 1 to 8,
The location management unit
A site management system characterized by acquiring information indicating a position in a real space using a sensor mounted on a terminal on which the 3D animation is displayed. an object storage step of storing objects that can be displayed in a virtual space within a 3D animation representing a construction site;
a position management step of associating and managing positions in the real space and positions in the 3D animation;
an identifying step of identifying an object corresponding to a given target present at the construction site;
and updating the 3D animation by displaying the identified object at a position within the 3D animation that corresponds to the position of the predetermined target in real space. In the field management method according to claim 10,
a photo storage step of correlating and storing a photo of a subject taken at the construction site and its position information;
an analyzing step of analyzing the photograph to identify the subject;
In the specific step,
identifying an object corresponding to the subject detected in the analysis step;
In the updating step,
and updating the 3D animation by displaying an object corresponding to the subject identified in the updating step at a position in the 3D animation corresponding to the position of the subject in the real space.

Images