JP2012189433A - Surface formation supporting system, surface formation supporting device, and surface formation supporting program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a surface formation supporting system, a surface formation supporting device, and a surface formation supporting program that are capable of shortening time required for construction work.SOLUTION: A surface formation supporting system comprises: an information generating device for generating image information for each photographic position obtained by virtually photographing a prescribed image displayed on a predetermined target surface in a preset photographic direction from a plurality of preset photographic positions in a virtual space; and a plurality of projecting devices installed such that the positional relationship is the same as the plurality of photographic positions on the target surface to project an image displayed according to the corresponding image information in a corresponding photographing direction on a foundation surface that is a foundation when forming the target surface in a real space.

Description

  The present invention relates to a surface formation support system, a surface formation support device, and a surface formation support program, and more particularly, to a surface formation support system, a surface formation support device, and a surface formation support program that support formation of a predetermined target surface. .

  In recent years, a technique for obtaining three-dimensional shape information of the surface of an object to be measured for surface shape by image analysis has been used. As a technique used to obtain the three-dimensional shape information of the surface, the optical pattern is projected onto the measurement target existing within the predetermined imaging field of view, and the deformation amount of the optical pattern deformed according to the three-dimensional shape of the measurement target is calculated. Techniques for analysis are known. Typical examples of the method include a light cutting method, a space code method, and a fringe analysis method. These are all based on the principle of triangulation, but among them, many methods such as space fringe analysis and time fringe analysis have been proposed for the fringe analysis method and are known as methods for obtaining high measurement accuracy.

Usually, in these methods, an area sensor is used to read a measurement target surface on which an optical pattern is projected. However, when an area sensor is used, the measurement target surface often does not fit within one imaging field of view. There is a problem in that it is often necessary to divide the field of view in multiple directions while moving the image both vertically and horizontally, and the imaging time becomes long.
As a countermeasure, for example, a three-dimensional shape measuring apparatus capable of measuring three-dimensional shape information quickly and with high accuracy has been proposed (see Patent Document 1). This apparatus projects a light pattern whose luminance periodically changes according to a position onto a partial area on a conveyance stage where a measurement object is measured, and first line sensor for imaging a light pattern irradiation area And a second line sensor that images a non-irradiated area of the optical pattern, and is included in an image obtained by removing background information from an image captured by the first line sensor and an image captured by the second line sensor. The phase of the light pattern in a certain pixel is calculated based on the luminance values of the pixel in the image and the surrounding pixels, and the height information of the measurement target is calculated based on the calculated phase. This makes it possible to capture the measurement target with high resolution while reducing the number of times the measurement target is moved relative to the line sensor in the main scanning direction.

JP 2009-31150 A

  By the way, using the above-described technology for measuring a three-dimensional shape, the construction surface is indicated by the three-dimensional shape measured by the technology when it is constructed so that a predetermined surface of the building has a target height. A technique (hereinafter referred to as “construction support technology”) that presents a construction worker with a deviation between the predetermined height of the surface and the target height is conceivable.

  When the technique disclosed in Patent Document 1 is applied as the construction support technique and a surface is formed by performing construction on a three-dimensional construction object in real space, the shape of the surface during construction is measured. Although it can be presented to the construction worker, it is necessary to construct the construction object while referring to the shape of the surface in the middle of construction, so the construction work takes time. was there.

  The present invention has been made to solve such a problem, and its purpose is to provide a surface formation support system, a surface formation support device, and a surface formation support program capable of reducing the time required for construction work. It is to provide.

  In order to achieve the above object, the surface formation support system according to claim 1, in the virtual space, a predetermined image displayed on a predetermined target surface is set in advance from a plurality of predetermined shooting positions. An information generation device that generates image information for each of the shooting positions obtained by virtually shooting toward the object, and the plurality of the target surfaces corresponding to the target surfaces in the real space A projection direction corresponding to the photographing direction is set on the base surface that is the base position when forming the formation target surface, and the image indicated by the corresponding image information is installed so as to have the same positional relationship as the photographing position of A plurality of projection devices that project toward the screen.

  According to the surface formation support system according to claim 1, the information generation apparatus captures a predetermined image displayed on a predetermined target surface in a virtual space from a plurality of predetermined photographing positions. Image information for each position obtained by virtually shooting with respect to a direction is generated, and a plurality of projection apparatuses capture a plurality of images of a target surface with respect to a formation target surface corresponding to the target surface in real space. Shooting directions corresponding to the base plane that forms the target plane for the images obtained by the corresponding image information each installed so as to have the same positional relationship as the position and generated by the information generating device Projecting toward the projection direction corresponding to. Thereby, compared with the case where it constructs, referring the measurement result of the three-dimensional position displayed in the position different from a construction surface, construction can be completed in a shorter time.

  In the surface formation support system according to claim 1, as in the invention according to claim 2, the information generation device is configured to input an installation position and a projection direction of each of the plurality of projection devices in the real space. And a plurality of installation positions and projection directions received by the reception means may be set as the plurality of imaging positions and the imaging directions, respectively. Thereby, the installation operation of the projection apparatus can be easily performed as compared with the case where the projection apparatus is positioned in the imaging position and the imaging direction set in the information generation apparatus.

  According to a first aspect of the present invention, there is provided a surface formation support system according to the third aspect of the present invention, comprising: an imaging device that captures an image projected from each of the plurality of projection devices; and the imaging device. A measuring device that measures a physical quantity indicating a shift amount between the formation target surface and the base surface with respect to the projection direction based on a shift amount between images projected from each of the plurality of projection devices in a captured image; A surface forming device that forms the target surface with respect to the base surface may be further provided so that the physical quantity measured by the measuring device falls within a predetermined range. As a result, the target surface can be formed automatically and with high accuracy.

  Further, in the surface formation support system according to claim 3, as in the invention according to claim 4, the predetermined image is a lattice pattern image, and the measuring device includes a plurality of images taken by the photographing device. The physical quantity may be measured based on the shift amount of the corresponding grid point between the images projected from each of the projection apparatuses. Thereby, the physical quantity indicating the amount of deviation can be measured easily and accurately.

  On the other hand, in order to achieve the above object, the surface formation support device according to claim 5 presets a predetermined image displayed on a predetermined target surface from a plurality of predetermined shooting positions in a virtual space. Information generating means for generating image information for each shooting position obtained by virtually shooting in the shooting direction; and in a real space, with respect to the formation target surface corresponding to the target surface, Projecting images corresponding to the shooting directions onto the base planes that are installed so as to have the same positional relationship as the plurality of shooting positions and that are indicated by the corresponding image information and form the target plane. A plurality of projection means for projecting in the direction.

  Therefore, according to the surface formation support device according to claim 5, since it can be operated in the same manner as the invention according to claim 1, the position different from the construction surface as in the invention according to claim 1. The construction can be completed in a shorter time compared to the construction with reference to the measurement result of the three-dimensional position displayed in (1).

  In order to achieve the above object, the surface formation support program according to claim 6 presets a predetermined image displayed on a predetermined target surface in a virtual space from a plurality of preset photographing positions. An information generation step for generating image information for each shooting position obtained by virtually shooting in the shooting direction; and in a real space, with respect to the formation target surface corresponding to the target surface, For a plurality of projection devices installed so as to be in the same positional relationship as the plurality of photographing positions, the images indicated by the corresponding image information are used as a base surface that forms the basis for forming the target surface. And causing the computer to execute a projection step of projecting in the projection direction corresponding to the imaging direction.

  Therefore, according to the surface formation support program according to claim 6, since the computer can be operated in the same manner as the invention according to claim 1, the construction surface is the same as the invention according to claim 1. The construction can be completed in a shorter time compared to the case of construction with reference to the measurement results of the three-dimensional positions displayed at different positions.

  According to the present invention, it is possible to reduce the time required for the construction work as compared with the case of construction while referring to the measurement result of the three-dimensional position displayed at a position different from the construction surface. It is done.

It is a conceptual diagram for demonstrating the principle of the surface formation assistance system which concerns on embodiment. 1 is an overall configuration diagram of a surface formation support system according to a first embodiment. It is a block diagram which shows the principal part structure of the electric system of the surface formation assistance system which concerns on 1st Embodiment. It is a schematic diagram which shows the memory content of the memory | storage part of PC in the surface formation assistance system which concerns on 1st Embodiment. It is a figure which shows the projection direction of the projector in the surface formation assistance system which concerns on embodiment, (A) is a top view, (B) is a side view. It is a flowchart which shows the flow of a process of the projection information generation process program which concerns on 1st Embodiment. It is a flowchart which shows the flow of a process of the construction assistance processing program which concerns on 1st Embodiment. It is a figure which shows the installation assistance screen displayed in the construction assistance processing program which concerns on 1st Embodiment. (A) thru | or (C) is a side schematic diagram which shows the construction state of a construction target object, (D) thru | or (F) are two projectors in each construction state shown to (A) thru | or (C). It is a figure which shows the lattice pattern displayed on a construction surface by. It is a whole block diagram of the surface formation assistance system which concerns on 2nd Embodiment. It is a flowchart which shows the flow of a process of the construction assistance processing program which concerns on 2nd Embodiment. It is a figure which shows the input screen displayed in the construction assistance processing program which concerns on 2nd Embodiment. It is a flowchart which shows the flow of a process of the projection information generation process program which concerns on 2nd Embodiment. It is a block diagram which shows the principal part structure of the electric system of the surface formation assistance system which concerns on 3rd Embodiment. (A) is a schematic front view for explaining a method for deriving a deviation amount, and (B) is a schematic top view for explaining a method for deriving a deviation amount. It is a flowchart which shows the flow of a process of the construction processing program which concerns on 3rd Embodiment. It is a schematic side view for explaining an application example of the present invention. It is a schematic side view for explaining an application example of the present invention. It is a figure where it uses for description of the application example of this invention, (A) and (B) are side views, (C) and (D) are perspective views.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Here, a description will be given of a form example in the case where the present invention is applied to a surface formation support system that supports a construction in which urethane foam is sprayed onto the surface of a component (in this embodiment, a pillar) constituting a building. . Further, here, a description will be given of an example in which there are two projection apparatuses of the present invention.

  FIG. 1 is a conceptual diagram for explaining the principle of the surface formation support system 1 according to the embodiment. As shown in FIG. 1, in the surface formation support system 1 according to the present embodiment, in a virtual space 10, a surface after the completion of construction of the surface to be constructed indicated by the three-dimensional CAD information of the building to be constructed (hereinafter referred to as the construction target) , Referred to as “target surface 11”) in a state where a predetermined image (in this embodiment, a lattice pattern, hereinafter referred to as “target image”) is virtually displayed, a plurality of preset target images are displayed. Image information for each shooting position obtained by virtually shooting from two shooting positions (in this embodiment) toward a preset shooting direction is generated.

  On the other hand, in the surface formation support system 1 according to the present embodiment, in the real space 20, a surface corresponding to the target surface 11 in the virtual space 10 (a formation target surface, hereinafter referred to as “target surface A”). The plurality of (two in this embodiment) projectors 22A and 22B respectively installed on the target surface A so as to have the same positional relationship as the plurality of shooting positions with respect to the target surface 11 in the virtual space 10 The image indicated by the corresponding image information is projected toward the corresponding photographing direction onto a surface (hereinafter referred to as “construction surface 21 </ b> A”) that forms the basis for forming the target surface A. In the surface formation support system 1 according to the present embodiment, the setting of the projection direction by each projector 22A, 22B is individually attached to the upper measurement unit of the transit, and the direction measured by the transit is determined. This is done by setting to match the shooting direction. However, it is needless to say that the configuration is not limited to this configuration, and may be set using another azimuth measuring device.

  As described above, in a state where the construction surface 21A does not coincide with the target surface A, the images projected from the projectors 22A and 22B are displaced, so that the construction worker performs the construction work until the displacement does not occur in the entire area of the construction surface 21A. By performing it continuously, the construction work can be completed with high accuracy.

  Thus, in the surface formation support system 1 which concerns on this Embodiment, since it constructs with respect to the said construction surface 21A, referring the state of the image projected on the construction surface 21A, it differs from the said construction surface. The construction can be completed in a shorter time compared to the construction with reference to the measurement result of the three-dimensional position displayed at the position.

  The target image to be projected is a shaped grid pattern (a lattice pattern), a concentric circle pattern composed of a plurality of circles with different radii around the same position, a dot pattern in which a plurality of dots are arranged in a grid pattern, etc. Yes, any image can be used as long as it is possible to determine the deviation of the projection image of each projector 22A, 22B when projected from the plurality of projectors 22A, 22B. Alternatively, by projecting solid images with different colors from the plurality of projectors 22A and 22B, and using the fact that the colors change when the projected images overlap, the deviation of the projected images is determined. Also good. For example, solid images of red, green, and blue, which are the three primary colors of light, are projected from three projectors so that each color area overlaps when the projection plane is the same height as the target plane. Thus, the construction worker can easily visually determine the deviation of the projection image from the area of the region displayed in white in the projection image. Here, as described above, a lattice pattern will be described as an example.

  Note that the target surface 11 is configured from the three-dimensional CAD information and a lattice pattern is displayed on the target surface 11, and virtual cameras (hereinafter referred to as “virtual cameras 12A, 12B ”), and image information indicating an image to be projected onto the real space 20 is generated by photographing the lattice pattern with the virtual cameras 12A and 12B. It is preferable to project from the projectors 22A and 22B.

[First Embodiment]
FIG. 2 is an overall configuration diagram showing the configuration of the surface formation support system 1 according to the first embodiment. As illustrated in FIG. 2, the surface formation support system 1 according to the first embodiment includes a personal computer (hereinafter referred to as “PC”) 13 that performs processing in the virtual space described above, and processing in the real space described above. PC24 which bears. In the surface formation support system 1 according to the present embodiment, the PC 13 is provided in a construction management center that comprehensively manages construction for a plurality of predetermined buildings (hereinafter referred to as “managed buildings”). PC24 is provided in the vicinity of each construction site of a management object building.

  As described above, the PC 13 virtually configures the target surface 11 by drawing the three-dimensional image indicated by the three-dimensional CAD information of the building to be constructed, and displays the target image. Image information for each photographing position obtained by virtually photographing an image from two preset photographing positions toward a preset photographing direction is generated. In the PC 13 according to the present embodiment, two virtual cameras, a virtual camera 12A and a virtual camera 12B, are used for virtual shooting at this time.

  In the surface formation support system 1 according to the present embodiment, the coordinate system that is the same as the three-dimensional coordinate system used in the three-dimensional CAD information of the building to be processed is used as the coordinate system indicating the photographing position and the photographing direction. The position of the origin (0, 0, 0) is the same as the position of the origin of the three-dimensional CAD information.

  On the other hand, as described above, the PC 24 displays the image indicated by the corresponding image information by the two projectors 22A and 22B installed so as to have the same positional relationship as the above two shooting positions with respect to the target surface 11. Control is performed to project onto the construction surface 21A of the construction object 21 in the projection direction corresponding to the imaging direction.

  The PC 24 according to the present embodiment receives from the PC 13 the image information generated by the PC 13 and the information on the shooting positions and shooting directions of the virtual camera 12A and the virtual camera 12B set when the image information is generated. To do. Note that image information, shooting position information, and shooting direction information transmitted from the PC 13 to the PC 24 at this time are collectively referred to as “projection information” below.

  Then, the PC 24 presents shooting position information and shooting direction information included in the received projection information. In response to this, the construction worker positions the installation position and the projection direction of the projector 22A and the projector 22B so as to coincide with the shooting position and the shooting direction indicated by the presented shooting position information and shooting direction information.

  When the positioning of the projectors 22A and 22B by the construction worker is completed, the PC 24 responds to the projectors 22A and 22B by transmitting the image information included in the received projection information to the corresponding projectors 22A and 22B. An image (target image) indicated by the image information to be projected is projected toward the construction surface 21A.

  FIG. 3 is a block diagram showing a main configuration of the electrical system of the surface formation support system 1 according to the first embodiment. As shown in FIG. 3, the PC 13 includes a CPU (Central Processing Unit) and a RAM (Random Access Memory), and a control unit 30 that generally controls the entire PC 13 under the control of the CPU, and a communication unit that controls communication with the PC 24. 31, an input device such as a keyboard and a mouse, an input unit 32 that transmits information instructed by a user operation on the input device to the control unit 30 as input information, a display device such as a liquid crystal display, and the control of the control unit 30 A display unit 33 for displaying various information on the display device, a ROM (Read Only Memory), other non-volatile memory, a hard disk, etc., and a program used for control by the control unit 30 and various information used for control Is stored.

  The PC 24 includes a CPU and a RAM, and a control unit 35 that controls the entire PC 24 under the control of the CPU, a communication unit 36 that controls communication with the PC 13, an input device such as a keyboard and a mouse, and a user for these. An input unit 37 that transmits information instructed by operation to the control unit 35 as input information, a display unit 38 that includes a display device such as a liquid crystal display and displays various information on the display device based on the control of the control unit 35, ROM And a non-volatile memory, a hard disk, and the like, and a storage unit 39 for storing programs used for control by the control unit 35 and various information used for control.

  Further, a projector 22A and a projector 22B are electrically connected to the PC 24 by wire, and the control unit 35 outputs image information to the projectors 22A and 22B. The projectors 22A and 22B that have input the image information project the input image information in a preset direction. Further, the camera 24 is electrically connected to the PC 24 by wire, and the control unit 35 inputs image information (hereinafter referred to as “photographing information”) obtained by photographing from the camera 23. The PC 24, the projectors 22A and 22B, and the camera 23 may transmit and receive image information and shooting information by wireless communication instead of being connected by wire.

  Note that the communication method between the PC 13 and the PC 24 may be wireless or wired, and an existing communication medium such as the Internet or a wireless local area network (LAN) can be used.

  FIG. 4 is a schematic diagram showing the storage contents of the storage unit 34 of the PC 13 in the surface formation support system 1 of the first embodiment. As shown in FIG. 4, the storage unit 34 includes at least a database region 34a in which three-dimensional CAD information 34a1 is stored and a program region 34b in which a program used by the control unit 30 is stored. In the database area 34a, three-dimensional CAD information indicating different buildings is stored in advance in association with information specifying the corresponding building. When a building to be constructed is designated by a construction worker or the like, 3D CAD information associated with the building is selected and used.

  FIG. 5A is a top view showing the projection directions of the projector 22A and the projector 22B in the embodiment, and FIG. 5B is a side view showing the projection directions of the projector 22A and the projector 22B in the embodiment. The projection directions of the projectors 22A and 22B are determined by the horizontal angle θx with respect to the axis perpendicular to the projection plane and the vertical angle θz with respect to the axis perpendicular to the projection plane. Therefore, in the surface formation support system 1 according to the present embodiment, the projection directions of the projectors 22A and 22B are defined by the two angles of the angle θx and the angle θz.

  Next, the operation of the surface formation support system 1 according to the present embodiment will be described.

  In the surface formation support system 1 according to the present embodiment, the PC 13 executes the projection information generation processing program, while the PC 24 executes the construction support processing program. First, the operation of the PC 13 when executing the projection information generation processing program will be described with reference to FIG. FIG. 6 is a flowchart showing a flow of processing of the projection information generation processing program executed by the control unit 30 of the PC 13 when an execution instruction from a construction worker or the like is received via the input unit 32. The program is stored in advance in the program area 34b of the storage unit 34.

  First, the control unit 30 of the PC 13 reads out the three-dimensional CAD information corresponding to the building including the construction object 21 from the storage unit 34 (S101). The building including the construction object 21 may be input by the construction worker in step S101 or may be selected and set in advance by the construction worker.

  The control unit 30 receives an instruction to select the target surface 11 to be constructed in the construction object 21 (S103). At this time, for example, the control unit 30 generates a three-dimensional CAD model from the three-dimensional CAD information read out in step S101 and causes the display unit 33 to display the three-dimensional CAD model. An instruction to select the target surface 11 is accepted by selecting any surface from the model.

  In addition, the control unit 30 receives input of the shooting positions and shooting directions of the virtual cameras 12A and 12B in the virtual space 10 (S105). At this time, for example, the control unit 30 generates a three-dimensional CAD model from the three-dimensional CAD information read out in step S101 and causes the display unit 33 to display the virtual model 12A, via the input unit 32 by the construction worker. This input is accepted by prompting the user to input the shooting position and shooting direction of 12B.

  Note that the shooting position by the plurality of virtual cameras 12A and 12B can be any position, but this position is the installation position of the projectors 22A and 22B in the real space 20, so when actually performing construction work. It is necessary to apply a position having a sufficient space for installing the projectors 22A and 22B. Further, if the distance from the construction surface 21A is too far, the images displayed on the construction surface 21A by the projectors 22A and 22B become thin, while if too close, the construction work is hindered. There is.

  The control unit 30 virtually constructs the target surface 11 from the three-dimensional CAD information read in step S101, and virtually draws a lattice pattern on the target surface 11 (S107).

  The control unit 30 displays image information indicating images virtually captured by the virtual cameras 12A and 12B when the virtual cameras 12A and 12B are positioned so as to be in the capturing position and the capturing direction received in step S105. After the generation, projection information is generated by associating each piece of information and image information of the shooting position and shooting direction with each virtual camera 12A, 12B (S109). The generation of the image information can be performed by a conventionally known application program for general-purpose computer graphics. Therefore, detailed description thereof is omitted here.

  The control unit 30 transmits the projection information generated in step S109 to the PC 24 (S111). After this, the projection information generation processing program is terminated.

  Next, the operation of the PC 24 when executing the construction support processing program will be described with reference to FIG. FIG. 7 is a flowchart showing a processing flow of the construction support processing program executed by the control unit 35 of the PC 24 when an execution instruction from the construction worker or the like is received via the input unit 37. The program is stored in advance in a predetermined area of the storage unit 39.

  First, the control unit 35 of the PC 24 determines whether or not the projection information transmitted from the PC 13 in step S111 has been received (S201). If not received (S201; N), the control unit 35 stands by as it is.

  When the projection information is received (S201; Y), the control unit 35 displays the shooting position and shooting direction included in the projection information received in step S201 as the installation position and projection direction of each projector 22A, 22B. (S203).

  FIG. 8 is a diagram showing the installation support screen 40 displayed in step 203. As shown in FIG. 8, on the construction support screen 40, the installation position and projection direction of the left projector 22A, the installation position and projection direction of the right projector 22B are displayed, and the construction operator provides information on the completion of installation. An installation completion button 41 for inputting is displayed. The construction worker confirms the installation position / projection direction of each projector 22A, 22B on the construction support screen 40, and after installing each projector 22A, 22B according to the information, the installation has been completed. The installation completion button 41 is designated to indicate

  The control unit 35 determines whether or not the projectors 22A and 22B have been installed (S205). At this time, when the installation completion button 41 is designated by the user operation, it is determined that the installation of the projectors 22A and 22B is completed.

  When the installation of the projectors 22A and 22B is completed (S205; Y), the control unit 35 projects corresponding images from the projectors 22A and 22B based on the image information included in the projection information received in step S201. (S207), and then the construction support processing program is terminated.

  9 (A) to 9 (C) are schematic side views showing a construction state of the construction object 21, and FIGS. 9 (D) to 9 (F) are construction surfaces by a plurality of projectors 22A and 22B. It is a figure which shows the lattice pattern projected on 21A.

  As shown in FIG. 9A, when the target surface A and the construction surface 21A of the construction object 21 do not match, as shown in FIG. 9D, the lattice pattern projected from the projector 22A 42 and the lattice pattern 43 projected from the projector 22B do not coincide with each other, and are displayed at shifted positions.

  As shown in FIG. 9 (B), when the construction work by the construction worker proceeds and the target surface A and the construction surface 21A of the construction object 21 are closer than shown in FIG. 9 (A), FIG. As shown in FIG. 9E, the positions of the lattice pattern 42 projected from the projector 22A and the lattice pattern 43 projected from the projector 22B are displayed at positions closer to the lattice pattern shown in FIG. The

  Thus, when the target surface A and the construction surface 21A of the construction object 21 gradually approach each other and the target surface A and the construction surface 21A coincide as shown in FIG. 9C, FIG. As shown in FIG. 4, the positions of the lattice pattern 42 projected from the projector 22A and the lattice pattern 43 projected from the projector 22B completely coincide. The construction worker can visually recognize that the construction target surface A matches the target surface A by the lattice patterns 42 and 43 projected on the construction surface 21A.

  According to the surface formation support system 1 according to the present embodiment, the PC 13 that is the information generation device uses the virtual space 10 to display the target image displayed on the predetermined target surface 11 from a plurality of preset shooting positions. Image information for each position obtained by virtually shooting in a preset shooting direction is generated, and a plurality of projectors 22A and 22B, which are a plurality of projection devices, are connected to the target plane 11 in the real space 20. A base surface (construction) that is installed so as to have the same positional relationship as the photographing position and that is obtained from the corresponding image information generated by the PC 13 that is the information generation device is used as a basis when the target surface A is formed. Projection is performed on the surface 21A) in the projection direction corresponding to the corresponding imaging direction.

  As described above, the construction worker can perform the construction on the construction surface 21A while referring to the state of the image (for example, a lattice pattern) projected on the construction surface 21A, and therefore, at a position different from the construction surface 21A. The construction can be completed in a shorter time compared to the construction with reference to the displayed measurement result of the three-dimensional position.

  Moreover, according to the surface formation support system 1, since the positional relationship between the target surface A and the construction surface 21A can be visually recognized in real time, construction and inspection can be performed at the same time, and construction completion can be regarded as inspection completion. Therefore, man-hours can be reduced. Furthermore, according to the surface formation support system 1, the construction worker can confirm the surface shape with the naked eye without using an interface such as an HMD (head mounted display) as in the existing AR (reality augmentation) technology. Are better.

  In addition, you may make it project not only the position made into a construction target but analysis results, such as performance, by utilizing the attribute information in three-dimensional CAD information. For example, the temperature distribution in the room that varies depending on the position of the wall is displayed with contour lines or color distribution.

  Moreover, as shown in FIG. 9, in this embodiment, although the case where the target surface A was a plane was shown, it is not limited to this, and even if the target surface A is a curved surface, the same procedure is used for the construction worker. Can support surface formation. In this case, when the construction surface 21A is a flat surface at the construction start stage, each line of the lattice pattern displayed as the target image is displayed as a curve. However, depending on the construction work, the construction surface 21A and the target surface A are displayed. As the curve approaches, the curve approaches a straight line.

[Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described. In addition, since the structure of the surface formation assistance system 1 which concerns on 2nd Embodiment is the same as the surface formation assistance system 1 which concerns on the said 1st Embodiment, description here is abbreviate | omitted.

  FIG. 10 is an overall configuration diagram of the surface formation support system 1 according to the second embodiment. In the surface formation support system 1 according to the first embodiment, after the relative positions of the target surface 11 and the virtual cameras 12A and 12B are set by the PC 13, the construction surface in the real space 20 is set based on the relative positions. Although the relative positions of 21A and projectors 22A and 22B are set, the surface formation support system 1 according to the second embodiment is configured to install each of the construction surface 21A and the projectors 22A and 22B in the real space 20. After the position and the projection direction are set, the installation position and the projection direction are transmitted to the PC 13, and the PC 13 compares each of the target surface 11 and the virtual cameras 12A and 12B in the virtual space 10 based on the relative positions. The position is set.

  Next, the operation of the surface formation support system 1 according to the present embodiment will be described.

  In the surface formation support system 1 according to the present embodiment, the construction support processing program is executed by the PC 24, while the projection information generation processing program is executed by the PC 13. First, the operation of the PC 24 when executing the construction support processing program will be described with reference to FIG. In addition, FIG. 11 is a flowchart which shows the flow of a process of the construction assistance process program performed by the control part 35 of PC24, when the execution instruction from a construction worker etc. is received via the input part 32, The program is stored in the storage unit 39 in advance.

  First, the control unit 35 of the PC 24 causes the display unit 38 to display input screens for the installation positions and projection directions of the plurality of projectors 22A and 22B (S301). FIG. 12 is a diagram showing an input screen 44 for inputting the installation positions and projection directions of the projectors 22A and 22B. As shown in FIG. 12, the input screen 44 has input fields 45 for the installation positions and projection directions of the left projector 22A and the right projector 22B, and a transmission button for inputting an instruction to transmit the input information. 46. When starting the construction work, the construction worker sets the installation positions and projection directions of the projectors 22A and 22B with respect to the construction object 21 in the real space 20, and inputs each information into each input field 45 via the input unit 37. After that, the send button 46 is designated.

  The control unit 35 determines whether or not input of installation positions / projection directions of the plurality of projectors 22A and 22B has been received (S302). At this time, when the transmission button 46 is designated on the input screen 44, it is determined that the input has been accepted. When the input is not accepted (S302; N), the control unit 35 waits until the input is accepted.

  When the input is accepted (S302; Y), the control unit 35 transmits the input information on the installation positions and projection directions of the plurality of projectors 22A and 22B to the PC 14 via the communication unit 36 (S303). . And PC13 which received the information of an installation position and a projection direction performs the projection information generation process which produces | generates projection information based on such information.

  FIG. 13 is a flowchart showing a flow of processing of a projection information generation processing program executed by the control unit 30 of the PC 13 when information on the installation position and the projection direction is received from the PC 24, and the program is stored in the storage unit 34. Pre-stored in the program area 34b.

  The control unit 30 of the PC 13 determines whether or not the installation position and projection direction information transmitted from the PC 24 in step S303 has been received (S401). If not received (S401; N), the control unit 30 stands by until it is received. When the information on the installation position and the projection direction is received (S401; Y), the control unit 30 reads out the three-dimensional CAD information corresponding to the building including the construction object 21 from the storage unit 34 (S403).

  The control unit 30 receives an instruction to select the target surface 11 to be constructed in the construction object 21 (S404). At this time, for example, the control unit 30 generates a three-dimensional CAD model from the three-dimensional CAD information read out in step S403 and causes the display unit 33 to display the three-dimensional CAD model. An instruction to select the target surface 11 is accepted by selecting any surface from the model.

  The control unit 30 virtually constructs the target surface 11 from the three-dimensional CAD information read in step S403, and virtually draws a lattice pattern on the target surface 11 (S405).

  The control unit 30 shows images taken by the virtual cameras 12A and 12B when the virtual cameras 12A and 12B are positioned so as to be in the shooting position and shooting direction corresponding to the installation position and projection direction received in step S401. After the image information is generated, projection information in which the information on the shooting position and the shooting direction and the image information are associated with each virtual camera 12A, 12B is generated (S407). Then, the control unit 30 transmits the projection information generated in step S407 to the PC 24 (S409).

  The control unit 35 of the PC 24 determines whether or not the projection information transmitted from the PC 13 in step S409 has been received (S305). If not received (S305; N), the control unit 35 waits until reception.

  When the projection information is received (S305; Y), the control unit 35 projects the corresponding images from the plurality of projectors 22A and 22B based on the image information included in the received projection information (S307), and thereafter This construction support processing program ends.

  As described above, according to the surface formation support system 1, the PC 13 that is the information generation device receives the input of the installation positions and projection directions of the projectors 22 </ b> A and 22 </ b> B that are the plurality of projection devices in the real space 20. Screen 44 and input unit 37), and the projection position and projection direction received by the receiving means are set as the respective shooting positions and shooting directions with respect to the target plane 11 in the virtual space 10. Thereby, the construction worker installs the projectors 22A and 22B, which are a plurality of projection devices, in the real space 20 in advance, and the installation positions and projections of the projectors 22A and 22B which are the plurality of projectors installed. Since the image information for each position can be generated in the virtual space 10 based on the direction, the projectors 22A and 22B as the projection devices are positioned in the shooting position and shooting direction set in the PC 13 as the information generation device. Compared to the above, the installation work of the projectors 22A and 22B, which are projection apparatuses, can be easily performed.

  According to the first and second embodiments, the construction worker depends on the position and shape of the surface for the difference in position between the target surface that is not actually shaped and the surface that is actually being constructed. Therefore, the effect of being able to grasp visually in real time during construction work can be obtained.

[Third Embodiment]
Hereinafter, a third embodiment of the present invention will be described.

  The surface formation support system 1 according to the first embodiment and the second embodiment supports the construction work of the construction worker by projecting the projection information generated by the PC 13 onto the construction surface 21A of the real space 20. However, the surface formation support system 1 according to the third embodiment automatically derives the difference between the construction surface 21A and the target surface A and automatically matches the target surface A and the construction surface 21A. It is to perform construction.

  First, with reference to FIG. 14, the structure of the surface formation assistance system 1 which concerns on this 3rd Embodiment is demonstrated. FIG. 14 is a block diagram illustrating an electrical main configuration of the surface formation support system 1 according to the third embodiment. Note that the same components in FIG. 3 as those in FIG. 3 are denoted by the same reference numerals as those in FIG.

  As shown in the figure, the surface forming support system 1 according to the third embodiment is configured to be capable of spraying urethane foam, and a spray unit 25 whose spray direction and spray amount are variable is newly provided. This is different from the first and second embodiments.

  The spraying unit 25 is connected to the PC 24, and the blowing direction and amount of urethane foam sprayed by the spraying unit 25 are controlled by the control unit 35 of the PC 24.

  FIG. 15A is a schematic front view for explaining a method for deriving a deviation amount between the target surface A and the construction surface 21A, and FIG. 15B explains a method for deriving the deviation amount. FIG. As shown in FIG. 15A, when the target surface A and the construction surface 21A do not coincide with each other, the lattice pattern projected from the projector 22A and the lattice pattern projected from the projector 22B onto the construction surface 21A are obtained. Deviation occurs. FIG. 15 (B) shows that the amount of shift of each of these lattice patterns is L, the distance between the projector 22A and the projector 22B is L ′, and the distance from each projector 22A, 22B to the target plane A is R. As shown, the distance t between the target surface A and the construction surface 21A can be obtained by the equation t = R × L ÷ L ′, and this can be used as a deviation amount.

  Next, the operation of the surface formation support system 1 according to the present embodiment will be described.

  In the surface formation support system 1 according to the present embodiment, the projection information support processing program (see FIG. 6) similar to that of the first embodiment is executed by the PC 13, while the construction processing program is executed by the PC 24. Then, with reference to FIG. 16, the effect | action of PC24 at the time of executing a construction processing program is demonstrated. FIG. 16 is a flowchart showing the flow of processing of a construction processing program executed by the control unit 35 of the PC 24 when an execution instruction from a construction worker or the like is received via the input unit 32. The program is stored in the storage unit 39 in advance.

  First, the control unit 35 of the PC 24 determines whether or not the projection information transmitted from the PC 13 in step S111 has been received (S501). If not received (S501; N), the control unit 35 waits until reception.

  When the projection information is received (S501; Y), the control unit 35 displays the shooting position and shooting direction included in the projection information received in step S501 on the display unit 38 as the projection position and projection direction of the projectors 22A and 22B. Is displayed (S503). At this time, the control unit 35 may display the construction support screen 40 as shown in FIG. 8 on the display unit 38 as in step S203. The construction worker confirms the installation position / projection direction of each projector 22A, 22B on the construction support screen 40, and after installing each projector 22A, 22B based on the information, the installation is completed. In order to indicate this, the installation completion button 41 is selected.

  The control unit 35 determines whether or not the projectors 22A and 22B have been installed (S505). At this time, it is determined that the installation of the projectors 22A and 22B has been completed based on the selection of the installation completion button 41 by the user operation.

  Based on the image information included in the projection information received in step S501, the control unit 35 projects the corresponding images (here, lattice patterns) from the projectors 22A and 22B onto the construction surface 21A (S507).

  The control unit 35 photographs the construction surface 21A on which the lattice pattern is projected in step S507 with the camera 23 (S509). Then, the control unit 35 calculates the distance t from the image captured by the camera 23 based on the distance between the corresponding points of the lattice pattern projected from the projector 22A and the lattice pattern projected from the projector 22B. Thus, the amount of deviation is derived (S511).

  The control unit 35 determines whether any deviation amount derived in step S511 is greater than or equal to a predetermined value (S513). The predetermined value at this time is an absolute value in a range that can be regarded as an error when the target surface A and the construction surface 21A are matched, and the control unit 35 sets the construction target if the deviation amount is less than the predetermined value. It is determined that the surface A and the construction surface 21A match.

  When the absolute value of any deviation amount is equal to or greater than the predetermined value (S513; Y), the control unit 35 determines that the surface A to be constructed and the construction surface 21A do not match, and the step The spraying portion 25 is controlled so as to spray an amount of foamed urethane corresponding to the amount of deviation derived in S511 to a corresponding position on the construction surface 21A (S515). Then, the process of step S511 is performed again.

  On the other hand, when the absolute values of all the deviation amounts are not equal to or larger than the predetermined value (S513; N), the control unit 35 determines that the target surface A and the construction surface 21A coincide with each other, and the construction processing is completed. As a thing, this construction processing program is complete | finished.

  In this way, in the surface formation support system 1, the virtual cameras 12A and 12B, which are imaging devices, are placed at predetermined positions where the images projected from the projectors 22A, 22B, which are a plurality of projection devices, are captured within one angle of view. The virtual space 10 is installed based on the amount of deviation between the images projected by the projectors 22A and 22B, which are a plurality of projection devices, in the image taken by the PC 24 that is a measurement device and is photographed by the camera 23 that is a photographing device. The physical quantity indicating the amount of deviation between the position of the target surface 11 in the real space 20 and the position of the projection surface (construction surface 21A) in the real space 20 is measured, and the physical quantity measured by the measuring device in the real space 20 is shifted by the surface forming apparatus. The target surface A is formed with respect to the foundation surface (construction surface 21A) so as to minimize the amount.

  Further, in each of the above embodiments, the case where the PC 24, the projectors 22A and 22B, and the camera 23 used in real space are individually configured as a single device has been described, but the present invention is not limited to this, It is good also as a form which comprises these apparatuses integrally.

  FIG. 17 shows an example of an apparatus 1A configured integrally in this case. In this apparatus 1A, projectors 22A and 22B similar to those in the above embodiments are provided in two horizontal positions on the front surface of the apparatus, and a camera 23 similar to that in the above embodiments is provided in the center of the apparatus front surface. . In this case, it is possible to further improve convenience by making the apparatus 1A a size that can be carried by a construction worker and enabling communication with the PC 13 wirelessly.

  Moreover, although each said embodiment demonstrated the case where this invention was applied to the system which supports the construction which matches the height of a construction surface with a target surface, this invention can be applied to other various systems. .

  For example, as shown in FIG. 18 as an example, the camera 23 sequentially changes the projection direction of the image from each projector so that the position in the height direction of the target plane where the images projected from each projector match. The present invention may be applied to a form in which the image is captured by the above and the shape of the construction surface with respect to the height direction is grasped based on the projection direction in which the images obtained by the photographing match.

  In addition, for example, as shown in FIG. 19A as an example, the present invention is applied to a system in which a gradient angle of a gradient surface provided to become a target gradient angle is set to be the target gradient angle. As an example, as shown in FIG. 19 (B), the interior finishing member provided so that the surface has a target height is applied to a system that is installed so as to have the target height. You may apply this invention to the other system constructed so that a height position may turn into a target position.

  Further, for example, as shown in FIG. 19C as an example, a form applied to a system for measuring the accuracy of curved surface finishing, as an example, as shown in FIG. 19D, a gradient is automatically calculated and contour lines are projected. Thus, the present invention may be applied to other systems that measure the height position of the surface, such as a form that is applied to a system that measures a water gradient.

  According to the third embodiment, the construction apparatus determines the amount of deviation between the target surface A and the construction surface 21A from the difference in position between the target surface A that is not actually shaped and the construction surface 21A that is actually constructed. The effect that it can measure in real time and can form the surface A made into a construction target automatically and with high precision by performing construction processing based on the deviation | shift amount is acquired.

  DESCRIPTION OF SYMBOLS 1 ... Surface formation support system, 1A ... Surface formation support apparatus, 10 ... Virtual space, 11 ... Target surface, 12A, 12B ... Virtual camera, 13 ... PC, 20 ... Real space, 21 ... Construction object, 21A ... Construction surface 22A, 22B ... projector, 23 ... camera, 24 ... PC, 30, 35 ... control unit, 31, 36 ... communication unit, 32, 37 ... input unit, 33, 38 ... display unit, 34, 39 ... storage unit, 40 ... Installation support screen, 41 ... Installation complete button, 42 ... Grid pattern projected by left projector, 43 ... Grid pattern projected by right projector, 44 ... Input screen, 45 ... Input field, 46 ... Send button , A ... Target plane

Claims (6)

Image information for each shooting position obtained by virtually shooting a predetermined image displayed on a predetermined target plane in a virtual space from a plurality of preset shooting positions in a preset shooting direction. An information generating device to generate;
In real space, with respect to the formation target surface corresponding to the target surface, each image is set to have the same positional relationship as the plurality of shooting positions with respect to the target surface, and the image indicated by the corresponding image information is A plurality of projection devices for projecting toward a projection direction corresponding to the imaging direction on a basic surface serving as a basis for forming a formation target surface;
Surface formation support system with The information generation apparatus includes a reception unit that receives an input of each installation position and projection direction of each of the plurality of projection apparatuses in the real space, and each of the plurality of installation positions and the projection direction received by the reception unit. The surface formation support system according to claim 1, wherein a plurality of the photographing positions and the photographing directions are set. A photographing device for photographing an image projected from each of the plurality of projection devices;
Based on the amount of deviation between images projected from each of the plurality of projection devices in the image photographed by the photographing device, a physical quantity indicating the amount of deviation of the formation target surface and the base surface with respect to the projection direction is measured. A measuring device to
A surface forming device that forms the target surface with respect to the base surface so that a physical quantity measured by the measuring device is within a predetermined range;
The surface formation support system according to claim 1, further comprising: The predetermined image is a lattice pattern image,
The measurement device measures the physical quantity based on a shift amount of a corresponding lattice point between images projected from each of the plurality of projection devices in an image photographed by the photographing device. Item 4. The surface formation support system according to Item 3. Image information for each shooting position obtained by virtually shooting a predetermined image displayed on a predetermined target plane in a virtual space from a plurality of preset shooting positions in a preset shooting direction. Information generating means for generating;
In real space, with respect to the formation target surface corresponding to the target surface, each image is set to have the same positional relationship as the plurality of shooting positions with respect to the target surface, and the image indicated by the corresponding image information is A plurality of projection means for projecting toward a projection direction corresponding to the imaging direction on a base plane that is a basis for forming a target plane;
A surface forming support device. Image information for each shooting position obtained by virtually shooting a predetermined image displayed on a predetermined target plane in a virtual space from a plurality of preset shooting positions in a preset shooting direction. An information generation step to generate;
In the real space, the image corresponding to the plurality of projection devices respectively installed so as to have the same positional relationship as the plurality of photographing positions with respect to the target surface with respect to the formation target surface corresponding to the target surface A projecting step of projecting an image indicated by the information onto a base plane serving as a basis for forming the target plane in the projection direction corresponding to the photographing direction;
Surface formation support program for causing a computer to execute.