JP3251557B2 - Wall image / damage / repair information registration management system and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mosaic image for repairing a disease or damage on a wall, and registration and management of information relating to the disease, damage, and repair history, and an image of the wall, damage, and the like.
The present invention relates to a repair information registration management system and method.

[0002]

2. Description of the Related Art Mural paintings have valuable information about each country, religion, lifestyle, customs, and other historically valuable information at that time. The older it is, the more natural it is, as a matter of course, over time or due to its preservation conditions, partial defects, diseases such as fouling, cracking, alteration, etc.
It requires a great deal of time, labor and technology to identify and repair them.

[0003] The murals to be actually rehabilitated, etc., vary not only in the size of the buildings and the size of the murals, but also in the positions of the murals, and generally cannot be moved or transported. is there. Therefore, when repairing a mural, conventionally, first, photogrammetry based on analog photographs is performed to plot the mural, and based on the image, the state evaluation,
Identify the disease and consider repair. In traditional photogrammetry,
Orientation points are set and measured on the measurement target surface, and the scale of the photograph, the tilt of the camera, and the position of the camera are calculated using the three-dimensional coordinates of the orientation points to obtain the orientation elements.

[0004] However, in photogrammetry based on analog photography, which has been used for plotting murals, very expensive equipment such as a measuring camera and an analytical plotter is used. The workload of the operator was heavy, and stereophonic viewing by a skilled operator was indispensable for plotting.

[0005]

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and can create a high-resolution mosaic image without setting and measuring control points, managing disease and damage, and managing repair information. Can be easily performed.

For this purpose, the present invention provides a wall image / damage / repair information registration / management system for creating a mosaic image for repairing a disease / damage on a wall, registering and managing information relating to the disease / damage / repair history. A photographed image registration processing means for registering a photographed image and photographing information composed of left and right index images obtained by photographing the entire wall surface and a detailed image obtained by dividing the wall surface, and registration by the photographed image registration processing means. Shape information creation processing means for determining a shooting position and a shooting direction of an image based on a plurality of corresponding points designated on the plurality of images thus created to create three-dimensional shape information of the target object; Image conversion processing means for converting the captured image from an image of central projection to an image of orthographic projection or a developed image based on shooting direction and object shape information; Mosaic processing means for creating a mosaic image by joining orthographically projected or developed images, and information and repair history of the disease or damage to the wall with a mosaic image based on the detailed image created by the mosaic processing means as a background Repair information management means for registering and managing information, performing the creation of the three-dimensional shape information based on the left and right index images, and performing the mosaic processing of the detailed image using the three-dimensional shape information. And a mosaic image of the wall is formed.

[0007]

[0008] Further, as a method for registering and managing information relating to disease, damage, and repair history, creating a mosaic image for repairing disease and damage to a wall, and managing and registering image / damage and repair information for a wall, a camera is used. The left and right index images of the entire wall surface are photographed, the wall surface is divided and overlapped with the adjacent one to photograph a plurality of detailed images, and the orientation of the image is performed by specifying corresponding points on the left and right index images. The photographing position and photographing direction of the index image are determined, and three-dimensional shape information of the object is created based on the left and right index images, photographing position and photographing direction, and the left and right images are formed based on the photographing position, photographing direction and shape information. Convert the index image into an orthographic projection image, and perform image orientation by specifying corresponding points with the left and right index images on the plurality of detailed images The photographing position of the detailed image, the photographing direction are determined, the photographing position of the detailed image, the photographing direction, the detailed image is converted into an orthographic projection image based on the shape information, and the orthographic projection image based on the detailed image is joined. A mosaic image, and registering and managing damage / repair information with the mosaic image as a background.

[0009]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an embodiment of a wall image / damage / repair information registration / management system according to the present invention, and FIG. 2 is a hardware configuration of a wall image / damage / repair information registration / management system according to the present invention. FIG. 3 is a diagram for explaining the overall processing flow of the wall image / damage / repair information registration management system according to the present invention, and FIG. 4 is a diagram for explaining the processing flow of the index image and the detailed image. FIG. 5 and FIG. 5 are diagrams for explaining the entire index image and the detailed image to be captured. In the figure, 1 is an arithmetic processing unit, 2 is a database, 3 is a photographing unit, 4 is an input unit, 5 is an output unit, 11 is a photographed image registration unit, 12 is an image preprocessing unit, 13 is an image orientation unit, 14 Is the DTM creation unit, 15
Is an image orthographic conversion unit, 16 is a mosaic processing unit, 17 is an image data registration unit, 18 is a restoration information registration unit, 19 is a restoration information management unit, 21 is a work management data file, 22 is a captured image data file, and 23 is An object three-dimensional data file, 24 an ortho image data file, 25 a mosaic image data file, 26 a basic information data file,
27 indicates a restoration history data file.

In FIG. 1, an arithmetic processing unit 1 registers photographed image data photographed by a digital camera, corrects the sensitivity characteristics of the camera (pre-processing), and adjusts the photographing position and direction of the image. Decision (orientation), creation of DTM, conversion of orthographic projection to orthoimage, creation of mosaic image, registration of image data, registration of disease data, disease contents, restoration history information, etc., management of restoration history information, etc. It has each processing means and is composed of, for example, a computer (PC) as shown in FIG. The photographed image includes an entire index image of a mural photographed by a stereo camera and a detailed image overlapped with an adjacent image.

The database 2 includes photographed image data, additional information such as photographing conditions, three-dimensional data of an object obtained by processing the data by the arithmetic processing unit 1, ortho images, mosaic images, image data for mural painting restoration, It has files for storing data such as basic information and restoration history, and is composed of a storage device such as an MO or DVD as shown in FIG. 2, for example.

The photographing section 3 captures an index image of the entire mural to be restored and a detailed image obtained by dividing the mural in detail. For example, as shown in FIG. 2, lighting equipment, a megapixel digital camera, etc. Consists of The input unit 4 inputs additional information such as a photographing condition when registering photographed image data including an index image and a detailed image photographed by the photograph photographing unit 3 and designates a corresponding point at the time of image processing. And inputs necessary processing information to the arithmetic processing unit 1 and necessary information, and includes, for example, a keyboard, a mouse, a digitizer, and an image scanner as shown in FIG. The output unit 5 outputs the results and progress of the processing in the arithmetic processing device 1, the database 2
And outputs the data stored in the printer, for example, as shown in FIG.

Each processing means of the arithmetic processing unit 1 is as follows. The photographed image registration unit 11 performs a process of storing data of an index image and a detailed image photographed by a digital camera together with additional information such as photographing conditions in a photographed image data file 22 and a work management data file 21 of the database 2. is there. Image preprocessing unit 1
Numeral 2 is a processing for correcting the sensitivity characteristic of the camera so that data obtained by photographing the same object has the same value. The correction table to be used is set in advance by camera calibration. Even if you shoot the same object under the same shooting conditions,
There are cases where there is a difference in data values between images taken by different cameras. This is because the sensitivity characteristics differ depending on the camera. Unless this sensitivity characteristic is corrected, when performing mosaicing of an image described later, a difference occurs in brightness and color tone for each image. Become. The pre-processing is performed to solve such a problem.

The image orientation unit 13 performs a process of determining a photographing position and a photographing direction of an image by designating corresponding points on a plurality of images. In the orientation of the index image, the same point is selected on the left and right images, and three or more points on the reference plane are specified. In the orientation of the detailed image, the same point is selected on the entire index image and the detailed image. The DTM creating unit 14 automatically searches for corresponding points from the left and right index images (stereo matching) based on the orientation of the index images, thereby obtaining the shape information (DTM) of the object necessary to create the ortho image, for example. A process of acquiring the coordinates at the coordinates of x, y, and z is performed, and the data is stored in the object three-dimensional data file 23. An orthoimage is an orthographic image projected on an arbitrary projection surface and having planar distance accuracy. The image orthographic conversion unit 15 performs a process of converting the central projection image into a parallel projection image (orthogonal projection image / ortho image), and these data are stored in an ortho image data file 24.

The mosaic processing unit 16 performs a process of joining adjacent ortho images, and their data is stored in a mosaic image data file 25.
Mosaic is performed by performing registration and color matching using overlapping parts of adjacent images and joining them together.
There are vertical, horizontal, vertical and horizontal, and diagonal mosaics. Density correction, alignment, and unification of coordinate systems that match different shades and colors of each image using the image of the overlapping portion are executed as needed. The above is the image processing system.

The image data registration unit 17 registers basic information such as a cave number, a mural number, and an age of a mural image mosaiced by the image processing system in the basic information data file 26. The repair information registration unit 18 displays a mural image on a screen, and performs a process of inputting and registering disease data, disease contents, repair history information, and the like with the image as a background, and the data is stored in a repair history data file. 27 is registered. The repair information management unit 18 searches for the repair information and displays the result on the screen. The mural image is called on the screen, the disease graphic is selected, the repair history information is displayed, and the content of the repair history information is displayed. To call up the corresponding mural image on the screen, to display the history information thereof, and to print a form or drawing. The above is the restoration history management system.

The overall processing flow of the image / damage / repair information registration / management system for a wall having the above configuration will be described. As shown in FIG. 3, first, an index image and a detailed image are photographed by a digital camera (step S11), and photographed images of the index image and the detailed image and their photographing information (additional information such as photographing conditions) are registered (step S1).
2). Next, the index image is processed based on the specification of the index image, the photographing information, and the corresponding point (step S13), and the index image obtained by the processing of step S13 and the three-dimensional object data, a detailed image,
Processing of the detailed image is performed based on the designation of the shooting information and the corresponding point (step S14). Through the above processing, a detailed ortho mosaic image of a mural, which is an orthographic projection image with planar distance accuracy projected on an arbitrary projection surface, can be obtained.

When a mosaic image of the detailed ortho image is obtained, a mosaiced wall image is selected as image data registration processing and attribute information is registered (step S15). Thereafter, while displaying the wall image on the screen, disease data, disease content, and restoration history information are input with this image as a background (step S16). Then, the repair information is searched and displayed on the screen, and the search result is output as a form or drawing to manage the repair history information (step S17). In the search of the repair history information, for example, call the mural image on the screen, select the disease figure and display the repair history information, or specify the content of the repair history information, call the corresponding mural image on the screen, and display the history information. Display. As described above, when the mural is repaired, the orthographic image is obtained in a non-contact manner without installing and measuring the control points on the mural to be measured, and registration of the repair information, management of the history, and the like are performed. To perform the processing,
It uses a two-step photography method.

In the photographing of the index image and the detailed image in step S11, the entire mural is photographed with a stereo camera as shown in FIG. 5A, and this image is used as an index image, and as shown in FIG. Each part is photographed only for a part of the divided mural, and this image is used as a detailed image. In this case, in photographing the detailed image, the photographing is performed so as to overlap the adjacent detailed image by, for example, about 30% so that there is no omission in photographing. For example, if the size of the mural is 5 m x 5 m, and a picture is taken with a digital camera having one million pixels, one pixel of the index image is 5 mm x 5 mm on the mural. Similarly, when the photographing range of the detailed image is 1 m × 1 m on the mural, one pixel of the detailed image becomes 5 mm × 5 mm on the mural when photographed with a digital camera having 1 million pixels.

Further, in the processing of the entire index image in step S13, the sensitivity characteristic of the camera is corrected as shown in FIG. 4A so that data obtained by photographing the same object has the same value. Pre-processing ”(step S21),
“Image orientation” for determining the image capturing position and image capturing direction by specifying target points on a plurality of images (step S
22) “DTM creation” for acquiring shape information (DTM) of the object necessary for creating an ortho image (step S23), and converting the center projection image into a parallel projection image (orthographic image / ortho image) Then, "orthogonal transformation of image" (step S24) and "creation of mosaic image" (step S25) in which a plurality of ortho images are joined to form a mosaic image are sequentially performed. In the processing of the detailed image in step S14, similarly to the processing of the entire index image, as shown in FIG. 4B, "image preprocessing" (step S31), "image orientation"
(Step S32), “Orthogonal transformation of image” (Step S32)
33), "Mosaic image creation" (step S34) is sequentially performed.

Each of the above processes will be described in more detail. First, processing of an index image will be described. FIG. 6 is a diagram for explaining shooting of an index image, FIG. 7 is a diagram for explaining a flow of an index image registration process,
FIG. 8 is a diagram for explaining the flow of the pre-processing of the index image, FIG. 9 is a diagram for explaining the flow of the orientation process of the index image, and FIG. 10 is a DTM from the index image.
FIG. 11 is a diagram for explaining a flow of a creation process, FIG. 11 is a diagram for explaining a flow of an orthographic conversion process of an index image, FIG. 12 is a diagram showing an example of correspondence between processed images, and FIG. It is a figure for explaining the flow of mosaic processing.

First, as shown in FIG. 6, in the photographing of the index image, as a preparation before photographing by on-site work, installation of a floor sheet, vertical and horizontal sizes of a target mural, a distance of a camera pull, and the like, local dimensions by convex. Measurement and determine the shooting conditions such as the local dimensions, the camera focal length, the distance between the cameras, the angle of the camera, the height of the camera, etc., and create a shooting plan. Then, by determining the camera position and photographing the mural, the photographed images are acquired as left and right index images. Additional information such as shooting conditions at this time includes, for example, file name, shooting date and time, camera I
D, shooting location (left or right), shooting method (parallel shooting or convergent shooting), shooting position (approximate distance from left wall), approximate distance to target, camera height, camera angle, target Approximate size of objects, distance between cameras, presence and size of scale,
There is information such as aperture value and shutter speed.

In the registration processing of the index image, as shown in FIG. 7, the data of the whole photographed image photographed by the camera is transferred online or offline to an image / damage / repair information registration / management system of a wall surface of a personal computer or the like. It is registered in the photographed image data file 22 and the work management data file 21 together with the photographing information.

In the pre-processing of the index image, as shown in FIG. 8, the left and right index images are corrected based on a correction table previously set in the work management data file 22 by, for example, correcting for peripheral dimming (optical system) or CCD. The characteristics of the camera such as sensitivity adjustment (electronic system) are corrected by conversion of data or the like, so that data obtained by photographing the same object has the same value. This correction table is created by a camera calibration in advance such as calibration using a gray scale or calibration using a color chart.

In the index image orientation process, as shown in FIG. 9, the corresponding points on the left and right images are designated based on the left and right index images subjected to the pre-processing and their photographing information, and orientation is performed. The photographing position and photographing direction are determined. In this case, three or more points located on the reference plane are selected from the selected points, and a distance between two points or a distance between two cameras is given. For example, the distance between two points can be given by imprinting a scale bar on an image and selecting points at both ends of the scale bar.

In the DTM creation process from the next index image, a corresponding point is automatically searched (stereo matching) based on the left and right index images, the photographing position, and the photographing direction as shown in FIG. Here, FIG. 12 (A) are shown so obtained image coordinates of the corresponding point (I _L, J _L) and (I _R, J _R) from object space coordinates (X of corresponding points, Y,
Calculate the Z), Z _G of the lattice points by interpolation (X _G, Y _G)
The coordinates are obtained and stored in the object three-dimensional data file 24 as object three-dimensional data.

In the orthographic transformation process of the index image, as shown in FIG. 11, based on the photographing position, photographing direction, index image, and three-dimensional object data, (X _G , Y _G ,
(I _G , J _G ) is calculated from Z _G ), and as shown in FIG. 12B, the data of the photographed image corresponding to (I _G , J _G ) is obtained, and the image data is represented by (X _G , J _G ). Y _G , Z _G ) are taken as orthographic image data.

In the mosaic processing of the index images, the orthographically transformed left and right index images are joined as shown in FIG. In this case, a joining line to be joined at a pixel having the smallest difference between the data values of the left image and the right image for each line is determined as shown in FIG. 13B, and a fixed width on both sides of the joining line is determined as a joining processing range. To perform the smoothing process.

Next, the processing of the detailed image will be described.
FIG. 14 is a diagram for explaining camera shooting of a detailed image, FIG. 15 is a diagram for explaining the flow of a detailed image registration process,
16 is a diagram for explaining the flow of the orientation processing of the detailed image, FIG. 17 is a diagram for explaining the flow of the orthographic conversion process of the detailed image, FIG. 18 is a diagram showing an example of correspondence between the processed images, FIG. 19 is a diagram for explaining the flow of the mosaic processing of the detailed image.

First, in the camera shooting of the detailed image, a shooting plan is created based on the index image and the shooting conditions as shown in FIG. 14, as in the case of the camera shooting of the index image. Then, the camera position is determined, and the captured image is obtained as a detailed image by capturing the detailed image.

In the registration process of the detailed image, as shown in FIG. 15, the data of the detailed image taken by the camera as the detailed image is transferred online or offline to the image / damage / repair information registration / management system of a wall surface such as a personal computer. Thus, the information is registered in the photographed image data file 22 and the work management data file 21 together with the photographing information. At this time, the index image is not necessarily required, but can be used for confirming the position of the photographed portion.

The pre-processing of the detailed image is the same as the pre-processing of the index image shown in FIG. 8. In the orientation processing of the detailed image, as shown in FIG. Based on the information, the processed index image, and the three-dimensional data of the object, orientation is performed by designating corresponding points on two images, a detailed image and an index image, as shown in FIG. Determine the position and shooting direction.

In the orthographic conversion processing of the detailed image, as shown in FIG. 17, based on the photographing position, photographing direction, detailed image, and three-dimensional data of the object determined by locating the detailed image, (X
(I _G , J _G ) is calculated from _G , Y _G , Z _G ), and FIG.
As shown in _{(B) (I G, J} G) seeking data of the captured image corresponding to the image data (X _G, Y _G, Z
_G ) Orthogonal image data at the position.

In the detailed image mosaic processing, as shown in FIG. 19B, as shown in FIG. 19B, based on the N orthographically transformed detailed images and the detailed orthorectified images as shown in FIG. The images are joined in an overlapping area, and N pieces of patchwork are pasted together to perform a smoothing process to create a detailed mosaic image. That is, as shown in FIG. 19B, image data for each detailed ortho image is pasted into a detailed ortho mosaic image file having a size that covers the entire object. After adjusting the brightness and color so that the brightness and color tone of each detailed ortho image become the same brightness and color tone as the corresponding portion in the index image, the brightness and color are adjusted to the corresponding positions in the detailed ortho mosaic image file. Write image data.

In normal photogrammetry, a photo control point is set and measured on a surface to be measured, and the scale of the photograph, the tilt of the camera, and the position of the camera are calculated using the three-dimensional coordinates of the photo control point to obtain a photo control element. According to the present invention, the orientation elements are calculated without fixing the orientation points on the measurement target, by fixing the distance between the cameras or printing two signs having the fixed distances on the photograph. In addition, in normal measurement, shooting is performed using an expensive measurement camera, negatives are read by a scanner and digital ortho is created, but in the present invention, shooting is performed using a commercially available digital camera, and a large area is taken. On the other hand, since a method is used in which a plurality of pieces of image data obtained by dividing and photographing are respectively ortho-processed and then combined with one image by mosaic processing, a high-resolution ortho-image can be obtained. Of course, it is also possible to perform measurement by reading from the negative with a scanner.

In the restoration of the mural, the ortho image created as described above is incorporated into the background data, the disease information is managed by graphic data having coordinate values, and the repair information for the disease is managed as a history like a medical chart. . The processing related to registration of repair information and history management will be described below.

FIG. 20 is a diagram for explaining the flow of image data registration processing, FIG. 21 is a diagram showing an example of a system initial screen and an image registration screen, and FIG. 22 is a diagram showing an example of a registration screen. 23 shows an example of a registered image display screen and a correction screen, FIG. 24 shows an example of a correction screen, and FIG. 25 shows an example of a deletion screen.

In the process of registering image data, as shown in FIG. 20, a mosaic image mosaiced from a detailed mosaic image file is displayed in a list, an image to be registered in the system is selected, a cave number, a mural number, an age, etc. Is registered in the basic information data file. Then, in the correction of registered contents to correct those registered basic information, select the cave number and mural number you want to correct, correct the attribute contents,
Update the basic information data file. In the deletion of the registered contents for deleting the registered mural image file, the cave number and the mural number to be deleted are selected and the registered mural image file is deleted from the basic information data file.

The following is a description of an example of a screen. On the system initial screen, as shown in FIG. 21, a main menu including items of image registration, wall surface calling, restoration information input, and restoration information management is displayed. When image registration → registration is selected from here, it is possible to shift to a graphic (mural mosaic image) file registration and attribute registration (attribute registration ON) screen shown in FIG. When the file type is input and attribute registration is selected, the screen can be changed to that screen. When the attribute registration image display is selected, the image display screen of FIG. 23A can be changed. When the user selects “modify” from the image registration screen shown in FIG. 21, the screen can be changed to the mural selection screen shown in FIG. 23. By inputting a cave number, the screen is changed to the attribute correction screen shown in FIG. Becomes possible. When "delete" is selected from the image registration screen in FIG. 21, it is possible to make a transition to the mural selection screen in FIG. 25 and further to an image display screen by image display.

FIG. 26 is a diagram for explaining the flow of the repair information registration process, FIG. 27 is a diagram showing an example of a screen call screen, FIG. 28 is a diagram showing an example of a display control screen, and FIG. FIG. 30 is a diagram showing an example of a disease range input screen, and FIG. 31 is a diagram showing an example of a disease information input screen.

In the restoration information registration processing, as shown in FIG. 26, the mosaic image mosaiced from the detailed mosaic image data file and the basic information data file is displayed on the screen by the cave number and the mural number, and the disease information and the repair information are displayed. , The data on the diseased area is stored in the restoration history data file with the called detailed mosaic image as a background. After that, when the disease information is further input, the disease figures and attributes (basic disease information, repair history information)
Select the disease shape, its attributes (disease type, repair history,
Repair method, reagent, etc.). Note that the history of the repair information in the attribute can be managed. Similarly, when modifying disease information, disease figures, attributes (basic disease information,
(Repair history information) is selected, and the disease graphic once input or its attribute content is corrected, and when the disease information is deleted, the disease area graphic once input is deleted. At this time, the attribute information is also deleted at the same time.

The following is a description of an example of a screen. When the mural call is selected on the system initial screen, a transition can be made to the mural selection screen and the mural display screen of FIG. 27, and scrolling, zooming, redrawing, and display control can be performed. Here, when the display control button is selected, the mold and salt damage shown in FIG.
A transition to a display control screen for basic disease information such as peeling, peeling, and hollowing is possible. When the user selects input of repair information on the initial screen of the system, it is possible to make a transition to the repair information input screen of FIG. 29, and by selecting an input therefrom, it becomes possible to make a transition from the screen of FIG. 29 to each screen of FIG. It is possible to input a range (graphic), a disease range (attribute), and disease information.

FIG. 32 is a diagram for explaining the flow of a repair information management process, FIG. 33 is a diagram showing an example of a repair information management screen and a search result display screen, and FIG. 34 is a detailed screen of a search result display dialog. FIG. 35 is a diagram showing an example of an attribute search screen, and FIGS. 36 and 37 are diagrams showing examples of an information search result display screen.

In the repair information management process, as shown in FIG. 32, the mosaic image mosaiced from the detailed mosaic image data file is displayed on the screen by the cave number and the mural number.
Search the repair history information and display the result on the screen. At this time, in the case of attribute search from a figure, the figure whose repair history information is desired is clicked and selected, and the repair history information is displayed on the screen. Also, when searching for the mural from the attribute, set search conditions such as cave number, mural number, disease type, date of restoration, etc., display the list and number of applicable murals, and want to display from the list Select a mural and display restoration history information. These search results are output as a form or drawing from, for example, a printer.

The following is a description of an example of a screen. When the repair information management is selected on the system initial screen, transition to the attribute search screen from the figure in FIG. 33 and the search result display screen becomes possible, and further, the detailed screen of the search result display dialog in FIG. 35, the information search result screen of FIG. 36, the disease information search result screen of FIG. 37, and the like.

It should be noted that the present invention is not limited to the above embodiment, and various modifications are possible. For example, in the above embodiment, creation of a mosaic image for repairing a mural disease, registration of disease information, restoration history information thereof,
It was explained as a system that manages and outputs, but it does not crack the walls of buildings such as buildings, ships, aircraft, etc., the walls of bridges and dams, slopes and other civil engineering structures, and the coating surfaces of steel plates, concrete, mortar, etc. Needless to say, the present invention can be similarly applied to a system for creating a mosaic image for repairing loss, contamination, sinking, cavities, and other damages, and for registering, managing, and outputting damage information and its repair history information. Of course, the present invention can be similarly applied to sculptures, pottery, Buddha statues, and the like as a system for creating a mosaic image for repairing a disease or damage, registering damage information, and registering, managing, and outputting the repair history information. In addition, although the image of the center projection was converted to an orthoimage (orthographic projection image),
The mosaic image may be created by converting the image of the central projection to a plane and expanding it to a developed image (developed image). By performing such a conversion, in the case of a mural on the ceiling of a dome or a curved wall with irregularities, a portion with a height is compressed and projected on a plane in an ortho image, whereas a curved surface is compressed in a developed image. Can be expressed without having to do so. Furthermore, the left and right index images were shot using a stereo camera, but the left and right index images may be shot using a single camera,
Instead of using a digital camera, a similar process may be performed by taking an image using a normal analog camera, reading the image with a scanner, and converting the image into digital image data.

[0047]

As is apparent from the above description, according to the present invention, the left and right index images and the wall surface of the entire wall surface photographed by the stereo camera by the two-stage photographing method are divided and overlapped with the adjacent wall surface. Photographed image registration processing means for registering data of a plurality of photographed detailed images; photographing position and photographing direction of the image based on a plurality of corresponding points designated on the plurality of images registered by the photographed image registration processing means Shape information creation processing means for determining object shape information by determining the image, image conversion processing means for converting a central projection image registered by the photographed image registration processing means to an orthographic projection image, and the image Mosaic processing means for joining the orthographic projection images converted by the conversion processing means, registration of disease information and repair information on the wall surface based on the mosaiced detailed images, And a restoration information control means for performing,
After performing the mosaic processing of the left and right index images, the mosaic processing of the detailed image is performed based on the mosaiced index image, and the wall surface is damaged or stained.
Since it is configured to create images for repairing diseases such as cracks, for example, by using a mark that has three-dimensional coordinate values to be printed on a photograph, setting and measuring control points on the measurement object , And an ortho image can be obtained in a non-contact manner, and work time on site can be greatly reduced. Moreover, by using a digital camera, the working process can be simplified and the working efficiency can be improved. In addition, by performing two-stage imaging, it is possible to associate the position with the entire wall surface even in the case of partial orthography, and perform partial processing with uniform accuracy. Furthermore, the number of shots and the amount of processing in image processing can be greatly reduced, and the principle of photogrammetry is used, so that geometric accuracy can be obtained,
Even if a digital camera with a low resolution is used, high-resolution image data can be obtained by mosaicing.

Further, an image creation processing means for creating a wall image in which orthographic detailed images obtained by converting a detailed image taken by dividing a wall surface are created, and a wall surface created by the image creating means Image data registration processing means for registering an image and attribute information, and repair information for inputting data relating to disease information and repair information with the wall image as a background based on the wall image and attribute information registered by the image data registration processing means Input processing means, and repair information management processing means for searching for and outputting the repair information input by the repair information input processing means, managing the disease information by graphic data having coordinate values, and storing the repair information for the disease. Since it is configured to manage as history, it is possible to manage position information with coordinate values using ortho images, measure area and length, and It can be classified management for the disease. Furthermore, by inputting and managing the repair information, it is possible to check the history of what kind of disease the target wall surface has been affected in the past and the repair has been performed.

[Brief description of the drawings]

FIG. 1 is a diagram showing an embodiment of a wall image / damage / repair information registration management system according to the present invention.

FIG. 2 is a diagram showing a hardware configuration of a wall image / damage / repair information registration / management system according to the present invention.

FIG. 3 is a diagram for explaining the overall processing flow of the image / damage / repair information registration / management system for a wall according to the present invention.

FIG. 4 is a diagram illustrating a flow of processing of an index image and a detailed image.

FIG. 5 is a diagram for explaining an entire index image and a detailed image to be captured.

FIG. 6 is a diagram illustrating shooting of an index image.

FIG. 7 is a diagram for explaining the flow of an index image registration process.

FIG. 8 is a diagram for explaining the flow of preprocessing of an index image.

FIG. 9 is a diagram for explaining a flow of an index image orientation process.

FIG. 10 is a diagram illustrating a flow of a DTM creation process from an index image.

FIG. 11 is a diagram illustrating a flow of an orthographic conversion process of an index image.

FIG. 12 is a diagram showing an example of correspondence between processed images.

FIG. 13 is a diagram for explaining the flow of mosaic processing of an index image.

FIG. 14 is a diagram for describing camera shooting of a detailed image.

FIG. 15 is a diagram illustrating a flow of a registration process of a detailed image.

FIG. 16 is a diagram for explaining the flow of a localization process of a detailed image.

FIG. 17 is a diagram illustrating a flow of an orthographic conversion process of a detailed image.

FIG. 18 is a diagram showing an example of correspondence between processed images.

FIG. 19 is a diagram illustrating the flow of the mosaic processing of the detailed image.

FIG. 20 is a diagram illustrating a flow of a registration process of image data.

FIG. 21 is a diagram illustrating an example of a system initial screen and each screen of image registration.

FIG. 22 is a diagram showing an example of a registration screen.

FIG. 23 is a diagram showing an example of a registered image display screen and a correction screen.

FIG. 24 is a diagram showing an example of a correction screen.

FIG. 25 is a diagram showing an example of a deletion screen.

FIG. 26 is a diagram for explaining a flow of a registration process of repair information.

FIG. 27 is a diagram illustrating an example of a screen call screen.

FIG. 28 is a diagram illustrating an example of a display control screen.

FIG. 29 is a diagram showing a correction information input screen and an example of the input screen.

FIG. 30 is a diagram showing an example of a disease range input screen.

FIG. 31 is a diagram showing an example of a disease information input screen.

FIG. 32 is a diagram for explaining a flow of a repair information management process.

FIG. 33 is a diagram showing an example of a repair information tube search surface and a search result display screen.

FIG. 34 is a diagram showing an example of a detailed screen of a search result display dialog.

FIG. 35 is a diagram showing an example of an attribute search screen.

FIG. 36 is a diagram showing an example of an information search result display screen.

FIG. 37 is a diagram showing an example of an information search result display screen.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 arithmetic processing device 2 database 3 photograph photographing unit 4 input unit 5 output unit 11 photographed image registration unit
12: image preprocessing unit, 13: image orientation unit, 14: DTM
Creating unit, 15: image orthographic conversion unit, 16: mosaic processing unit, 17: image data registration unit, 18: restoration information registration unit,
19: restoration information management unit, 21: work management data file, 22: photographed image data file, 23: object 3D data file, 24: ortho image data file,
25: mosaic image data file, 26: basic information data file, 27: restoration history data file

────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Seiki Fujiwara 2 Rokubancho, Chiyoda-ku, Tokyo Kokusai Kogyo Co., Ltd. (56) References JP-A-5-322778 (JP, A) JP-A-8- 147494 (JP, A) JP-A-11-12961 (JP, A) JP-A-11-238136 (JP, A) JP-A-2000-111322 (JP, A) (58) Fields investigated (Int. Cl. ⁷⁾ , DB name) G06T 1/00 315

Claims (4)

(57) [Claims] 1. A wall image / damage / repair information registration / management system for creating a mosaic image for repairing a wall disease or damage, registering and managing information relating to the disease, damage, and repair history, Photographed image registration processing means for registering photographed images and photographing information composed of left and right index images obtained by photographing the entire wall and detailed images obtained by dividing the wall, and a plurality of photographed images registered by the photographed image registration processing means Shooting position of the image based on a plurality of corresponding points specified on the image,
Shape information creation processing means for determining three-dimensional shape information of an object by determining a shooting direction; and orthographically projecting the shot image from a central projection image based on the shooting position, shooting direction, and object shape information Image conversion processing means for converting into an image or a developed image, mosaic processing means for creating a mosaic image by joining orthographic images or developed images converted by the image conversion processing means, and the mosaic processing means Restoration information management means for registering and managing information on the disease and damage of the wall surface and restoration history information with a mosaic image based on the created detailed image as a background, and based on the left and right index images,
It is configured to create three-dimensional shape information, perform mosaic processing of the detailed image using the three-dimensional shape information, and create a mosaic image of the wall surface. Repair information registration management system. 2. The photographed image according to claim 2, wherein the photographed image is a left and right index image of the entire wall surface photographed by a camera, and a plurality of detailed images photographed by dividing the wall surface and overlapping the adjacent wall surface. The image / damage / repair information registration / management system for the wall described in 1. 3. A shape information creation processing means performs orientation by designating corresponding points on left and right index images to determine respective shooting positions and shooting directions, creates three-dimensional shape information of an object, 2. An image / damage / repair information registration / management system for a wall according to claim 1, wherein orientation is performed by designating corresponding points in the index image and the detailed image to determine the respective photographing positions and photographing directions. 4. A method of registering and managing mosaic images for repairing disease and damage on a wall, registering and managing information relating to disease, damage and repair history, and managing and registering image, damage and repair information on a wall. The camera captures the left and right index images of the entire wall surface, divides the wall surface and overlaps the adjacent wall surface to capture a plurality of detailed images, and specifies the corresponding points on the left and right index images to perform image orientation. The shooting position of the index image,
Determine a shooting direction, create three-dimensional shape information of the object based on the left and right index images, shooting position, and shooting direction, and orthographically project the left and right index images based on the shooting position, shooting direction, and shape information. Convert to a projected image, determine the shooting position of the detailed image by specifying the corresponding points with the left and right index images on the plurality of detailed images, determine the shooting position of the detailed image, the shooting position of the detailed image, The detailed image is converted into an orthographic projection image based on the shooting direction and the shape information, and the orthographic projection image based on the detailed image is joined to create a mosaic image, and damage / repair information is registered with the mosaic image as a background. A method for registering and managing images, damage and repair information on wall surfaces characterized by management.