JP6926486B2 - Information processing equipment, information processing methods and programs - Google Patents

Description

The present invention relates to information processing devices, information processing methods and programs.

In recent years, various technologies have been disclosed as technologies related to systems that support inspection work on structures. For example, a technique for creating a developed view based on an image obtained by imaging the wall surface of a tunnel and the coordinates and reflection intensity values of each of a plurality of measurement points on the wall surface of the tunnel measured by a laser scanner is disclosed. (See, for example, Patent Document 1).

Further, a technique is disclosed in which a development drawing is automatically created and displayed based on an input numerical value on an input screen of a portable PC (Personal Computer), and a deformed part is directly input in the displayed development drawing (for example,). See Patent Document 2). Further, a technique is disclosed in which a measurement target area of a structure is divided into predetermined units, diagnostic data is created based on the tapping sound data obtained by the tapping sound measuring device, and the diagnostic data is superimposed on the developed view. (See, for example, Patent Document 3).

In such a general technique, an inspection result is described (input) in a drawing (hereinafter, also referred to as a “downward view”) created from a viewpoint of looking down on a structure from above. As an example, in tunnel inspection work, a modified development map is created by describing the inspection results on a field note (paper on which a tunnel drawing is printed). As another example, in bridge inspection work, a damage diagram is created by describing the inspection results on a field note (paper on which a drawing of a bridge is printed).

Japanese Unexamined Patent Publication No. 2012-220471 JP-A-2002-083017 Japanese Unexamined Patent Publication No. 2003-057218

However, when the inspection result is described in the down view, the inspection operator (user) himself draws the inspection result in the down view in order to describe the inspection result of the structure from the viewpoint of the inside or the lower part of the structure. It will be necessary to convert it to an inputtable format (it will be necessary to perform viewpoint conversion). Therefore, not only is it necessary for the inspector to have sufficient experience in order to carry out the inspection work efficiently, but there is a possibility that an error in the description of the inspection result may occur.

Therefore, it is desired to provide a technique capable of more efficiently describing the inspection results for the structure.

In order to solve the above problem, according to a certain viewpoint of the present invention, a display control unit that controls the display of drawing data related to the structure according to the user's viewpoint with respect to a predetermined structure and a switching of the viewpoint are detected. The display control unit is provided with an information processing device that controls the display of the drawing data after the affine transformation with respect to the drawing data when the switching of the viewpoint is detected.

Further, according to another viewpoint of the present invention, it is possible to control the display of drawing data regarding the structure according to the user's viewpoint with respect to the predetermined structure, detect the switching of the viewpoint, and obtain the viewpoint. When switching is detected, an information processing method is provided, including controlling the display of the drawing data after the affine transformation with respect to the drawing data.

Further, according to another aspect of the present invention, the computer is a display control unit that controls the display of drawing data related to the structure according to the user's viewpoint with respect to a predetermined structure, and a detection that detects switching of the viewpoint. The display control unit is provided with a unit and a program for functioning as an information processing device that controls the display of the drawing data after the affine conversion with respect to the drawing data when the switching of the viewpoint is detected. NS.

As described above, according to the present invention, it is possible to more efficiently describe the inspection results for the structure.

It is explanatory drawing which showed the structural example of the information processing system which concerns on embodiment of this invention. It is a block diagram which shows the functional structure example of the tablet terminal (information processing apparatus) which concerns on this embodiment. It is a figure for demonstrating the example of making a top-down view. It is a figure which shows the example of the top-down view display screen. It is a figure which shows the example of the input screen. It is a figure which shows the display example of a composite image. It is a figure for demonstrating the case where a user inspects the left lane side in the inside of a road tunnel. It is a figure for demonstrating the creation example of the looking-up view (left lane), and the figure which shows the display example of the composite image. It is a figure for demonstrating the case where a user inspects the right lane side in the inside of a road tunnel. It is a figure for demonstrating the creation example of the looking-up view (right lane), and the figure which shows the display example of the composite image. It is a figure which shows the example of the conversion performed between any two combinations of the top view, the look up view (left lane), and the look up view (right lane). It is a figure which shows the example of the conversion performed between the combination of the drawing data (drawing data of a wall surface part) about every two road tunnels of a top view, a look up view (left lane) and a look up view (right lane). It is a figure which shows the example of the conversion performed between the combination of the drawing data (drawing data of a road surface part) about every two road surfaces among the top view, the look up view (left lane) and the look up view (right lane). It is a flowchart which shows the operation example of the information processing system which concerns on embodiment of this invention. It is a figure which shows the hardware configuration of the tablet terminal which concerns on this embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

Further, in the present specification and the drawings, a plurality of components having substantially the same or similar functional configurations are distinguished by adding different numbers after the same reference numerals. In addition, similar components of different embodiments are distinguished by adding different alphabets after the same reference numerals. However, if it is not necessary to distinguish each of a plurality of components having substantially the same functional configuration, only the same reference numerals are given.

(0. Overview)
First, an outline of an embodiment of the present invention will be described. In recent years, various technologies have been disclosed as technologies related to systems that support inspection work on structures. In such a technique, in general, an inspection result is described (input) in a drawing (hereinafter, also referred to as a "look-down view") created from a viewpoint of looking down on a structure from above. As an example, in tunnel inspection work, a modified development map is created by describing the inspection results on a field note (paper on which a tunnel drawing is printed). As another example, in bridge inspection work, a damage diagram is created by describing the inspection results on a field note (paper on which a drawing of a bridge is printed).

When the inspection result is described in the down view, the inspection operator (user) can input the inspection result into the down view by himself / herself in order to describe the inspection result of the structure from the viewpoint of the inside or the lower part of the structure. It will be necessary to convert to a different format (it will be necessary to perform viewpoint conversion). Therefore, not only is it necessary for the inspector to have sufficient experience in order to carry out the inspection work efficiently, but there is a possibility that an error in the description of the inspection result may occur. Therefore, in this specification, we mainly propose a technique capable of more efficiently describing the inspection results for the structure.

The outline of the embodiment of the present invention has been described above.

(1. Details of the embodiment)
First, the details of the embodiment of the present invention will be described.

(1-1. Configuration of information processing system)
A configuration example of the information processing system 1 according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is an explanatory diagram showing a configuration example of the information processing system 1 according to the embodiment of the present invention. As shown in FIG. 1, the information processing system 1 includes a tablet terminal 10 and an electronic pen 20. The tablet terminal 10 and the electronic pen 20 are used by an inspector (hereinafter, also referred to as “user”), and the tablet terminal 10 has a function of displaying a screen. On the other hand, the electronic pen 20 has a function of inputting a position on the screen.

In the embodiment of the present invention, an example in which the information processing system 1 has the tablet terminal 10 will be mainly described, but the information processing system 1 may be replaced with another information processing device (for example, a notebook PC) instead of the tablet terminal 10. , Smartphone, etc.). Further, in the embodiment of the present invention, an example in which the information processing system 1 has the electronic pen 20 will be mainly described, but a part of the user's body (for example, a user's finger) is used instead of the electronic pen 20. May be done.

The configuration example of the information processing system 1 according to the embodiment of the present invention has been described above.

(1-2. Functional configuration of tablet terminal)
Subsequently, a functional configuration example of the tablet terminal (information processing device) 10 according to the embodiment of the present invention will be described. FIG. 2 is a block diagram showing a functional configuration example of the tablet terminal (information processing device) 10 according to the embodiment of the present invention. As shown in FIG. 2, the tablet terminal 10 according to the embodiment of the present invention includes a control unit 110, an input unit 120, a sensor unit 130, a storage unit 140, and a display unit 150.

The control unit 110 has a function of controlling the entire operation of the tablet terminal 10. The control unit 110 may be configured by dedicated hardware, or a program stored in a ROM (Read Only Memory) by a CPU (Central Processing Unit) built in the tablet terminal 10 in a RAM (Random Access Memory). It may be realized by deploying and executing. In addition to being provided with such a program, a storage medium storing such a program may also be provided. The control unit 110 includes a detection unit 111, a processing unit 112, a recording control unit 113, an inspection result data acquisition unit 114, and a display control unit 115. Each of these functional blocks will be described later.

The input unit 120 may be configured by an input device that accepts input of a position with respect to the screen. In the embodiment of the present invention, an example in which the input unit 120 is composed of a touch panel for detecting the contact position or the proximity position of the electronic pen 20 with respect to the screen will be mainly described. However, the input unit 120 may be configured by an input device other than the touch panel (for example, a keyboard, a mouse, etc.). The input unit 120 provides the control unit 110 with a position input to the screen.

The sensor unit 130 may be composed of a sensor. The sensor unit 130 obtains the sensor data detected by such a sensor. For example, the sensor unit 130 can detect the orientation of the tablet terminal 10. Here, the method for detecting the orientation of the tablet terminal 10 is not particularly limited. For example, when the sensor unit 130 has a geomagnetic sensor, the sensor unit 130 may detect the direction in which the tablet terminal 10 is facing as the orientation of the tablet terminal 10 based on the geomagnetic data detected by the geomagnetic sensor.

Alternatively, when the sensor unit 130 has an acceleration sensor, the sensor unit 130 may detect the orientation of the tablet terminal 10 based on the acceleration detected by the acceleration sensor. Alternatively, when the sensor unit 130 has a gyro sensor, the sensor unit 130 may detect the orientation of the tablet terminal 10 based on the angular velocity detected by the gyro sensor.

The storage unit 140 may be configured by a storage device that stores various types of data. For example, a program for operating the control unit 110 is stored. Further, the storage unit 140 stores data for operating the control unit 110. In addition, the storage unit 140 can temporarily store various data required in the process of operation of the control unit 110.

The display unit 150 has a function of displaying according to the control by the control unit 110. For example, the display unit 150 can display various screens generated by the control unit 110. Here, the form of the display unit 150 is not particularly limited. For example, the display unit 150 may be a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Node) device, or a lamp.

The functional configuration example of the tablet terminal 10 according to the embodiment of the present invention has been described above.

(1-3. Details of information processing system functions)
Subsequently, the functional details of the information processing system 1 according to the embodiment of the present invention will be described. In the embodiment of the present invention, an example in which a user inspects a road tunnel as an example of a predetermined structure and inputs inspection result data to the tablet terminal 10 with an electronic pen 20 will be described. However, the structures to be inspected are not limited to road tunnels. For example, the structure to be inspected may be a railway tunnel, a bridge, a shed, a culvert, a pedestrian bridge, or the like. It may be another structure.

(1-3-1. Use of top-down view)
First, the user takes the tablet terminal 10 and the electronic pen 20 and goes to the road tunnel to be inspected. In the tablet terminal 10, the display control unit 115 controls the display of drawing data related to the road tunnel according to the user's viewpoint with respect to the road tunnel. As an example, the display control unit 115 controls the display of drawing data (look-down view) created from a viewpoint looking down on the road tunnel from above. The drawing data whose display is controlled by the display control unit 115 may be created from a viewpoint different from the viewpoint of looking down on the road tunnel from above.

Further, the look-down view may be created in advance by the tablet terminal 10 or may be created in advance by a device different from the tablet terminal 10. Further, the look-down view may be stored in advance in the storage unit 140 of the tablet terminal 10, or may be stored in advance by a storage device different from the storage unit 140 (for example, an external storage device of the tablet terminal 10). May be good.

FIG. 3 is a diagram for explaining an example of creating a top-down view. With reference to FIG. 3, a top-down view creation example V10 is shown. As shown in the look-down view creation example V10, the look-down view F10 is created from a viewpoint of looking down on the road tunnel N10 from above, and includes drawing data F11 (drawing data of a wall surface portion) relating to the road tunnel. In addition, in the look-down view creation example V10, the case where the look-down view F10 includes a development view of the road tunnel N10 according to the user's viewpoint (a development view created from a viewpoint looking down on the road tunnel N10 from above) is shown. ing. However, the road tunnel N10 does not necessarily have to be accurately reflected in the top-down view F10.

As an example, it is assumed that the road tunnel N10 has a curved region. In such a case, the curved region of the road tunnel N10 does not have to be accurately reflected in the downward view F10. For example, in the curved region of the road tunnel N10, the shorter portion may be corrected to fit the longer portion. Further, the downward view F10 does not have to be a development view of the road tunnel N10, and may be a plan view of the road tunnel N10 or the like.

Further, the down view F10 includes drawing data F12 (drawing data of a road surface portion created from a viewpoint looking down on the road tunnel N10 from above) regarding the road surface according to the user's viewpoint. In the downward view F10, "L" indicates the left lane of the road surface, and "R" indicates the right lane of the road surface. Further, the downward view F10 may include a scale indicating the length of the road tunnel N10 for each predetermined length. For example, the look-down view F10 shown in FIG. 3 includes a scale every 5 m.

In the embodiment of the present invention, an example in which the down view F10 is created so that the left side of the road tunnel N10 (and the left lane of the road surface) is located above the down view F10 will be mainly described. However, the look-down view F10 may be created so that the right side of the road tunnel N10 (and the right lane of the road surface) is located below the look-down view F10.

The look-down view F10 created in this way is displayed and controlled by the display control unit 115. FIG. 4 is a diagram showing an example of a top-down view display screen. As shown in FIG. 4, in the look-down view display screen G10, in addition to the look-down view F10, the deformation information input selection button B11, the look-down view selection button B21, the look-up view (left lane) selection button B22, and the look-up view (right lane) ) Selection button B23 may be included. When the look-down view display screen G10 is displayed, the user may input the inspection result data into the look-down view F10 using the electronic pen 20.

For example, the inspection result data may include deformation information in at least one of the road tunnel N10 and the road surface. That is, when the user finds the deformation information to be input to the look-down view F10 in the inspection from the outside of the road tunnel N10, the user may select the input of the deformation information. For example, the input of the deformation information can be selected by selecting the deformation information input selection button B11 with the electronic pen 20. In the following, it is mainly assumed that the inspection result data includes the deformation information in the road tunnel N10. The look-down view selection button B21, the look-up view (left lane) selection button B22, and the look-up view (right lane) selection button B23 will be described later.

Here, the deformation information may include any information. As an example, the deformation information may include information indicating the deformation position and information indicating the type of deformation occurring at the deformation position. That is, the user inputs the information indicating the deformed position and the information indicating the deformed type into the look-down view F10. The input unit 120 accepts the input of the information indicating the deformation position and the information indicating the deformation type. In the following, it is mainly assumed that the deformation information includes information indicating the deformation position and information indicating the deformation type.

For example, when the user selects the deformation information input selection button B11 with the electronic pen 20, the selection of the deformation information input selection button B11 is accepted by the input unit 120. Then, when the user inputs the position P in the look-down view F10 corresponding to the deformed position in the road tunnel N10 by the electronic pen 20, the input unit 120 inputs the information (coordinates P (X, Y)) indicating the position P. It is accepted as information indicating the deformed position (coordinates P (X, Y)).

When the input unit 120 receives the input of the information indicating the deformed position (coordinates P (X, Y)), the display control unit 115 controls the display of the input screen. FIG. 5 is a diagram showing an example of an input screen. As shown in FIG. 5, the input screen G11 may include input fields for each of the deformed portion, the deformed content, and the scale of the deformed range. In addition, the deformed part may include a target part and a part classification, the deformed content may include a deformed classification and a deformed type, and the scale of the deformed range is width × length, memo, and soundness. May include.

More specifically, in the example shown in FIG. 5, the input screen G11 has a target location input field T11, a site classification input field T12, a deformation classification input field T13, and a deformation type input field (information indicating the deformation type). Input field) T14, width x length input field T15, memo input field T16, and soundness input field T17 are included. The input to these input fields may be performed in any way. For example, when the keyboard is displayed and controlled by the display control unit 115, information may be input to each of these input fields using the keyboard, or when the display control unit 115 displays options. , It may be possible to input each information in these input fields using options.

In addition, the input screen G11 may include an OK button B31 and a cancel button B32. For example, when the user selects the cancel button B32 with the electronic pen 20, the selection of the cancel button B32 is accepted by the input unit 120. Then, the display control unit 115 cancels the display of the input screen G11 and controls the display of the top-down view display screen G10.

On the other hand, when the user selects the OK button B31 with the electronic pen 20, the selection of the OK button B31 is accepted by the input unit 120. Then, it is input to each of the target location input field T11, the part classification input field T12, the deformation classification input field T13, the deformation type input field T14, the width x length input field T15, the memo input field T16, and the soundness input field T17. In addition to the above-mentioned information, the information (coordinates P (X, Y)) indicating the deformed position input as described above is acquired by the inspection result data acquisition unit 114.

Each piece of information acquired by the inspection result data acquisition unit 114 is recorded and controlled by the recording control unit 113. Where each information acquired by the inspection result data acquisition unit 114 is recorded is not limited. In the embodiment of the present invention, it is mainly assumed that each information acquired by the inspection result data acquisition unit 114 is recorded in the storage unit 140, but a storage device different from the storage unit 140 (for example, the tablet terminal 10). It may be recorded in a storage device of a server capable of communicating with.

Further, when each information is acquired by the inspection result data acquisition unit 114, the display control unit 115 synthesizes the inspection result data in the down view F10 and displays the composite image in which the inspection result data is combined in the down view F10. Control. For example, the display control unit 115 displays a predetermined display according to the information indicating the deformation position (coordinates P (X, Y)) and the information indicating the deformation type (information input in the deformation type input field T14). The object is combined with the lower view F10. For example, a predetermined display object may include a display image and a character string.

That is, the display control unit 115 displays a display image according to the information indicating the deformation position (coordinates P (X, Y)) and the information indicating the deformation type (information input in the deformation type input field T14). It may be combined with the top-down view F10. Further, the display control unit 115 sets a character string corresponding to the information indicating the deformation position (coordinates P (X, Y)) and the information indicating the deformation type (information input in the deformation type input field T14). It may be combined with the top-down view F10.

FIG. 6 is a diagram showing a display example of a composite image. As shown in FIG. 6, the display control unit 115 refers to the information indicating the deformation type (the information “crack” input in the deformation type input field T14 with respect to the deformation position P (X, Y) in the down view F10. The display image D11 corresponding to ") may be combined. Further, as shown in FIG. 6, the display control unit 115 displays information indicating the type of deformation (in the deformation type input field T14) with respect to the position corresponding to the deformation position P (X, Y) in the look-down view F10. The character string E11 "crack" corresponding to the input information "crack") may be synthesized.

In the embodiment of the present invention, in order to simplify the explanation, it is mainly assumed that the coordinates P (X, Y) of one point are input as the information indicating the deformed position. However, there are cases where the deformation has a certain range. Therefore, the coordinates of a plurality of points may be input as the information indicating the deformed position. At this time, when the user draws a curve using the electronic pen 20, the coordinates of each of the plurality of points on the curve may be input, or the coordinates of the plurality of points may be input by the user using the electronic pen 20. It may be entered one by one.

Further, in the embodiment of the present invention, in consideration of the legibility of the drawing, it is mainly assumed that the shape of the display image D11 is a triangle. However, the shape of the display image D11 is not limited. For example, when the coordinates of a plurality of points are input as the information indicating the deformed position, the shape of the display image D11 may be a shape corresponding to the coordinates of each of the plurality of points. For example, the shape of the display image D11 may be a curve connecting the coordinates of each of the plurality of points. Alternatively, when the coordinates of each of the two points are input as the information indicating the deformed position, the shape of the display image D11 may be a rectangular region having the two points as the vertices of the diagonal line.

(1-3-2. Use of looking-up view (left lane))
Subsequently, the user moves inside the road tunnel N10 while holding the tablet terminal 10 and the electronic pen 20. Then, the user first inspects either the left lane side or the right lane side of the inside (wall surface and road surface) of the road tunnel N10. Here, it is assumed that the user first inspects the left lane side of the inside of the road tunnel N10.

FIG. 7 is a diagram for explaining a case where the user inspects the left lane side of the inside of the road tunnel N10. As shown in FIG. 7, when the user U1 inspects the left lane side “L” of the inside of the road tunnel N10, the user U1 holds the tablet terminal 10 and the electronic pen 20 while holding the inside of the road tunnel N10. Turn to the left lane. Since the user U1 faces the left lane side of the inside of the road tunnel N10, it becomes difficult for the user U1 to inspect the right lane side (dashed line arrow in FIG. 7).

On the other hand, the user U1 can easily inspect the left lane side of the inside of the road tunnel N10 by facing the left lane side (solid arrow in FIG. 7). Here, the detection unit 111 detects the switching of the viewpoint of the user U1 with respect to the road tunnel N10. More specifically, the detection unit 111 detects the viewpoint after switching of the user U1 (for example, whether it is facing the left lane side or the right lane side). Here, the viewpoint after switching of the user U1 may be detected in any way.

As an example, the detection unit 111 may detect the viewpoint after switching of the user U1 based on the sensor data detected by the sensor unit 130. For example, when the sensor unit 130 can detect the orientation of the tablet terminal 10 by the method as described above, the detection unit 111 switches the orientation of the tablet terminal 10 detected by the sensor unit 130 to the user U1. It may be detected as a later viewpoint. In the following, it is mainly assumed that the detection unit 111 detects the viewpoint after switching of the user U1 based on the viewpoint switching operation input by the user U1.

Here, since it is assumed that the inspection on the left lane side is performed first, it is assumed that the user U1 selects the look-up view (left lane) selection button B22 (FIG. 4). When the input unit 120 accepts the selection of the look-up view (left lane) selection button B22, the detection unit 111 detects such selection. When the detection unit 111 detects such a selection, the processing unit 112 performs affine transformation on the drawing data F11 (drawing data of the wall surface portion) relating to the road tunnel, and the display control unit 115 performs the affine transformation drawing. Control the display of data.

More specifically, the processing unit 112 performs affine transformation on the drawing data F11 (drawing data of the wall surface portion) relating to the road tunnel according to the viewpoint after the switching of the user U1. The affine transformation may be at least one of left-right inversion and up-down inversion. That is, the processing unit 112 may perform at least one of horizontal inversion and vertical inversion with respect to the drawing data F11 (drawing data of the wall surface portion) relating to the road tunnel.

According to such a configuration, in order to describe the inspection result of the road tunnel N10 with the inside of the road tunnel N10 as a viewpoint, it is not necessary for the user to convert the inspection result into a format that can be input to the look-down diagram (viewpoint conversion is performed). No need). Therefore, it is possible to more efficiently describe the inspection result for the road tunnel N10. More specifically, it is possible to efficiently perform inspection work without requiring sufficient experience of the user, and the possibility of error in describing the inspection result is reduced.

In the embodiment of the present invention, it is mainly assumed that the processing unit 112 performs the affine transformation every time the viewpoint of the user U1 is switched. However, the drawing data after the affine transformation may be stored in advance in the storage unit 140 of the tablet terminal 10, or may be stored in advance by a storage device different from the storage unit 140 (for example, an external storage device of the tablet terminal 10). It may be remembered. In such a case, the affine transformation by the processing unit 112 does not have to be performed.

Then, the display control unit 115 may control the display of the top view (left lane) including the drawing data related to the road surface according to the user's viewpoint in addition to the drawing data after the affine transformation. Then, when the user finds the deformation information to be input to the looking-up view (left lane) in the inspection on the left lane side of the road tunnel N10, the user may select the input of the deformation information. For example, the input of the deformation information can be selected by selecting the deformation information input selection button B11 with the electronic pen 20.

Then, when the user inputs the position in the looking-up view (left lane) corresponding to the deformed position in the road tunnel N10 with the electronic pen 20, the input unit 120 accepts the input of the information indicating the position as the information indicating the deformed position. Be done. Then, the display control unit 115 controls the display of the input screen G11 (FIG. 5). Here, as described with reference to FIG. 5, when the input is performed for each input field of the input screen G11 and the OK button B31 is selected, in addition to the information input in each input field, as described above. The information indicating the deformed position input in the above is acquired by the inspection result data acquisition unit 114.

Each piece of information acquired by the inspection result data acquisition unit 114 is recorded and controlled by the recording control unit 113. At this time, the information indicating the deformed position may be recorded and controlled as the information indicating the deformed position in the looking-up view (left lane), but the looking-down view is taken from the information indicating the deformed position in the looking-up view (left lane). It is desirable that the recording is controlled after being converted into the information indicating the deformed position in. Then, all the recorded information indicating the deformed position is unified with the information based on the top-down view.

When each information is acquired by the inspection result data acquisition unit 114, the display control unit 115 synthesizes the inspection result data in the look-up view (left lane) and the inspection result data in the look-up view (left lane). Controls the display of composite images. For example, the display control unit 115 synthesizes a predetermined display object according to the information indicating the deformation position and the information indicating the deformation type into a looking-up view (left lane). For example, a predetermined display object may include a display image and a character string.

That is, the display control unit 115 may combine the display image corresponding to the information indicating the deformation position and the information indicating the deformation type into the looking-up view (left lane). Further, the display control unit 115 may synthesize a character string corresponding to the information indicating the deformation position and the information indicating the deformation type into a looking-up view (left lane). Here, it is assumed that the display image corresponding to the information indicating the deformation position and the information indicating the deformation type is combined with the looking-up view (left lane).

FIG. 8 is a diagram for explaining a creation example of a looking-up view (left lane) and a diagram showing a display example of a composite image. With reference to FIG. 8, a looking-up view (left lane) creation example V20 is shown. As shown in the look-up view (left lane) creation example V20, the look-up view (left lane) F20 corresponds to a viewpoint looking up at the left lane side inside the road tunnel N10.

Therefore, when the down-view view F10 and the look-up view (left lane) F20 are compared, the positional relationship between the left lane and the right lane is reversed between the drawing data F11 regarding the road tunnel and the drawing data F21 regarding the road tunnel. (Upside down). That is, the processing unit 112 may obtain the drawing data F21 relating to the road tunnel by turning it upside down with respect to the drawing data F11 relating to the road tunnel.

On the other hand, when the downward view F10 and the upward view (left lane) F20 are compared, the positional relationship between the left lane and the right lane is not reversed between the drawing data F12 regarding the road surface and the drawing data F22 regarding the road surface. That is, the processing unit 112 may obtain the drawing data F22 relating to the road surface without inverting the drawing data F12 relating to the road surface.

Further, as shown in FIG. 8, the display control unit 115 may synthesize a display image D12 corresponding to the information indicating the deformation type with respect to the deformation position in the looking-up view (left lane) F20.

As shown in FIG. 8, the processing unit 112 also affines the display image D11 (FIG. 6) synthesized in the down view F10 from the drawing data F11 relating to the road tunnel to the drawing data F21 relating to the road tunnel. The same affine transformation as the transformation (that is, upside down) may be performed. Then, the display control unit 115 may combine the display image D11 after the affine transformation with the upper view (left lane) F20.

Further, the processing unit 112 performs the same affine transformation as the affine transformation from the drawing data F11 relating to the road tunnel to the drawing data F21 relating to the road tunnel for the character string E11 (FIG. 6) synthesized in the downward view F10. Of these, only the position may be converted (that is, the orientation is not reversed and the position is flipped upside down). Then, the display control unit 115 may synthesize the character string E11 after the affine transformation into the upper view (left lane) F20.

(1-3-3. Use of looking-up view (right lane))
Subsequently, the user inspects the other of the inside (wall surface and road surface) of the road tunnel N10 on the left lane side and the right lane side while holding the tablet terminal 10 and the electronic pen 20. Here, it is assumed that the user inspects the left lane side of the inside of the road tunnel N10 and then the right lane side of the inside of the road tunnel N10.

FIG. 9 is a diagram for explaining a case where the user inspects the right lane side of the inside of the road tunnel N10. As shown in FIG. 9, when the user U1 inspects the right lane side “R” of the inside of the road tunnel N10, the user U1 holds the tablet terminal 10 and the electronic pen 20 while holding the inside of the road tunnel N10. Turn to the right lane. Since the user U1 faces the right lane side of the inside of the road tunnel N10, it becomes difficult for the user U1 to inspect the left lane side (dashed line arrow in FIG. 9).

On the other hand, the user U1 can easily inspect the right lane side of the inside of the road tunnel N10 by facing the right lane side (solid arrow in FIG. 9). Here, the detection unit 111 detects the switching of the viewpoint (switching of the viewpoint again) with respect to the road tunnel N10 of the user U1 as described above. Here, since it is assumed that the inspection on the right lane side is performed, it is assumed that the user U1 selects the look-up view (right lane) selection button B23 (FIG. 4).

When the input unit 120 accepts the selection of the look-up view (right lane) selection button B23, the detection unit 111 detects such selection. When the detection unit 111 detects such a selection, the processing unit 112 performs affine transformation on the drawing data F21 (drawing data of the wall surface portion) relating to the road tunnel, and the display control unit 115 performs the affine transformation drawing. Control the display of data.

More specifically, assuming that the processing unit 112 uses the affine transformation (drawing data F11 related to the road tunnel as a reference) for the drawing data F21 (drawing data of the wall surface portion) related to the road tunnel according to the viewpoint after switching of the user U1. Perform affine transformation again). The affine transformation may be at least one of left-right inversion and up-down inversion. That is, the processing unit 112 may perform at least one of horizontal inversion and vertical inversion with respect to the drawing data F21 (drawing data of the wall surface portion) relating to the road tunnel.

Then, the display control unit 115 may control the display of the top view (right lane) including the drawing data related to the road surface according to the user's viewpoint in addition to the drawing data after the affine transformation. Then, when the user finds the deformation information to be input to the looking-up view (right lane) in the inspection on the right lane side of the road tunnel N10, the user may select the input of the deformation information. For example, the input of the deformation information can be selected by selecting the deformation information input selection button B11 with the electronic pen 20.

Then, when the user inputs the position in the look-up view (right lane) corresponding to the deformed position in the road tunnel N10 with the electronic pen 20, the input unit 120 accepts the input of the information indicating the position as the information indicating the deformed position. Be done. Then, the display control unit 115 controls the display of the input screen G11 (FIG. 5). Here, as described with reference to FIG. 5, when the input is performed for each input field of the input screen G11 and the OK button B31 is selected, in addition to the information input in each input field, as described above. The information indicating the deformed position input in the above is acquired by the inspection result data acquisition unit 114.

Each piece of information acquired by the inspection result data acquisition unit 114 is recorded and controlled by the recording control unit 113. At this time, the information indicating the deformed position may be recorded and controlled as the information indicating the deformed position in the looking-up view (right lane), but the looking-down view is taken from the information indicating the deformed position in the looking-up view (right lane). It is desirable that the recording is controlled after being converted into the information indicating the deformed position in. Then, all the recorded information indicating the deformed position is unified with the information based on the top-down view.

When each information is acquired by the inspection result data acquisition unit 114, the display control unit 115 synthesizes the inspection result data in the look-up view (right lane) and the inspection result data in the look-up view (right lane). Controls the display of composite images. For example, the display control unit 115 synthesizes a predetermined display object according to the information indicating the deformation position and the information indicating the deformation type into a looking-up view (right lane). For example, a predetermined display object may include a display image and a character string.

That is, the display control unit 115 may combine the display image corresponding to the information indicating the deformation position and the information indicating the deformation type into the looking-up view (right lane). Further, the display control unit 115 may synthesize a character string corresponding to the information indicating the deformation position and the information indicating the deformation type into a looking-up view (right lane). Here, it is assumed that the display image corresponding to the information indicating the deformation position and the information indicating the deformation type is combined with the looking-up view (right lane).

FIG. 10 is a diagram for explaining a creation example of a looking-up view (right lane) and a diagram showing a display example of a composite image. With reference to FIG. 10, a looking-up view (right lane) creation example V30 is shown. As shown in the look-up view (right lane) creation example V30, the look-up view (right lane) F30 corresponds to a viewpoint looking up at the right lane side inside the road tunnel N10.

Therefore, comparing the look-up view (left lane) F20 and the look-up view (right lane) F30, the positional relationship between the left lane and the right lane between the drawing data F21 regarding the road tunnel and the drawing data F31 regarding the road tunnel. Is reversed, and the directions of the left lane and the right lane are reversed (upside down, left and right are reversed). That is, the processing unit 112 may obtain the drawing data F31 relating to the road tunnel by flipping the drawing data F21 relating to the road tunnel vertically and horizontally.

On the other hand, when the looking-up view (left lane) F20 and the looking-up view (right lane) F30 are compared, the positional relationship between the left lane and the right lane is reversed between the drawing data F22 regarding the road surface and the drawing data F32 regarding the road surface. However, the directions of the left lane and the right lane are opposite (the top and bottom are reversed, and the left and right are reversed). That is, the processing unit 112 may obtain the drawing data F32 relating to the road surface by flipping the drawing data F22 relating to the road surface upside down and horizontally.

Further, as shown in FIG. 10, the display control unit 115 may synthesize a display image D13 corresponding to the information indicating the deformation type with respect to the deformation position in the looking-up view (right lane) F30.

As shown in FIG. 10, the display control unit 115 also refers to the display images D11 and D12 (FIG. 8) combined with the looking-up view (left lane) F20 from the drawing data F21 relating to the road tunnel to the road tunnel. The same affine transformation as the affine transformation to the drawing data F31 with respect to the above (that is, upside down and left / right inversion) may be performed. Then, the display control unit 115 may combine the displayed images D11 and D12 after the affine transformation with the upper view (right lane) F30.

Further, the display control unit 115 performs an affine transformation from the drawing data F21 relating to the road tunnel to the drawing data F31 relating to the road tunnel for the character string E11 (FIG. 8) synthesized in the looking-up view (left lane) F20. Of the same affine transformations, only the position conversion (that is, no orientation inversion, position upside down and left / right inversion) may be performed. Then, the display control unit 115 may synthesize the character string E11 after the affine transformation into the upper view (right lane) F30.

(1-3-4. Other usage)
In the above, after the user inspects from the outside of the road tunnel N10, the left lane side of the inside of the road tunnel N10 is inspected, and the right lane side of the inside of the road tunnel N10 is inspected. explained. However, the order in which the user performs the inspection is not particularly limited. At this time, conversion can be performed between any two combinations of the looking-down view F10, the looking-up view (left lane) F20, and the looking-up view (right lane) F30, depending on the order in which the user performs the inspection.

FIG. 11 is a diagram showing an example of a conversion performed between any two combinations of the looking-down view F10, the looking-up view (left lane) F20, and the looking-up view (right lane) F30. As shown in FIG. 11, conversions can be made between any two drawing data. In addition, each of the mark C10, the mark C20 and the mark C30 is displayed fixed to the road surface (left lane and right lane) so that the position and direction of the road surface (left lane and right lane) can be easily grasped. good.

FIG. 12 shows the conversion performed between the combination of the drawing data (drawing data of the wall surface portion) for any two road tunnels among the looking down view F10, the looking up view (left lane) F20 and the looking up view (right lane) F30. It is a figure which shows an example. With reference to FIG. 12, an example of conversion performed on the drawing data (drawing data of the wall surface portion) relating to the road tunnel is shown corresponding to the viewpoint before the switching and the viewpoint after the switching.

FIG. 13 shows an example of conversion performed between a combination of drawing data (drawing data of a road surface portion) for any two road surfaces of a looking-down view F10, a looking-up view (left lane) F20, and a looking-up view (right lane) F30. It is a figure which shows. With reference to FIG. 13, an example of conversion performed on the drawing data (drawing data of the road surface portion) relating to the road surface is shown corresponding to the viewpoint before the switching and the viewpoint after the switching.

The functional details of the information processing system 1 according to the embodiment of the present invention have been described above.

(1-4. Operation of information processing system)
Subsequently, an operation example of the information processing system 1 according to the embodiment of the present invention will be described. FIG. 14 is a flowchart showing an operation example of the information processing system 1 according to the embodiment of the present invention. As shown in FIG. 14, first, in the tablet terminal 10, the display control unit 115 controls the display of the drawing of the basic viewpoint (S11). The drawing of the basic viewpoint corresponds to the down view F10 in the above. Then, when the viewpoint switching is selected by the user (“Yes” in S12), the processing unit 112 generates drawing data at the viewpoint after switching by affine transformation according to the viewpoint switching (S13).

In the above example, the selection of the viewpoint switching corresponds to the selection of one of the down view selection button B21, the looking up view (left lane) selection button B22, and the looking up view (right lane) selection button B23. The display control unit 115 controls the display of the drawing at the viewpoint after switching (S14), and returns to S12. On the other hand, if the viewpoint switching is not selected by the user (“No” in S12), the control unit 110 proceeds to S15.

Subsequently, when the input of the deformation information is selected by the user (“Yes” in S15), the inspection result data acquisition unit 114 receives the input of the deformation position in the drawing via the input unit 120, and the display control unit 114. The 115 controls the display of the input screen (S16). In the above example, the selection of the deformation information input corresponds to the selection of the deformation information input selection button B11.

On the other hand, when the input of the deformation information is not selected by the user (“No” in S15), the control unit 110 proceeds to S18. When the input completion is not selected by the user (“No” in S18), the control unit 110 returns to S12. On the other hand, when the input completion is selected by the user (“Yes” in S18), the control unit 110 ends the operation.

The operation example of the information processing system 1 according to the embodiment of the present invention has been described above.

(1-5. Hardware configuration example)
Subsequently, the hardware configuration of the tablet terminal 10 according to the embodiment of the present invention will be described. FIG. 15 is a diagram showing a hardware configuration of the tablet terminal 10 according to the embodiment of the present invention. The tablet terminal 10 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, and the like. It includes an input device 908, an output device 909, a storage device 910, and a sensor 911.

The CPU 901 functions as an arithmetic processing unit and a control device, and controls the overall operation in the tablet terminal 10 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs, calculation parameters, and the like used by the CPU 901. The RAM 903 temporarily stores a program used in the execution of the CPU 901, parameters that are appropriately changed in the execution, and the like. These are connected to each other by a host bus 904 composed of a CPU bus or the like.

The host bus 904 is connected to an external bus 906 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 905. It is not always necessary to separately configure the host bus 904, the bridge 905, and the external bus 906, and these functions may be implemented in one bus.

The input device 908 includes input means for the user to input information such as a mouse, keyboard, touch panel, buttons, microphone, switch, and lever, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 901. And so on. By operating the input device 908, the user who operates the tablet terminal 10 can input various data to the tablet terminal 10 and instruct the processing operation.

The output device 909 includes, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Node) device, a display device such as a lamp, and an audio output device such as a speaker.

The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, a deleting device for deleting the data recorded on the storage medium, and the like. The storage device 910 is composed of, for example, an HDD (Hard Disk Drive). The storage device 910 drives a hard disk and stores programs and various data executed by the CPU 901.

The sensor 911 detects the sensor data by sensing. For example, the sensor 911 may include at least one of an acceleration sensor, a gyro sensor and a geomagnetic sensor. The acceleration sensor detects the acceleration generated in the tablet terminal 10 as sensor data. Further, the gyro sensor detects the angular velocity generated in the tablet terminal 10 as sensor data. Further, the geomagnetic sensor detects the direction in which the tablet terminal 10 is facing as sensor data.

In the above, the hardware configuration of the tablet terminal 10 according to the embodiment of the present invention has been described.

(1-6. Effect)
According to the embodiment of the present invention, the display control unit 115 that controls the display of drawing data (look-down view) regarding the road tunnel N10 according to the user's viewpoint with respect to the road tunnel N10, and the detection unit 111 that detects the switching of the viewpoint. , A tablet terminal 10 is provided. Here, the display control unit 115 controls the display of the drawing data after the affine transformation with respect to the drawing data relating to the road tunnel N10 when the switching of the viewpoint is detected.

According to such a configuration, in order to describe the inspection result of the road tunnel N10 with the inside of the road tunnel N10 as a viewpoint, it is not necessary for the user to convert the inspection result into a format that can be input to the look-down diagram (viewpoint conversion is performed). No need). Therefore, it is possible to more efficiently describe the inspection result for the road tunnel N10. More specifically, it is possible to efficiently perform inspection work without requiring sufficient experience of the user, and the possibility of error in describing the inspection result is reduced.

Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical ideas described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

For example, in the above, the road tunnel N10 is shown as part of the entire road tunnel. In this way, when one of the plurality of division data obtained by dividing the entire road tunnel is displayed, the display control unit 115 has input a predetermined transition operation (for example, pressing a transition button) by the user. In that case, the display may be switched to the display of the next divided data. For example, the display control unit 115 inputs a predetermined transition operation in a state where the first division data of the first division data and the second division data obtained by dividing the entire road tunnel is displayed. In this case, the display of the first divided data may be stopped and the display of the second divided data may be started.

Further, in the above, in order to simplify the explanation, the case where the coordinates P (X, Y) of one point are input as the information indicating the deformed position has been described. At this time, an example in which the display images D11 and D12 are also affine-transformed when the switching of the viewpoint is detected has been described. However, when the information indicating the deformed position is the coordinates of one point, the conversion of only the position among the affine transformations may be performed on the display images D11 and D12 (the orientation conversion with respect to the display images D11 and D12). It does not have to be removed).

Further, in the above, an example in which each information acquired by the inspection result data acquisition unit 114 is recorded and controlled by the recording control unit 113 has been described. At this time, the recording control unit 113 may also record and control the identification information (user ID) of the user who used the tablet terminal 10 in association with each information acquired by the inspection result data acquisition unit 114. As an example, when the user ID is associated with the identification information (terminal ID) of the tablet terminal 10, the recording control unit 113 records and controls the user ID associated with the terminal ID of the tablet terminal 10 being used. You can.

1 Information processing system 10 Tablet terminal 110 Control unit 111 Detection unit 112 Processing unit 113 Recording control unit 114 Inspection result data acquisition unit 115 Display control unit 120 Input unit 130 Sensor unit 140 Storage unit 150 Display unit 20 Electronic pen

Claims (12)

A display control unit that controls the display of drawing data related to a predetermined structure according to the user's viewpoint, and
A detection unit for detecting the switching of the viewpoint is provided.
The display control unit is an information processing device that controls the display of the drawing data after the affine transformation with respect to the drawing data when the switching of the viewpoint is detected .
The information processing device includes an inspection result data acquisition unit that acquires inspection result data input by the user with respect to the drawing data after the affine transformation.
The display control unit controls the display of a composite image in which the inspection result data is combined with the drawing data after the affine transformation.
The inspection result data includes information indicating a deformed position in the drawing data after the affine transformation and information indicating a deformed type generated at the deformed position.
The display control unit synthesizes a predetermined display object corresponding to the information indicating the deformation position and the information indicating the deformation type into the drawing data after the affine transformation.
The display object includes a display image and a character string.
When the re-switching of the viewpoint is detected, the display control unit displays the drawing data after the affine transformation for the drawing data after the affine transformation, which is the same as the affine transformation for the display image. The display image after the affine transformation is combined, and the character string after only the position of the same affine transformation as the affine transformation is combined with the character string.
Information processing device . The display control unit controls the display of the drawing data after the affine transformation according to the viewpoint after the switching of the user.
The information processing device according to claim 1. The display control unit obtains the drawing data after the affine transformation in which at least one of left-right inversion and up-down inversion is performed with respect to the drawing data relating to the structure.
The information processing device according to claim 1. The detection unit detects the viewpoint after the switching and
When the viewpoint after the switching is detected, the display control unit controls the display of the drawing data after the affine transformation according to the viewpoint after the switching.
The information processing device according to claim 1. The detection unit detects the viewpoint after the switching based on the viewpoint switching operation input by the user.
The information processing device according to claim 4. The detection unit detects the viewpoint after the switching based on the sensor data detected by the predetermined sensor.
The information processing device according to claim 4. When the drawing data relating to the structure corresponds to the first division data of the first division data and the second division data obtained by the division of the structure, the display control unit performs a predetermined transition operation. When is detected, the display of the first divided data is stopped and the display of the second divided data is started.
The information processing device according to claim 1. The display control unit controls the display of drawing data related to the road surface according to the viewpoint of the user.
The information processing device according to claim 1. The drawing data relating to the structure includes a development view of the structure according to the viewpoint of the user.
The information processing device according to claim 1. The structure includes at least one of a road tunnel, a railroad tunnel, a bridge, a shed, a culvert, and a pedestrian bridge.
The information processing device according to claim 1. Controlling the display of drawing data related to a predetermined structure according to the user's viewpoint, and
Detecting the switching of the viewpoint and
When the switching of the viewpoint is detected, the display of the drawing data after the affine transformation with respect to the drawing data is controlled.
Acquiring the inspection result data input by the user with respect to the drawing data after the affine transformation, and
Controlling the display of a composite image in which the inspection result data is combined with the drawing data after the affine transformation,
The including, an information processing method,
The inspection result data includes information indicating a deformed position in the drawing data after the affine transformation and information indicating a deformed type generated at the deformed position.
The information processing method includes synthesizing a predetermined display object corresponding to the information indicating the deformation position and the information indicating the deformation type into the drawing data after the affine transformation.
The display object includes a display image and a character string.
When the re-switching of the viewpoint is detected, the information processing method is the same as the affine transformation for the displayed image in the drawing data after the affine transformation for the drawing data after the affine transformation. Including synthesizing the display image after the affine transformation is performed, and synthesizing the character string after only the position of the same affine transformation as the affine transformation is performed with respect to the character string.
Information processing method. Computer,
A display control unit that controls the display of drawing data related to a predetermined structure according to the user's viewpoint, and
A detection unit for detecting the switching of the viewpoint is provided.
The display control unit is an information processing device that controls the display of the drawing data after the affine transformation with respect to the drawing data when the switching of the viewpoint is detected .
The information processing device includes an inspection result data acquisition unit that acquires inspection result data input by the user with respect to the drawing data after the affine transformation.
The display control unit controls the display of a composite image in which the inspection result data is combined with the drawing data after the affine transformation.
The inspection result data includes information indicating a deformed position in the drawing data after the affine transformation and information indicating a deformed type generated at the deformed position.
The display control unit synthesizes a predetermined display object corresponding to the information indicating the deformation position and the information indicating the deformation type into the drawing data after the affine transformation.
The display object includes a display image and a character string.
When the re-switching of the viewpoint is detected, the display control unit displays the drawing data after the affine transformation for the drawing data after the affine transformation, which is the same as the affine transformation for the display image. The display image after the affine transformation is combined, and the character string after only the position of the same affine transformation as the affine transformation is combined with the character string.
A program for functioning as an information processing device.

Images