JP5718264B2 - Map survey device, map survey method, and map survey program - Google Patents

Description

  The present invention relates to, for example, an apparatus, method, and program for making it possible to digitize and grasp the contents of a survey in a house map survey with as little trouble as possible.

  Detailed and accurate housing maps are now provided and used in various places. It is preferable that the latest information is reflected on the house map as much as possible, and it is important to re-investigate and update the map information at an appropriate timing. Usually, the re-investigation of the map is based on the printed map at the time of the previous survey (the most recent map reflecting the previous survey), and the investigator finds a different part (difference part) from the previous one while checking each house. This is done by manually writing information on the difference portion on the map. In the map production department, a map on which the re-survey result is handwritten is used as a manuscript, and the original map is updated in accordance with the items entered in the manuscript.

  In this way, the map is re-investigated on a paper basis. In addition to entering the survey results, all inspections and input of the survey results depend on human power. For this reason, there is a problem that re-investigation of the map takes time. In addition, as described above, the investigator searches for different parts from the previous time while checking each house based on the map at the previous time. For this reason, the burden on investigators is large. Regarding the former problem, it is conceivable to use a portable information processing apparatus. As for the latter problem, as in the invention described in Patent Document 1 described later, the image data of the survey location is stored in association with the shooting position and the shooting direction, and the investigator It is conceivable that an image taken at the previous survey is compared with the current situation, a portion where a building or the like has changed is identified, and that portion is the subject of the survey.

Japanese Patent Application Laid-Open No. 09-200366

  However, using the technique described in Patent Document 1 described above, a past image captured at the time of the previous survey, and a situation (image) when viewing the same direction at the same position as when the past image was captured, In many cases, however, it is not effective for map surveys even if parts with different shapes are known. For example, even if the shape of the building has changed, there are many cases in which the resident has not changed, but has simply been rebuilt, renovated, or expanded. On the contrary, it is often the case that the occupants have changed even though the shape of the building has not changed, and examining such changes in the occupants is one of the important matters in the review of the map.

  In view of the above points, an object of the present invention is to, for example, digitize and grasp as much as possible the contents of a survey in a house map survey, and to strongly support the investigator.

In order to solve the above-mentioned problem, the map survey device according to the first aspect of the present invention provides:
Extraction means for analyzing new image information captured at a map survey location and associated with a shooting position and a shooting direction, and extracting character information included in the new image information together with a position on the image;
When past image information having the same shooting position and shooting direction exists, the character information extracted from the new image information and the character information extracted by analyzing the past image information A comparison means for comparing content and position on the image;
Display processing means for displaying the difference part found as a result of the comparison on the display means;
Selection input receiving means for receiving a selection input of the difference portion;
Change information receiving means for receiving input of change information for the selected difference portion;
And recording means for recording the change information in a recording medium in association with the position information of the changed portion.

  According to the map survey apparatus of the first aspect of the present invention, the extraction means analyzes new image information that is photographed at a map survey location and is associated with a photographing position and a photographing direction, and the image information is included in the image information. The included character information is extracted together with the position on the image. When there is past image information in which the new image information, the shooting position, and the shooting direction are the same, the new image information is extracted by analyzing the character information extracted from the new image information and the past image information. The comparison means compares the content of the character information and the display position on the image.

  As a result, a portion (difference portion) that is different between the two is specified, and the display processing means displays the difference portion on the display means. Thereafter, the selection input of the difference portion is received through the selection input receiving means, and the change information about the selected difference portion is received through the change information receiving means. The received change information is recorded on the recording medium by the recording means in association with the position information of the changed portion.

  Thereby, the change information in the map survey can be acquired and stored as electronic data. In addition, based on the difference between the text information contained in the old and new images taken at the same shooting position and the same shooting direction, it is possible to show the investigator where to investigate, and can strongly assist (assist) the investigator. .

  According to the present invention, for example, in a house map survey, it is possible to grasp the contents of the survey by digitizing it with as little trouble as possible. Moreover, the researcher who performs a map survey can be supported strongly by the presentation of the changed part which paid its attention to the character information contained in an image.

It is a block diagram for demonstrating the structural example of the map investigation apparatus 1 of embodiment. It is a figure for demonstrating the example of the storage data of the past image database. 6 is a diagram for explaining an example of data stored in a change information file 133. FIG. It is a flowchart for demonstrating the map investigation assistance process performed with the map investigation apparatus. It is a flowchart following FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG. 6 is a diagram illustrating a display example of a display image displayed on the display unit 123. FIG.

  Hereinafter, embodiments of the apparatus, method, and program of the present invention will be described with reference to the drawings. The present invention can be similarly implemented in map surveys carried out in various countries around the world. However, in the following, for the sake of simplicity, a case where a map survey is performed in Japan will be described as an example.

[Configuration Example of Map Survey Device 1]
FIG. 1 is a block diagram for explaining a configuration example of the map survey device 1 of this embodiment. The map survey device 1 of this embodiment is realized as a portable information terminal called a tablet PC or a pad type information terminal. The term “PC” is an abbreviation for personal computer. First, each part which comprises the map investigation apparatus 1 is demonstrated.

[Basic components of the map survey device 1]
The control unit 100 controls each unit of the map survey apparatus 1, and is a computer in which a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected through a CPU bus 104. Device. The storage device 110 includes a hard disk or a non-volatile memory as a recording medium, and performs writing / recording holding / reading / deleting various application programs and data obtained by various processes to the recording medium. The recording medium of the storage device 110 also stores information such as character data used when character information is extracted by image recognition.

  The transmission / reception antenna 111 and the wireless communication unit 112 realize a function of performing communication through a wide area network such as a mobile phone network or the Internet. That is, the wireless communication unit 112 connects to the Internet, enables transmission / reception of data through the Internet, enables transmission / reception of electronic mail, browsing of Web pages disclosed on the Internet, and the like. The time control unit 120 manages the current date, current day, and current time.

  The key operation unit 121 includes hardware keys provided in the map survey device 1 and accepts an operation input from a user. The display processing unit 122 and the display unit 123 are for displaying display information such as various videos (images) and display messages. The touch panel 124 is affixed to the display screen of the display unit 123, detects a contact position (contact coordinates) by an indicator such as a user's finger, and notifies the control unit 100 of this. Therefore, the touch panel 124 constitutes an input interface together with display information displayed on the display screen of the display unit 123 whose display position is controlled by the control unit 100. The audio output unit 125 and the speaker 126 are for outputting various audio information.

  The camera unit 127 includes an imaging lens, an imaging device, a camera signal processing circuit, and the like, and has a function of capturing an image of a subject and capturing the image as video (image) data of a digital signal. At the time of shooting, the video data captured through the camera unit 127 is supplied to the display processing unit 122 through the control unit 100. The display processing unit 122 forms a video signal to be supplied to the display unit 123 from the video data supplied thereto, and supplies this to the display unit 123. Thus, the video captured by the camera unit 127 is displayed on the display unit 123, and the user can take a picture while confirming the display image on the display unit 123. Note that both a still image and a moving image can be taken through the camera unit 127. However, in this embodiment, in order to simplify the description, for example, a case where a still image is taken in a map survey area will be described.

  The microphone 128 and the sound input unit 129 have a function of collecting sound and capturing it as a digital signal, for example, when capturing a moving image through the camera unit 127. When a video recording instruction (recording instruction) is input through the key operation unit 121 or the touch panel 124, video data captured through the camera unit 127 and audio captured through the microphone 128 and the audio input unit 129 are displayed. For example, the data can be recorded (recorded or recorded) on a recording medium of the storage device 110.

  A map database (hereinafter referred to as a map DB) 131 is created on a large-capacity recording medium such as a hard disk or a non-volatile memory, for example, and at least the map information at the time of the previous survey in the survey area (reflecting the previous survey) The latest map information) is stored and held. The map information can accurately represent the positions and sizes of various houses, buildings, landmarks, facilities, administrative districts, roads, etc. as well as one house or building. The map DB 131 stores map data (map drawing data) such as vector data and raster data for drawing a map in association with latitude / longitude information. The map DB 131 also stores and holds note data displayed on the map in association with latitude / longitude information. The annotation data can also be used as information when a guide display is performed in a display image using augmented reality technology described later.

  The past image database (hereinafter referred to as past image DB) 132 is created on, for example, a large-capacity recording medium such as a hard disk or a non-volatile memory, and is obtained by taking an image through the camera unit 127 at a map survey site. The image data (image information) of the still image is stored and held. FIG. 2 is a diagram for explaining an example of stored data (image data file) stored in the past image DB 132 in a file format, for example. As shown in FIG. 2, the stored data stored in the past image DB 132 includes a file name, shooting date / time, shooting position, shooting direction, other shooting information, image data, display position, and recognized character information.

  In FIG. 2, the file name is automatically generated and assigned by the map surveying apparatus 1 when the stored data is formed. The shooting date and time is information that is acquired at the time of shooting and specifies the shooting date and time. The shooting position is information that is acquired at the time of shooting and identifies the shooting position (location). The shooting direction is information that is acquired at the time of shooting and specifies the shooting direction. The shooting date and time is acquired from the time control unit 120, the shooting position can be acquired from the GPS unit 142 and the like described later, and the shooting direction is information that can be acquired from the direction sensor of the sensor unit 141 and described later. The other shooting information is various shooting information that can be acquired at the time of shooting, and is, for example, various metadata that conforms to Exif (Exchangeable Image File Format). The image data is digital data for forming a subject image obtained by photographing, and is information captured through the camera unit 127.

  In FIG. 2, the display position and the recognized character information are information obtained by analyzing (image recognition processing) image data obtained by photographing, as will be described in detail later. Among these, the recognized character information is character information included in the image formed by the image data, and the display position is information indicating the position of the recognized character information on the image. With this information, the image data specified by the file name can clearly specify when (shooting date and time), where (shooting position), and in which direction (shooting direction) the image was taken. Further, what kind of character information (recognized character information) exists in the image formed by the image data, and the character information is in any position (X (horizontal) direction and Y (vertical) direction) on the image. It can be clearly identified whether it exists (displayed) at the specified position.

  The change information file 133 is created on a large-capacity recording medium such as a hard disk or a non-volatile memory, for example, and stores and holds change information for different parts between the previous map survey and the current map survey. FIG. 3 is a diagram for explaining an example of stored data stored in the change information file 133. As shown in FIG. 3, the storage data stored in the change information file 133 is the management number. , Survey date, investigator code, address code, update classification, location information, building name, number of floors, change contents.

  In FIG. Is automatically given by the map survey device 1 when the change data is formed. The survey date is the current date and time acquired from the time control unit 120 during the map survey, and is information that specifies the date and time when the survey was performed. The investigator code is, for example, information set in advance by the researcher in the map research apparatus 1 and is information for identifying the researcher. The address code is numeric information that identifies the address of the map survey site, and is information that can be acquired from the map DB 131 based on position information described later. The update category is information indicating either new, changed, or deleted, and is basically input by the investigator at the time of the survey. Here, “new” is used when there is a building or the like that is not on the map at the previous survey. “Change” is used when, for example, the building has not changed on the map of the previous survey, but the occupant has changed. “Delete” is used when a building or the like existing on the map at the previous survey was demolished and cleared.

  The position information is longitude and latitude information indicating the changed position on the map. Further, the building name is a name such as “XX building” attached to the building when the changed part is a medium-high-rise building such as a building. The number of floors is information indicating how many floors the changed part is when the changed part is a medium-high-rise building such as a building. The change content is information indicating the specific change content, and information after the change such as the name of a new resident is input.

  The position information is a current position (latitude / longitude) acquired through a GPS unit 142 (to be described later) when changing information is input, or a latitude / longitude specified by indicating a position on a map. The building name, the number of floors, and the change content are information input as change information. And management no. The change information specified by can identify when (survey date) and who (survey code) was investigated. In addition, the address (address code) of the place where the change occurred, the update classification (new, changed, deleted), the exact location (location information) on the map where the update occurred, and if the change location is a building, etc. The building name and number of floors can be specified, and specific changes can be specified.

  The sensor unit 141 includes an acceleration sensor and an orientation sensor. The acceleration sensor detects the inclination of the map survey device 1 in order to determine the vertical direction of the display unit 123, for example. In addition, the direction sensor detects which direction the map survey apparatus 1 is facing by detecting geomagnetism. With this azimuth sensor, when shooting is performed using the camera unit 127, it is possible to detect which direction is being shot. The GPS unit 142 and the GPS antenna 143 are for measuring the current position of the own device.

  The map research apparatus 1 having these configurations displays a map of a survey target area on the display unit 123, and a researcher performs a map survey while confirming the displayed map. When a location where the map information has changed is found, the changed location is specified by instructing the changed location through the touch panel 124 on the map displayed on the display unit 123. Then, change information about the changed portion can be input and stored in the change information file 133 as electronic data.

  The change information can be input by recognizing an image captured through the camera unit 127 or by recognizing audio information received through the microphone 128 and the audio input unit 129. . Of course, it is also possible to input change information by inputting characters through display information displayed on the display unit 123 and a so-called software keyboard constituted by the touch panel 124.

  In addition, the map survey device 1 can create and refer to an email, access the Internet to send and receive emails, and browse web pages by using the wireless communication function of the device itself. . As a result, it is possible to report the survey status to the company by e-mail, or to receive map information reflecting the previous survey of the survey site via the Internet. Of course, the latest map information of the survey location can be provided from a company computer through a digital interface (not shown) and stored in the map DB 131.

[Investigator support function during map survey]
The map survey device 1 according to this embodiment implements a function for supporting a researcher who performs a map survey using an image recognition technology or an augmented reality technology. As a part for realizing the function of supporting the investigator, a character information extraction unit 151, a comparison processing unit 152, a notification processing unit 153, and an augmented reality processing unit 154 are provided.

  The character information extraction unit 151 performs analysis using image recognition technology on image data obtained by photographing through the camera unit 127 at the survey site, and character information included in an image formed by the image data and the characters The position of the information on the image (display position) is extracted. The character information included in the image is information described mainly on a signboard, a sign, a nameplate, and the like. Then, the character information extraction unit 151 checks whether or not image data captured in the past at the same shooting position and the same shooting direction as the current shooting exists in the past image DB 132.

  As a result of this confirmation, it is assumed that image data captured in the past at the same shooting position and the same shooting direction as the current shooting does not exist in the past image DB 132. In this case, the character information extracting unit 151 forms storage data (image data file) having the mode shown in FIG. 2 including the image data obtained by photographing this time, and records this in the past image DB 132. Do. Further, as a result of the confirmation, it is assumed that image data captured in the past at the same shooting position and the same shooting direction as the current shooting exist in the past image DB 132. In this case, the character information extraction unit 151 receives the character information included in the image formed by the past image data in the comparison processing unit 152 through the control unit 100 and the image data (current image data) obtained by the current shooting. Requests a comparison process with character information included in the image to be formed.

  The comparison processing unit 152 compares the character information extracted from past image data taken at the same shooting position and the same shooting direction with the contents of the character data extracted from the latest image data obtained by the latest shooting and the image data. Compare locations to identify differences. As will be described in detail later, the comparison processing unit 152 displays an image corresponding to past image data captured at the same shooting position and the same shooting direction and an image corresponding to the latest image data captured most recently. 123.

  In this case, the comparison processing unit 152 determines, for example, a portion (difference portion) in which character information is different between an image corresponding to the past image data and an image corresponding to the current image data captured most recently. It is shown in the image according to the current image data so that the investigator can recognize it. As a result, for example, a part where the content or position of a signboard, a sign, a nameplate, etc. has changed between the past image at the time of the previous survey and the current image at the time of the current survey is identified, and the map information changes for that part Since there is a high possibility that it has been conducted, the investigator can be informed that the investigation is conducted without leakage.

  The notification processing unit 153 notifies the investigator of the survey location and the survey time based on the information obtained by analyzing the image data obtained by photographing through the camera unit 127 during the previous survey. Process. For example, it is assumed that the image data of the notice board of the architectural plan set up in the vacant land at the previous survey is obtained by photographing through the camera unit 127 and stored in the past image DB 132. In this case, based on the “place name of the building site”, which is the text information obtained by analyzing the image data of the notice signboard of the building plan, the location to be investigated (location number, etc.) must be reported. Or reporting the survey time based on “scheduled completion”.

  However, it is not limited to the notice signboard of the architectural plan. For example, a signboard notifying that a change will occur in map information, such as a signboard for occupying a condominium or an apartment, a signboard notifying the opening of a store, etc., is photographed, and character information is extracted and stored by image recognition. Keep it. And according to the said character information, a place, an entering time, a store opening time, etc. can be specified, and an investigation place and an investigation time can be alert | reported to an investigator.

  As described above, the augmented reality processing unit 154 displays an image captured by the camera unit 127 on the display unit 123 through the control unit 100 and the display processing unit 122. Processing for adding and displaying the annotation data of the DB 131 is performed. In this case, the shooting position can be specified through the GPS unit 142, and the shooting direction can be specified by the direction sensor of the sensor unit 141. The image range captured by the camera unit 127 is specified by taking into consideration the shooting position and shooting direction, shooting information of the camera unit 127, and the like (accompanying information obtained when an image is captured through the camera unit 127). be able to.

The shooting information of the camera unit 127 is specifically various information recorded according to the above-described Exif. In other words, an Exif-compliant device having a camera function can acquire various information such as image width, image height, image bit depth, compression type, and so on. By considering this, the image range captured by the camera unit 127 can be accurately specified. The details of the Exif standard are, for example, Web pages of CIPA (Camera & Imaging Products Association).
It can be viewed at “http://www.cipa.jp/hyoujunka/kikaku/cipa-kikaku_list.html”.

  Then, the augmented reality processing unit 154 acquires annotation data about buildings and the like existing in the specified image range from the map DB 131 and specifies display positions of the display units 123 on the display screen. Then, the annotation data and the display position on the display screen are supplied to the display processing unit 122, and the camera unit 127 captures the annotation data such as the building name on the image displayed on the display unit 123. Can be displayed. As a result, the investigator can obtain information such as the building name, facility name, and intersection name on the image displayed on the display unit 123 by capturing the camera unit 127 without checking the map information one by one. And map survey can be performed accurately.

  As described above, the map survey device 1 according to the present embodiment is a portion in which the content and position (position on the image) of the character information are different between the image captured during the previous survey and the image captured during the current survey. Can be identified and shown to the investigator. Thereby, the place where the map information is likely to change can be clearly shown to the investigator, and the investigator can be supported. Also, note data or the like can be displayed on the image from the camera unit 127 using augmented reality technology. Thereby, it is possible to assist the investigator, such as clearly identifying the survey location not only through the map information displayed on the display unit 123 of the map survey apparatus 1 but also through the image captured through the camera unit 127.

[About the map survey process in the map survey device 1]
Next, a map survey support process performed by the map survey device 1 of this embodiment having the configuration shown in FIG. 1 will be described. 4 and 5 are flowcharts for explaining the map survey support process. 6 to 10 are diagrams illustrating display examples of display images and the like displayed on the display unit 123 of the map survey device 1 in the map survey support process. The processing shown in the flowcharts of FIGS. 4 and 5 is executed by the control unit 100 when the map survey apparatus 1 is turned on at the map survey site.

  When the processing shown in FIGS. 4 and 5 is executed, the control unit 100 first controls the GPS unit 142 to start positioning of the current position of the own device (step S101). Then, the control unit 100, based on the current position from the GPS unit 142 that has started positioning in step S101, a map of the area including the current position, and when taking an image in the past in the area Performs a process of displaying information indicating that an image has been taken in the past (step S102).

  In step S <b> 102, the control unit 100 first reads out the map information of the area including the current position from the GPS unit 142 from the map DB 131 and displays it on the display unit 123 through the display processing unit 122. Furthermore, when there is an image captured in the past in the area, the control unit 100 displays the reduced image of the image on the map using the data stored in the past image DB 132 (image data file). . A mark indicating the current position is also displayed on the map.

  By the processing in step S102, a map of the area including the current position is displayed on the display screen 123G of the display unit 123, for example, as shown in FIG. The current position is indicated by a black square mark. Also, as shown in FIG. 6, a reduced image of the past image is displayed for a place where the image has been taken in the past. In the case of the example shown in FIG. 6, it is displayed that there are images taken in the past of each floor information board installed for “XXX building” and “△ XXX real estate”. Yes.

  Even when past images are reduced and displayed, it is considered that images taken in the vicinity may overlap and become unrecognizable. For this reason, referring to the shooting position and shooting direction of the stored data in the past image DB 132, when there is an image shot in the past in the area, first, the shooting position and shooting of the image shot in the past are first represented by simple symbols. Display direction. In the case of the example shown in FIG. 6, a black circle mark and an arrow on the map indicate a place (photographing position) and a direction (photographing direction) where an image has been taken in the past in the area. Then, when an instruction is made by bringing a finger or the like into contact with the touch panel 124 at the position where the black circle mark and the arrow shown on the map are displayed, a reduced image of an image captured in the past at that location is displayed in the past image DB 132. It is also possible to form based on the stored data and display it.

  Thereafter, the control unit 100 accepts an operation input from the user through the touch panel 124 or the key operation unit 121 (step S103), and determines whether or not the accepted operation input instructs activation of the camera unit 127 ( Step S104). When it is determined in the determination process in step S104 that the camera unit 127 is not instructed to start, the control unit 100 determines whether or not the received operation input is an instruction to end the map survey support process (step S105). ). When it is determined in the determination process in step S105 that the end instruction has been received, the control unit 100 performs a predetermined end process such as ending the operation of the GPS unit 142 and turning off the power (step S106). Then, the process shown in FIG.

  If it is determined in the determination process in step S105 that an end instruction has not been received, the control unit 100 performs a process according to the received operation input (step S107), and thereafter repeats the process from step S102. . In step S107, normal change information input processing, such as receiving an instruction input of a place where the change has occurred, or receiving an input of change information, is performed.

  Then, in the determination process in step S104, it is determined that the operation input received in step S103 is an instruction to start the camera unit 127. In this case, the control unit 100 activates the camera unit 127 to display the video from the camera unit 127 on the display unit 123 and controls the augmented reality processing unit 154 to guide the video displayed on the display unit 123. A process of superimposing the display is performed (step S108). In step S <b> 108, the control unit 100 activates the camera unit 127 and supplies video data from the camera unit 127 to the display processing unit 122 through the control unit 100. Thereby, the video captured by the camera unit 127 can be displayed on the display unit 123.

  Furthermore, in step S108, the augmented reality processing unit 154 functions, and based on the current position from the GPS unit 142, the shooting direction from the orientation sensor of the sensor unit 141, the shooting information of the camera unit 127, and the like, An image range captured by 127 is specified. Then, the augmented reality processing unit 154 acquires note data about buildings and the like existing in the specified image range from the map DB 131, and specifies the display positions on the display screen. Then, the augmented reality processing unit 154 supplies the annotation data and the display position on the display screen to the display processing unit 122 through the control unit 100.

  Thus, for example, as shown in FIG. 7, the camera unit 127 captures and displays the annotation data such as the building name superimposed on the video displayed on the display screen 123 </ b> G of the display unit 123. In other words, it is assumed that the investigator who has the map survey device 1 is at the position indicated by the black square mark P in FIG. 6 and captures the direction indicated by the dotted arrow from this position through the camera unit 127. In this case, as shown in FIG. 7, an image captured by the camera unit 127 is displayed on the display screen 123 </ b> G of the display unit 123. And augmented reality technology is used, the building on the left side is “△ ○ △ Real Estate”, the building on the left side is “XXX Building”, the building on the right side is “XX Building”, and the building on the right side is “□□” Annotation data and the like are superimposed and displayed as “building”. Thus, the investigator can accurately grasp the names of neighboring buildings in the survey area in the video captured through the camera unit 127 without checking the map.

  Thereafter, the control unit 100 receives an operation input from the user through the touch panel 124 or the key operation unit 121 (step S109), and determines whether or not the received operation input is an operation (shutter operation) instructing to perform shooting. It discriminate | determines (step S110). When it is determined in the determination process of step S110 that the operation is not an instruction to perform shooting, the control unit 100 determines whether or not the received operation input is an instruction to end the map survey support process (step S111). .

  When it is determined in the determination process of step S111 that the end instruction has been received, the control unit 100 performs a predetermined end process such as stopping the operation of the GPS unit 142 and turning off the power (step S112). Then, the processing shown in FIGS. 4 and 5 ends. If it is determined in the determination process in step S111 that an end instruction has not been received, a valid operation input has not been received, and the control unit 100 repeats the process from step S108.

  In the determination process of step S110, when it is determined that the received operation input is an operation for instructing to perform shooting, the control unit 100 executes the shooting process (step S113). In step S <b> 113, the control unit 100 takes in the image data of the image captured through the camera unit 127 and records it on a recording medium of the storage device 110, for example. Then, the control unit 100 acquires the shooting date and time, the shooting position, and the shooting direction (step S114). In step S114, the control unit 100 acquires the current date and time provided by the time control unit 120 as the shooting date and time, acquires the current position from the GPS unit 142 as the shooting position, and detects from the azimuth sensor of the sensor unit 141. Get output as shooting direction.

  In addition, when photographing each floor information board installed in the building, the current position may not be acquired through the GPS unit 142 because radio waves from the GPS satellite cannot be received. In such a case, the control unit 100 displays the map read from the map DB 131 on the display unit 123 based on the current position acquired from the GPS unit 142 most recently. And the control part 100 receives the instruction | indication input of the imaging position from a user through the touch panel 124 on the said displayed map. In this case, the control unit 100 can display a message prompting the user to input the shooting position on the display unit 123 through the display processing unit 122 or emit sound from the speaker 126 through the audio output unit 125. In addition, if the shooting direction cannot be specified by the orientation sensor of the sensor unit 141 for some reason, it is possible to accept an input of the shooting direction through the touch panel 124 on the map.

  After the process of step S114, the control unit 100 proceeds to the process of step S115 in FIG. The control unit 100 controls the character information extraction unit 151 to analyze the image data acquired by the photographing process in step S113, and to detect the character information included in the image formed by the image data and the character information on the image. Are extracted (step S115). By the processing from step S113 to step S115, the image data file having the mode shown in FIG. 2 as the data stored in the past image DB 132 is formed.

  Thereafter, the control unit 100 refers to the past image DB 132 based on the shooting position and shooting direction acquired in step S114 and determines whether there is past image data having the same shooting position and shooting direction. (Step S116). Assume that in the determination processing in step S116, it is determined that there is no past image data having the same shooting position and shooting direction. In this case, the control unit 100 creates an image data file having the mode shown in FIG. 2 based on the information acquired by the processing from step S113 to step S115 described above, and performs processing for recording this in the past image DB 132. (Step S117). Thereafter, the control unit 100 repeats the processing from step S102 shown in FIG.

  Also, in the determination process in step S116, it is determined that there is past image data having the same shooting position and shooting direction. In this case, the control unit 100 controls the comparison processing unit 152 so that the character information included in the image captured this time and the character information included in the image captured in the past are the same in the shooting position and the shooting direction. A process of comparing the position on the image is performed (step S118). Then, under the control of the control unit 100, the comparison processing unit 152 displays the result of the comparison processing in step S118 on the display unit 123 through the display processing unit 122 (step S119).

  For example, it is assumed that there are previous (previous) and current (present) image data acquired by photographing outdoors. In this case, as shown in FIG. 8, the comparison processing unit 152 displays an image corresponding to past image data on the upper half of the display screen 123G, and displays an image corresponding to the image data captured this time at the bottom of the display screen 123G. Image data to be displayed in half is formed and supplied to the display processing unit 122. As a result, the image corresponding to the past image data and the image corresponding to the current image data are displayed on the display screen 123G in a manner as shown in FIG. Further, as shown in FIG. 8, the comparison processing unit 152 includes marks S1, S2, and mark S1, S2, and the like on portions where the content of the character information and the position on the image are different from the previous image. S3 is displayed. Therefore, in the case of the example shown in FIG. 8, “Karaoke XX” is available on the third floor of “XYZ Building” (the occupancy), and the building that was “Co., Ltd. △△” becomes “XX Bank”. Changes have become obvious at a glance.

  It is also assumed that there are previous (previous) and current (present) image data acquired by photographing each floor guide board installed in the building. Also in this case, the comparison processing unit 152 performs the same processing as that described with reference to FIG. That is, as shown in FIG. 9, the comparison processing unit 152 divides the display screen 123G vertically into two, and displays the previous captured image in the upper half and the current captured image in the lower half. Further, the comparison processing unit 152 adds marks S4 and S5 to portions where the content of the character information and the position on the image are different from the previous image on the current captured image displayed in the lower half of the display screen. Therefore, in the case of the example shown in FIG. 9, the fourth floor changes from “□□ Tokyo Branch Co., Ltd.” to “(ABC Sangyo Co., Ltd.)” and the first floor changes from “Co., Ltd.” to “Coffee Shop △ It becomes clear at a glance that it has changed to □.

  Thereafter, the control unit 100 accepts an operation input from the user through the touch panel 124 or the key operation unit 121 (step S120), and determines whether or not the accepted operation input is a position indication of a changed portion made through the touch panel 124. (Step S121). For example, when the difference display shown in FIG. 8 is displayed, an operation or the like for indicating a portion surrounded by marks S1, S2, and S3 indicating the difference portion is an operation input for position indication. In addition, when the difference display shown in FIG. 9 is performed, an operation for instructing a portion surrounded by marks S4 and S5 indicating the difference portion is an operation input for position indication. Of course, when a part other than the different part is used as the changed part, an operation for designating the target part may be performed.

  In the determination process of step S121, when it is determined that the received operation input is a position instruction of a change place made through the touch panel 124, the control unit 100 performs a selection input of an input unit that receives an input of change contents. Accept (step S122). The map survey device 1 of this embodiment includes three input means as described above. One is an image recognition input for extracting and inputting a change content by recognizing an image taken through the camera unit 127. The other one is voice recognition input for inputting change contents by voice recognition of voice information received through the microphone 128 and the voice input unit 129. The last one is type input (character input) for inputting change contents through display information displayed on the display unit 123 and a so-called software keyboard configured by the touch panel 124.

  The researcher selects a means for inputting the change contents according to the situation of the survey site. For example, since it is the image recognition input that can input the change contents most simply and accurately, the image recognition input is usually selected. However, when there is no signboard, sign, nameplate, etc., or the characters written on the signboard, sign, nameplate, etc. are too small or difficult to recognize because of the special typeface, voice input is selected. However, when the surrounding noise is so strong that voice input is not possible, type input is selected. In this way, the surveyor selects the most suitable input means according to the situation of the survey site.

  And the control part 100 receives the input of a change content through the input means selected by step S122 (step S123). In step S123, a change content input screen corresponding to the selected input means is displayed, and the input of the change content is accepted. Specifically, a signboard or nameplate that is different from the previous time is photographed through the camera unit 127, or the description content of the signboard or nameplate is input by voice through the microphone 128 and the voice input unit 129. Is entered through the touch panel 124.

  Thereafter, for example, as illustrated in FIG. 10, the control unit 100 displays the input change content or the like on the display unit 123 of the map survey apparatus 1 and receives a correction input (step S <b> 124). In the example shown in FIG. 10, the change information is displayed on the upper side of the display screen 123G, and the software keyboard is displayed on the lower side. Then, if necessary, information to be changed is selected through the touch panel 124, and the information is corrected and input through the software keyboard.

  Thereafter, the control unit 100 determines whether or not the “OK” button BT2 is operated on the change information display screen illustrated in FIG. 10 (step S125). When it is determined in the determination process in step S125 that the “OK” button BT2 has been operated, the control unit 100 determines whether the management No. To the change information file 133 is registered in the change information file 133 (step S126), and the processing from step S120 is repeated. When it is determined in the determination process in step S125 that the “OK” button BT2 has not been operated, the control unit 100 determines whether or not the “delete” button BT1 has been operated on the change information display screen shown in FIG. Is determined (step S127).

  When it is determined in the determination process of step S127 that the “delete” button BT1 is operated, the control unit 100 deletes the displayed change information and discards the input change content (step S128). Thereafter, the processing from step S120 is repeated. If it is determined in the determination process in step S127 that the “erase” button BT1 is not operated, the control unit 100 repeats the process from step S124, and accepts correction of the change information.

  Also, in the determination process of step S121 described above, when it is determined that the operation input received in step S120 is not a change location position instruction, the control unit 100 has performed a predetermined operation instructing “no change”. It is determined whether or not (step S129). Assume that in the determination processing in step S129, it is determined that a predetermined operation instructing “no change” has been performed. In this case, the control unit 100 forms an image data file in the format shown in FIG. 2 from the information acquired by the processes in steps S113 to S115, and performs a process of updating this to the past image DB 132 (step S130). In step S130, the image data file formed this time is registered in place of the past image data file having the same shooting position and shooting direction. If it is determined in the determination process in step S129 that the predetermined operation for instructing “no change” is not performed, the control unit 100 repeats the process from step S120.

  In this way, in the survey area of the map, in the image captured in the past and the image captured this time, the contents and display positions of the character information included in those images are compared, and the location where the map information has changed is determined. You can identify and investigate the location.

  It is assumed that the past image is an image of an architectural plan notice signboard and the current image is, for example, an image of a completed building. In this case, it is meaningless to compare the contents of character information and the display position. Therefore, in step S119 shown in FIG. 5, for example, as shown in FIG. 11, the image of the notice board of the architectural plan is displayed on the upper half of the display screen 123G, and the current image is displayed on the lower half of the display screen 123G. (Image of newly constructed building) is displayed. Then, for the current image displayed in the lower half of the display screen 123G, a comment is displayed indicating that a new building is completed and investigation is necessary. In this case, although it is different from the difference display shown in FIGS. 8 and 9, it becomes obvious at a glance that the building existing in the current image needs to be investigated. In addition, in order to simplify the explanation, a sample image of a notice board for an architectural plan without detailed information is shown in the upper part of FIG.

[Effect of the embodiment]
By using the map survey device 1 according to the above-described embodiment, it is possible to clearly indicate the location where the map information has changed. This will not cause any oversight of the investigator. That is, it is possible to strongly support the map survey conducted by the researcher. Moreover, the change information about the location where the map information has been changed can be input and stored in the map survey device 1 as electronic data. Therefore, since the map information can be updated to the latest state based on the change information of the electronic data stored in the map survey device 1, the load of the map update work can be reduced.

[Modifications, etc.]
In the above-described embodiment, this is notified when the character information of the past photographed image and the character information of the current photographed image are different in content and display position. However, it is not limited to this. For example, when the signboard of the architectural plan shown in FIG. 11 is photographed and the image data is stored and held, at least the scheduled completion date and the place name / location number of the building site are recognized by performing image recognition. Keep it. Then, when the scheduled completion date has passed, the scheduled completion date and the place name / location number of the building site can be displayed on the display unit 123 to prompt a resurvey.

  In this case, the past image and the current image are not a comparison of character information, but are a notification of an investigation timing and an investigation place based on the character information included in the past image. This function can be realized by the cooperation of the notification processing unit 153 and the time control unit 120 under the control of the control unit 100. Further, such notification of the survey timing and survey location is not possible only by the image of the notice signboard of the building plan. For example, after shooting advertisements and signboards for various stores, advertising billboards for condominiums, etc., recognizing character information contained in the captured images, It is possible to display information indicating the shooting location and prompt the user to conduct a re-survey. That is, based on the character information obtained by analyzing the captured image information, it is possible to identify the timing at which re-survey is necessary and the location where re-survey is necessary, and notify the investigator.

  In the above-described embodiment, the case where a map survey is performed in Japan has been described as an example. However, the embodiment can be similarly realized in various countries around the world. When realized in a country other than Japan, only the type (language) of recognized character information is different.

  In addition, after the survey is completed, the survey result can be transferred to a computer device such as a company through a digital interface, or can be transmitted to a computer or the like that performs map information update processing through the Internet at a definition timing.

  The camera unit may not be mounted on the map survey device 1. In other words, the camera unit may be a so-called external camera module that can be connected to the map research apparatus 1 through a digital interface or the like.

  In Japan, it is possible to measure the current position using GPS by using signals from Michibiki, a quasi-zenith orbit satellite that stays over the Japanese archipelago for a long time. It can be done accurately. That is, the map survey support can be performed with high reliability.

[Others]
As can be seen from the description of the embodiment described above, the function as the extraction means of the map survey device is realized by the character information extraction unit 151 of the map survey device 1, and the function as the comparison means of the map survey device is the map The comparison processing unit 152 of the investigation device 1 is realized. Further, the display unit 123 of the map survey device 1 realizes the function as the display means of the map survey device, and the display processing unit 122 of the map survey device 1 realizes the function as the display processing means of the map survey device ing. Further, the function as the selection input receiving means of the map survey apparatus is realized by the touch panel 124 and the key operation unit 121 of the map survey apparatus 1, and the functions as the change information receiving means of the map survey apparatus are the camera section 127 and the microphone 128. The voice input unit 129, the touch panel 124, or the key operation unit 121 is realized. Further, the change information file 133 functions as a change information recording medium of the map survey device, and the control unit 100 realizes a function as a change information recording means of the map survey device.

  In addition, the past image DB 132 realizes the function of the map surveying apparatus as the image information recording medium, and the control unit 100 realizes the function of the map researching apparatus as the image information recording means. The function as the notification processing means of the map survey device is realized by the notification processing unit 153 of the map survey device 1. Each function as an imaging unit, a positioning unit, an orientation sensor, a map information storage unit, and an augmented reality processing unit of the map survey device includes a camera unit 127 of the map survey device 1, a GPS unit 142, an orientation sensor of the sensor unit 141, The map DB 131 and the augmented reality processing unit 154 are realized. In addition, the functions of the image recognition input unit, the voice recognition input unit, and the type input unit of the map survey apparatus are the functions of the camera unit 127, the microphone 128, the voice input unit 129, the touch panel 124, and the control unit 100 of the map survey apparatus 1. Realized.

  The processing shown in the flowcharts of FIGS. 4 and 5 corresponds to the map survey method used in the map survey device of the present invention. Moreover, the program which performs the process according to the flowchart of FIG. 4, FIG. 5 is a map investigation program performed with the map investigation apparatus of this invention. Therefore, the map survey device of the present invention can be easily realized by forming a program for executing the processing shown in FIGS. 4 and 5 and mounting the program on the tablet PC so that the program can be executed on the tablet PC. can do.

  DESCRIPTION OF SYMBOLS 1 ... Map investigation apparatus, 100 ... Control part, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... CPU bus, 110 ... Memory | storage device, 111 ... Transmission / reception antenna, 112 ... Radio | wireless communication part, 120 ... Time control part, DESCRIPTION OF SYMBOLS 121 ... Key operation part, 122 ... Display processing part, 123 ... Display part, 124 ... Touch panel, 125 ... Audio | voice output part, 126 ... Speaker, 127 ... Camera part, 128 ... Microphone, 129 ... Voice input part, 131 ... Map DB 132 ... Past image DB, 133 ... Change information file, 141 ... Sensor unit, 142 ... GPS unit, 143 ... GPS antenna, 151 ... Character information extraction unit, 152 ... Comparison processing unit, 153 ... Notification processing unit, 154 ... Extension Reality processing department

Claims (7)

Extraction means for analyzing new image information captured at a map survey location and associated with a shooting position and a shooting direction, and extracting character information included in the new image information together with a position on the image;
When past image information having the same shooting position and shooting direction exists, the character information extracted from the new image information and the character information extracted by analyzing the past image information A comparison means for comparing content and position on the image;
Display processing means for displaying the difference part found as a result of the comparison on the display means;
Selection input receiving means for receiving a selection input of the difference portion;
Change information receiving means for receiving input of change information for the selected difference portion;
A map survey apparatus comprising: a recording unit that records the change information in a recording medium in association with the position information of the changed part. The map survey device according to claim 1,
A map survey apparatus comprising image information recording means for recording at least the new image information on a predetermined recording medium when there is no past image information having the same shooting position and shooting direction. The map survey device according to claim 2,
A map survey apparatus comprising: a notification processing means for reporting a re-survey timing and a re-survey location based on character information extracted by analyzing the image information recorded on the predetermined recording medium. A map survey device according to any one of claims 1, 2 or 3,
Imaging means;
A positioning method of the current position;
An orientation sensor for detecting an imaging direction by the imaging means;
Map information storage means for storing and holding map information;
Information relating to the map stored in the map information storage unit based on the current position measured by the positioning unit and the shooting direction detected by the azimuth sensor for the video captured through the imaging unit A map survey apparatus comprising: augmented reality processing means for adding and displaying on a display means using augmented reality technology. A map survey device according to any one of claims 1, 2, 3, or 4,
The change information receiving means includes an image recognition input means, a voice recognition input means, and a type input means, and selects one of them to input change information. The extraction unit analyzes new image information that is shot at the map survey location and associates the shooting position with the shooting direction, and extracts character information included in the new image information together with the position on the image. An extraction process;
When there is past image information having the same shooting position and shooting direction, the comparison unit is extracted by analyzing the character information extracted from the new image information and the past image information. A comparison process for comparing the content of the character information and the position on the image;
A display processing step in which the display processing means displays the difference portion found as a result of the comparison on the display means;
A selection input receiving step of receiving a selection input of the difference portion through a selection input receiving means;
A change information receiving step for receiving input of change information about the selected difference portion through the change information receiving means;
And a recording step of recording the change information in a recording medium in association with the position information of the changed portion. A program executed by a computer mounted on a map survey device,
Through the extraction means, new image information that has been photographed at the map survey location and is associated with the photographing position and the photographing direction is analyzed, and character information included in the new image information is extracted together with the position on the image. An extraction step;
Extracted by analyzing the character information extracted from the new image information and the past image information through comparison means when there is past image information having the same shooting position and shooting direction. A comparison step for comparing the content of the character information and the position on the image;
A display processing step of displaying on the display means the difference portion found as a result of the comparison through the display processing means;
A selection input receiving step of receiving a selection input of the difference portion through a selection input receiving means;
A change information receiving step for receiving input of change information for the selected difference portion through the change information receiving means;
And a recording step of recording the change information in a recording medium in association with the position information of the changed portion through a recording means.

Images