JP2015056152A - Display control device and method for controlling display control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable an image which could have been recognized by an image retriever to be easily retrieved.SOLUTION: There is provided a display control device for retrieving, from a plurality of pieces of preregistered image data, image data in which a specific object to be retrieved is seen and displaying the retrieved image data, the display control device comprising retrieval range calculation means for calculating, from position information and path information about the object to be retrieved, a position range in which an image is retrieved, and order of priority setting means for imparting an order of priority to the retrieval result on the basis of the position information about the object to be retrieved and image information about the retrieved image, the display control device enabling time and labor for retrieving an image which could have been recognized by an image retriever to be dispensed with by acquiring a position and direction as well as path information.

Description

  The present invention relates to a display control device and a control method of the display control device, and more particularly to a technique suitable for searching for an image in which a specific subject is captured from a plurality of images.

  In order to search for an image of a specific subject such as a historic site or a building from images taken by a plurality of cameras, a conventional image search device specifies the subject using camera position information and orientation information, and then captures the image. Images around the position and around the subject were searched.

  For example, Patent Document 1 discloses a technique for finding a building by comparing image data and map data using camera position information and azimuth information, and searching for an image taken near the building. Patent Document 2 discloses a technique for searching for image data close to the shooting location and shooting date and time of image data desired to be searched.

JP 2009-225279 A JP 2009-176262 A

  However, in the prior art disclosed in the above-mentioned patent document, an image near the subject or the shooting position is searched. However, in which place near the subject and the shooting position, the image shot in which direction is searched. I did not understand.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to obtain a search result more appropriate for a user in image search.

  The display control device according to the present invention is a display control device that searches and displays image data in which a specific search object is captured from a plurality of pre-registered image data, the position information of the search object And search range calculation means for calculating a position range for searching for an image from route information, and priority order setting for giving priority to search results based on the position information of the search object and the image information of the searched image Means.

  According to the present invention, it is possible to provide a display control device capable of obtaining a search result more appropriate for a user in searching for an image.

It is explanatory drawing which shows the outline | summary of the image search system by embodiment of this invention. It is a block diagram which shows the structural example of the imaging device by 1st Embodiment. It is a flowchart explaining the procedure of the data processing of the imaging device by 1st Embodiment. It is a block diagram which shows the structural example of the server by 1st Embodiment. It is a flowchart explaining the procedure of the data processing of the server of 1st Embodiment. It is a flowchart explaining the procedure of the image search of the server by 1st Embodiment. It is a figure which shows the example of the imaging condition search range by 1st Embodiment. It is a figure which shows the example of an expansion of the imaging condition search range by 1st Embodiment. It is a figure which shows the example of priority assignment | providing of the search imaging condition by 1st Embodiment. It is explanatory drawing of the priority determination method of the image-based display method by 1st Embodiment. It is explanatory drawing of the priority determination method of the distance-based display method by 1st Embodiment. It is a block diagram which shows the structural example of the user terminal by 1st Embodiment. It is a flowchart which shows an example of the procedure of the data processing of the user terminal by 1st Embodiment. It is a flowchart which shows an example of the procedure of the data processing of the user terminal by 1st Embodiment. It is a figure which shows the calculation example of the search route data by the search result display method on the map by 1st Embodiment. It is a figure which shows the calculation example of the search route data by the search result display method of the route order by 1st Embodiment. It is a figure which shows the example of a search result display on the map by 1st Embodiment. It is a figure which shows the example of a search result display of the order of a path | route by 1st Embodiment. It is a block diagram which shows the structural example of the user terminal by 2nd Embodiment. It is a flowchart explaining the procedure of the data processing of the user terminal by 2nd Embodiment. It is a flowchart explaining the image search process of the server by 2nd Embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
<First Embodiment>
Hereinafter, image search processing according to the first embodiment of the present invention will be described with reference to the drawings.
[System Overview]
FIG. 1 is an explanatory diagram showing an outline of an image search system using the display control apparatus of the present invention. The image search system includes an imaging device 100, a server 101, and a user terminal 102, and communicates data between the imaging device 100, the server 101, and the user terminal 102 via the Internet 103 or the like. The photographing apparatus 100 and the user terminal 102 can be used together. The image search system configured as described above searches for an image in which a specific search object is captured from a plurality of image data registered in advance.

  The photographing apparatus 100 has means for photographing a subject to generate an image and detecting a photographing position and a photographing direction. The server 101 has means for recording an image photographed by the photographing apparatus 100 and photographing conditions. ing. Further, the user terminal 102 has means for displaying the image information output from the server 101 on a map. The photographing apparatus 100, the server 101, and the user terminal 102 each include a communication unit.

  The server 101 can be configured by a known personal computer. As the imaging device 100 and the user terminal 102, a mobile phone with a camera such as a smartphone, a digital camera with a communication device such as a wireless LAN, a laptop computer, a so-called tablet device, or the like can be used.

In the above system, first, the image capturing apparatus 100 transmits original image data 104 obtained by image capturing to the server 101. When the received original image data 104 includes shooting condition data, the server 101 divides the image data 105 and the shooting condition data 106 and records them in the database. In this process, not only the image capturing apparatus 100 but also image data from other apparatuses are recorded in the database. As a result, a lot of image data and shooting condition data are accumulated in the database of the server 101.
On the other hand, the user terminal 102 transmits information serving as a search key to the server 101 in order to obtain desired image data from the image data stored in the server 101. In the present embodiment, the information transmitted here is three of search position data 107, display condition data 108, and search route data 109.

  The search position data 107 is the position of the search target designated on the user terminal 102. The display condition data 108 is data that specifies how to display the searched image on the user terminal 102. The display condition data includes the number of display images specified by the user (that is, the number of images received from the server 101), and the distance from the nearest point to be searched for the image data to be displayed (specified distance). Further, there are a selection flag for displaying images on the map / in order of route, a selection flag for image base display / distance base display, and the like. The search route data 109 is a route that is an image search target extracted from the route data recorded in the user terminal 102. The generation method and use method of these data will be described later, and the description will proceed first.

When the server 101 receives the search position data 107, the display condition data 108, and the search route data 109 from the user terminal 102, the image data corresponding to the conditions based on these data and the image corresponding to the image condition data 106 are obtained. Data 105 is searched. The image capturing condition data 106 and the image data 105, which are the search results, are collectively transmitted to the user terminal 102 as the search image data 110.
The user terminal 102 that has received the search image data 110 transmitted from the server 101 outputs an image of the obtained search image data 110 according to the display condition data 108.
The above is the basic configuration of this system. For example, the server 101 may record the original image data 104 including the shooting condition data without dividing the image data 105 and the shooting condition data 106. Further, the photographing condition data 106 may be divided and transmitted to the server 101 on the photographing apparatus 100 side.
A system for realizing such an overall configuration and an implementation method thereof will be described below with reference to embodiments.

[Image transmission processing by photographing apparatus 100]
FIG. 2 is a block diagram illustrating a configuration example of the imaging apparatus 100 according to the embodiment of the present invention, and FIG. 3 is a flowchart illustrating a data processing procedure performed by the imaging apparatus 100.
In the present embodiment, a small communication terminal with a camera is cited. The photographing apparatus 100 includes a CPU 200 that performs arithmetic processing, a memory 201 such as a ROM / RAM that cooperates therewith, an image storage unit 202, a display unit 203 that displays a screen, and an operation input unit 204 that transmits user input to the CPU 200. .

  Furthermore, in addition to the communication unit 205 for connecting to and communicating with a network such as the Internet 103, a shooting unit 206 that shoots a subject and generates an image, and a position such as a GPS sensor that detects the position of the shooting device And a detection unit 207. In addition, the direction detection unit 208 including a gyro sensor and a magnetic direction sensor that detect the direction of the front direction of the image capturing apparatus 100 (the direction of the optical axis of the lens included in the image capturing unit), and the date and time of image capturing from the internal clock of the image capturing apparatus 100 are detected. A time detection unit 209 is included.

Next, an image transmission flow of the photographing apparatus 100 of the present embodiment will be described using the flowchart of FIG. The process of this flowchart is started, for example, in response to receiving a shooting instruction from the user by the operation input unit 204.
First, in S300, the CPU 200 performs a shooting process using the shooting unit 206.
In step S <b> 301, the CPU 200 includes image data acquired by the shooting unit 206 at the time of image shooting, shooting position information by the position detection unit 207, shooting direction information by the direction detection unit 208, and shooting date / time information by the time detection unit 209. Concatenate processing of shooting condition data. Here, the image data is handled in the Exif-Jpeg format, and the shooting condition data is recorded in a predetermined area prepared in the header area of the image data, thereby connecting the data.

If one or more of the four shooting condition data described above cannot be acquired, the connection process of S301 is performed with the remaining shooting condition data.
In S <b> 302, CPU 200 stores the connected image data in image storage unit 202.
In S <b> 303, CPU 200 reads out the image data stored in image storage unit 202 by CPU 200.
In S304, CPU 200 transmits the read image data to server 101 via communication unit 205, and ends the process.

  In the present embodiment, an example in which image data is transmitted from the photographing apparatus 100 to the server 101 (S304) is transmitted to the server 101 via the Internet. However, the present invention is not limited to this. For example, when a camera-equipped mobile phone is employed as the photographing apparatus 100, a cellular line may be used. Alternatively, the image data of the photographing apparatus 100 may be temporarily stored in a communication terminal such as a personal computer, and data transmission may be performed from the communication terminal to the server 101. That is, it is sufficient that the server 101 can store image data including shooting condition data by some means.

[Image accumulation processing by server 101]
FIG. 4 is a block diagram illustrating a configuration example of the server 101 according to the present embodiment, and FIGS. 5 and 6 are flowcharts illustrating a data processing procedure of the server 101.
The server 101 includes a CPU 400 that performs arithmetic processing, a memory 401 such as a ROM / RAM cooperating with the CPU 101, an image storage unit 402 including a hard disk, and a communication unit 403 for connecting and communicating with a network such as the Internet 103. .

An image storage procedure of the server 101 of this embodiment will be described with reference to the flowchart of FIG. The processing of this flowchart is started in response to, for example, the server 101 being turned on.
In S <b> 500, the CPU 400 receives the original image data 104 from the imaging apparatus 100 through the communication unit 403.
In step S <b> 501, the CPU 400 performs division processing on the original image data 104 received from the imaging apparatus 100. Specifically, the CPU 400 divides the received original image data 104 into image data 105 and shooting condition data 106.
In S502, the CPU 400 stores and accumulates the image data 105 and the shooting condition data 106 obtained in S501 in the image storage unit 402, respectively.

3 and 5, a plurality of pieces of image data are accumulated in the server 101.
In the following, description will be given assuming a scene in which the image data accumulated in this way is used from the user terminal 102.
[Image search by server 101]
First, before describing the operation of the user terminal 102, the operation of the server 101 will be described.
FIG. 6 is a flowchart for explaining the procedure of image search performed by the server 101 of this embodiment.
In S <b> 600, the CPU 400 receives the search position data 107, the search route data 109, and the display condition data 108 from the user terminal 102 via the communication unit 403 of the server 101. These data are generated by the user terminal 102. The generation procedure will be described later.
In step S <b> 601, the CPU 400 calculates a position range for determining a data search target based on the received search path data 109.

FIG. 7 is a conceptual diagram for explaining an example of the search range calculated in the search range calculation process of S601. In FIG. 7, a position (search position) of a desired search target designated by the user terminal 102 is shown as a position 701. In addition, the search path is a lower thick line. Based on the search route, the CPU 400 determines the vicinity of the route between the viewpoint and the end point of the search route (for example, a range of 10 m from the route) as the search range. In the example of FIG. 7, the shaded area is defined as the search range. This search route is a route that is selected and transmitted by the user terminal 102 including a position indicating a position close to the search position. The processing on the user terminal 102 side will be described later.
In this way, the vicinity of the position of the search object and the vicinity of the route is set as the search range.

In step S602, the CPU 400 searches the stored shooting condition data for shooting condition data in which the included position information indicates a position within the search range described above.
In step S603, the CPU 400 determines whether there is shooting condition data searched in step S602. If photographing condition data is found within the search range, the process proceeds to S604, and if not found, the process proceeds to S607.

In S607, the CPU 400 determines whether or not the search range can be expanded. If the search range cannot be expanded, the process proceeds to S608, where the fact that there is no image is transmitted to the user terminal 102, and the process ends. If it can be expanded, the process proceeds to S601, where the range is expanded and the search is performed again. Here, expanding the search range will be described.
FIG. 8 shows an example of expansion of the image search range in S601. Here, not only the search route data but also the information of the search position is used. That is, the area surrounded by the route connecting the start point and end point of the route and the search position and the route is reset as the search range. By enlarging in this way, it is possible to acquire an image obtained by photographing the subject at the search position from a different position, but not on the route.

In step S604, the CPU 400 performs a priority setting process for classifying the shooting condition data found in step S602 with a priority.
FIG. 9 is a diagram for explaining an example of giving priority to the imaging condition data including the position indicated by the position information within the search range of FIG. In FIG. 9, the position indicated by the shooting position included in the shooting condition data is indicated by a white circle, and the shooting direction is indicated by an arrow. Among these shooting condition data, the shooting condition indicating that there is direction information and that the camera is in the search target direction is set to priority level 1. The shooting condition without orientation information is set to priority 2. Shooting conditions that have azimuth information and are not facing the search target direction are set to priority 3. Note that this method of assigning priority is merely an example. For example, it may be classified into more stages or more simply fewer stages.

  Here, whether or not it is in the search target direction includes the direction indicated by the shooting direction within a predetermined angle based on the direction from the shooting position to the designated position as in the example of priority 1 in FIG. It is determined by whether or not. In addition to this, for example, referring to the imaging date / time included in the imaging condition data and the route acquisition date / time information included in the route information, priority is given to images taken on similar time zones (time information) or on similar dates. You may raise the ranking.

  That is, priorities are assigned in the order of 1a and 1b, with priority 1a for images taken at similar times with priority 1 and priority 1b for images not taken at similar times with priority 1 May be. Note that the priority may not be determined as in this example, but may be determined freely by the user. Further, the CPU 400 looks at the flag of image base or distance base included in the display condition data 108 and further determines the priority of the imaging condition data prioritized in the above-described procedure. Details of this priority determination method will be described later.

In step S <b> 605, the CPU 400 generates search image data (image data and data including the imaging position) in descending order of priority and transmits the search image data to the user terminal 102. The image data may be an image link destination or a thumbnail.
In step S <b> 606, the CPU 400 determines whether the transmitted search image data has reached the number of images specified by the display condition data 108 received from the user terminal 102. If it is determined that it has not reached, the process returns to S605, and search image data with a low priority is generated and transmitted. The processes of S606 and S605 are repeated until the designated number of images is reached. On the other hand, if the CPU 400 determines that the specified number of images has been reached, the processing on the server side is terminated.

Next, another example of the priority determination method described in FIG. 9 will be described.
FIG. 10 is a diagram for explaining a priority order determination method of the image-based display method. In this example, the shooting date is not considered. The white circles and arrows in FIG. 10 are the imaging condition data corresponding to the priority 1 classification in which all of the imaging condition data faces the search position. The priorities of the images 0 to 4 according to the image-based display method are the order of image 0, image 2, image 1, image 4, and image 3 in order from the closest point.

  However, with this method, the images are concentrated in the vicinity of the nearest point (0 m), and there is a possibility that only an image with no change in the shooting direction is displayed. In that case, it becomes difficult for the user to search for an image obtained by photographing the designated position from another direction. The following distance-based display method is effective for this.

  FIG. 11 is a diagram for explaining a priority order determination method of the distance-based display method. In FIG. 11, it is assumed that 0 m, 100 m, and 200 m are designated as the designated distance. In the distance-based display method, the imaging condition data is divided for each designated distance, and the imaging condition data is prioritized in the order from the closest to the designated distance.

  In the case of FIG. 11, image 2, image 0, image 1, image 4, and image 3 are entered in this order in group 1 of 0 to 50 m (designated distance 0 m), and image 5 is entered in group 2 of 50 to 150 m (designated distance 100 m). The image 6 is entered in this order. Moreover, the priority order is assigned to the group 3 of 150 to 250 m (designated distance 200 m) in the order of the image 7 and the image 8, and the priority order of each group is increased in ascending order of the designated distance. That is, the search result is divided for each desired distance from a position on the route in the vicinity of the position of the search object, and a priority is given to each division unit.

  In FIG. 11, the images are concentrated in the vicinity of the distance of 0 to 50 m. However, when the images are displayed one by one in order of priority from the groups 1, 2, and 3, the images taken at the designated positions from different directions are displayed. It can be displayed easily. When selecting 5 images in the above example, the image 2 of the group 1 has the highest priority, and the image 5 of the group 2, the image 7 of the group 3, the image 0 of the group 1, and the image 6 of the group 2 continue in this order. .

Note that the priority may not be determined as described above, and the user can freely determine the designated distance at the user terminal. Further, the grouping for each distance may not be as described in the above example, and the group may be further divided on the route before and after the search position.
The configuration and operation of the server 101 in this embodiment have been described above.

Next, the configuration and operation of the user terminal 102 in this embodiment will be described.
FIG. 12 is a block diagram illustrating a configuration example of the user terminal 102 according to the present embodiment, and FIGS. 13 and 14 are flowcharts illustrating an example of data processing of the user terminal 102.
The user terminal 102 includes a CPU 1200 that performs arithmetic processing, a memory 1201 such as a ROM / RAM that cooperates therewith, and a position detection unit 1202 such as a GPS that detects a point where the user terminal 102 exists.

  Further, a storage unit 1203 for storing position data and map data obtained by the position detection unit 1202, a display unit 1204 for displaying a screen, and an operation input unit 1205 for transmitting user input to the CPU 1200 are provided. In addition, a communication unit 1206 for connecting and communicating with a network such as the Internet 103 is provided. Note that the storage unit 1203 may be, for example, a hard disk built in the user terminal 102 or a storage medium similar to an SSD, or may be a removable storage medium such as an SD card.

  The position data obtained by the position detector 1202 is stored as passing position data for a certain time or every certain distance. The storage location of the passage position data may be recorded in the storage unit 1203 of the user terminal 102, or may be uploaded and stored in an external server via the communication unit 1206 as necessary. The passing position data includes not only position information but also date information indicating the date and time when the position information was acquired. In the present embodiment, the passage position data is stored in the storage unit 1203 as a different file for each unit of date on which the position information is acquired. Here, the passing position data is handled in the form of a text file (so-called log file) in a format according to the NMEA format.

The search condition transmission flow of the user terminal 102 of this embodiment will be described using the flowchart of FIG. The process of this flowchart is started in response to an instruction based on a menu operation from the user via the operation input unit 1205.
In S1300, CPU 1200 receives an image search request from operation input unit 1205.
In step S1301, it is determined whether the network is available. If the network is available, the process proceeds to S1302. If it is not available, the process proceeds to S1308, a message for requesting connection to the network is displayed on the display unit 1204, and the process ends.

In S1302, the CPU 1200 calculates passage route data of the user terminal 102 from position data (passing position data) that the user terminal 102 has passed in the past. This data is obtained by reading position information from log data in chronological order. This order is an order according to the date and time information corresponding to the position information. For example, position data in the latest log file stored in the storage unit 1203 can be used as the passage position data to be referred to when calculating the passage route data. Alternatively, position data in one or a plurality of log files designated by the user in advance may be used.
In S <b> 1303, the CPU 1200 reads out the passage route data and the corresponding map data in the vicinity from the storage unit 1203 and displays them on the display unit 1204.

  In step S1304, the CPU 1200 determines whether or not the search position data 107 of the desired search target and the display condition data 108 related to the display method of the search result are input from the operation input unit 1205 such as a touch panel and operation buttons. As the search position data 107, for example, the position of a building designated on the map by the user via the touch panel can be cited.

  The display condition data 108 includes the number of display images designated by the user, the distance from the nearest point to be searched for the image data to be displayed (designated distance), a selection flag for displaying images on the map / route order, image-based display / Distance-based display selection flag and the like. The meaning of each flag will be described later. Note that the display condition data 108 may be set in advance by the user using the operation input unit 1205 and only read out in S1304.

In S1304, if the search position data 107 and the display condition data 108 of the desired search object are input, the process proceeds to S1305.
In step S <b> 1305, the CPU 1200 calculates the search route data 109 from the passage route data related to the search position data 107 and the display condition data 108 and stores the search route data 109 in the memory 1201. An example of calculating the search route data will be described later.

In step S1306, the CPU 1200 reads the search path data 109 calculated in step S1305 from the memory 1201.
In step S1307, the CPU 1200 transmits the search position data 107, the display condition data 108, and the search route data 109 to the server 101 via the communication unit 1206, and ends the process.

An example of a search result output procedure of the user terminal 102 according to this embodiment will be described with reference to the flowchart of FIG. The process of this flowchart is executed following the process of FIG.
In S <b> 1400, the CPU 1200 receives the search image data 110 generated by the server 101 via the communication unit 1206.
In S1401, the CPU 1200 performs display processing so that the received data can be displayed in a format according to the display condition data 108.

  In step S1402, an image is drawn on the display unit 1204 for the display-processed data. As a result, the displayed screen is in a form according to the display condition data. It should be noted that, as described above, as to how the image found as a result of the search is displayed, there are a method of displaying on a map and a method of displaying in order of route. In addition, as described above, there is a method of selecting a target of an image to be displayed by assigning a priority order based on an image base / distance base. These are specified by the display condition data 108.

15 and 16 show examples of calculation of search path data related to search position data and display condition data.
FIG. 15 is a diagram illustrating a calculation example of search route data when it is specified that an image is displayed on a map as display condition data. The position of the black circle pin is the search position designated by the user on the map. The position through which the user terminal passes is sampled at the position of the lower round spot, and the thick line connecting the positions is the path through which the user terminal has passed. If the end points of the route that has passed on the map are the start point and the end point, the thick line passing position data displayed on the map + the starting point and end point position data are calculated as the search route data.

  FIG. 16 is a diagram illustrating a calculation example of search route data when it is specified that the images are displayed in order of routes as the display condition data. A position (search position) designated as the image search position is indicated by a position 1601. The position that the user terminal has passed is sampled at the position of the lower round spot, and the path that the user terminal has passed proceeds in the direction of the right arrow along the lower line.

  In FIG. 16, the passing position of the user terminal closest to the search position is indicated by a central black dot as the nearest point. If the position on the route that is the distance (specified distance) specified by the user terminal from the nearest neighbor point is the start point and end point, the passing position data between the start point and end point + the start point and end point position data is calculated as the search route data Will be.

  FIG. 17 is a diagram illustrating a display example of a screen when a search result is presented in a manner of displaying an image on a map. A black circle pin position is a search position designated by the user on the map, and a thick line is a position where the user terminal passes. FIG. 17 shows an example in which five images are input as display condition data. That is, five images (images 0 to 4) are sent from the server to the position indicated by the hatched area with the designated position as the center, and are displayed on the user terminal 102. In the hatched area, for example, thumbnails of images are displayed superimposed on the map.

FIG. 18 is a diagram illustrating a display example of a screen when a search result is presented in a form in which images are displayed in order of route. FIG. 18 shows an example in which five images are input as display condition data. That is, two images are displayed in the order of the traveling direction around the image 0 10 m before the nearest point.
According to the above configuration, a candidate image of a subject such as a building estimated to be seen from a location where the user has passed is obtained, and an image candidate obtained by photographing the subject with a composition that is not recognized by the user is output. Can be prevented. As a result, an image that is more relevant to the user can be presented as a candidate, so that it is possible to reduce time and labor when the user searches for an image that is more relevant to the user.

  In the embodiment described above, the map data is stored in the user terminal, but a part or all of the map data may be stored in the server. That is, the map data may be stored in the storage unit 1203 in advance, or may be downloaded from an external server sequentially via a network as necessary. In the embodiment described above, the search route is calculated on the user terminal side. However, the search route may be calculated on the server side based on the passing position data transmitted from the user terminal.

  In the present invention, a moving image shot by a video camera can also be handled as the image data 105. Further, although the memory and the storage unit are described separately in the configuration diagrams of FIGS. 2, 4, and 12 of the present embodiment, the storage unit may be configured on the memory.

<Second Embodiment>
Hereinafter, image search processing according to the second embodiment of the present invention will be described with reference to FIGS. Other configurations are the same as those of the first embodiment.
In the first embodiment, the search position data input at the user terminal is transmitted to the server. However, in the second embodiment, the shooting condition of the shot image obtained by shooting at the user terminal 102 instead. Send data and search for images.

  FIG. 19 is a block diagram illustrating a configuration example of the user terminal 102 according to the present embodiment, and FIG. 20 is a flowchart illustrating a data processing procedure of the user terminal. The configuration of the user terminal 102 according to the present embodiment is the same as that of the photographing apparatus 100 according to the first embodiment of FIG. 2, and a GPS such as a smartphone, an electronic compass, and a camera-equipped mobile phone are adopted as the user terminal 102. Can do.

An example of a search condition transmission procedure of the user terminal 102 according to the present embodiment will be described with reference to the flowchart of FIG. This flow is processing performed instead of the search condition transmission flow of FIG. 13 of the first embodiment.
In step S2000, the CPU 1900 receives an image designation in response to a user operation on the operation input unit 1904.
In S2001 to S2003 and S2008, processing similar to S1301 to S1303 and S1308 in FIG. 13 is performed.
In step S2004, the CPU 1900 determines whether an input of display conditions has been accepted. If the CPU 1900 determines that the input of display conditions has not been accepted, it repeats the process of S2004 and waits for the input of display conditions. If the CPU 1900 determines that an input of display conditions has been accepted, the process proceeds to S2005. In S2005 to S2006, the same processing as S1305 to S1306 in FIG. 13 is executed.
In step S2007, the CPU 1900 transmits the shooting condition data, display condition data, and search path data to the server 101 via the communication unit 1206, and ends the process.

FIG. 21 is a flowchart for explaining the details of the retrieval processing of the photographing condition data of the server 101 according to the second embodiment of the present invention. This flow is processing performed instead of the image search processing flow of FIG. 6 of the first embodiment.
The difference from FIG. 6 is that the server 101 receives the shooting condition data of the image to be searched instead of the search position (S2100), and the server 101 calculates the position information of the search object from the shooting condition data. That is, it is a process of estimating the position of the search object from information such as shooting position information, shooting direction information, and focal length included in the shooting condition data (S2101).

  Examples of search objects to be estimated include famous buildings that exist in the shooting direction. The server 101 performs the subsequent processing using the estimated position of the search object as the search position data 107 in FIG. Further, in FIG. 6 of the first embodiment, the priority of the photographing condition data close to the route acquisition date / time information included in the search route data 109 is increased in the prioritization in S604. On the other hand, in S2105 of FIG. 21, the priority of the shooting condition data close to the shooting date / time data of the image to be searched may be increased.

According to the present embodiment, it is not necessary to specify a search position by the user terminal, and it is possible to obtain image data obtained by photographing a subject of an image at a different angle of view with a simple procedure.
As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (computer program) that implements the functions of the above-described embodiments is supplied to a system or apparatus via a network or various computer-readable storage media. Then, the computer (or CPU, MPU, etc.) of the system or apparatus reads out and executes the program.

DESCRIPTION OF SYMBOLS 100 Imaging device 101 Server 102 User terminal 103 Internet 104 Original image data 105 Image data 106 Shooting condition data 107 Search position data 108 Display condition data 109 Search path data 110 Search image data

Claims (21)

A display control device for searching and displaying image data in which a specific search object is captured from a plurality of pre-registered image data,
Search range calculation means for calculating a position range for searching for an image from the position information and route information of the search object;
A display control apparatus comprising: priority setting means for assigning a priority to a search result based on position information of the search object and image information of the searched image.   The display control apparatus according to claim 1, wherein the search range calculation unit sets a search range near a position of the search target and a route.   The display control apparatus according to claim 1, wherein the search range calculation unit sets a range surrounded by a position of the search target object and the route as a search range.   The priority order setting means uses the shooting position information of the image searched as the image information, and assigns a priority by increasing the priority as the shooting position information is closer to the position of the search object. The display control apparatus according to any one of claims 1 to 3.   The priority order setting means uses the shooting position information of the searched image as the image information, and the search result for each predetermined distance from the position on the route in the vicinity of the position of the search object based on the shooting position information. The display control apparatus according to claim 1, wherein priority is given to each division unit.   The priority order setting means uses the shooting orientation information of the searched image as the image information, and assigns a priority by increasing the priority order as it is closer to the direction in which the search object exists. The display control apparatus according to any one of claims 1 to 3.   The priority order setting means uses the shooting date / time information of the searched image as the image information, and increases the priority order as the date and time information included in the route information to be searched increases and sets the priority order. The display control device according to claim 1, wherein the display control device is provided. A display control device for searching and displaying image data in which a specific search object is captured from a plurality of pre-registered image data,
Search range calculation means for calculating position information of a search object from image information of a specific image and calculating a position range for searching for an image from the position information of the search object and information of a search path;
A display control apparatus comprising: priority setting means for assigning a priority to a search result based on position information of the search object and image information of the searched image.   9. The display control apparatus according to claim 8, wherein the image information of the specific image uses position information and azimuth information at the time of image capturing.   The display control apparatus according to claim 8, wherein the search range calculation unit sets a search range near a position of the search target and a route.   The display control apparatus according to claim 8, wherein the search range calculation unit sets a range surrounded by the position of the search target object and the route as a search range.   The priority order setting means uses the photographing position information of the searched image as the image information, and assigns a priority by increasing the priority order as the photographing position information is closer to the position of the search object. The display control device according to claim 8, wherein the display control device is a display control device.   The priority order setting means uses the shooting position information of the searched image as the image information, and the search result for each predetermined distance from the position on the route in the vicinity of the position of the search object based on the shooting position information. The display control apparatus according to claim 8, wherein priority is given to each division unit.   The priority order setting means uses the shooting orientation information of the searched image as the image information, and assigns a priority by increasing the priority order as it is closer to the direction in which the search object exists. The display control apparatus according to any one of claims 8 to 11.   The priority order setting means uses the shooting date / time information of the searched image as the image information, and increases the priority order as the date and time information included in the route information to be searched increases and sets the priority order. The display control apparatus according to claim 8, wherein the display control apparatus is provided.   The priority order setting means uses the shooting date / time information of the searched image as the image information, and assigns a priority by increasing the priority as the shooting date / time of the image to be searched is closer. The display control apparatus according to any one of claims 8 to 11. A control method of a display control device for searching and displaying image data in which a specific search object is captured from a plurality of pre-registered image data,
A search range calculating step for calculating a position range for searching for an image from the position information and route information of the search object;
A control method for a display control device, comprising: a priority order setting step of assigning a priority order to a search result based on position information of the search object and image information of the searched image. A control method of a display control device for searching and displaying image data in which a specific search object is captured from a plurality of pre-registered image data,
A search range calculation step of calculating position information of a search object from image information of a specific image, and calculating a position range for searching for an image from the position information of the search object and information of a search path;
A control method for a display control device, comprising: a priority order setting step of assigning a priority order to a search result based on position information of the search object and image information of the searched image. A program that causes a computer to execute a control method of a display control device that searches and displays image data in which a specific search object is captured from a plurality of pre-registered image data,
A search range calculating step for calculating a position range for searching for an image from the position information and route information of the search object;
A program for causing a computer to execute a priority setting step for assigning a priority to a search result based on position information of the search object and image information of a searched image. A program that causes a computer to execute a control method of a display control device that searches and displays image data in which a specific search object is captured from a plurality of pre-registered image data,
A search range calculation step of calculating position information of a search object from image information of a specific image, and calculating a position range for searching for an image from the position information of the search object and information of a search path;
A program for causing a computer to execute a priority setting step for assigning a priority to a search result based on position information of the search object and image information of a searched image.   A computer-readable storage medium storing the program according to claim 19 or 20.

Images