JP5753514B2 - Image display device and computer program - Google Patents

Description

  The present invention relates to an image display device that displays an image captured by a camera on a display screen, and a computer program for causing the image display device to control operations.

  Conventionally, when shooting an image using a digital camera or the like (hereinafter referred to as “camera or the like”), shooting status information such as shooting date / time or location coordinate information of the shooting location is superimposed on the shot image, There is known an imaging apparatus that stores a captured image in a storage memory in association with shooting situation information.

  As shown in Patent Document 1 below, such an imaging device creates a distance image based on the values of a plurality of distance measuring points obtained by a distance measuring device such as an external light passive method, and is extracted based on the distance image. The position coordinate information of a person or the like is calculated, unique information such as a person is extracted as main subject information, and the position coordinate information and the main subject information are recorded on a recording medium.

  According to such an imaging apparatus, position coordinate information on the captured image of the main subject can be calculated, and the position coordinates and unique information of the main subject can be recorded together with the captured image.

  Here, in the conventional imaging apparatus, information that can be extracted as unique information of the main subject is a matter that can be estimated from the size of the main subject that can be calculated from the image and the physical feature amount of the image (for example, the main subject is As a means for recording information that can identify what was photographed, such as the name of the main subject, the user has to input the information again. According to such an image capturing device, when the user does not grasp the information of the image captured at the place where the user first performed, the user can recognize the feature (for example, a part of the lake or the appearance of the lake). As a result, it is impossible to determine the name of a building, etc.), and there is a problem that an image of a feature different from the purpose is recorded.

  In order to solve such a problem, the applicant of the present invention specifies that an imaging device (image display device) that displays an image captured by a camera on a display screen of the display device identifies a feature according to the image captured by the camera. Information (information for specifying a feature such as position and name) is searched for, and the searched feature specifying information and the captured image are superimposed and displayed on the display screen ( For example, see Patent Document 2).

Japanese Patent Laid-Open No. 2005-12307 JP 2011-41145 A

  However, in the above-described conventional image display device, when the feature according to the image captured by the camera cannot be specified (for example, when the feature specifying information according to the image cannot be searched or the feature according to the image is detected). There is a problem in that useful information cannot be provided to the photographer (user) when there is too much feature identification information searched as the object identification information and it is difficult to determine which feature identification information is appropriate. It was.

  The present invention has been made to solve the above-described problems, and provides useful information to a user even when a feature cannot be specified when shooting the feature with a camera or the like. The purpose is to be able to.

  The image display device of the present invention is an image display device that displays an image taken by a camera on a display screen of a display device, and stores map information for displaying map information on the display screen. A feature specifying information storage means for storing feature specifying information for specifying a feature by position, name, etc., a shooting spot specifying means for specifying a shooting spot, and an image taken by the camera Feature specifying information searching means for searching for the feature specifying information, and number of feature specifying information for determining whether or not the number of feature specifying information searched by the feature specifying information searching means is equal to or more than a specified number. When the determination means and the feature specific information number determination means determine that the number is greater than or equal to the specific number, the map information search means for searching for map information including the shooting location, and the map information search means Map information Map image information creating means for creating map image information indicating a map image in which at least a part of the specified number of feature specifying information is associated with the map, and map image information created by the map image information creating means And map image display means for superimposing and displaying the map image on the photographed image.

  With the above-described configuration, useful information can be provided to the user even when the feature cannot be specified when the feature is photographed by a camera or the like.

  It may include a direction detecting unit that detects a shooting direction of the camera, and the map image display unit may superimpose and display the map image in a manner matching the shooting direction.

  The map image information creating unit may create map image information indicating a map image including an identification image indicating that the feature specifying information is associated with the map.

  Selection operation accepting means for accepting the selection operation of the identification image in the map image displayed by the map image display means, and information related to the feature specifying information corresponding to the identification image accepted by the selection operation accepting means It is good also as a structure containing the related information display means to display on the said display screen.

  It is good also as a structure containing the feature specific information display means which superimposes the feature specific information searched by the said feature specific information search means, and the said image | photographed image on the said display screen.

  The feature specifying information display means superimposes the searched feature specifying information and the captured image when the feature specifying information number determining means determines that the number is not greater than the specified number. It is good also as a structure displayed on a screen.

  The image display program of the present invention is an image display program for causing an image display device to control an operation so that an image taken by a camera is displayed on a display screen of the display device. From the feature specifying information stored in the feature specifying information storage means for storing the shooting point specifying process for specifying the point and the feature specifying information for specifying the feature by position, name, etc., by the camera Whether or not the number of feature specifying information searched in the feature specifying information search processing for searching for the feature specifying information according to the captured image and the number of feature specifying information searched in the feature specifying information search processing is greater than or equal to the specified number. A map that stores map information for displaying a map on the display screen when it is determined that the number is greater than the specific number in the feature specific information number determination process to be determined and the feature specific information number determination process Information storage A map information search process for searching for map information including the shooting point from the map information stored in the map information, and a map indicated by the map information searched by the map information search process includes more than the specified number of feature specifying information. Map image information creation processing for creating map image information indicating a map image associated with at least a part of the map image information, and map image information created in the map image information creation processing based on the map image This is for executing the map image display processing for displaying the image in a superimposed manner.

  ADVANTAGE OF THE INVENTION According to this invention, when image | photographing a feature with a camera etc., even if it is a case where a feature cannot be specified, useful information can be provided now to a user.

It is a block diagram which shows an example of a structure of the digital camera using the image display apparatus which concerns on this invention. It is explanatory drawing which shows the example of the storage state of feature specific information. It is explanatory drawing which shows the example of the storage state of display mode information. It is a flowchart which shows the example of an image display process. It is a flowchart which shows the example of an image display process. It is explanatory drawing for demonstrating imaging | photography space. It is explanatory drawing which shows the example of the display screen on which the imaging | photography direction image was displayed. It is explanatory drawing which shows the example of the display screen on which the map image was displayed. It is a flowchart which shows the example of the display mode determination process in this example. It is explanatory drawing for demonstrating the method to determine whether each feature is displayed on the display screen. It is explanatory drawing which shows the example of the storage state of display mode information. It is explanatory drawing which shows the example of the display screen on which the map image was displayed. It is explanatory drawing which shows the example in the case of using a plane range as a search range.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The following embodiments do not limit the invention according to each claim, and all combinations of features described in the embodiments are indispensable for the solution means of the invention. Not exclusively.

  FIG. 1 is a block diagram showing an example of the configuration of a digital camera 100 using an image display device 10 according to the present invention. As shown in FIG. 1, the digital camera 100 includes an image display device 10 and a photographing unit 20.

  The imaging unit 20 includes a condenser lens 21, an area sensor 22, and an A / D converter 23. The condensing lens 21 condenses light from the subject onto the area sensor 22. The area sensor 22 has a plurality of photoelectric conversion elements such as CCDs. The area sensor 22 has a plurality of image sensors that constitute pixels. A plurality of image sensors constituting pixels are arranged in a matrix in the horizontal direction and the vertical direction.

  Each pixel has a color filter disposed on the light receiving surface side. As the color filter, a complementary color filter composed of Cy (Cyan), Mg (Magenta), Ye (Yellow), and G (Green) is used. Light incident on each pixel of the area sensor 22 is converted into an electrical signal and output from the area sensor 22. Since the electrical signal output from the area sensor 22 is an analog signal, it is converted into digital electronic data by the A / D converter 23.

  In addition, an azimuth information acquisition unit 62 of an imaging space specifying unit 60 (to be described later) is connected to the condensing lens 21, and the direction in which the condensing lens 21 faces (direction of the camera line of sight) is determined by the azimuth information acquisition unit 62. The shooting direction information shown can be acquired.

  The image display device 10 is a device for displaying an image photographed by the photographing unit 20, and includes a storage unit 30, a processing unit 40, a display unit 50, a photographing space specifying unit 60, and a map information storage unit 80. A feature specifying information storage unit 81, a display mode information storage unit 82, a search unit F1, and a display mode determination unit F2.

  The storage unit 30 includes a RAM (Random Access Memory) 31 and a flash memory 32. The flash memory 32 is a rewritable recording medium that can retain recorded contents without being energized, and is built in the image display device 10 or detachably attached to the digital camera 100. The RAM 31 temporarily stores digital electronic data output from the A / D converter 23 and image data processed by the processing unit 40. The flash memory 32 accumulates and stores / stores image data temporarily recorded in the RAM 31.

  The processing unit 40 is an electric circuit for processing the electronic data output from the photographing unit 20, and includes a CPU (Central Processing Unit) 41, a ROM (Read Only Memory) 42, and a processing circuit 43.

  The ROM 42 stores computer programs executed by the CPU 41 and the processing circuit 43. The processing circuit 43 has a function of executing various image processing such as exposure correction, pixel interpolation, and data compression on the digital electronic data output from the photographing unit 20. The processing circuit 43 is an electronic circuit dedicated to image processing that performs image processing. The CPU 41 controls and controls each component of the image display device 10 according to the computer program stored in the ROM 42, and executes various program processes.

  The processing unit 40 is connected to an input unit for receiving input from the user. The input unit includes, for example, a shutter button 71 that receives a recording request for an image taken in response to being pressed by a user, an input button 72 that receives operation inputs of various functions in the digital camera 100, and the like.

  The display unit 50 is a display (monitor) that displays the electronic data processed by the processing unit 40 as an image. For example, a known liquid crystal panel is used.

  The imaging space specifying unit 60 includes a position information acquisition unit 61, an orientation information acquisition unit 62, and a three-dimensional posture detection unit 63.

  The position information acquisition unit 61 has a function of acquiring position information (longitude, latitude, altitude) of a shooting point by GPS (Global Positioning System) or the like.

  The azimuth information acquisition unit 62 has a azimuth detection sensor, detects the attitude of the condensing lens 21, and acquires photographing azimuth information indicating the direction (azimuth and elevation angle) in which the condensing lens 21 is facing. Have

  The three-dimensional posture detection unit 63 has a posture detection sensor and has a function of acquiring posture information indicating the three-dimensional posture of the condenser lens 21.

  The shooting space specifying unit 60 specifies a shooting space shot by the shooting unit 20 based on the position information of the shooting point, shooting direction information, and posture information. In this example, the photographing space specifying unit 60 photographs a substantially cone-shaped space having a photographing point as a vertex, a predetermined angle as an apex angle, and a predetermined height in a direction in which the condenser lens 21 faces. Space.

  The map information storage unit 80 is a storage medium that stores map information by dividing it into a rectangular range (mesh) divided by a certain longitude width and latitude width. In addition to being stored in the map information storage unit 80, the map information can be stored in an auxiliary storage device as a removable medium called an SD memory card, for example. The map information includes various types of information (for example, two-dimensional image information and three-dimensional image information) used for displaying an image corresponding to the coordinates on the display screen. In addition, since a known technique is used for a map display method according to the current position and scale, detailed description thereof is omitted here.

  The feature specifying information storage unit 81 stores feature specifying information including information such as names, positions, sizes, planar shapes, and representative video data of points and features (buildings, mountains, rivers, lakes, etc.). Storage medium.

  FIG. 2 is an explanatory diagram illustrating an example of a storage state of the feature specifying information stored in the feature specifying information storage unit 81. As shown in FIG. 2, the feature identification information in this example includes feature ID, feature genre, feature name, representative point coordinates, planar shape, height information, representative This is information associated with an image. Here, the plane shape is for showing the area occupied by each feature when the map is considered as a two-dimensional plane (two-dimensional coordinates without height information), and shows the detailed shape of the feature. For example, it may be information such as “circle of radius ○ meter centered on representative point coordinates” or information indicating an area where each feature exists in the range of latitude and longitude. Good. In this example, the case where the planar shape indicates a region where each feature exists in the range of latitude and longitude will be described as an example.

  The display mode information storage unit 82 displays the display mode information in which the feature specifying information of the feature located in the shooting space is associated with the information indicating the display mode when displaying the feature specifying information on the display screen. It is a storage medium for storing.

  FIG. 3 is an explanatory diagram illustrating an example of a storage state of display mode information stored in the display mode information storage unit 82. As shown in FIG. 3, the display mode information is information in which a feature name and a display mode are associated with each other. In this example, it is assumed that there are “solid line”, “list”, “dashed line”, and “no display” as display modes. The display mode information will be described in detail later.

  The search unit F <b> 1 has a function of referring to the feature specifying information storage unit 81 and searching for feature specifying information indicating features existing in the shooting space specified by the shooting space specifying unit 60. In addition, it is good also as a structure which can adjust the processing time which a search process requires as a structure which can set a search condition previously by a user. In this case, as a search condition for the image display device 10 to accept a setting operation by the user, for example, various search conditions such as the genre of the feature and the maximum number of searches can be considered.

  The display mode determination unit F2 executes a display mode determination process (see FIG. 9), which will be described later, in response to the search for the feature specifying information of the feature existing in the shooting space, and the display screen of the display unit 50 Has a function of determining the display mode of the feature specifying information to be displayed.

  Next, the operation of the image display apparatus 10 in this example will be described with reference to the drawings. Note that a detailed description of processing not particularly related to the present invention may be omitted.

  4 and 5 are flowcharts illustrating an example of image display processing executed by the image display apparatus 10. In the image display process, the feature specifying information corresponding to the image shot by the shooting unit 20 is searched, and various images (in this example, a shooting orientation image, a map image, or feature specifying information) are displayed on the display screen. Processing for display is performed. In this example, the case where the image display device 10 displays the name of a feature (that is, an image indicating the name of the feature. The feature specifying image) as the feature specifying information will be described as an example. The image display device 10 in this example has a live view function for displaying an image captured by the photographing unit 20 on a display screen in substantially real time according to an output from the image sensor. “The image made” means not only the image stored in the storage unit 30 but also the image displayed on the display screen of the display unit 50 by the live view function.

  The image marking process in this example is started in response to electronic data being output from the imaging unit 20 to the processing unit 40, for example. In the image display process, first, the processing unit 40 acquires a location information by specifying a shooting location by the location information acquisition unit 61 (step S101). In this example, the focal point of the photographing unit 20 is used as the position indicating the photographing point. When the position information of the shooting point is acquired, the processing unit 40 acquires the shooting direction information by the direction information acquisition unit 62 (step S102).

  When the shooting direction information is acquired, the processing unit 40 performs processing for specifying the shooting space by the shooting space acquisition unit 60 (step S103).

  FIG. 6 is an explanatory diagram for explaining the imaging space specified at this time. As shown in FIG. 6, the shooting space specifying unit 60 sets the coordinates indicated by the position information of the shooting point as the vertex O (hereinafter referred to as “shooting point O”), the angle of view of the digital camera 100 as the apex angle θ, A quadrangular pyramid shaped space 90 having a height H as a limit distance that can be focused in the digital camera 100 is defined as an imaging space. Note that points a to e in FIG. 6 indicate representative points of the features A to E.

  When the shooting space is specified, the processing unit 40 searches the feature specifying information indicating the feature existing in the shooting space by the search unit F1 (step S104). Here, in this example, the case where the search condition is that the representative point coordinates in the feature specifying information are located in the specified imaging space will be described as an example. That is, in the situation shown in FIG. 6, the search unit F1 stores the features A to D where the representative points a to e are located in the space 90 as the search results.

  When the feature specifying information is searched, the processing unit 40 determines whether there is a feature existing in the shooting space (that is, the feature specifying searched as the feature specifying information indicating the feature existing in the shooting space. It is determined whether or not there is information (step S105). If it is determined that there is no feature present in the shooting space (N in step S105), the processing unit 40 creates shooting direction image information (step S106). In this example, the processing unit 40 includes map information including a shooting point from the map information stored in the map information storage unit 80 (for example, map information indicating a map centered on the point indicated by the position information). And using the retrieved map information, shooting direction image information indicating a shooting direction image for notifying the user of the shooting direction is created.

  When the shooting direction image information is created, the processing unit 40 displays the shooting direction image based on the created shooting direction image information (step S107).

  FIG. 7 is an explanatory diagram illustrating an example of a display screen (a shooting direction image display screen) on which a shooting direction image is displayed. As shown in FIG. 7, on the shooting direction image display screen, a shooting direction image 701 is superimposed and displayed on an image shot by the shooting unit 20 (an image including the features A, B, and C). In this example, the shooting direction image 701 is a map in which the shooting direction is arranged above the display screen (upward in the drawing in FIG. 7), and corresponds to the shooting point P and the features A, B, and C. By including the images MA, MB, and MC and the character string display area 702 indicating the shooting direction, it plays a role of informing the user of the shooting direction. In this case, information in which the shooting direction and the display mode of the map image on the display screen are associated becomes shooting direction image information.

  When the shooting orientation image is displayed, the processing unit 40 proceeds to the process of step S113 described later.

  On the other hand, if it is determined that there is a feature that exists in the shooting space (Y in step S105), the processing unit 40 counts the number of features that exist in the shooting space (that is, a feature that indicates a feature that exists in the shooting space). It is determined whether or not the number of feature specifying information retrieved as specific information is equal to or greater than a predetermined number (for example, four or more) (step S108). If it is determined that the number of features is equal to or greater than the specific number (Y in step S108), the processing unit 40 searches the map information stored in the map information storage unit for map information including the shooting location ( Step S109).

  When the map information is searched, the processing unit 40 notifies the user that the map indicated by the map information and the feature specifying information are associated with each other based on the searched map information and the searched feature specifying information. The map image information indicating the map image which is the image of is created (step S110). Note that the feature specifying information associated with the map may be a part or all of the feature specifying information such as the name of the feature.

  When the map image information is created, the processing unit 40 displays a map image based on the created map image information (step S111).

  FIG. 8 is an explanatory diagram for describing an example of a display screen (map image display screen) on which a map image is displayed. As shown in FIG. 8, on the map image display screen, a map image 801 is superimposed and displayed on an image (an image including the features A, B, and C) taken by the photographing unit 20. In this example, the map image 801 is a map in which the shooting direction is arranged above the display screen (upward in the drawing in FIG. 8), and corresponds to the shooting point P and the features A, B, and C. Identification indicating that feature identification information is associated with the images MA, MB, MC, the image MD corresponding to the feature D located on the ground, and the images MA, MB, MC, and image MD, respectively. Images 811 to 814. In addition, the structure of an identification image is not specifically limited, The character string etc. which show the content of the feature specific information linked | related with the map may be sufficient.

  When the map image is displayed, the processing unit 40 proceeds to the process of step S113 described later. In this example, when the selection operation of the identification images 811 to 814 by the user is received while the map image display screen is displayed, the processing unit 40 identifies the feature specifying information corresponding to the identification image indicated by the received selection operation. (For example, a part of the feature specifying information or other feature specifying information previously associated with the feature specifying information) is displayed on the display screen.

  On the other hand, if it is determined in step S108 that the number of features is not equal to or greater than the specific number (N in step S108), the processing unit 40 displays the feature name in the feature specifying information on the display screen of the display unit 50. Processing for determining a display mode (display mode determination processing) is executed (step S200).

  Here, the display mode determination processing in this example will be described with reference to the drawings.

  FIG. 9 is a flowchart illustrating an example of display mode determination processing in this example. In the display mode determination process, a process for determining the display mode when displaying the feature specifying information indicating the feature having the representative point in the imaging space on the display screen of the display unit 50 is performed. Hereinafter, the case where the specific number referred to in the process of step S108 is “3” will be described as an example. That is, the number set as the specific number is different from that described with reference to FIG.

  In the display mode determination process, first, the processing unit 40 calculates the distance between the shooting point and the representative point of each feature by the display mode determination unit F2 (step S201). In this example, the distance between the shooting point and the representative point of each feature is calculated from the position information of the shooting point and the representative point.

  When the distance between the shooting point and each feature is calculated, the processing unit 40 causes the display mode determination unit F2 to determine that the shooting space is in focus based on the subject distance and the depth of field (hereinafter referred to as the focus). , “Focused space”) is specified (step S202). In addition, since a known technique is used for the calculation processing of the subject distance and the depth of field, a detailed description thereof is omitted here.

  When the in-focus space is specified, the processing unit 40 determines whether or not each feature is displayed on the display screen based on the information on the shooting space and the feature specifying information corresponding to each feature by the display mode determination unit F2. Is determined (step S203).

  FIG. 10 is an explanatory diagram for explaining a method of determining whether or not each feature is displayed on the display screen. As shown in FIG. 10, the feature specifying information indicating the feature located in the space 90 specified as the shooting space in this example includes information indicating the planar shape and height of the feature. The presence range of the feature can be shown. Therefore, the display mode determination unit F2 is a feature displayed in the display range depending on whether or not the existence range of other features is located on a straight line connecting the shooting point O and the existence range of each feature. It is determined whether or not there is. In FIG. 10, the display mode determination unit F2 determines that the features A to C are features displayed on the display screen. In FIG. 10, the in-focus space identified in step S202 can be indicated by a square pyramid-shaped space 91 having a depth of field of height S.

  If it determines with it being the feature currently displayed on the display screen (Y of step S203), the process part 40 will determine whether the representative point of the feature exists in the focusing space by the display mode determination part F2. Is determined (step S204). In this example, the display mode determination unit F2 determines that all the features A to C displayed on the display screen have representative points in the in-focus space 91.

  If it is determined that there is a representative point in the in-focus space (Y in step S204), the processing unit 40 sets the display mode information as information to be displayed in the vicinity of the representative point by the display mode determination unit F2 ( The process proceeds to step S205) and step S210. In this example, the processing unit 40 causes the display mode determination unit F2 to store the feature specifying information corresponding to the representative point in the display mode information as information to be displayed near the representative point. On the other hand, when it is determined that there is no representative point in the in-focus space (N in step S204), the processing unit 40 sets the display mode information as information to be displayed as a list by the display mode determination unit F2 (step S206). The process proceeds to step S210.

  On the other hand, when it determines with it not being the feature currently displayed on the display screen in step S203 (N of step S203), the process part 40 is the feature which exists in an in-focus area by the display mode determination part F2. It is determined whether or not (step S207). In this example, the display mode determination unit F2 determines that the feature D is a feature that is not displayed on the display screen, and determines that there is a representative point in the in-focus space 92.

  If it is determined that there is a representative point in the in-focus space (Y in step S207), the processing unit 40 informs the user that the display mode determining unit F2 does not display the display screen but exists in the imaging space. The display mode information is set as information to be notified (step S208), and the process proceeds to step S210. Here, when it is determined that there is no representative point in the in-focus space (N in step S207), the processing unit 40 sets the display mode information as information not to be displayed by the display mode determination unit F2 (step S209). The process proceeds to step S210.

  In step S210, the processing unit 40 refers to the display mode information storage unit 82 and determines whether or not all the display modes of the feature specifying information indicating the features in the shooting space have been determined.

  If it is determined that all display modes have not been determined (N in step S210), the processing unit 40 proceeds to the process in step S201. On the other hand, when it is determined that all the display modes have been determined (Y in step S210), the processing unit 40 proceeds to the process of step S112 of the image display process (see FIG. 5).

  When the display mode determination process is executed as the process of step S200 in the image display process, the processing unit 40 refers to the display mode information storage unit 82 and displays the display screen based on the display mode information set in the feature specifying information. The feature name is displayed superimposed on the displayed image (step S107). In this example, the display mode information at this time (that is, the storage state of the display mode information stored in the display mode information storage unit 82) is as shown in FIG.

  FIG. 12 is an explanatory diagram showing an example of the display screen at this time. As shown in FIG. 12, on the display screen, in the vicinity of the captured images of the features A to C (for example, the vicinity of the coordinates when the representative point coordinates of each feature are converted to the coordinates on the display screen), The corresponding feature names 101 to 103 are displayed with solid lines.

  In addition, for the feature D in which “notification” is set as the display mode, the existence range of the feature D on the display screen is indicated by a broken line based on the information indicating the existence range of the feature D, and the feature is located in the vicinity thereof. The presence of the name 104 is notified to the user.

  In the case where “list” is set as the display mode, the feature name is displayed in a predetermined list display area on the display screen. If “no display” is set, the name of the feature is displayed as the peripheral feature information by operating the input button 72. Note that the display mode of the feature specifying information is not limited to this, and various methods are conceivable, for example, the feature names of the features that are not displayed on the display screen are blinked.

  When the feature name is displayed superimposed on the display screen (or when a shooting orientation image or a map image is displayed), the processing unit 40 has received a recording request for an image shot by the shooting unit 20 using the shutter button 71. It is determined whether or not (step S113). Here, for example, if it is determined that a recording request is received by the user pressing the shutter button 71 with a finger (Y in step S113), the processing unit 40 is searched by the image displayed on the display screen and the search unit F1. The feature specifying information is associated and stored in the storage unit 30 (step S114). In this example, the processing unit 40 stores information indicating the shooting space (position information of shooting points, shooting direction information, etc.) in the storage unit 30 together with the image displayed on the display screen. . Further, in this example, when it is determined that an image recording request has been received, if a shooting direction image is displayed on the display screen (see FIG. 7), the processing unit 40 stores the generated shooting direction image information in the storage unit. 30. When it is determined that an image recording request has been received and the map image is displayed on the display screen (see FIG. 8), the processing unit 40 stores the created map image information in the storage unit 30.

  By storing the image displayed on the display screen and the feature specifying information in association with each other when an image recording request is received, the target image can be easily extracted when searching for the stored image. That is, for example, when the image display device 10 has a function of searching for an image stored based on a search word, a search is performed for an image associated with feature specifying information including the search word input by the user. Will be able to. In this example, for example, when the stored image is reproduced on the display screen, the processing unit 40 stores the feature specifying information and the like so that the user can select whether or not to display the feature name or the like. 30.

  When the image displayed on the display screen and the feature specifying information when the image recording request is received are stored, or when it is determined that the recording request by the user is not received (N in step S113), the processing unit 40 It is determined whether or not the shooting by 20 has been completed (step S115). Here, for example, when the photographing end request or the end of the live view mode is received by the operation of the input button 72 by the user, the processing unit 40 determines that the photographing is finished (Y in step S115), and performs the image display processing. finish. On the other hand, when it determines with imaging | photography not having been complete | finished (N of step S115), the process part 40 transfers to the process of step S101.

  As described above, in the above-described embodiment, the image display device 10 that displays an image photographed by the camera (for example, the photographing unit 20) on the display screen of the display device (for example, the display unit 50) is displayed. A map information storage unit 80 that stores map information for displaying a map on the screen, and a feature specifying information storage unit 81 that stores feature specifying information for specifying a feature by position, name, and the like are provided. The shooting point is specified (for example, step S101), the feature specifying information corresponding to the image shot by the camera is searched (for example, step S104), and the number of searched feature specifying information is greater than or equal to the specified number. (For example, step S108), and when it is determined that the number is equal to or greater than the specific number (for example, Y in step S108), the map information including the shooting point is searched (for example, step S1). 9) Creates map image information indicating a map image in which at least a part of the feature specifying information of the specified number or more is associated with the map indicated by the searched map information (for example, step S110), and the generated map image information Since the map image is superimposed on the captured image (for example, step S111), the user can be identified even when the feature cannot be specified when capturing the feature with a camera or the like. And useful information can be provided.

  That is, when there is too much feature specifying information corresponding to the image taken by the camera, information useful for specifying the feature (feature specifying information) cannot be provided to the user, depending on the shooting position. It is possible to provide information (image) indicating a map image that is an image in which the feature specifying information is associated with the map. As a result, the user can guess the object to be photographed with reference to the map image.

  In the above-described embodiment, the image display device 10 detects the shooting direction of the camera (for example, step S102), and the mode (for example, the shooting direction) according to the shooting direction is arranged on the display screen. In the aspect, the map image is superimposed and displayed (for example, step S111), so that it is possible to provide information that allows the user to easily recognize the shooting direction.

  In the above-described embodiment, the image display device 10 creates map image information indicating the map image 801 including the identification images 811 to 814 indicating that the feature specifying information is associated with the map. (For example, refer to FIG. 8), it is possible to provide information that allows the user to easily recognize the presence or absence of the feature specifying information.

  Further, in the above-described embodiment, the image display device 10 receives a selection operation of the identification images 811 to 814 in the displayed map image 801, and information related to the feature specifying information corresponding to the identification image for which the selection has been received ( For example, a part of the feature specifying information) is displayed on the display screen, so that a map image that can be browsed by selecting any feature specifying information from among the plurality of feature specifying information is provided to the user. Thus, the usefulness of the image display device can be enhanced.

  In the above-described embodiment, the image display device 10 is configured to superimpose the searched feature specifying information and the image photographed by the camera (for example, the photographing unit 20) and display them on the display screen. When photographing features with a camera or the like, it is possible to reduce mistakes in copying by using information on surrounding features. That is, since the user can take a picture with reference to the feature specifying information displayed on the display screen, the user can recognize what the image displayed on the display screen is. Shooting can be prevented.

  In the above-described embodiment, the number of the feature specifying information retrieved as the feature specifying information according to the image captured by the camera (for example, the imaging unit 20) is not more than the specified number. (For example, N in step S108), the retrieved feature specifying information and the captured image are superimposed and displayed on the display screen (for example, step S112). It becomes possible to provide information to the user in a manner suitable for the number.

  In the above-described embodiment, the image display device 10 is configured to specify a shooting space to be shot by the camera and search for feature specifying information of a feature existing in the specified shooting space. It becomes possible to efficiently search for features that may be displayed on the display screen. In addition, it is possible to perform shooting in consideration of peripheral information other than the features that are actually visible to the user.

  In the above-described embodiment, the image display device 10 specifies the shooting point, detects the shooting direction of the camera, detects the three-dimensional posture of the camera, and takes a picture from the shooting point, the shooting direction, and the three-dimensional posture. Since the space is specified, it is possible to specify a shooting space having position information.

  Further, in the above-described embodiment, the image display device 10 is a quadrangular pyramid type having a predetermined height (for example, a limit distance that can be focused) with the focal point of the camera as the apex and the angle of view of the camera as the apex angle. Therefore, it is possible to specify a range that can be actually shot by the camera as the shooting space.

  In the above-described embodiment, the feature specifying information includes representative point information (for example, representative point coordinates) indicating the representative point of each feature, and information (for example, planar shape and height) indicating the existence range of each feature. And the image display device 10 displays the feature specifying information based on the representative points and the existence ranges of the features in the specified shooting space in response to the search for the plurality of feature specifying information. Since it is set as the structure which carries out, it becomes easy to make a user recognize the positional relationship of the feature specific information displayed on a display screen.

  In the above-described embodiment, the screen display device 10 focuses the image photographed by the camera, and the features existing in the focused portion (for example, in the focused space) of the photographing space. Since the object specifying information and the other feature specifying information are displayed so as to be distinguishable, the visibility of the display screen can be improved.

  Although not particularly mentioned in the above-described embodiment, the screen display device 10 accepts selection of the feature specifying information to be displayed on the display screen from the searched feature specifying information, and the received ground. It is good also as a structure which displays object specific information. With this configuration, it is possible to prevent the information displayed on the display screen from becoming complicated.

  Although not specifically mentioned in the above-described embodiment, the screen display device 10 specifies the distance to the object to be imaged (for example, the distance between the imaging position and the representative point of the feature) in the image captured by the camera. And it is good also as a structure which sets the search condition of feature specific information according to the distance to the specified imaging | photography target object. That is, for example, in the feature specifying information, features are classified into a plurality of types based on a specific size (for example, a large type such as a mountain or a building is classified as a first type, a size of a bronze image or the like as a second type) The processing unit 40 is configured to separate the feature to be searched when the distance to the shooting target is within a specific distance and the feature to be searched when the shooting target is farther than the specific distance. Can reduce the load required for the search. In addition, when the shooting target is within a specific distance, the feature specifying information may not be searched, but may be searched for information related to a thing having a smaller scale than the feature such as an article stored in advance. In this case, a configuration may be adopted in which the search condition for the feature specifying information is set according to the focal length in the imaging unit 20 instead of the distance to the imaging object.

  Although not particularly mentioned in the above-described embodiment, the screen display unit 10 may display the feature indicated by the searched feature specifying information as an image captured by the camera on the display screen. The feature specifying information may be displayed based on the calculated display possibility. That is, for example, when the image display device 10 cannot determine whether or not it is a feature displayed on the display screen, the image display device 10 including information included in the shooting point and the feature specifying information can be acquired. The possibility of being displayed on the display screen is calculated using the information (for example, the size and positional relationship of each feature) as a parameter, and for example, the calculated possibility is displayed as a numerical value on the display screen together with the name of the feature. With the configuration, it is possible to provide useful information to the user. In this case, the genre to which each feature belongs is stored in association with the feature specifying information, the user's favorite genre can be registered, and the display possibility of the feature belonging to the registered genre is set high. Also good.

  Although not particularly mentioned in the above-described embodiment, the azimuth information acquisition unit acquires the elevation angle of the condensing lens 21 as photographing azimuth information indicating the direction in which the condensing lens 21 is facing (the direction of the camera line of sight). When the height information is not stored as the feature specifying information, the image display device 10 uses the two-dimensional plane range as the feature search range instead of the three-dimensional shooting space. It is good also as composition to do. In this case, as shown in FIG. 13, the features A to D are searched for as features located in a triangular plane range 91 having a photographing point as a vertex and a predetermined angle and height set. . In addition to the triangular shape, for example, a sector-shaped plane range may be used as the feature search range. In principle, the plane range is a distance range from 0 m to ∞ m, but in general photographing, it is preferably set to several hundreds m to several tens km.

  Although not particularly mentioned in the above-described embodiment, the image display device 10 may be configured to display the name of a feature close to the shooting point when a plurality of feature candidates are searched.

  Although not particularly mentioned in the above-described embodiment, the image display device 10 stores in advance features that can be photographed from a predetermined point (for example, Tokyo Tower observatory, Osaka Castle castle tower, Kiyomizu-dera Grand Stage, etc.). In addition, it may be configured to determine whether or not the specified shooting point is a predetermined point, and display the feature name in response to the determination that the specified shooting point is the predetermined point.

  Further, in the search for the feature specifying information, the method for searching for the feature specifying information from the specified position information has been described. This search method is a representative image of a facility stored in advance in the feature information storage unit 81. A configuration may be adopted in which a captured image is discriminated using image recognition technology based on the information. In addition, when the user knows the feature to be photographed in advance, the photographing target may be designated and the feature name may be displayed only by measuring the orientation by the orientation information acquisition unit 62.

  Although not specifically mentioned in the above-described embodiment, the image display device 10 appropriately combines the shooting direction image, the map image, and the feature specifying information according to, for example, an operation input by the user. It is good also as a structure displayed on a display screen.

  Moreover, although the case where the present invention is applied to the display unit of a digital camera has been described in the above embodiment, the present invention may be applied to a handy type navigation system.

  The present invention is useful for an image display device used in a photographing apparatus.

F1 search unit F2 display mode determination unit 10 image display device 20 imaging unit 30 storage unit 40 processing unit 50 display unit 60 imaging space identification unit 71 shutter button 80 map information storage unit 81 feature identification information storage unit 82 display mode information storage unit 100 digital camera

Claims (7)

An image display device that displays an image captured by a camera on a display screen of a display device,
Map information storage means for storing map information for displaying a map on the display screen;
Feature specifying information storage means for storing feature specifying information for specifying a feature by position, name, etc .;
A shooting point specifying means for specifying a shooting point;
Feature specifying information search means for searching for the feature specifying information according to an image photographed by the camera;
Feature identification information number determination means for determining whether or not the number of feature identification information retrieved by the feature identification information retrieval means is greater than or equal to a specific number;
Map information search means for searching for map information including the shooting point when the feature specific information number determination means determines that the number is greater than or equal to the specific number;
Map image information creating means for creating map image information indicating a map image in which at least a part of the feature specifying information of the specified number or more is associated with the map indicated by the map information searched by the map information searching means;
An image display device comprising: map image display means for displaying the map image superimposed on the captured image based on the map image information created by the map image information creation means. Including azimuth detecting means for detecting a shooting azimuth of the camera;
The image display device according to claim 1, wherein the map image display unit displays the map image in a superimposed manner in a manner that matches the shooting direction. The image display according to claim 1, wherein the map image information creating unit creates map image information indicating a map image including an identification image indicating that the feature specifying information is associated with the map. apparatus. A selection operation receiving means for receiving a selection operation of the identification image in the map image displayed by the map image display means;
The image display apparatus according to claim 3, further comprising: related information display means for displaying information related to the feature specifying information corresponding to the identification image whose selection has been received by the selection operation receiving means on the display screen. The feature specifying information display means for displaying the feature specifying information searched by the feature specifying information searching means and the photographed image on the display screen in a superimposed manner. Any one of claims 1 to 4 An image display device according to claim 1. The feature specifying information display means superimposes the searched feature specifying information and the captured image when the feature specifying information number determining means determines that the number is not greater than the specified number. The image display device according to claim 5, which is displayed on a screen. An image display program for causing an image display device to control an operation so as to display an image captured by a camera on a display screen of the display device,
In the image display device,
A shooting point specifying process for specifying a shooting point;
The feature according to the image photographed by the camera from among the feature specification information stored in the feature specification information storage means for storing the feature specification information for specifying the feature by position, name, etc. Feature specific information search processing for searching for specific information;
A feature identification information number determination process for determining whether or not the number of feature identification information searched in the feature identification information search process is greater than or equal to a specific number;
Among the map information stored in the map information storage means for storing the map information for displaying the map on the display screen when it is determined in the feature specific information number determination process that the number is more than the specific number. A map information search process for searching map information including the shooting point from
Map image information creation processing for creating map image information indicating a map image in which at least a part of the specified feature number or more is associated with the map indicated by the map information searched in the map information search processing;
An image display program for executing a map image display process for superimposing and displaying the map image on the captured image based on the map image information created by the map image information creation process.

Images