JP2009118389A - Electronic camera and image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily search and display an image corresponding to a photographing state among images recorded beforehand. <P>SOLUTION: A digital camera picks up an object by a CCD 113, acquires a through image and displays the acquired through image on a monitor 104. Through the processing of a CPU 101, a time-space zoom image relating to the through image is searched among images recorded beforehand in a time-space data base which is stored in a server or a memory card 115 that can be accessed by wireless communication, and the searched time-space zoom image is changed into a through image to be displayed on the monitor 104. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic camera and an image display device.

  Conventionally, various methods for searching for a desired image from captured images recorded in a camera have been proposed. Patent Document 1 discloses an electronic camera that, when a user inputs a keyword such as a file name, a shooting date, and a name, searches for a corresponding image from recorded images based on the keyword. .

JP 2006-166193 A

  The electronic camera disclosed in Patent Document 1 is troublesome for the user because a search keyword must be input. Therefore, there is a need for a method that can easily search for and display an image according to a shooting situation from pre-recorded images without inputting a keyword.

An electronic camera according to a first aspect of the invention includes an imaging unit that captures a subject and acquires a through image, a display unit that displays a through image acquired by the imaging unit, and an image related to the through image from a pre-recorded image And a search unit for searching for images, and the image searched by the search unit is switched to a through image and displayed on the display unit.
According to a second aspect of the present invention, in the electronic camera according to the first aspect, the search unit searches for an image related to the through image based on the position and direction in which the through image is acquired by the imaging unit.
According to a third aspect of the present invention, in the electronic camera according to the second aspect, the search unit is photographed as an image related to the through image at the same photographing position and photographing direction as the position and direction in which the through image is acquired. The search is for an image having a narrower angle of view.
According to a fourth aspect of the present invention, in the electronic camera according to the second aspect, the search unit has the same shooting direction as the direction in which the through image is acquired as an image related to the through image, and is more than the position in which the through image is acquired. This is to search for an image shot at a shooting position that is close to the subject.
According to a fifth aspect of the present invention, in the electronic camera according to the second aspect, as the image related to the through image, the retrieval unit has the same photographing direction as the direction in which the through image is acquired and is in the photographing direction with respect to the subject. This searches for an image taken at a position.
According to a sixth aspect of the present invention, in the electronic camera according to any one of the first to fifth aspects, the display unit indicates the angle of view of the image retrieved by the retrieval unit in the through image.
The invention according to claim 7 is the electronic camera according to any one of claims 1 to 6, further comprising an operation unit for detecting a zoom operation for changing a field angle of the through image, and is detected by the operation unit. In response to the zoom operation, the image searched by the search unit is switched to a through image and displayed on the display unit.
The invention according to claim 8 is the electronic camera according to claim 1, wherein a map is displayed on the display unit, and the search unit is an image obtained by photographing a subject from a point designated on the map as an image related to the through image. Is to search.
The electronic camera according to the invention of claim 9 is a search for searching for an image obtained by photographing a subject specified by the specifying unit from a display unit for displaying a map, a specifying unit for specifying the subject, and a point specified on the map. The image searched by the search unit is switched to a map and displayed on the display unit.

  According to the present invention, it is possible to easily search for and display an image according to a shooting situation from images recorded in advance.

-First embodiment-
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram of a camera system including a digital camera according to an embodiment of the present invention. The camera system shown in FIG. 1 includes a digital camera 1, an access point 2, and a server device 3. The access point 2 and the server device 3 are connected via the Internet.

  The digital camera 1 is an electronic camera that takes a subject in accordance with a user's shooting instruction and acquires captured image information. The digital camera 1 also has a wireless communication function for performing wireless communication with the access point 2. By this wireless communication, the digital camera 1 and the server device 3 are connected via the access point 2 and the Internet. The configuration of the digital camera 1 will be described in detail later with reference to FIGS.

  The access point 2 is a device for enabling various devices including the digital camera 1 having a wireless communication function to communicate using a network such as the Internet. When the digital camera 1 and the access point 2 perform wireless communication, the digital camera 1 and the server device 3 are connected as described above.

  The server device 3 stores a database of information called a space-time database. In this space-time database, various information is recorded in association with the acquisition position and acquisition time of the information. For example, photographic image information acquired by the digital camera 1 or another camera, character information, audio information, and the like are recorded in the space-time database in association with the acquisition position and acquisition time.

  Next, the configuration of the digital camera 1 will be described. FIG. 2 is a diagram illustrating an appearance of the digital camera 1. 2, the digital camera 1 includes a shutter button 11, a power button 12, a zoom button 13, a playback button 14, a menu button 15, a delete button 16, a jog dial 17, a determination button 18, and a LAN (Local Area Network) access. LED (Light Emitting Diode) 19, strobe charging LED 20, AF (Auto Focus) LED 21, memory access LED 22, power LED 23, and monitor 104.

  The shutter button 11 is an operation button for the user to give a shooting instruction to the digital camera 1 and has a two-stage switch of half-press and full-press. The power button 12 is an operation button for the user to switch the main power source of the digital camera 1 from on to off or from off to on. The zoom button 13 is an operation button used when the user changes the focal length of the photographing lens of the digital camera 1.

  The playback button 14 is an operation button for the user to instruct the digital camera 1 to play back image data. The menu button 15 is an operation button for the user to instruct the digital camera 1 to call a menu screen. The delete button 16 is an operation button used when the user deletes image data from the memory card loaded in the digital camera 1.

  The jog dial 17 is a rotatable operation member for a user to give an instruction to move the cursor on the screen. The determination button 18 is an operation button for the user to determine setting contents on the menu screen.

  The LAN access LED 19 is a display device that lights up when the digital camera 1 is performing wireless communication with the access point 2. When the LED 19 for LAN access is turned on, the user can be notified that the digital camera 1 is communicating. The strobe charging LED 20 is a display device that is lit while the strobe is being charged. When the strobe charging LED 20 is turned on before photographing, the user can be informed that the strobe is being charged and preparation for photographing is not completed.

  The AF LED 21 is a display device for informing the user of the AF in-focus state. The memory access LED 22 is a display device that lights up in a memory access state, that is, when data is being written to a memory card loaded in the digital camera 1 and when data is being read from the memory card. The power LED 23 is a display device that lights up when the digital camera 1 is in a power-on state.

  The monitor 104 is a color display device using an LCD (Liquid Crystal Display) or the like, and displays various images. For example, when the monitor 104 displays a through image, the monitor 104 is used as a viewfinder at the time of shooting. A through image (through image) is a captured image of a subject displayed on the monitor 104 in real time during shooting. Further, the monitor 104 can also display a captured image, display a menu screen, and the like.

  FIG. 3 is a block diagram of the digital camera 1. As shown in this block diagram, the digital camera 1 includes a CPU 101, a compression / expansion circuit 102, a display driver 103, a monitor 104, a key input unit 105, a wireless LAN circuit 106, a GPS (Global Positioning System) sensor 107, and a motion sensor 108. , Capacitor 109, battery 110, strobe 111, CCD (Charge Coupled Device) driver 112, CCD 113, and memory 114. A memory card 115 as a recording medium is loaded in a card slot (not shown).

  The CPU 101 is a circuit for executing various processes and controls, and is configured using a microcomputer or the like. The compression / decompression circuit 102 is a circuit that compresses / decompresses captured image data. The display driver 103 is a drive circuit that controls an image displayed on the monitor 104. The key input unit 105 is a circuit that detects operations of buttons, switches, dials, and the like provided in the digital camera 1.

  The wireless LAN circuit 106 is a communication circuit for communicating with an external device wirelessly. By performing wireless communication with the access point 2 by the wireless LAN circuit 106, the digital camera 1 is connected to the server apparatus 3 via the Internet. Note that WiFi positioning may be performed using a wireless LAN. In this case, GPS is unnecessary.

  The GPS sensor 107 receives a GPS signal transmitted from a GPS satellite and outputs it to the CPU 101. Based on this GPS signal, the CPU 101 detects the current position of the digital camera 1. The motion sensor 108 detects the posture change of the digital camera 1 in each direction of pitch, yaw, and roll. Note that when the optical axis of the digital camera 1 is oriented in the horizontal direction, the change in posture in the pitch direction represents a change in posture about an axis that is orthogonal to the optical axis, that is, a change in elevation angle, and a change in posture in the yaw direction. Represents a change in posture around an axis perpendicular to the optical axis, that is, a change in azimuth. Further, the posture change in the roll direction represents a posture change around the optical axis, that is, a change in the tilt of the digital camera 1.

  The capacitor 109 is charged by receiving electric power from the battery 110 and is used for light emission of the strobe 111. It is also used to drive the camera as a backup power source in case of emergency. The battery 110 is a power source such as a lithium ion rechargeable battery that supplies power necessary for operating the digital camera 1.

  The strobe 111 enables photographing even in a dark environment by irradiating the subject with auxiliary light. The CCD driver 112 is a circuit for driving the CCD 113. The CCD 113 is an image sensor for capturing a subject image via a photographing lens. When a subject image is picked up by the CCD 113, an image pickup signal is output from the CCD 113 to the CCD driver 112. The imaging signal is converted into captured image data by the CCD driver 112 and then output to the CPU 101.

  The memory 114 is a nonvolatile semiconductor memory, and stores programs, data, and the like for use in control executed by the CPU 101. The memory card 115 stores various information such as photographed image information acquired by the digital camera 1 under the control of the CPU 101. Note that information is recorded in the memory card 115 in association with the acquisition position and the acquisition time, as in the server device 3 of FIG. 1 described above. That is, the memory card 115 stores a space-time database based on information acquired by the digital camera 1.

  Next, the operation of the digital camera 1 will be described. The digital camera 1 can set a shooting mode for acquiring a shot image in accordance with a user operation.

  When the shooting mode is set, the digital camera 1 acquires a through image as described above based on the image of the subject imaged by the CCD 113 and displays it on the monitor 104 before imaging the subject. . When a shooting instruction is performed by the user operating the shutter button 11, the digital camera 1 captures a subject and acquires a captured image in accordance with the shooting instruction, and stores information on the acquired captured image in the memory card 115. Record.

  When recording photographed image information in the memory card 115, the digital camera 1 adds various information at the time of photographing as meta information to the photographed image information. For example, various information such as the shooting time, the angle of view of the shot image, the focal length, the shutter speed, the position of the main subject, and the distance to the main subject are added as meta information to the shot image information and recorded in the memory card 115. . The meta information includes position information of the digital camera 1 detected at the time of shooting using the GPS sensor 107. That is, the image picked up by the CCD 113 has information (data) related to the position detected by the CPU 101 based on the GPS signal output from the GPS sensor 107 as meta information. The captured image information to which such meta information is added is recorded in the memory card 115, so that the information of the captured image acquired by the digital camera 1 is associated with the acquisition position and acquisition time of the memory card 115. Recorded in space-time database.

  Further, at this time, the digital camera 1 detects the orientation of the digital camera 1 at the time of shooting based on the posture change of the digital camera 1 detected by the motion sensor 108. At this time, the orientation of the digital camera 1 at the time of shooting is detected by obtaining an azimuth angle representing the horizontal direction of the digital camera 1 and an elevation angle representing the vertical direction of the digital camera 1. The captured image information may be further associated with the acquisition direction and recorded in the space-time database of the memory card 115 by adding the detected shooting direction information to the meta information.

  A part of the captured image information recorded in the memory card 115 may be transmitted from the digital camera 1 to the server device 3 in accordance with a user operation and recorded in the space-time database in the server device 3. At this time, information such as the position, orientation, and time of the digital camera 1 detected when the captured image is acquired is transmitted as meta information together with the captured image information. By recording the meta information together with the captured image information, the captured image information is recorded in the space-time database of the server device 3 in association with the acquisition position, the acquisition time, the acquisition direction, and the like. That is, in the space-time database of the memory card 115 or the server device 3, information having meta information such as position data, direction data, time data when the information is created, and the like is recorded.

  The digital camera 1 further has a space-time zoom function. The space-time zoom function is a function for searching and displaying an image related to the through image of the subject displayed by the digital camera 1 from the captured images recorded in the space-time database. By using this space-time zoom function, the digital camera 1 can easily retrieve and display an image according to the shooting situation from the space-time database. When an image recorded in the space-time database of the server device 3 is retrieved by the space-time zoom function, the image is transmitted to the digital camera 1 via the Internet and the access point 2.

  A specific example of the above space-time zoom function will be described. For example, it is assumed that a through image as shown in FIG. 4 is acquired by the CCD 113 in the digital camera 1 and displayed on the monitor 104. In the through image of FIG. 4, a mountain 31 is photographed as a subject.

  When the operation from the user is detected at the zoom button 13 while the through image of FIG. 4 is displayed, the view angle of the through image changes due to the change in the focal length of the photographic lens, and the through image is displayed. Scaled up or down. The operation for changing the angle of view of the through image in this way is hereinafter referred to as a zoom operation. When the focal length of the photographing lens is set to the maximum zoom distance, that is, the tele end side by this zoom operation, a through image as shown in FIG. 5 is displayed, for example. In the through image of FIG. 5, the mountain 31 is displayed in an enlarged manner as compared with FIG.

  When the maximum zoom distance is set in the digital camera 1 and the through image of FIG. 5 is displayed, a captured image related to the through image is retrieved from the space-time database. At this time, an image related to the through image is searched based on the position and direction of the digital camera 1 when the through image is acquired. The image searched in this way is hereinafter referred to as a space-time zoom image.

  For example, an image that is shot at the same shooting position and shooting direction as the position and direction of the digital camera 1 when the through image in FIG. 5 is acquired and that has a narrower angle of view than the through image is used as a space-time zoom image related to the through image. Search for. That is, an image captured at a zoom distance longer than the maximum zoom distance of the digital camera 1 from the same place where the through image is acquired is searched as a space-time zoom image.

  When the space-time zoom image is searched as described above, the angle-of-view frame 32 is displayed in the through image of FIG. This angle of view frame 32 indicates the angle of view of the space-time zoom image. By displaying such an angle of view frame 32 in the through image of FIG. 5, the user can know which range in the through image the searched space-time zoom image corresponds to. If the space-time zoom image is not searched, the view angle frame 32 is not displayed in the through image of FIG.

  Information on the angle of view for displaying the angle of view frame 32 is added to the captured image as the above-described meta information and recorded in the space-time database. Based on the information on the angle of view, the angle of view of the captured image retrieved as the space-time zoom image is obtained, and the angle of view frame 32 is displayed in the through image with a size corresponding to the obtained angle of view. The display position of the angle-of-view frame 32 is determined based on the orientation information of the digital camera 1 at the time of shooting added to the captured image as the above-described meta information.

  After the view angle frame 32 is displayed in the through image of FIG. 5, when the zoom button 13 is further operated in the tele direction, the searched space-time zoom image is switched to the through image and displayed. For example, the photographed image as shown in FIG. 6 is displayed as a space-time zoom image by switching to the through image of FIG. In this space-time zoom image, the mountain 31 is displayed further enlarged than in FIG. Note that the angle of view of the space-time zoom image in FIG. 6 corresponds to the range of the angle-of-view frame 32 shown in FIG.

  By searching for and displaying the space-time zoom image as described above, the digital camera 1 can present to the user an image that cannot be actually observed because it exceeds the zoomable range.

  Alternatively, the image is taken in the same shooting direction as the direction of the digital camera 1 when the through image of FIG. 5 is acquired, and the shooting position is closer to the mountain 31 as the subject than the position where the digital camera 1 acquires the through image. You may search the image | photographed image as a space-time zoom image relevant to a through image. That is, an image captured in the same direction as the through image at a position closer to the subject than the place where the through image is acquired is searched as a space-time zoom image. By displaying such a space-time zoom image, it is possible to provide an image that exceeds the zoomable range of the digital camera 1.

  Further, a captured image of an object that is blocked by an obstacle or the like and is not actually visible from the through image acquisition position may be searched as a space-time zoom image related to the through image. For example, when a wall or the like is captured as a subject in the through image, an image photographed in the same photographing direction on the other side of the wall is searched as a space-time zoom image related to the through image. In other words, a space-time zoom associated with a through image is obtained by capturing an image captured in the same shooting direction as the direction of the digital camera 1 when the through image is acquired and captured at a shooting position in the shooting direction relative to the subject in the through image. Search as an image. If such a spatio-temporal zoom image is displayed, it is possible to give the user a visual effect as if it was photographed through a wall or the like.

  Note that the search and display of the space-time zoom image as described above may be executed in a digital camera using both optical zoom and digital zoom. That is, after performing digital zoom at a predetermined magnification beyond the range where optical zoom is possible, a captured image exceeding the digital zoom range can be retrieved from the space-time database and displayed as a space-time zoom image.

  The digital camera 1 retrieves and displays a space-time zoom image related to the through image from the space-time database by executing the processing described above. FIG. 7 is a flowchart showing the flow of processing at this time. This flowchart is executed by the CPU 101. Hereinafter, the flowchart of FIG. 7 will be described.

  In step S10, captured image data based on the imaging signal from the CCD 113 is received from the CCD driver 112, and a through image of the subject is acquired. In step S20, the through image acquired in step S10 is displayed on the monitor 104. Thereby, a through image as shown in FIG. 4 or 5 is displayed.

  In step S30, it is determined whether or not the focal length of the taking lens is set to the maximum zoom distance. If the maximum zoom distance is set, the process proceeds to the next step S40. If the maximum zoom distance is not set, the process returns to step S10 to continue acquiring the through image. At this time, when the user operates the shutter button 11 to give a shooting instruction, a shot image is acquired according to the shooting instruction, and the shot image information is recorded in the memory card 115.

  In step S40, the camera position is detected. Here, a GPS signal is received by the GPS sensor 107, and a camera position indicating the current position of the digital camera 1 is detected based on the GPS signal. In the next step S50, the camera posture is detected. Here, based on the posture change of the digital camera 1 detected by the motion sensor 108, the camera orientation indicating the current orientation of the digital camera 1 is detected. By executing Step S40 and Step S50, the position and direction in which the through image is acquired in Step S10 are detected.

  In step S60, a space-time zoom image is searched based on the camera position detected in step S40 and the camera orientation detected in step S50. Here, the space-time zoom image related to the through image acquired in step S10 is searched from the space-time database by any of the methods described above. In other words, the image was shot at the same shooting position and shooting direction as the position and direction from which the through image was acquired, and the shooting angle is the same as the direction in which the through angle was acquired. Space-time zoom for images taken at a shooting position closer to the subject than the position, or images taken at a shooting position that is in the same shooting direction as the through image and in the shooting direction Search the space-time database as an image. Thereby, the space-time zoom image related to the through image is searched based on the position and direction at which the through image is acquired in step S10.

  In step S70, it is determined in step S60 whether a space-time zoom image related to the through image acquired in step S10 has been searched. If a space-time zoom image satisfying any of the above conditions is retrieved from the space-time database, the process proceeds to step S80. On the other hand, if the image satisfying the above conditions is not recorded in the space-time database, and therefore the space-time zoom image cannot be searched, the process returns to step S10 and starts again from the acquisition of the through image.

  In step S80, a frame indicating the angle of view of the space-time zoom image retrieved in step S60 is displayed in the through image displayed in step S20. Thereby, the angle-of-view frame 32 is displayed in the through image of FIG. If a plurality of space-time zoom images are searched in step S60, an angle-of-view frame is displayed for each of the plurality of space-time zoom images.

  In step S90, it is determined whether or not the zoom operation has been performed on the zoom button 13 from the user in the tele-side direction. If such a zoom operation is detected by the zoom button 13, the process proceeds to step S100. If the zoom operation is not detected, the process returns to step S10.

  In step S100, the space-time zoom image searched in step S60 is displayed on the monitor 104 in accordance with the zoom operation detected by the zoom button 13 in step S90. Thereby, the display is switched to the through image displayed in step S20, and the space-time zoom image as shown in FIG. 6 related to the through image is displayed on the monitor 104. If a plurality of space-time zoom images are searched in step S60, all of them may be displayed, or the user may select which of the searched space-time zoom images is to be displayed. Also good. For example, a space-time zoom image can be selected by allowing the user to select one of a plurality of angle-of-view frames displayed in the through image in step S80 by operating the jog dial 17 or changing the direction of the digital camera 1. It can be performed. The operation of the jog dial 17 is, for example, an operation of the focus selector.

  When step S100 is executed, the flowchart of FIG. 7 is terminated. The digital camera 1 searches the space-time zoom image related to the through image and presents it to the user by executing the above-described processing in the CPU 101.

According to 1st Embodiment described above, there exists the following effect.
(1) The digital camera 1 captures a subject with the CCD 113 to acquire a through image (step S10), and displays the acquired through image on the monitor 104 (step S20). Then, by the processing of the CPU 101, a space-time zoom image related to the through image is searched from images recorded in advance in the space-time database (step S60), and the searched space-time zoom image is switched to the through image and displayed on the monitor 104 ( Step S100). Since it did in this way, the image according to the imaging | photography situation can be easily searched and displayed from the image recorded previously.

(2) The digital camera 1 detects the camera position and the camera orientation in steps S40 and S50 by the processing of the CPU 101, respectively. In step S60, using this detection result, a space-time zoom image related to the through image is searched based on the position and direction in which the through image is acquired. Since it did in this way, a space-time zoom image can be searched reliably from a space-time database.

(3) In step S60, as a spatio-temporal zoom image related to the through image, an image that is shot at the same shooting position and shooting direction as the position and direction at which the through image is acquired and has a narrower angle of view than the through image can be searched. it can. By displaying the retrieved image on the monitor 104, the digital camera 1 can present to the user an image that cannot be actually observed because it exceeds the zoomable range.

(4) Further, in step S60, the space-time zoom image related to the through image has the same shooting direction as the direction in which the through image is acquired, and is shot at a shooting position that is closer to the subject than the position at which the through image is acquired. Searched images can also be searched. By displaying the image searched in this way on the monitor 104, the digital camera 1 can present to the user an image that cannot be actually observed because it exceeds the zoomable range, as described above.

(5) Further, in step S60, as a spatio-temporal zoom image related to the through image, search for an image taken at a shooting position that is in the same shooting direction as the through image and is in the shooting direction relative to the subject. You can also. By displaying the image searched in this way on the monitor 104, the digital camera 1 can give the user a visual effect as if it was photographed through a wall or the like.

(6) The digital camera 1 displays the angle-of-view frame of the space-time zoom image with respect to the through image on the monitor 104 (step S80). As a result, the angle of view of the space-time zoom image retrieved in step S60 is shown in the through image. Since it did in this way, it can inform a user intelligibly which range in the through-image to which the searched space-time zoom image corresponds.

(7) When a zoom operation is detected by the zoom button 13 (step S90), step S100 is executed in accordance with the zoom operation, and the space-time zoom image searched in step S60 is switched to a through image and displayed on the monitor 104. It was decided to. Since this is done, the user can easily use the space-time zoom function without any particular awareness.

-Second Embodiment-
Next, a second embodiment of the present invention will be described. In the present embodiment, an example in which a space-time zoom image related to a through image is searched from a space-time database using a method different from the above will be described.

  For example, it is assumed that a through image as shown in FIG. 8 is acquired by the CCD 113 in the digital camera 1 and displayed on the monitor 104. In the through image of FIG. 8, the Tokyo Tower 33 is taken as a subject. At this time, the subject in the through image in FIG. 8 is identified as Tokyo Tower based on the position and orientation of the digital camera 1, the focal length of the photographing lens, the focus adjustment state, and the like. The subject may be specified by analyzing the through image. When there are a plurality of subjects, a desired subject may be selected by a user operation of the focus selector.

  When a predetermined map display request operation is performed using the menu button 15 or the enter button 18 or the like in the digital camera 1 while the through image of FIG. 8 is displayed, a map as shown in FIG. Is displayed. In the map of FIG. 9, the current camera position, that is, the through image acquisition position of FIG. 8 is displayed by the cursor 34. The map may be a two-dimensional (2D) map or a three-dimensional (3D) map.

  In the map of FIG. 9, when the user operates the jog dial 17 or the like, the position of the cursor 34 moves according to the operation. After the cursor 34 is moved to an arbitrary position on the map, for example, when the user operates the determination button 18, the point selected by the cursor 34 at that time is designated as a search target point of the space-time zoom image. When the search target point of the space-time zoom image is designated in this way, an image obtained by shooting the Tokyo tower 33 that is the subject of the through image in FIG. 8 from that point is searched from the space-time database as a space-time zoom image. In addition, you may make it show the point which can search a space-time zoom image on a map.

  As described above, when a space-time zoom image in which a subject is photographed at a search target point designated on a map is searched, the space-time zoom image is displayed on the monitor 104. By searching and displaying the space-time zoom image in this way, an image obtained by photographing the subject at an arbitrary position can be presented to the user without requiring actual position movement.

  For example, as shown in FIG. 10, it is assumed that the cursor 34 is moved on the map to a point close to Tokyo Tower, and this point is designated as a search target point of the space-time zoom image. In this case, as shown in FIG. 11, an image obtained by looking up at the Tokyo Tower 33 from directly below is retrieved from the space-time database as a space-time zoom image and displayed on the monitor 104.

  Note that the search for the space-time zoom image as described above may be performed without acquiring a through image. For example, the map is displayed as described above, and the user is allowed to designate any point on the map as a search target point, and the user is allowed to input information for specifying a subject to be searched. At this time, for example, the user inputs information for identifying the subject by inputting a keyword such as “Tokyo Tower” or specifying the position of the Tokyo Tower as the subject on the map. Based on the input information, a subject can be specified, and an image obtained by photographing the subject can be searched as a space-time zoom image. Further, the user input may speak a keyword. In this case, a keyword is selected by voice recognition.

  Further, the time range of the space-time zoom image to be searched may be specified in the digital camera 1. For example, when the user changes the tilt of the digital camera 1, a time range corresponding to the tilt is set and a space-time zoom image is searched. Thus, for example, instead of the space-time zoom image of FIG. 11, a captured image of Tokyo Tower in the night view and a captured image of Tokyo Tower under construction are displayed. Note that the time range may be set by other methods.

  The digital camera 1 performs processing such as described above, and retrieves and displays an image obtained by photographing a subject from a point designated on the map as a space-time zoom image from the space-time database. FIG. 12 is a flowchart showing the flow of processing at this time. This flowchart is executed by the CPU 101. Hereinafter, the flowchart of FIG. 12 will be described.

  In steps S110 and S120, processing similar to that in steps S10 and S20 in the flowchart of FIG. 7 is executed. That is, a through image of the subject is acquired in step S110, and the through image is displayed on the monitor 104 in step S120. Thereby, a through image as shown in FIG. 8 is displayed. Note that when searching for a space-time zoom image without acquiring a through image as described above, the processing in steps S110 and S120 may not be executed.

  In step S130, it is determined whether a predetermined map display request operation has been performed. If a map display request operation by the menu button 15 or the determination button 18 is detected, the process proceeds to the next step S140. If a map display request operation is not detected, the process returns to step S110 and continues to acquire a through image. At this time, when the user operates the shutter button 11 to give a shooting instruction, a shot image is acquired according to the shooting instruction, and the shot image information is recorded in the memory card 115.

  In step S140, the camera position is detected as in step S40 of FIG. In step S150, the camera posture is detected as in step S50 of FIG. Thereby, the position and direction where the through image is acquired in step S110 is detected.

  In step S160, a map near the camera position detected in step S140 is displayed on the monitor 104. Further, the camera position detected in step S140 is displayed on the displayed map as the through image acquisition position. Thereby, a map as shown in FIG. 9 is displayed.

  In step S170, the subject is specified. Here, for example, based on the position and orientation of the digital camera 1 detected in steps S140 and S150, the subject in the through image acquired in step S110 is specified. At this time, the focal length of the photographing lens or the focus adjustment state at the time of obtaining the through image may be used. Alternatively, the subject may be specified by analyzing the through image acquired in step S110. On the other hand, when searching for a space-time zoom image without acquiring a through image as described above, the subject is specified based on the input keyword, the position of the subject designated on the map, or the like.

  In step S180, it is determined whether any point on the map displayed in step S160 is designated as a search target point of the space-time zoom image by operating the jog dial 17 or the determination button 18. As shown in FIG. 10, when the search target point of the space-time zoom image is designated on the map, the process proceeds to step S190.

  In step S190, a space-time zoom image is searched. Here, a space-time zoom image obtained by photographing the subject specified in step S170 at the search target point designated in step S180 is searched from the space-time database. Thereby, an image obtained by photographing the same subject from another point is searched as the space-time zoom image related to the through image acquired in step S10. At this time, as described above, the time range of the space-time zoom image to be searched may be designated in the digital camera 1. It should be noted that the space-time database may be stored in the memory 114 in the camera, thereby eliminating the server device. In this case, you can see the photos you have taken and other people's photos that you have downloaded to your camera.

  In step S200, it is determined whether or not a space-time zoom image has been searched in step S190. When the space-time zoom image as described above is retrieved from the space-time database, the process proceeds to step S210. On the other hand, if the image of the subject at the designated search target point is not recorded in the space-time database, and therefore the space-time zoom image cannot be searched, the process returns to step S180, and another search target point is designated. Wait for it.

  In step S210, the space-time zoom image retrieved in step S190 is displayed on the monitor 104. Thereby, the map is switched to the map displayed in step S160, and the space-time zoom image as shown in FIG.

  If step S210 is performed, the flowchart of FIG. 12 will be complete | finished. The digital camera 1 searches the space-time zoom image related to the through image and presents it to the user by executing the above-described processing in the CPU 101.

  According to the second embodiment described above, the digital camera 1 displays a map on the monitor 104 (step S160), acquires a through image (step S110), and specifies a subject of the through image (step S110). Step S170). Then, the space-time zoom image obtained by photographing the subject from the point specified on the map is searched as an image related to the through image (step S190), and the searched space-time zoom image is switched to the map and displayed on the monitor 104. (Step S210). Since it did in this way, the image according to the imaging | photography situation can be easily searched and displayed from the image recorded previously.

  In each of the above embodiments, the digital camera 1 which is an electronic camera has been described as an example. However, the present invention can also be applied to other devices. For example, the present invention can be applied to a mobile electronic device such as a camera-equipped mobile phone. Alternatively, the present invention may be applied when searching and displaying various types of information such as image information recorded in a space-time database in advance in digital binoculars or field scopes that do not perform shooting.

  Each embodiment and various modifications described above are merely examples. Therefore, the present invention is not limited to these contents as long as the characteristics of the present invention are not impaired.

It is a block diagram of the camera system by one embodiment of this invention. It is a figure which shows the external appearance of the digital camera by one embodiment of this invention. 1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a figure which shows the example of the through image in 1st Embodiment. It is a figure which shows the example of the through image in the maximum zoom distance. It is a figure which shows the example of the space-time zoom image searched and displayed in 1st Embodiment. It is a figure which shows the flowchart which shows the flow of a process when searching and displaying the space-time zoom image relevant to a through image from a space-time database. It is a figure which shows the example of the through image in 2nd Embodiment. It is a figure which shows the example of the map displayed when map display request | requirement operation is performed. It is a figure which shows the example which designated the search object point on the map. It is a figure which shows the example of the space-time zoom image searched and displayed in 2nd Embodiment. It is a figure which shows the flowchart which shows the flow of a process when searching and displaying the image which image | photographed the object from the location designated on the map as a space-time zoom image.

Explanation of symbols

1: Digital camera 2: Access point 3: Server device

Claims (9)

An imaging unit that captures a subject and acquires a through image;
A display unit for displaying a through image acquired by the imaging unit;
A search unit for searching for an image related to the through image from an image recorded in advance,
An electronic camera, wherein the image searched by the search unit is switched to the through image and displayed on the display unit. The electronic camera according to claim 1,
The electronic camera according to claim 1, wherein the search unit searches for an image related to the through image based on a position and a direction in which the through image is acquired by the imaging unit. The electronic camera according to claim 2,
The search unit is configured to search for an image having an angle of view smaller than that of the through image, as an image related to the through image, which is shot at the same shooting position and shooting direction as the position and direction of acquiring the through image. And an electronic camera. The electronic camera according to claim 2,
The retrieval unit was photographed at a photographing position that is the same photographing direction as the direction in which the through image was acquired as an image related to the through image and that is closer to the subject than the position at which the through image was acquired. An electronic camera characterized by searching for images. The electronic camera according to claim 2,
The search unit searches for an image taken at a shooting position that is in the same shooting direction as the direction in which the through image was acquired as the image related to the through image and that is in the shooting direction relative to the subject. And an electronic camera. In the electronic camera as described in any one of Claims 1-5,
The electronic camera according to claim 1, wherein the display unit indicates an angle of view of the image searched by the search unit in the through image. In the electronic camera as described in any one of Claims 1-6,
An operation unit for detecting a zoom operation for changing the angle of view of the through image;
In accordance with a zoom operation detected by the operation unit, an image searched by the search unit is switched to the through image and displayed on the display unit. The electronic camera according to claim 1,
Display a map on the display unit,
The electronic camera is characterized in that the search unit searches for an image obtained by photographing the subject from a point designated on the map as an image related to the through image. A display for displaying a map;
A specific part for identifying the subject;
A search unit that searches for an image of the subject specified by the specifying unit from a point specified on the map;
An image display device, wherein the image searched by the search unit is switched to the map and displayed on the display unit.

Images