JP5003358B2 - Display device, electronic camera, and control program - Google Patents

Description

The present invention relates to a display device , an electronic camera, and a control program .

  Conventionally, various methods for searching for desired information from various information such as a captured image recorded in a camera have been proposed. Patent Document 1 discloses an electronic camera that, when a user inputs a keyword such as a file name, a shooting date, and a name, searches for a corresponding image from recorded images and displays a list based on the keyword. It is disclosed.

JP 2006-166193 A

  In the electronic camera disclosed in Patent Document 1, the searched images are displayed as a list by a list or an index. For this reason, when a large number of various types of images are searched, the images cannot be easily displayed and it may not be easy to select any one of the images. Accordingly, there is a demand for a display device and an electronic camera that can easily select any information while displaying various information in an easy-to-view manner.

The display device according to claim 1, based on the photographing position recorded in association with the photographed image, from an external recording device in which a plurality of photographed images recorded in association with the photographing position are recorded. An extraction unit that extracts a photographed image included in the pseudo three-dimensional space represented above, a space cursor that indicates a predetermined area of the pseudo three-dimensional space, and a three-dimensional icon corresponding to the photographed image extracted by the extraction unit And a selection unit that selects the three-dimensional icon arranged in the space cursor, and the display unit is located at a position corresponding to the photographing position in the pseudo three-dimensional space. The solid icon is displayed by changing the shape of the solid icon in accordance with a main subject included in the image.
An electronic camera according to a tenth aspect includes the display device according to any one of the first to ninth aspects.
The display device according to claim 13 is based on the photographing position recorded in association with the photographed image from an external recording device in which a plurality of photographed images recorded in association with the photographing position and the photographing direction are recorded. An extraction unit that extracts a captured image included in the pseudo-stereoscopic space represented on the screen, a space cursor indicating a predetermined area of the pseudo-stereoscopic space, and a captured image extracted by the extraction unit A display unit that displays a three-dimensional icon to be displayed, and a selection unit that selects the three-dimensional icon arranged in the space cursor, and the display unit is located at a position corresponding to the shooting position in the pseudo three-dimensional space. The three-dimensional icon is displayed in a direction corresponding to the shooting direction.
An electronic camera according to a fourteenth aspect is the display device according to the thirteenth aspect, a photographed image acquisition unit that photographs a subject and obtains a photographed image, and a photographing position acquisition that obtains a photographing position when the subject is photographed. A shooting direction acquisition unit that acquires a shooting direction when the subject is shot, the shot image acquired by the shot image acquisition unit, the shooting position acquired by the shooting position acquisition unit, and the shooting direction acquisition. And a recording control unit that records the recording direction in association with the shooting direction acquired by the recording unit.
The control program according to claim 15, based on the photographing position recorded in association with the photographed image, from an external recording device in which a plurality of photographed images recorded in association with the photographing position are recorded. An extraction step for extracting a photographed image included in the pseudo three-dimensional space represented above, a space cursor indicating a predetermined region of the pseudo three-dimensional space, and a three-dimensional icon corresponding to the photographed image extracted by the extraction step And a selection program for selecting the three-dimensional icon arranged in the space cursor. The display step includes the shooting position in the pseudo three-dimensional space. The shape of the solid icon is changed to a position corresponding to the main subject included in the captured image, To display the three-dimensional icon.
The control program according to claim 16 is based on the photographing position recorded in association with the photographed image from an external recording device in which a plurality of photographed images recorded in association with the photographing position and the photographing direction are recorded. An extraction step of extracting a captured image included in the pseudo-stereoscopic space represented on the screen, a space cursor indicating a predetermined area of the pseudo-stereoscopic space, and the captured image extracted by the extracting step A control program for causing a computer to execute a display step for displaying a three-dimensional icon to be performed and a selection step for selecting the three-dimensional icon arranged in the space cursor, wherein the display step is performed in the pseudo three-dimensional space. The three-dimensional icon is displayed in a direction corresponding to the shooting direction at a position corresponding to the shooting position.

According to the present invention, it is Rukoto showing legible display the various information.

The electronic camera of this embodiment will be described below with reference to the drawings. FIG. 1 is a configuration diagram of a camera system including a digital camera according to an embodiment of the present invention. The camera system shown in FIG. 1 includes a digital camera 1, an access point 2, and a server device 3. The access point 2 and the server device 3 are connected via the Internet.

  The digital camera 1 is an electronic camera that takes a subject in accordance with a user's shooting instruction and acquires captured image information. The digital camera 1 also has a wireless communication function for performing wireless communication with the access point 2. By this wireless communication, the digital camera 1 and the server device 3 are connected via the access point 2 and the Internet. The configuration of the digital camera 1 will be described in detail later with reference to FIGS.

  The access point 2 is a device for enabling various devices including the digital camera 1 having a wireless communication function to communicate using a network such as the Internet. When the digital camera 1 and the access point 2 perform wireless communication, the digital camera 1 and the server device 3 are connected as described above.

  The server device 3 stores a database of information called a space-time database. In this space-time database, various information is recorded in association with the acquisition position and acquisition time of the information. For example, photographic image information acquired by the digital camera 1 or another camera, character information, audio information, and the like are recorded in the space-time database in association with the acquisition position and acquisition time.

  Next, the configuration of the digital camera 1 will be described. FIG. 2 is a diagram illustrating an appearance of the digital camera 1. 2, the digital camera 1 includes a shutter button 11, a power button 12, a zoom button 13, a playback button 14, a menu button 15, a delete button 16, a jog dial 17, a determination button 18, and a LAN (Local Area Network) access. LED (Light Emitting Diode) 19, strobe charging LED 20, AF (Auto Focus) LED 21, memory access LED 22, power LED 23, and monitor 104.

  The shutter button 11 is an operation button for the user to give a shooting instruction to the digital camera 1 and has a two-stage switch of half-press and full-press. The power button 12 is an operation button for the user to switch the main power source of the digital camera 1 from on to off or from off to on. The zoom button 13 is an operation button used when the user changes the focal length of the photographing lens of the digital camera 1.

  The playback button 14 is an operation button for the user to instruct the digital camera 1 to play back image data. The menu button 15 is an operation button for the user to instruct the digital camera 1 to call a menu screen. The delete button 16 is an operation button used when the user deletes image data from the memory card loaded in the digital camera 1.

  The jog dial 17 is a rotatable operation member for a user to give an instruction to move the cursor on the screen. The determination button 18 is an operation button for the user to determine setting contents on the menu screen.

  The LAN access LED 19 is a display device that lights up when the digital camera 1 is performing wireless communication with the access point 2. When the LED 19 for LAN access is turned on, the user can be notified that the digital camera 1 is communicating. The strobe charging LED 20 is a display device that is lit while the strobe is being charged. When the strobe charging LED 20 is turned on before photographing, the user can be informed that the strobe is being charged and preparation for photographing is not completed.

  The AF LED 21 is a display device for informing the user of the AF in-focus state. The memory access LED 22 is a display device that lights up in a memory access state, that is, when data is being written to a memory card loaded in the digital camera 1 and when data is being read from the memory card. The power LED 23 is a display device that lights up when the digital camera 1 is in a power-on state.

  The monitor 104 is a color display device using an LCD (Liquid Crystal Display) or the like, and displays various images. For example, when the monitor 104 displays a through image, the monitor 104 is used as a viewfinder at the time of shooting. The through image (through image) is a photographed image of a subject displayed on the monitor 104 in real time when an operation mode such as a photographing mode or an information search mode described later is set in the digital camera 1. is there. Further, the monitor 104 can also display a captured image, display a menu screen, and the like.

  FIG. 3 is a block diagram of the digital camera 1. As shown in this block diagram, the digital camera 1 includes a CPU 101, a compression / expansion circuit 102, a display driver 103, a monitor 104, a key input unit 105, a wireless LAN circuit 106, a GPS (Global Positioning System) sensor 107, and a motion sensor 108. , Capacitor 109, battery 110, strobe 111, CCD (Charge Coupled Device) driver 112, CCD 113, and memory 114. A memory card 115 as a recording medium is loaded in a card slot (not shown).

  The CPU 101 is a circuit for executing various processes and controls, and is configured using a microcomputer or the like. The compression / decompression circuit 102 is a circuit that compresses / decompresses captured image data. The display driver 103 is a drive circuit that controls an image displayed on the monitor 104. The key input unit 105 is a circuit that detects operations of buttons, switches, dials, and the like provided in the digital camera 1.

  The wireless LAN circuit 106 is a communication circuit for communicating with an external device wirelessly. By performing wireless communication with the access point 2 by the wireless LAN circuit 106, the digital camera 1 is connected to the server apparatus 3 via the Internet.

  The GPS sensor 107 receives a GPS signal transmitted from a GPS satellite and outputs it to the CPU 101. Based on this GPS signal, the CPU 101 detects the current position of the digital camera 1. The motion sensor 108 detects the posture change of the digital camera 1 in each direction of pitch, yaw, and roll. Note that when the optical axis of the digital camera 1 is oriented in the horizontal direction, the change in posture in the pitch direction represents a change in posture around an axis that is orthogonal to the optical axis, that is, a change in elevation angle. Represents a change in posture around an axis perpendicular to the optical axis, that is, a change in azimuth. Further, the posture change in the roll direction represents a posture change around the optical axis, that is, a change in the tilt of the digital camera 1.

  The capacitor 109 is charged by receiving electric power from the battery 110 and is used for light emission of the strobe 111. It is also used to drive the camera as a backup power source in case of emergency. The battery 110 is a power source such as a lithium ion rechargeable battery that supplies power necessary for operating the digital camera 1.

  The strobe 111 enables photographing even in a dark environment by irradiating the subject with auxiliary light. The CCD driver 112 is a circuit for driving the CCD 113. The CCD 113 is an image sensor for capturing a subject image via a photographing lens. When a subject image is picked up by the CCD 113, an image pickup signal is output from the CCD 113 to the CCD driver 112. The imaging signal is converted into captured image data by the CCD driver 112 and then output to the CPU 101.

  The memory 114 is a nonvolatile semiconductor memory, and stores programs, data, and the like for use in control executed by the CPU 101. The memory card 115 stores various information such as photographed image information acquired by the digital camera 1 under the control of the CPU 101. Note that information is recorded in the memory card 115 in association with the acquisition position and the acquisition time, as in the server device 3 of FIG. 1 described above. That is, the memory card 115 stores a space-time database based on information acquired by the digital camera 1.

  Next, the operation of the digital camera 1 will be described. The digital camera 1 can set various operation modes such as a shooting mode for acquiring a shot image and an information search mode for searching for information from a space-time database according to a user operation.

  When the shooting mode is set, the digital camera 1 acquires a through image as described above based on the image of the subject imaged by the CCD 113 and displays it on the monitor 104 before imaging the subject. . When a shooting instruction is performed by the user operating the shutter button 11, the digital camera 1 captures a subject and acquires a captured image in accordance with the shooting instruction, and stores information on the acquired captured image in the memory card 115. Record.

  When recording photographed image information in the memory card 115, the digital camera 1 adds various information at the time of photographing as meta information to the photographed image information. For example, various information such as the shooting time, the angle of view of the shot image, the focal length, the shutter speed, the position of the main subject, and the distance to the main subject are added as meta information to the shot image information and recorded in the memory card 115. . The meta information includes position information of the digital camera 1 detected at the time of shooting using the GPS sensor 107. That is, the image picked up by the CCD 113 has information (data) related to the position detected by the CPU 101 based on the GPS signal output from the GPS sensor 107 as meta information. The captured image information to which such meta information is added is recorded in the memory card 115, so that the information of the captured image acquired by the digital camera 1 is associated with the acquisition position and acquisition time of the memory card 115. Recorded in space-time database.

  Further, at this time, the digital camera 1 detects the orientation of the digital camera 1 at the time of shooting based on the posture change of the digital camera 1 detected by the motion sensor 108. At this time, the orientation of the digital camera 1 at the time of shooting is detected by obtaining an azimuth angle representing the horizontal direction of the digital camera 1 and an elevation angle representing the vertical direction of the digital camera 1. The captured image information may be further associated with the acquisition direction and recorded in the space-time database of the memory card 115 by adding the detected shooting direction information to the meta information.

  A part of the captured image information recorded in the memory card 115 may be transmitted from the digital camera 1 to the server device 3 in accordance with a user operation and recorded in the space-time database in the server device 3. At this time, information such as the position, orientation, and time of the digital camera 1 detected when the captured image is acquired is transmitted as meta information together with the captured image information. By recording the meta information together with the captured image information, the captured image information is recorded in the space-time database of the server device 3 in association with the acquisition position, the acquisition time, the acquisition direction, and the like. That is, in the space-time database of the memory card 115 or the server device 3, information having meta information such as position data, direction data, time data when the information is created, and the like is recorded.

  On the other hand, when the information search mode is set, the digital camera 1 searches and extracts information satisfying a predetermined search condition from the space-time database stored in the server device 3 or the memory card 115. Then, the extracted information is displayed on the monitor 104 superimposed on the through image and presented to the user. Information extracted from the space-time database of the server device 3 is transmitted to the digital camera 1 via the Internet and the access point 2.

  The digital camera 1 can set a search target area for an information acquisition position as one of search conditions when searching for information from a space-time database. This search target area includes the current position (camera position) of the digital camera 1 based on the GPS signal received by the GPS sensor 107 and the optical axis direction (camera direction) based on the attitude of the digital camera 1 detected by the motion sensor 108. ). Specifically, the current camera position is set as the viewpoint, and a vector having a predetermined length extending from the viewpoint in the direction of the camera is set as a line-of-sight vector. A predetermined spatial range centered on this line-of-sight vector is set as the search target area. Note that the search target area is set to become wider as the distance from the viewpoint increases. Or the opposite may be sufficient.

  In setting the search target area, only the horizontal camera direction, that is, the azimuth angle may be used. That is, a predetermined spatial range can be set as the search target area for the horizontal direction, and the entire spatial range can be included in the search target area for the vertical direction. Alternatively, in addition to the horizontal camera direction, the vertical camera direction, that is, the elevation angle may also be used to set a predetermined spatial range in the search target area in each of the horizontal direction and the vertical direction. Furthermore, the search target area may be set based only on the camera position without using the camera orientation. That is, a predetermined range centered on the current camera position may be set as the search target area.

  In setting search conditions, in addition to the search target area as described above, a search target time for information acquisition time (creation time) may be set. That is, a predetermined time range is set from the past to the present, and the search condition is set by setting the time range as the search target time. The range of the search target time is set as follows based on the tilt around the optical axis (camera tilt) of the digital camera 1 detected by the motion sensor 108.

  When the current camera tilt is almost zero, that is, when the user is holding the digital camera 1 almost straight, a predetermined time range from the present time, for example, a time range up to one year ago is set as the search target time. To do. When the user tilts the digital camera 1 clockwise from that state, the range of the search target time is gradually changed back to the past. At this time, as the camera tilt angle increases, the range of the search target time may be changed greatly accordingly. For example, three stages of threshold values of 10 °, 20 ° and 30 ° are set for the camera tilt angle. When the camera tilt angle is 10 ° or more and less than 20 °, the search target time is set every month, every month when it is 20 ° or more and less than 30 °, and every year when it is 30 ° or more. Change the range retroactively. Conversely, when the user tilts the digital camera 1 counterclockwise, the range of the search target time is gradually changed from the past to the present. Similarly, the search target time can be changed greatly as the camera tilt angle increases.

  When the search conditions as described above are set in the digital camera 1, information satisfying the search conditions is extracted from the space-time database stored in the server device 3 or the memory card 115. That is, information related to the acquisition position in the search target area set as the search condition and information related to the acquisition time (creation time) within the search target time set as the search condition are searched from the space-time database. To be extracted. At this time, the space-time database of the memory card 115 is searched first, and if the corresponding information is not extracted, the space-time database of the server device 3 may be searched. Alternatively, both the memory card 115 and the space-time database of the server device 3 may be searched. Note that when searching the space-time database of the server device 3, the search conditions set in the digital camera 1 are transmitted to the server device 3 via the access point 2 and the Internet. Information extracted from the space-time database of the server device 3 is transmitted to the digital camera 1 via the Internet and the access point 2.

  The digital camera 1 displays the information extracted as described above from the space-time database of the server device 3 or the memory card 115 on the monitor 104 so as to be superimposed on the through image. Thereby, the information retrieved from the space-time database and extracted is presented to the user.

  Alternatively, information recorded in the space-time database may be input to the CPU 101 of the digital camera 1 and the information may be searched for in the digital camera 1. For example, information corresponding to a predetermined range from the current position of the digital camera 1 is transmitted from the space-time database to the digital camera 1 and stored in the digital camera 1. From this information, information satisfying the search condition set as described above may be searched and displayed together with the through image.

  Note that the information retrieved from the space-time database is not limited to the information of the captured image acquired by the digital camera 1. For example, information on a photographed image by another camera, character information other than the photographed image, voice information, and the like may be recorded in a space-time database and retrieved. Any information that is recorded in the space-time database in association with the acquisition position and the acquisition time can be searched. That is, the CPU 101 can search by inputting various information having data regarding the position from the space-time database.

  FIG. 4 is an example of a through image displayed on the monitor 104 when the shooting mode is set. When the shutter button 11 is not pressed in the shooting mode, such a through image is displayed. On the other hand, FIG. 5 is an example of a display screen on the monitor 104 when the information search mode is set. Hereinafter, such a display screen is referred to as a browser view screen.

  In the browser view screen of FIG. 5, grid lines for providing a three-dimensional visual effect are displayed so as to overlap the through image of FIG. Thereby, a pseudo three-dimensional space (hereinafter referred to as a pseudo three-dimensional space) is expressed on the screen. Further, a space cursor 30 is displayed in a predetermined area of the pseudo three-dimensional space. In the browser view screen of FIG. 5, the space cursor 30 is represented by a frame-type frame that three-dimensionally surrounds a part of the pseudo-stereoscopic space, but other representation methods may be used. For example, the spatial cursor 30 can be expressed by changing the hue and the transparency of the image from other parts.

  The range of the pseudo three-dimensional space on the browser view screen is determined according to the above-described camera position and camera orientation. That is, the digital camera 1 uses the current camera position detected based on the GPS signal received by the GPS sensor 107 as a viewpoint, and looks at the current camera direction based on the posture of the digital camera 1 detected by the motion sensor 108. A display target range in real space is set as a vector. The display target range at this time is preferably the same size as or smaller than the above search target area so that all the information extracted from the space-time database can be displayed. The pseudo three-dimensional space corresponding to the display target range set in this way is superimposed on the through image and expressed on the screen of the monitor 104. Thus, the range of the pseudo three-dimensional space on the browser view screen is set corresponding to the display target range in the real space according to the current camera position and camera orientation. Therefore, the range of the pseudo three-dimensional space is coincident with the display range of the through image.

  When the focal length of the photographing lens is variable in the digital camera 1, it is preferable to change the display target range according to the focal length of the photographing lens. In other words, the longer the focal length of the photographic lens and the smaller the angle of view, the smaller the display range of the through image. In this case, the pseudo three-dimensional space is enlarged and displayed on the browser view screen. On the other hand, as the focal length of the photographic lens is shortened and the angle of view is increased, the display range of the through image is increased, and accordingly, the display target range is increased accordingly. In this case, the pseudo three-dimensional space is reduced and displayed on the browser view screen. In this way, even when the focal length is changed, the display range of the through image and the range of the pseudo three-dimensional space on the browser view screen can be reliably matched.

  In the case described above, it is preferable that the size of the spatial cursor 30 on the browser view screen is also determined according to the focal length of the photographing lens. That is, when the focal length of the photographic lens becomes long and the pseudo three-dimensional space is enlarged on the browser view screen, the space cursor 30 is also displayed correspondingly. On the other hand, when the focal length of the photographing lens is shortened and the pseudo three-dimensional space is reduced on the browser view screen, the space cursor 30 is also displayed in a small size accordingly. By doing in this way, the user of the digital camera 1 can recognize that the range of the pseudo three-dimensional space is changed according to the focal length on the browser view screen.

  On the browser view screen, the space cursor 30 freely moves in the pseudo three-dimensional space in accordance with the camera direction, that is, the posture change of the digital camera 1 detected by the motion sensor 108. For example, based on the posture change in the yaw direction detected by the motion sensor 108, the current azimuth angle, that is, the horizontal camera direction is obtained, and on the plane on which grid lines are drawn according to the horizontal camera direction. The space cursor 30 moves in the left-right direction. Further, the current elevation angle, that is, the vertical camera direction is obtained based on the change in the pitch direction detected by the motion sensor 108, and a space is drawn on the plane on which the grid lines are drawn according to the vertical camera direction. The cursor 30 moves in the depth direction. Accordingly, the user can intuitively operate the digital camera 1 to move the space cursor 30 as desired in the pseudo-stereoscopic space.

  Note that the space cursor 30 may be further moved in the vertical direction in the pseudo three-dimensional space. For example, the space cursor 30 is moved up and down in accordance with the vertical camera direction. At this time, the movement in the depth direction is performed according to the operation of the zoom button 13, for example. Alternatively, the space cursor 30 may be moved in accordance with the operation of the jog dial 17 or the operation of a cross key (not shown) regardless of the camera orientation. That is, the digital camera 1 may include an operation member for moving the space cursor 30 in the pseudo three-dimensional space according to a user operation.

  In the browser view screen of FIG. 5 described above, icons 31 to 34 representing photographed image information extracted from the space-time database are respectively arranged at predetermined positions in the pseudo three-dimensional space. The display position of each icon is determined corresponding to the acquisition position of the captured image information represented by each icon, that is, the acquisition position recorded in the space-time database in association with the captured image information. In other words, on the browser view screen, the captured image information extracted from the space-time database is arranged and displayed at a position in the pseudo three-dimensional space corresponding to the acquisition position in the real space. That is, each piece of information represented by the icons 31 to 34 is arranged at a position in the through image corresponding to the position data of the meta information included in each piece of information.

  A plurality of captured images are displayed on the icon 31 in an overlapping manner. These photographed images are all photographed at a place in the real space corresponding to the same icon position. That is, information of a plurality of photographed images photographed within a predetermined area corresponding to the same icon position in the real space is represented by the icon 31. As described above, when a plurality of captured images corresponding to the same icon position are searched and extracted from the space-time database as information satisfying the search condition, the plurality of captured images are the same in the pseudo three-dimensional space on the browser view screen. Display overlaid on the position.

  When the icon 31 is in the space cursor 30, that is, when a plurality of captured images displayed in an overlapping manner are in the space cursor 30, the plurality of captured images are alternately displayed. For example, the icon 31 is animated so that the photographed image displayed on the foremost side is turned over and moved to the end, so that the photographed image on the near side is switched and displayed. By doing in this way, even if a plurality of captured images are displayed in a superimposed manner on the browser view screen, the user can check the contents of each captured image.

  In this example, the icon 31 is displayed by an image in which a plurality of photographed images are overlapped to indicate that a plurality of photographed image information is retrieved and extracted from the space-time database for the same icon position. May be represented by other display methods. For example, when a plurality of pieces of photographed image information are retrieved and extracted, a balloon-shaped frame indicating the number of photographed images is displayed. Alternatively, such a balloon-shaped frame may be displayed when selected by the space cursor 30.

  On the other hand, the icons 32 to 34 are all displayed as three-dimensional icons (three-dimensional icons). In the photographed image represented by the icon 32, a human face is photographed as the main subject, and in the photographed image represented by the icon 34, a mountain is photographed as the main subject.

  The icon 33 is a rectangular parallelepiped solid icon, and a thumbnail image obtained by reducing a captured image is pasted on one surface. The image pasted on the three-dimensional surface in this way is called a texture. In the icon 33, the shooting condition in the shot image is expressed by this rectangular parallelepiped. For example, the direction of the cuboid (direction of the texture plane) represents the shooting direction, and the thickness of the cuboid (length in the thickness direction with respect to the texture plane) represents the depth of field of the shot image. The size (the size of the texture surface) represents the angle of view in the captured image.

  By displaying the icon 33 as described above on the browser view screen, the user of the digital camera 1 can intuitively and easily grasp under what shooting conditions the captured image was acquired. . The information on the shooting conditions as described above is acquired at the time of shooting together with information on the shooting position and shooting time, and as a part of the above-described meta information, the memory card 115 or the server device 3 together with the shot image information controlled by the CPU 101. Recorded in the space-time database.

  Instead of pasting the thumbnail image as a texture on the solid icon as described above, the thumbnail image may be displayed as it is on the browser view screen. In this case, the direction of the thumbnail image when displaying the thumbnail image in the pseudo-stereoscopic space is the same as the direction of the rectangular parallelepiped in the icon 33, that is, the shooting direction recorded in the space-time database by the meta information, that is, the digital camera at the time of shooting. It is determined according to the direction. In other words, based on the data regarding the orientation of the captured image as the meta information, the orientation when the captured image is displayed in the pseudo three-dimensional space by the thumbnail image is determined according to the orientation represented by the data. Therefore, the user of the digital camera 1 can intuitively and easily grasp the shooting direction when the captured image is acquired.

  On the other hand, the icon 34 representing a photographed image having a mountain as a main subject has a three-dimensional shape simulating the mountain, and a mountain portion cut out from the photographed image is pasted as a texture on the side surface portion. Yes. Similarly, an icon 32 representing a photographed image having a face as a main subject has a spherical or disk-like three-dimensional shape that simulates a human head, and a side portion thereof is cut out from the photographed image. The face part of the person is pasted as a texture.

  In this way, the digital camera 1 displays the three-dimensional icons 32 and 34 having a shape simulating the subject of the captured image extracted from the space-time database on the browser view screen. That is, the shapes of the three-dimensional icons 32 and 34 are determined according to the main subject in the captured image information extracted from the space-time database. Thereby, the user of the digital camera 1 can intuitively and easily grasp what is reflected in the captured image of the solid icon.

  Further, an image obtained by cutting out the main subject portion from the photographed image is pasted on the three-dimensional icons 32 and 34. Thereby, the user of the digital camera 1 can specifically observe how the main subject represented by the three-dimensional icon is reflected in the captured image.

  Note that the shape of the three-dimensional icon as described above is merely an example, and other shapes can be used depending on the type of subject. For example, a human-shaped three-dimensional icon can be used for an entire image of a person, and an animal-shaped three-dimensional icon can be used for an animal. Furthermore, if it is a famous building such as Tokyo Tower, a solid icon having a shape corresponding to the building may be used.

  In the above, the process of cutting out the portion of the subject from the captured image can be automatically performed by the digital camera 1 or the server device 3 using a known processing method such as a main subject recognition process or a face recognition process. Or you may make it perform by the user of the digital camera 1, the administrator of the server apparatus 3, etc. specifying the cutting-out range.

  When the user changes the tilt of the digital camera 1 while the browser view screen is displayed, the search target time is changed as described above, and different search conditions are set. Therefore, the icon displayed in the pseudo three-dimensional space also changes to a different one.

  Note that even if the search target time is not set in the search condition, the display target time is set based on the camera tilt so that the icon displayed in the pseudo-stereoscopic space is displayed in the camera as in the case where the search target time is set. You may make it change according to inclination. For example, when the current camera tilt is almost zero, that is, when the user is holding the digital camera 1 facing almost straight, out of the information extracted from the space-time database, a predetermined time range from the present, for example, one year Displays icons of information created or obtained in the previous time range on the browser view screen. When the user tilts the digital camera 1 to the right from this state, the display target time, that is, the range of the acquisition time of information to be displayed as an icon on the browser view screen, is gradually changed back to the past. On the other hand, when the user tilts the digital camera 1 to the left, the display target time is gradually changed from the past to the present.

  Alternatively, the information created or acquired within the display target time set based on the camera tilt may be different from the information created or acquired outside the display target time. For example, a captured image acquired within the display target time is displayed in a normal color, and a captured image acquired in the past than the display target time is sepia, and a captured image acquired in the future after the display target time. Are displayed in blue. In this way, the temporal characteristics of each piece of information may be expressed on the browser view screen.

  When the shutter button 11 is half-pressed, an icon located in the space cursor 30 is selected on the browser view screen at that time, and information on the selected icon is displayed in a list on the monitor 104. As a result, information arranged in the space cursor 30 is selected from the extracted information from the space-time database arranged at a predetermined position on the browser view screen. Then, a screen as shown in FIG. 6 is displayed. Hereinafter, such a display screen is referred to as a select view screen. In the select view screen, as the information represented by the icons 31 and 32 positioned in the space cursor 30 in the browser view screen of FIG. 5, the captured images 35 to 37 corresponding to the icon 31 and the captured image corresponding to the icon 32 are displayed. 38 are displayed in a list.

  On the select view screen of FIG. 6, a photographed image 35 surrounded by a frame is selected from the displayed information. The position of this frame can be changed according to the operation of the digital camera 1. For example, the position of the frame may be changed according to a change in posture such as the elevation angle, azimuth angle, and tilt of the digital camera 1. Alternatively, the position of the frame may be changed according to the operation of the jog dial 17. Note that, similarly to the browser view screen, the selection view screen may set the display target time based on the camera tilt to change the acquisition time range of the information to be displayed.

  When the shutter button 11 is fully pressed on the select view screen, the information selected at that time is enlarged and displayed on the monitor 104. The screen displayed at this time is hereinafter referred to as a one-view screen. On the other hand, when the half-press operation of the shutter button 11 is released, the browser view screen of FIG. 5 is restored.

  FIG. 7 shows an example of the one-view screen when the captured image 35 is selected. When the full pressing operation of the shutter button 11 is released, the browser view screen of FIG. 5 is restored.

  When the information search mode is set, the digital camera 1 extracts various information from the space-time database and displays it by executing the processing as described above. FIG. 8 is a flowchart showing the flow of processing at this time. This flowchart is executed by the CPU 101. Hereinafter, the flowchart of FIG. 8 will be described.

  In step S10, captured image data based on the imaging signal from the CCD 113 is received from the CCD driver 112, and a through image of the subject is acquired. In step S20, the through image acquired in step S10 is displayed on the monitor 104. Thereby, a through image as shown in FIG. 4 is displayed.

  In step S30, it is determined whether or not the information search mode is set. If the information search mode is set, the process proceeds to the next step S40. On the other hand, if the information search mode is not set and the shooting mode is set, the process returns to step S10. Thereby, a through image as shown in FIG. 4 is displayed in the photographing mode. When the user issues a shooting instruction by operating the shutter button 11, a shot image is acquired according to the shooting instruction, and the shot image information is recorded in the memory card 115.

  In step S40, the camera position is detected. Here, a GPS signal is received by the GPS sensor 107, and a camera position indicating the current position of the digital camera 1 is detected based on the GPS signal. In the next step S50, the camera posture is detected. Here, based on the posture change of the digital camera 1 detected by the motion sensor 108, a camera orientation indicating the current orientation of the digital camera 1 and a camera tilt indicating the current tilt of the digital camera 1 are detected.

  In step S60, based on the camera posture detected in step S50, the information search time range corresponding to the camera tilt at that time is set as described above. In step S70, based on the camera position detected in step S40 and the time range set in step S60, search conditions for searching information from the space-time database are set by the method described above. That is, by setting the search target area based on the camera position and camera orientation, and setting the search target time based on the information search time range set according to the tilt state of the digital camera 1 at that time, Set search conditions. At this time, only the search target area may be set and the search target time may not be set.

  In step S80, information is searched from the space-time database based on the search condition set in step S70. At this time, information may be retrieved from either the space-time database of either the memory card 115 or the server device 3, or information may be retrieved from both space-time databases. In step S90, the information retrieved in step S80 is extracted from the space-time database. Thereby, information satisfying the search condition is extracted.

  When searching the space-time database of the server device 3 in step S80, the search condition set in step S70 may be transmitted to the server device 3 as described above. Alternatively, information recorded in the space-time database may be input to the CPU 101 of the digital camera 1 and the information may be searched for in the digital camera 1. Information retrieved from the space-time database by any method is extracted in step S90.

  In step S100, an icon creation process is performed on the information extracted in step S90. In this icon creation process, icons such as icons 31 to 34 in FIG. 5 are created according to the contents of each information extracted in step S90. Note that information such as shooting conditions necessary at this time is recorded in the space-time database as meta information added to the shot image information as described above.

  In step S110, a three-dimensional process is performed. Here, the range of the pseudo three-dimensional space is determined as described above based on the camera position detected in step S40 and the camera posture detected in step S50.

  In step S120, the browser view screen is displayed on the monitor 104. Here, the grid line and the space cursor corresponding to the range of the pseudo three-dimensional space determined by the three-dimensional processing in step S110 are displayed superimposed on the through image displayed in step S20, and the icon created in step S100 is displayed. Are respectively displayed at corresponding positions in the pseudo three-dimensional space. Thereby, a browser view screen as shown in FIG. 6 is displayed.

  In step S130, it is determined whether or not the camera posture detected by the motion sensor 108 has changed. If there is a change in the camera posture, the process proceeds to step S140. In step S140, the spatial cursor 30 is moved in the browser view screen as described above according to the change in the camera posture. If step S140 is performed, it will progress to step S150. On the other hand, if there is no change in the camera posture, the process proceeds to step S150 without executing step S140.

  In step S150, it is determined whether or not the icon 31 representing a plurality of images is in the space cursor 30. If there is an icon 31 in the space cursor 30, the process proceeds to the next step S160, and the icon 31 is animated as described above. Thereby, a plurality of photographed images are alternately displayed and displayed so that the user can confirm the contents of each photographed image. If step S160 is performed, it will progress to step S170. On the other hand, if there is no icon 31 in the space cursor 30, the process proceeds to step S170 without executing step S160.

  In step S170, it is determined whether or not the shutter button 11 is half-pressed. If there is a half-press operation on the browser view screen, the process proceeds to step S180; otherwise, the process returns to step S10.

  In step S180, it is determined whether there is information in the space cursor 30 or not. If there is information in the space cursor 30, that is, if an icon representing any information is displayed in the space cursor 30 on the browser view screen, the process proceeds to step S190. On the other hand, if there is no information in the space cursor 30, the process returns to step S10.

  In step S190, a select view screen as shown in FIG. 6 is displayed for the information determined to be in the space cursor 30 in step S180. In step S200, it is determined whether or not the shutter button 11 is fully pressed on the select view screen. If there is a full press operation, the process proceeds to step S210, and if not, the process proceeds to step S220.

  In step S210, a one-view screen as shown in FIG. 7 is displayed for the photographed image selected on the select view screen when the full-press operation is performed.

  In step S220, it is determined whether or not the operation of the shutter button 11 has been released. When the operation of the shutter button 11 is released, that is, when the half-press operation or the full-press operation is released, the process returns to step S10. Accordingly, the browser view screen is displayed again by repeating the processing as described above. On the other hand, if the shutter operation is not released, the process returns to step S190 to continue displaying the select view screen. If the full-press operation is performed, the one-view screen is displayed instead of the select-view screen.

According to the embodiment described above, the following operational effects are obtained.
(1) The digital camera 1 displays a browser view screen on the monitor 104 (step S120). As a result, the pseudo three-dimensional space is represented on the screen of the monitor 104, and the monitor 104 displays the space cursor 30 indicating the predetermined area of the pseudo three-dimensional space and is arranged at a predetermined position in the pseudo three-dimensional space. Various types of information are displayed by icons 31-34. When the shutter button 11 is half-pressed, the CPU 101 selects the information arranged in the space cursor 30 among the information of the icons 31 to 34 by the processing of the CPU 101, and displays the select view screen (step). S190). Since it did in this way, any information can be selected easily, displaying various information easily.

(2) The digital camera 1 can include a jog dial 17 or a cross key used as an operation member for moving the space cursor 30 in the pseudo three-dimensional space according to a user operation. Alternatively, the orientation of the digital camera 1 is detected based on the posture of the digital camera 1 detected by the motion sensor 108 (step S50). The space cursor 30 can move in the pseudo three-dimensional space according to this direction. Since it did in this way, the user can operate the digital camera 1 intuitively, and can move the space cursor 30 in the pseudo | stereoscopic space as desired.

(3) The size of the space cursor 30 on the browser view screen is preferably determined according to the focal length of the taking lens. Thereby, the user of the digital camera 1 can recognize that the range of the pseudo three-dimensional space is changed according to the focal length on the browser view screen.

(4) On the browser view screen, the arrangement of the icons 31 to 34 in the pseudo three-dimensional space is determined based on the acquisition position of each information represented by the icons 31 to 34. Since it did in this way, the digital camera 1 can present the information extracted from the space-time database to the user together with the acquisition position in an easy-to-understand manner.

(5) The digital camera 1 displays images such as icons 31 to 34 in the pseudo three-dimensional space as information to be displayed on the monitor 104 on the browser view screen. Since it did in this way, the content of an image can be shown to a user in an easy-to-understand manner.

(6) Under the control of the CPU 101, the digital camera 1 records data relating to the orientation of the digital camera 1 when the captured image is acquired, together with the captured image information, in the memory card 115 or the space-time database of the server device 3. The orientation of the image when the captured image is displayed in the pseudo three-dimensional space on the browser view screen is determined in accordance with the orientation of the digital camera 1 at the time of photographing represented by the data recorded in the space-time database. Therefore, the user of the digital camera 1 can intuitively and easily grasp the shooting direction when the captured image is acquired.

(7) The digital camera 1 displays the icon 31 on the monitor 104 to display a plurality of images superimposed on the same position in the pseudo three-dimensional space. If the icon 31 is in the space cursor 30, the icon 31 is displayed as an animation on the monitor 104 (step S160), and the plurality of images are alternately switched and displayed. Since it did in this way, the user can confirm the contents of each image, even if a plurality of images are displayed in a superimposed manner on the browser view screen.

(8) On the monitor 104, the digital camera 1 displays the three-dimensional icons 32-34 on which the captured images are pasted in the pseudo three-dimensional space. At this time, the shape of the three-dimensional icon 33 is determined based on the shooting condition when the captured image is acquired. Since it did in this way, the user can grasp | ascertain intuitively and easily what kind of imaging conditions the picked-up image was acquired.

(9) The shapes of the three-dimensional icons 32 and 34 are determined in accordance with the main subject in the captured image. That is, the shape of the three-dimensional icon 32 is determined according to the shape of the face of the person who is the main subject, and the shape of the three-dimensional icon 34 is determined according to the shape of the mountain which is the main subject. Since it did in this way, the user can grasp | ascertain intuitively and easily what is reflected in the picked-up image of the solid icon.

(10) An image obtained by cutting out the main subject is pasted on the three-dimensional icons 32 and 34. Since it did in this way, the user can observe specifically how the main subject represented with the solid icon is reflected in the picked-up image.

  In the above embodiment, the digital camera 1 which is an electronic camera has been described as an example. However, the present invention can also be applied to other devices. For example, the present invention can be applied to a portable electronic device such as a mobile phone with a camera. Alternatively, the present invention may be applied when searching and displaying various types of information such as image information recorded in a space-time database in advance in digital binoculars or field scopes that do not perform shooting. In other words, a space cursor indicating a predetermined area of the pseudo three-dimensional space represented on the screen, a display unit for displaying information arranged at a predetermined position in the pseudo three-dimensional space, and information arranged in the space cursor are selected. The present invention can also be applied to a display device including a selection unit that performs the above operation.

  The embodiment and various modifications described above are merely examples. Therefore, the present invention is not limited to these contents as long as the characteristics of the present invention are not impaired.

It is a block diagram of the camera system by one embodiment of this invention. It is a figure which shows the external appearance of the digital camera by one embodiment of this invention. 1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a figure which shows the example of the through image displayed when imaging | photography mode is set. It is a figure which shows the example of the browser view screen displayed when information search mode is set. It is a figure which shows the example of a select view screen. It is a figure which shows the example of a one view screen. It is a figure which shows the flowchart which shows the flow of a process when extracting and displaying various information from a space-time database.

Explanation of symbols

1: Digital camera 2: Access point 3: Server device

Claims (16)

In a pseudo three-dimensional space represented on the screen based on the shooting position recorded in association with the captured image from an external recording device in which a plurality of captured images recorded in association with the shooting position are recorded An extraction unit for extracting a captured image included in
A spatial cursor indicating a predetermined region of the pseudo 3D space, and a display unit for displaying a stereoscopic icon corresponding to the photographic image extracted by the extraction unit,
A selection unit for selecting the solid icon arranged in the space cursor ,
Wherein the display unit, at a position corresponding to the photographing position in the pseudo 3D space, you to view the stereoscopic icon by changing the shape of the three-dimensional icon in response to the main subject included in the captured image A display device. The display device according to claim 1,
The display unit displays the three-dimensional icon by using an image partially cut out from the photographed image so as to include the main subject as a texture.
A display device. The display device according to claim 2,
The display unit displays the solid icon by changing the size of the texture surface according to the angle of view of the captured image.
A display device. The display device according to claim 2 or 3,
The display unit displays the three-dimensional icon by changing a length in a thickness direction orthogonal to the texture plane according to a depth of field of the captured image.
A display device. In the display device according to any one of claims 1 to 4,
In the external recording device, a plurality of photographed images recorded in association with the photographing position and the photographing direction are recorded,
The display unit displays the three-dimensional icon in an orientation corresponding to the shooting direction in the pseudo three-dimensional space.
A display device. The display device according to any one of claims 1 to 5,
An operation unit operated by a user to move the space cursor in the pseudo three-dimensional space is further provided.
A display device. The display device according to any one of claims 1 to 5,
A detection unit for detecting the orientation of the display device;
The apparatus further comprises moving means for moving the space cursor in the pseudo-stereoscopic space in accordance with the orientation of the display device detected by the detection unit.
A display device. The display device according to any one of claims 1 to 7,
A mounting portion for mounting the recording device;
The external recording device is a recording device mounted on the mounting unit.
A display device. The display device according to any one of claims 1 to 8,
The external recording device is a server device connected via a wireless communication unit
A display device. A display device according to any one of claims 1 to 9 is provided.
An electronic camera characterized by The electronic camera according to claim 10.
A captured image acquisition unit that captures a captured image by capturing a subject;
A shooting position acquisition unit for acquiring a shooting position when shooting a subject;
A shooting direction acquisition unit for acquiring a shooting direction when shooting a subject;
Recording control for associating and recording the captured image acquired by the captured image acquisition unit, the imaging position acquired by the imaging position acquisition unit, and the imaging direction acquired by the imaging direction acquisition unit in the external recording device Further comprising a section
An electronic camera characterized by The electronic camera according to claim 10 or 11,
The display unit displays the space cursor by changing a size of the space cursor according to a set focal length of the photographing lens.
An electronic camera characterized by From an external recording device in which a plurality of photographed images recorded in association with the photographing position and the photographing direction are recorded, a pseudo image displayed on the screen based on the photographing position recorded in association with the photographed image. An extraction unit for extracting a captured image included in the three-dimensional space;
A display unit that displays a space cursor indicating a predetermined region of the pseudo-stereoscopic space and a stereoscopic icon corresponding to the captured image extracted by the extraction unit;
A selection unit for selecting the solid icon arranged in the space cursor,
The display unit displays the three-dimensional icon in a direction corresponding to the photographing direction at a position corresponding to the photographing position in the pseudo three-dimensional space.
A display device. A display device according to claim 13;
A captured image acquisition unit that captures a captured image by capturing a subject;
A shooting position acquisition unit for acquiring a shooting position when shooting a subject;
A shooting direction acquisition unit for acquiring a shooting direction when shooting a subject;
Recording control for associating and recording the captured image acquired by the captured image acquisition unit, the imaging position acquired by the imaging position acquisition unit, and the imaging direction acquired by the imaging direction acquisition unit in the external recording device Further comprising a section
An electronic camera characterized by In a pseudo three-dimensional space represented on the screen based on the shooting position recorded in association with the captured image from an external recording device in which a plurality of captured images recorded in association with the shooting position are recorded An extraction step of extracting a captured image included in
A display step of displaying a space cursor indicating a predetermined area of the pseudo-stereoscopic space and a stereoscopic icon corresponding to the captured image extracted by the extraction step;
A control program for causing a computer to execute a selection step of selecting the solid icon arranged in the space cursor,
The display step displays the stereoscopic icon by changing the shape of the stereoscopic icon according to the main subject included in the captured image at a position corresponding to the shooting position in the pseudo-stereoscopic space. . From an external recording device in which a plurality of photographed images recorded in association with the photographing position and the photographing direction are recorded, a pseudo image displayed on the screen based on the photographing position recorded in association with the photographed image. An extraction step of extracting a captured image included in the three-dimensional space;
A display step of displaying a space cursor indicating a predetermined area of the pseudo-stereoscopic space and a stereoscopic icon corresponding to the captured image extracted by the extraction step;
A control program for causing a computer to execute a selection step of selecting the solid icon arranged in the space cursor,
The display step is a control program for displaying the three-dimensional icon in a direction corresponding to the photographing direction at a position corresponding to the photographing position in the pseudo three-dimensional space.

Images