JP2007266902A - Camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera capable of retrieving pictures efficiently by a simple operation from simple information added at photographing. <P>SOLUTION: A photographing position detector 13 detects the position where an imaging device 28 takes a picture, and a clock 14 detects time information at photographing. Based on the outputs of the photographing position detector 13 and the clock 14, an MPU (Main CPU) 11 changes the sorting method at sorting and showing pictures on a display 21 according to the time information, the photographing position information and the number of taken pictures. The display 21 shows information of thus sorted pictures. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a camera for searching for a desired image from images taken by a camera taken many times.

  In recent years, the spread of small digital cameras and cameras have been installed in mobile phones and portable music players. In addition, the number of images taken by one person on a daily basis has increased, and even if you try to view the images captured by the camera later, it often takes time to find them and often gives up. . In addition, Internet site management companies and the like have recently emphasized technology for searching for images and music.

  Conventionally, a technique for attaching a sensitive keyword to an image (for example, see Patent Document 1 below), a technique for adding semantic information (for example, see Patent Document 2 below), a technique for searching by text (for example, , See Patent Document 3 below). In addition, a technique for associating a shooting point with an image has been proposed (see, for example, Patent Document 4 below).

On the other hand, as shown in Patent Document 5 below, a technique for displaying a past image in a small size is also known.
JP 2004-5334 A JP 2004-102792 A JP-A-8-83287 JP-A-2005-39702 JP 2003-134470 A

  However, the above-described prior arts of Patent Documents 1 to 4 are often associated with various text information associated with an image, require a huge database like dictionary information, and input a sentence. I was overloaded. Therefore, there has been a demand for a camera that can perform an efficient image search by a simple operation that does not put a load on the user.

  Moreover, although the said patent document 5 describes the technique which displays a past image small, these do not have a meaning in a two-dimensional direction, and there is no difference with the conventional calendar type thing. Met.

  Therefore, the present invention has been made in view of the above problems, and its purpose is to classify and display images so as to perform efficient image search by simple operation from simple information added at the time of shooting. It is to provide a camera that can.

  That is, the invention described in claim 1 is a photographing means for obtaining image data by photographing, a position detecting means for detecting photographing position information indicating a place at the time of photographing, a time detecting means for detecting time information at the time of photographing, Storage means for storing the image data, shooting position information, and time information, and classification display means for changing and displaying the image data classification method according to the shooting position information, time information, and the number of image data shot by the shooting means It is characterized by comprising.

  According to a second aspect of the present invention, in the first aspect of the present invention, the classification display means is configured such that the photographing time is close at a predetermined interval, and positional information indicating a photographing place is provided. A plurality of image data having a predetermined distance relationship are grouped together and displayed as a graphic having a size according to the number of image data.

  According to a third aspect of the present invention, in the first aspect of the invention, the classification display means represents a shooting time in a direction visually recognized as a depth of the screen, and a time in a direction other than the depth direction. The number of images taken at the time of shooting is displayed according to the size of the figure distributed in the depth direction.

  According to a fourth aspect of the present invention, in the first aspect of the invention, the classification method may be configured such that when the captured image data is not separated from the previous photographing by the time and position, the previous image data is obtained. It is characterized in that it is classified into the same folder, and even if the time and position are separated, the single image data is classified into the same folder as the previous image data.

  According to a fifth aspect of the present invention, in the first aspect of the present invention, the classification display means represents the date and time at the time of photographing in a direction visually recognized as the depth of the screen, and in a direction orthogonal to the depth direction. It represents a shooting point, and the number of images in the image folder is displayed in a graphic showing the folder.

  According to a sixth aspect of the present invention, in the first aspect of the invention, the classification display means displays a photograph stored based on time and direction with a specific position as a reference position and a display size. It is characterized by being displayed with its position changed.

  According to a seventh aspect of the present invention, in the first aspect of the invention, the classification display unit displays a position that is the center of the position information of the stored photograph as a reference position.

  The invention according to claim 8 is the invention according to claim 1, wherein the classification display means provides a plurality of display areas in accordance with the classification, and further approaches the old one of each classification to the same reference point. It is characterized by displaying as follows.

  According to a ninth aspect of the present invention, there is provided a photographing means for photographing a subject, a position detecting means for detecting a photographing position at which photographing is performed by the photographing means, a time detecting means for detecting time information at the time of photographing, and the position Based on the output of the detection means and the time detection means, classification means for classifying the information of the photograph according to the information on the photographing position, the time information, and the number of the photographed photographs, and the information on the photograph classified by the classification means Display means for displaying.

  According to a tenth aspect of the present invention, in the invention according to the ninth aspect, the classifying means has a relationship in which the photographing time is close at a predetermined interval and the photographing location is a predetermined distance. A plurality of photographs in the above are collected and classified by a figure having a size according to the number of photographs.

  The invention according to claim 11 further comprises storage means for storing the photograph taken by the photographing means based on time and direction according to the invention according to claim 9, wherein the classification means is specified. The information of the photograph stored in the storage means is displayed with the display size and the display position being changed, with the position of the reference as the reference position.

  According to a twelfth aspect of the present invention, in the invention according to the eleventh aspect, the classification means uses a position that is the center of position information of a stored photograph as a reference position.

  The invention according to claim 13 is the invention according to claim 9, wherein the display means is provided with a plurality of display areas in accordance with the classification by the classification means, and further, the oldest ones in each classification are based on the same standard. It displays so that it may approach a point.

  The invention described in claim 14 further comprises storage means for storing an image photographed by the photographing means in the invention according to claim 9, wherein the display means is preserved by the preservation means. For the image, the depth of the screen and the viewing direction indicate the time of shooting, the direction other than the depth direction indicates at least the shooting position other than the time, and the image is shot according to the size of the figure distributed in the depth direction. The information at the time of taking a picture is displayed.

  A fifteenth aspect of the present invention is the information processing apparatus according to the ninth aspect of the present invention, further comprising storage means for storing the images photographed by the photographing means for each folder, wherein the display means is the storage means. For the stored image, the date and time of shooting is shown in the direction of visual recognition and the depth of the image, the shooting point is shown in the direction orthogonal to the depth direction, and the image information in the folder is stored in the figure indicating the folder. It is characterized by displaying.

  According to the present invention, image data captured using information at the time of shooting is classified so that the user can perform an image search with an easy-to-understand display and simple operation. A suitable image can be selected.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a basic configuration of a camera according to an embodiment of the present invention. The camera includes a main CPU (hereinafter referred to as MPU) 11, a plurality of switches 11a, 11b, and 11c, a signal processing unit 12, a photographing position detection unit 13, a clock unit 14, a flash ROM 15, and an analog front. An end unit (AFE) 18, a RAM 19, a memory 20, a display unit 21, a microphone 22, a speaker 23, a print signal output unit 25, a wireless communication unit 26, an image sensor 28 and a photographing lens 29. It is configured.

  In FIG. 1, an MPU 11 having functions of a control means and a classification means is composed of a microcontroller or the like, and detects various operations by a user based on the states of switches 11a, 11b, and 11c. Further, the MPU 11 sequentially controls each block to be described later according to the detection results of the switches 11a, 11b, and 11c and the program stored in the flash ROM 15, and executes a shooting and playback sequence. The switches 11a to 11c have a function as a selection unit such as a power switch (11a) for turning on / off the power, a release switch (11b), and shooting / playback and other switches (11c) described later. The user's operation is input.

  Connected to the MPU 11 are a signal processing unit 12, a photographing position detection unit 13, a clock unit 14, and a flash ROM 15 that are compression means. The signal processing unit 12 performs processing such as color correction and signal compression. Further, the signal processing unit 12 includes an auxiliary block 12a for changing a correction method during image processing or adding a specific signal.

  The photographing position detecting unit 13 is position detecting means that detects and records a photographing position by a global positioning system (GPS) using a satellite (not shown). The clock unit 14 serving as a time detection unit is used for recording the shooting date and time and for measuring the exposure time and measuring a predetermined timing interval. Further, the flash ROM 15 stores various programs executed by the MPU 11 of the camera and various adjustment values related to the camera.

  The signal processing unit 12 includes an analog front end unit 18, a RAM 19, a memory 20, a display unit 21, a microphone 22 that is an audio input unit, a speaker 23, a print signal output unit 25, a wireless A communication unit 26 is connected. The analog front end unit 18 is connected to an image sensor 28 that is a photographing unit that forms an image of the subject 30 incident from the photographing lens 29 during photographing. The image sensor 28 is composed of a CCD, a CMOS sensor, or the like, and photoelectrically converts the subject image into an image signal.

  The analog front end unit 18 reads the converted image signal and performs A / D conversion. The digital image signal converted by the analog front end unit 18 is input to the signal processing unit 12. The signal processing unit 12 performs various image processes to generate image data. The image data is recorded in a removable memory 20 as a recording means. Here, the image data recorded in the memory 20 is compressed and recorded to an appropriate data amount according to the setting of the camera. At this time, data is appropriately stored in the RAM 19 in order to perform various calculations. In the present invention, the moving image is also first stored here.

  The display unit (display unit) 21 that constitutes the classification display unit together with the MPU is configured by an LCD or the like. The composition is determined by confirming the state of the subject 30 by sequentially reproducing and displaying signals from the image sensor 28 on the display unit 21. Reproduction display is performed by reading the compressed image data in the memory 20 into the signal processing unit 12, converting it into display data, and displaying it on the display unit 21 in accordance with the user's operation of the switch 11 c. Similarly, for audio reproduction, the compressed audio data in the memory 20 is read out to the signal processing unit 12 and converted into audio data according to the operation of the switch 11c, and is output from the speaker 23.

  The captured image or the like can be transmitted to an external device (not shown) via the print signal output unit 25 and the wireless communication unit 26.

  In such a configuration, when the user operates the switches 11a to 11c, the state is detected by the MPU 11, and each block is sequentially controlled in accordance with the program stored in the flash ROM 15, and the sequence of shooting and reproduction is performed. Is executed.

  At the time of shooting, an image of the subject 25 incident from the shooting lens 23 is captured by the image sensor 22 and converted into an electrical signal, and a digital image signal is input to the signal processing unit 12 via the analog front end unit 18. The signal processing unit 12 performs processing such as color correction and image compression. As a result, the compressed image data, date / time data, and position data are recorded in the memory 20 and the photographing is finished.

  FIG. 2 shows the result of taking a picture using the camera having such a configuration, with the horizontal axis representing the date and time and the vertical axis representing the photographed position. In this example, an example in which a child or familiar object is photographed near a holiday home, an example photographed at a company, or a photograph taken when traveling or a day trip is displayed. In FIG. 2, the number of shots is indicated by the size of a white circle.

  When these graphs shown in FIG. 2 are represented by simple date management, they are as shown in FIG. In the calendar display of FIG. 3, the number of shots is represented by the size of white circles.

  However, in the example of FIG. 3, there is a possibility that a problem may occur that it is not known which photograph is taken when traveling. Also, if there is a school event or a party on Sunday, for example, when you want to see a photo when you went on a trip later than the shooting date, the day when you took many photos Even if you think it is, there are actually differences.

  In this way, it is impossible to manage photos by time alone. On the other hand, when position information is added as in the graph of FIG. 2, it can be seen that the number of white circles is increased compared to the graph of FIG. 3, and there is a problem that the classification is too fine. In other words, it can be understood that, in the formats shown in FIGS. 2 and 3, the search becomes difficult unless the classification is made a little more roughly.

  Further, when the folder is displayed so that a plurality of images are included, the graph of FIG. 2 is represented as shown in FIG. In this case, the folder preferably includes a plurality of images, but it is not preferable that the number of images in the folder is too large. This is because even if a folder can be searched, subsequent image search becomes difficult.

  Therefore, in the present invention, a folder including an appropriate number of images is first made visible to the user so that the search can be facilitated, and then the images in the folder are searched by user operation.

  That is, first, as shown in FIG. 5A, for example, the user visually observes a graph as shown in FIG. 4 displayed on the liquid crystal display 31 as the display unit 21 provided on the back surface of the camera 35. ing. Next, in this state, the touch sensor 32 constituting the display unit 21 is operated by the user's finger 36, or a cross key switch provided on the back side of the camera 35 as shown in FIG. 33 is operated to select a desired folder. In this case, it is assumed that a folder indicated by diagonal lines is selected. Then, as shown in FIG. 5C, an image in the folder displayed on the liquid crystal display 31 is searched.

  Considering the space that can be displayed on the back of the camera, it is closer to the user's intuition and easier to use than the detailed display such as the graph shown in FIG. Can do. In addition, as shown in FIG. 6, the screen is made to feel the depth, the past memory is displayed at the back, and the image when going to a distant place is at the top. Then, the display is easy to understand even for users who are not familiar with graphs and the like.

  Next, the operation of the camera capable of such classification display will be described with reference to the flowcharts of FIGS. The operation of this camera is mainly performed by controlling the MPU 11 in the camera.

  When this routine is started, first, in step S1, it is determined whether the photographing mode or the reproduction mode. This mode selection is performed by a user operation. Here, when the reproduction mode is selected, the process proceeds to step S28 described later. On the other hand, when a mode other than the playback mode is selected, the state of the release switch 11a is determined in step S2 so that shooting is started. If shooting is not started, the process proceeds to step S1. If shooting is started, the shooting sequence after step S3 is executed.

  That is, in steps S3 and S4, focusing and exposure control are performed according to the conditions of the subject 30. Next, in step S <b> 5, the image signal is taken from the image sensor 28 into the signal processing unit 12. In step S6, features that can easily classify the features (color, brightness, subject shape, distance, etc.) of the image are extracted. For this feature extraction, for example, human detection that has been developed recently may be used.

  Next, in step S7, the image is compressed. In steps S8 and S9, the shooting position, date and time, and time are detected. In step S <b> 10, the detected position and time are recorded in the memory 20.

  Steps S11 and thereafter are flowcharts for collecting several image files for each photographing and collecting them in an image folder.

  That is, in step S11, the position information and the date / time information of the captured image captured this time and the previously captured image are compared. Next, in step S12, a positional difference between the home image and the image just taken is detected.

  By the way, the camera of the present embodiment has a function of prompting photographing at home after purchase of the camera, and GPS information and date / time information at that time are recorded in the memory 20. In the processing after step S13, a folder in which a photographed image already exists is obtained from the difference between the GPS (position) information and date / time information in steps S11 and S12 using the result of the previous photographing or the photographing at home. It is decided whether to put it in the new folder.

  That is, in step S13, it is determined whether or not the date of shooting is the same as the previous shooting. As a result, if it is the same day, it will transfer to step S23 mentioned later, and if it is another day, it will transfer to step S14.

  If it is determined in step S13 that it is another day, it is then determined in step S14 whether or not the previous shooting point and the current shooting point are separated by 20 km or more. Here, if it is not 20 km away, the process proceeds to step S21, and it is determined whether the number of images in the folder is large. This is to be managed in the same folder. However, as described above, if there are too many images in the same folder, the search becomes difficult, so if there are too many images in step S21. The process proceeds to step S15 to be described later. Otherwise, the process proceeds to step S22, and after the previous captured image is recorded in the same folder (old folder) as classified, the process proceeds to step S20.

  On the other hand, if it is determined in step S14 that the distance is 20 km or more, the process proceeds to steps S15 and S16 so that a new folder is created and the image taken this time is recorded there. ing. As a result, the old folder does not contain any more images, and future images are recorded in the new folder.

  However, if it is determined in step S17 that the old folder that no longer contains images contains only one image, the process proceeds to step S18, and the images in the old folder are Furthermore, it is recorded so as to be included in the previous folder (old folder). This is to prevent troubles in searching when a folder includes only one image although it is called a folder. Therefore, in order to reduce the number of folders as much as possible, in the subsequent step S19, the folder in which no image exists is deleted. Note that if the image in the old folder is not one in step S17, steps S18 and S19 are skipped.

  On the other hand, if the old folder is not only one image in step S21, the process proceeds to step S22, and the image is recorded in the old folder as it is.

  Here, the image is put in the old folder created before the old folder, but the contents of the old folder may be put in the new folder to reduce the number of folders.

  Thus, a folder that no longer contains an image is determined in step S20 according to the date and time of each image contained therein, the center value of longitude and latitude according to GPS information, and the characteristics of the image obtained in step S6. A signal that can be classified is added. Using this, when searching in the playback mode, the liquid crystal display 31 can be easily illustrated on the screen.

  If it is determined in step S13 that the images are on the same day, it is next determined in step S23 whether the number of images in the folder is large. This is because images taken on the same day want to be managed in the same folder as much as possible. However, as described above, if too many images are included in the same folder, the search becomes difficult. If there are too many images, steps S24 to S27 described later can be recorded in another folder.

  That is, if it is determined in step S23 that the number of images is not large, the process proceeds to step S22 and is recorded in the old folder. If it is determined in step S23 that the number of images in the old folder is large, it is determined in subsequent step S24 whether the current shooting position is far away, for example, 20 km or more away from home in this case. Is determined. As a result, if the distance is 20 km or more, the process proceeds to step S25, and if not, the process proceeds to step S26.

  In step S25, it is determined whether or not the current shooting position is 10 km or more away from the previous shooting position. If the distance is 10 km or more, the process proceeds to step S27. If not, the process proceeds to step S22, and the image is recorded in the old folder.

  In step S26, it is determined whether or not the current shooting position is within 500 m from the previous shooting position. Here, when it is within 500 m, it transfers to step S27, and when that is not right, it transfers to said step S15. In step S27, it is determined whether or not two hours have passed since the previous shooting. If 2 hours have elapsed, the process proceeds to step S15. If not, the process proceeds to step S22.

  As described above, in steps S24 to S27, if the shooting position is not separated and the time has not elapsed, the previous shot image is recorded in the same folder as that in step S22. However, if the condition is not satisfied, the number of images in the folder is too large to be searched (for example, it cannot be displayed on the screen of the display unit 31 in FIG. 5C). Create a new folder and record it there.

  What is characteristic of the processing in steps S24 to S27 is that if the distance from the home is 20 km or less and not so far, the position is compared with the previous shooting at 500 m (step S26), and the distance from the home is 20 km or more. The point is determined to be substantially the same position within a difference of 10 km (step S25). This corresponds to the fact that it is easy to recognize another place even if it is near the house if it is near the house, while if it is 20 km or more away from the house, for example, it is moving around violently on the road, This is because it is determined that the positions are almost the same if the difference is within 10 km.

  If it is determined in step S1 that the playback mode is set, the process enters the playback mode in step S28. As a result, the photographed image can be viewed on the liquid crystal display 31 provided on the back surface of the camera 35. First, in step S28, it is determined whether or not there is GPS information near the user's home. Here, if GPS information around the user's home is recorded in the memory 20, the process proceeds to step S32. If not recorded, the process proceeds to step S29.

  In step S29, a warning display as shown in FIG. 9A is performed. Next, in step S30, it is determined whether or not a release operation has been performed. That is, if the user who viewed the warning display displayed in step S29 performs a release operation, the process proceeds to step S31, and the date and time and GPS information at that time are recorded in the memory 20 of the camera. As a result, it can be used as data at the time of comparison in steps S11 and S12.

  In addition, since GPS information may not always be input correctly at the time of shooting, the position is detected at predetermined intervals in steps S32 and S33. Thereby, when GPS information is not acquired at the time of imaging | photography, a problem can be avoided by substituting this value.

  In step S34, it is determined whether or not the search mode is set. If the user has not set the search mode, the process proceeds to step S35. If the user has set the search mode, the process proceeds to step S42 described later.

  In step S35, the images are displayed on the liquid crystal display 31 so that the images can be viewed one by one. That is, the latest photographing result is displayed here. Then, in step S36, it is determined whether or not image switching has been performed by the user. Here, when an image switching operation is performed, the process proceeds to step S37, where another image is reproduced and displayed. On the other hand, when the image switching operation is not performed, the process proceeds to step S38.

Next, in step S38, the presence / absence of GPS information near the home is determined. If the GPS information is present, the process proceeds to step S41. If not, the process proceeds to step S39. In step S39, it is determined whether or not the reproduced image is near the home. For example, as shown in FIG. 9 (b), it displays the playback image 31 ₁ asks whether or not in the vicinity of home, is made on the liquid crystal display 31. At this time, if an image near the home is displayed, the user performs an input operation using the operation button 31 a displayed as “Yes” on the screen. In this case, the process proceeds to step S40, and GPS information (position information) included in the image is recorded in the memory 20 as information near the home. On the other hand, if the displayed reproduced image is not near the home in step S39, an input operation using the operation button 31b displayed as “No” on the screen is performed, and the process proceeds to step S41.

  In step S41, it is determined whether or not the reproduction of the image has ended. Here, if not finished yet, the process proceeds to step S36, and if finished, this sequence is finished.

  If it is determined in step S34 that the search mode is set, it is determined in step S42 whether a graph display is required.

  If graph display is required, the process proceeds to step S43, and the folder created in step S20 is displayed on the liquid crystal display 31. This graph is displayed, for example, with time on the horizontal axis and distance from the home on the vertical axis as shown in FIGS. 4 and 5A and 5B described above. At this time, if a folder with a large number of photographed images is large and a folder with a small number is displayed small, it becomes easier to search.

  Further, if the color or shape is changed according to the characteristics of the built-in image, the user can more easily search for the image.

  For example, a person having many images such as a wedding may be shaped like a person, or a person having many scenery such as a trip may be blue.

  In step S42, when the user selects a display other than the graph display, the process proceeds to step S44, and for example, the display as shown in FIG. 6 is performed. This is a visual display in which the past memory goes back.

  That is, in step S44, the folders 41, 42, and 43 of the images being traveled out of the past folders are displayed small on the upper side of the screen, and in the subsequent step S45, the images near the home in the past folders are displayed. Folders appear small at the bottom of the screen. Further, in step S46, the image folder 44 that is traveling among the recent folders is displayed larger in the upper part of the screen, and in the subsequent step S47, the image folder 45 near the home is enlarged. Displayed at the bottom of the screen. In step S48, folders that do not correspond to steps S44 to S47 are displayed in the middle of these.

  To put these together, past folders are displayed small, if they are closer than home, they are displayed below, and those far away are displayed above. Also, recent captured images are displayed in a large size, and those photographed in the neighborhood are displayed in the lower part, and those photographed in the distant place are displayed in the upper part. Further, other folders are displayed in the middle. If it does in this way, it will become a display as shown in FIG. 6, and the past folders (41-43) will seem to be far away, and the recent folders (44, 45) will be near by the effect like perspective. Looks like there is.

  Thereafter, in step S49, each folder is set so as to have characteristics according to the contents.

  As a result, the user can search for images in such a manner that the memory can be traced back to the past.

  In the folder search screen shown in FIG. 6, the characters “past” and “present” are displayed, but this notation is not necessary.

  Further, when the user searches for past images by operating the cross key or the like, the past folders may be displayed so as to come closer to the front.

  Hereinafter, another display example (modification) for folder search will be described.

(First modification)
FIG. 10 shows a display example when searching for a captured image according to the first modification.

  In this first modification, the past folder is displayed in a small area near the center so that it can be seen far away in perspective, and the new folder is displayed in the foreground, and the same display and display as in FIG. I try to have a search effect. In this first modification, the home position is not required, the positional relationship of each folder is obtained according to the coordinates (longitude and latitude obtained from GPS information) of all folders, and the center is set as the origin. That is, since the center of the GPS information of all images is the origin, no origin position such as home is required, and no map information is required, and as shown in FIG. The direction is determined, and the display is made according to which direction the center (origin) is. For example, it is possible to display on the liquid crystal display whether the travel destination is the Tohoku region or the Kansai area.

  However, since the relationship between east and west becomes indeterminate outside the country, in that case, it is sufficient to match the world map notation centered on that country.

  Note that the notations “east”, “west”, “south”, and “north” in FIG. 10 are not necessarily displayed.

  FIG. 11 is a flowchart for explaining a control operation by the MPU 11 of the camera in the case of displaying as shown in FIG.

  When this routine is started, first, in step S51, as described above, the center of the position of all folders is set as the origin. Next, in step S52, coordinates for arranging each folder are determined according to the latitude and longitude. Further, in step S53, the shooting date / time information is taken into consideration, and the old folder is corrected and arranged so as to be closer to the center so that it can be seen farther in perspective.

  Here, in step S54, the user selects one of the folders 41 to 45 while viewing the screen shown in FIG. This folder selection may be a touch panel type, a cross key type, or other switches.

  When a folder is selected in step S54, the folder selected in the next step S55 is displayed in the forefront, and a newer folder is removed from the candidate images so as not to be displayed. In this way, when the process proceeds to step S51, it is possible to display information that can be traced back to the past.

  If no folder is selected in step S54, the process proceeds to step S56 to determine whether or not to end the folder selection. If the selection is still continued, the process proceeds to step S54, and if completed, the process proceeds to step S57. In step S57, the display is switched to the image display as shown in FIG.

  In this way, since the folders arranged on the screen that roughly represent the time and space are selected and individual images are accessed, the user can recall the past memories while following the memories. Can be searched quickly. Further, the background screen does not have to be a still image, and may be a moving image display that flows to the near side so as to represent the flow of time.

(Second modification)
FIG. 12 is a diagram showing an example in which folders representing a person and a trip are arranged and displayed according to the characteristics of images in the folder as a second modification.

  FIG. 12A is a diagram showing an example in which a large person folder 51 exists in the center of the screen. If you want to select data before this, for example, if you select the folder 52 that shows the upper right travel photo, as shown in FIG. 12B, the central person folder 51 disappears so that the previous image can be seen. And past folders can be seen in the depth direction. In addition, a folder 52 a indicating a travel photograph corresponding to the folder 52 is highlighted.

  In FIGS. 12A and 12B, the numbers shown in the folders represent the shooting date and time in this case.

  In addition, a switch that goes back in time may be provided in the camera so that the object behind can be seen.

  In this way, each folder is classified and displayed on the time axis and the space axis, so that the user can search past images in the form of tracing the memory, and the relative position where the image was taken in the screen. It can be judged from the state of arrangement of the top, bottom, left and right.

  In addition, as shown by the arrow A in FIG. 12B, a moving image may be displayed to show the flow of time. You can also know the contents by designing the icons on the screen. At that time, the date of the folder may also be indicated.

  Furthermore, in order to effectively use the perspective method, the size of the circle representing the folder is used to represent the perspective, so this display form shows that almost every folder contains the same number of images. Assumed. However, as shown in FIG. 13A, the size of the icons 61 to 64 in the circle representing the folder may be changed according to the number of images in the image.

  Further, as shown in FIG. 13B, a circle may be displayed in a colored manner, and a folder with a small number of images may be displayed with the color portion reduced. For example, the folder 67 is almost full of images, and the folders 68 and 69 indicate that the folder has room.

  Furthermore, in this second modification, the perspective is expressed by the size relationship of the icons, but the depth direction is actually expressed by the recently developed 3D display technology, and the icons are displayed therein. Also good.

(Third Modification)
In addition, when the display technique using the time perspective according to the present invention is used, an area representing a season is provided in a two-dimensional direction (perpendicular to the paper surface), and as shown in FIG. Images can be classified for each region (GPS information) and time information), and past and recent photos can be classified and displayed for easy retrieval.

(Fourth modification)
Furthermore, as shown in FIG. 15, it is also possible to provide an area indicating the classification of photographs in a two-dimensional direction and perform display classified by time for each event. This example is performed based on classification information classified by the user without using GPS information.

(Fifth modification)
In addition, as shown in FIG. 16, the photographed person is classified in a two-dimensional direction, and the method is such that images are overlapped or displayed smaller toward the center as in perspective. It is also possible to make the search easier. This may use personal identification technology based on human face detection.

(Sixth Modification)
Furthermore, as shown in FIG. 17, it is of course possible to classify the images according to the distance of the subject, the brightness of the subject, and the image signal, and to indicate the context of the photographing time in the depth direction.

  As described above, according to the present invention, a user can easily enjoy a photo appreciation by searching for an item he / she wants to see from an old photo at any time. Therefore, it is possible to provide a camera that can be easily classified and displayed when searching for a captured image.

  In addition, the present invention is not a technique for completing everything in the camera, and the classification display may be performed by, for example, a personal computer. At this time, an image file to which the date and time and position are attached is sent from the camera.

  Furthermore, the present invention is not limited to a camera, but can be applied as a display device or a display method. In this case, the image is sent from, for example, a camera.

  For example, it is a display device that displays an image folder in a graphic form, which represents the time of shooting in the depth direction of the screen, represents at least the shooting position other than time in a direction other than the depth direction, and is distributed in the depth direction. You may make it display the number of the images image | photographed at the time of the said imaging | photography according to the magnitude | size of a figure.

  Alternatively, the date and time of shooting may be indicated in the depth direction of the image, the shooting point may be indicated in a direction orthogonal to the depth direction, and the number of images in the image folder may be displayed in a graphic indicating the folder. Good.

  In addition, an image captured in advance in the storage unit may be stored, for example, for each folder, and the above-described display may be performed on the image stored in the storage unit.

  According to the display device having such a configuration, the user can search for the location and the number of images in a manner that allows the captured image or the stored image to be traced back to the past.

  Furthermore, as a method of classifying captured images, if the time and distance are not different from the previous shooting, the images are classified into the same folder, and even if the time and distance are separated, a single image is also classified into the same folder. You may make it do.

  If classification is performed in this way, searching for each folder becomes easy.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  Further, the above-described embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effect described in the column of the effect of the invention Can be extracted as an invention.

It is a block diagram which shows the basic composition of the camera which concerns on one Embodiment of this invention. It is the graph showing the result of having photographed using the camera of the structure of FIG. It is the figure which showed the example which applied the graph of the imaging | photography result of FIG. 2 to the calendar display. FIG. 3 is a graph represented for each folder in order to search for a photographed result in the graph of FIG. 2. It is a figure explaining the example which searches the image image | photographed using the camera which concerns on one Embodiment of this invention. It is the figure which showed the example of the display screen showing the result of the photography image | photographed with the camera by this embodiment. It is a flowchart for demonstrating operation | movement of the camera in one Embodiment of this invention. It is a flowchart for demonstrating operation | movement of the camera in one Embodiment of this invention. (A) is a diagram showing an example of a warning display screen in step S29 of the flowcharts of FIGS. 7 and 8, and (b) is a screen at the time of image determination in step S39 of the flowcharts of FIGS. It is the figure which showed the example of. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 1st modification of this invention. It is a flowchart for demonstrating the operation | movement which displays the graph at the time of the search of the picked-up image shown by FIG. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 2nd modification of this invention. It is the figure which showed the other example of a display at the time of the search of the picked-up image by the 2nd modification of this invention. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 3rd modification of this invention. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 4th modification of this invention. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 5th modification of this invention. It is the figure which showed the example of a display at the time of the search of the picked-up image by the 6th modification of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Main CPU (MPU), 11a, 11b, 11c ... Switch, 12 ... Signal processing part, 13 ... Shooting position detection part, 14 ... Clock part, 15 ... Flash ROM, 18 ... Analog front end part (AFE), 19 ... RAM, 20 ... memory, 21 ... display unit, 22 ... microphone, 23 ... speaker, 25 ... print signal output unit, 26 ... wireless communication unit, 28 ... imaging device, 29 ... photographing lens, 30 ... subject, 31 ... liquid crystal Display, 35 ... Camera.

Claims (15)

Photographing means for obtaining image data by photographing;
Position detecting means for detecting shooting position information representing a place at the time of shooting;
Time detection means for detecting time information at the time of shooting;
Storage means for storing the image data, shooting position information, and time information;
Classification display means for changing and displaying the classification method of the image data according to the photographing position information, time information and the number of image data photographed by the photographing means,
A camera comprising:   The classification display unit classifies a plurality of image data in which the time at the time of shooting is close at a predetermined interval and the position information indicating the place at the time of shooting has a predetermined distance, and the image The camera according to claim 1, wherein the camera is displayed in a figure having a size according to the number of data.   The classification display means represents the time of shooting in the direction of visual recognition and the depth of the screen, represents the shooting position other than the time in the direction other than the depth direction, and according to the size of the figure distributed in the depth direction, The camera according to claim 1, wherein the number of images taken at the time of shooting is displayed.   The above classification method classifies the captured image data into the same folder as the previous image data when the time and position are not separated from the previous image capture, and even if the time and position are separated, a single image 2. The camera according to claim 1, wherein the data is classified into the same folder as the previous image data.   The classification display means represents the date and time of shooting in the direction viewed with the depth of the screen, represents the shooting point in a direction orthogonal to the depth direction, and represents the number of images in the image folder as a figure indicating the folder. The camera according to claim 1, wherein the camera is displayed inside.   The camera according to claim 1, wherein the classification display unit displays a photograph stored based on time and direction with a specific position as a reference position, with a display size and a display position being changed.   The camera according to claim 1, wherein the classification display unit displays a position that is a center of position information of a stored photograph as a reference position.   The camera according to claim 1, wherein the classification display means displays a plurality of display areas according to the classification, and further displays the oldest time of each classification so as to approach the same reference point. Photographing means for photographing the subject;
Position detecting means for detecting a shooting position at which shooting is performed by the shooting means;
Time detection means for detecting time information at the time of shooting;
Based on the output of the position detection means and the time detection means, classification means for classifying the information of the photo according to the information on the shooting position, the time information, and the number of the taken pictures,
Display means for displaying the information of the photos classified by the classification means;
A camera comprising:   The classification means collects a plurality of photographs in which the photographing time is close at a predetermined interval and the photographing places are in a predetermined distance, and the figure has a size according to the number of photographs. The camera according to claim 9, wherein the cameras are classified as follows. And further comprising storage means for storing the photograph taken by the photographing means based on time and direction,
The camera according to claim 9, wherein the classification unit displays the information of the photograph stored in the storage unit by changing a display size and a display position with a specific position as a reference position.   The camera according to claim 11, wherein the classification unit sets a position that is a center of position information of a stored photograph as a reference position.   The camera according to claim 9, wherein the display means provides a plurality of display areas according to the classification by the classification means, and further displays an old one for each classification so as to approach the same reference point. A storage unit that stores the image captured by the imaging unit;
For the image stored in the storage unit, the display unit represents the time of shooting in the direction viewed as the depth of the screen, represents at least the shooting position other than the time in a direction other than the depth direction, and the depth direction The camera according to claim 9, wherein information at the time of photographing of the photographed image is displayed in accordance with a size of a figure distributed on the screen. The image processing apparatus further includes a storage unit that stores the images captured by the imaging unit for each folder,
For the image stored in the storage unit, the display unit represents the date and time of shooting in the direction viewed with the depth of the image, the shooting point in the direction orthogonal to the depth direction, and the images in the folder The camera according to claim 9, wherein the information is displayed in a graphic indicating the folder.

Images