JP4274190B2 - Photographing and editing method, photographing and editing apparatus, and photographing and editing system - Google Patents

Description

  The present invention relates to an image recording / reproducing apparatus and method for electronically recording an image on a storage element such as a semiconductor memory or a magnetic disk without using a film.

  Usually, a photograph is taken using a silver salt film. The photographed film is developed and further baked on photographic paper for viewing.

  On the other hand, electronic still cameras have been put into practical use in recent years. This does not use a film but electronically records an image on a storage element such as a semiconductor memory or a magnetic disk. Playback can be performed on an external TV screen, or transferred to a computer for DTP (desktop publishing).

  In recent years, the number of photographs taken by individuals has increased rapidly. Individuals can order several dozen copies per year, and hundreds of copies per family. If you are newly married, or have a child, or if you travel abroad, there are many opportunities to take photos, and it may be nearly 500 a year.

  Organizing and storing these photos can be a daunting task. For this reason, most of them are simply inserted into pocket-type albums or stored as they are. Then, if you have a photo you want to see, it is difficult to find it, and if it is stored separately, you may lose it.

  In order to organize and save photos, an album of a type in which photos are pasted on a mount is usually used. You can also divide photos by theme and add comments. However, in order to organize and save in an album, it takes considerable effort to edit and organize it. That is, the photos are classified, rearranged, and arranged on the mount in a well-balanced manner. Add comments such as date and location. If you do this every time you take a photo, it may not be a pain, but once you have unorganized photos, it becomes cumbersome to organize. The photos themselves are often not taken well. That is, there are many things that are out of focus, such as being out of focus or not exposed.

  The purpose of this study is to provide an image recording / reproducing apparatus and method that can easily organize and store photographic images and provide them for viewing for the above problems. .

  In order to solve the above problem, in an image recording / reproducing apparatus including an image photographing unit and an image storage / display unit, when photographing a photographic image, the image photographing unit is provided with means for giving supplementary information regarding the image to the photographic image . Furthermore, when displaying a photographic image, a means for displaying based on incidental information is provided in the image storage display unit. In the image photographing unit, the image information is electronically captured as data using a device such as a CCD (charge coupled device) without using a silver salt film. Incidental information can also be handled uniformly by using electronic data. The image storage / display unit has a data storage unit to store image data and the like, and has an image display unit to electronically display images in the form of an album.

  As described above, according to the present invention, it is possible to provide an image recording / reproducing apparatus that can easily organize and store photographic images, and can display photographic images for presentation. Further, it is possible to provide an image recording / reproducing apparatus that can reduce failure in taking a photographic image.

  In the first embodiment, the image photographing unit is provided with a date and time when a photographic image is taken and attached to the photographic image information as supplementary information. Further, classification display is performed in the image storage / display unit based on the supplementary information.

  In the second embodiment, the image capturing unit is provided with the orientation detection unit of the image capturing unit, and the image capturing unit is provided with the orientation of the image capturing unit at the time of capturing the photographic image as additional information to the photographic image information. Furthermore, the direction in which the image is displayed in the image storage / display unit is changed based on the incidental information.

  In the third embodiment, the image photographing unit has a photographing location input unit, and the image photographing unit is provided with means for attaching the photographing location of the photographic image as incidental information to the photographic image information. Further, classification display is performed in the image storage / display unit based on the supplementary information.

  In the fourth embodiment, the image photographing unit has a photographer input unit, and means for attaching the photographer of the photographic image to the photographic image information as incidental information is provided in the image photographing unit. Further, classification display is performed in the image storage / display unit based on the supplementary information.

  In the fifth embodiment, the image photographing unit is provided with means for photographing a secondary photographic image at a time in the vicinity of the moment when the main photographic image is photographed, and adding it to the main photographic image information as supplementary information of the main photographic image. It was. Further, the image storage / display unit selects and displays a desired image from the main photographic image information or sub-photographic image information which is auxiliary information.

In the sixth embodiment, a means for taking a secondary photographic image with a different focus at a time in the vicinity of the moment when the main photographic image was taken, and assigning it to the main photographic image information as supplementary information of the main photographic image. Provided in the shooting section. Further, the image storage / display unit selects and displays a desired image from the main photographic image information or sub-photographic image information which is auxiliary information.

  In the seventh embodiment, there is provided means for photographing a secondary photographic image with a different aperture at a time in the vicinity of the moment when the main photographic image is taken, and assigning it to the main photo 0 image information as supplementary information of the main photographic image. Provided in the image shooting section. Further, the image storage / display unit selects and displays a desired image from the main photographic image information or sub-photographic image information which is auxiliary information.

  In the eighth embodiment, means for recording audio information at a shooting location at a time in the vicinity of the moment when a photographic image is taken and providing the photographic image information as supplementary information of the photographic image is provided in the image photographing unit. . Further, when the photographic image information is displayed in the image storage / display unit, the audio information which is supplementary information is reproduced.

At the time of taking a photographic image, additional information regarding the photographic image is added to the photographic image information. This information is temporarily stored in the storage unit in the image photographing unit and then transferred to the image storage display unit. In the image storage / display unit, photographic image information and incidental information are stored once. Further, album information for performing classification display is created based on the accompanying information data. At the time of display, classification display is performed in the form of an album based on the incidental information and album information. Furthermore, when displaying, the display form is changed based on the accompanying information.
In organizing photographs, they are often classified according to themes such as athletic meet and overseas travel. However, when targeting an individual or a family, these are separable events in time series, and for example, an athletic meet and an overseas trip are not performed simultaneously on the same date and time. Therefore, if it is classified by the date when the photo was taken or by the lump of time, it is classified by theme. In the first embodiment, the date and time are recorded as supplementary information every time a photographic image is taken. The image storage / display unit automatically displays a classification in the form of an album based on the incidental information and album information created from now on.

  A photographic image has vertical and horizontal directions. When displaying on an album, the orientation of the photographic image must be aligned so that the photographic image is upright. In the second embodiment, the orientation of the image pickup unit is recorded as supplementary information when taking a photographic image. The image display unit automatically displays the image so as to stand upright based on the incidental information.

  In the first embodiment, the classification is based on the date and time supplementary information, but it is also possible to further classify by the shooting location. In the third embodiment, the shooting location is recorded as supplementary information when taking a photographic image. The image storage / display unit automatically displays a classification in the form of an album based on the incidental information and album information created from now on. For example, in order to create an album for overseas travel, an album for the entire overseas travel can be created in the first embodiment, and the album can be classified by shooting location, for example, town, in the third embodiment.

  When there are a mixture of photographic images taken by a family, it is possible to create an individual album by classifying by photographer. In the fourth embodiment, the photographer is recorded as supplementary information when taking a photographic image. In the image storage / display unit, display is performed in the form of an album automatically classified for each photographer based on the incidental information and album information created from now on.

  Often you miss a photo opportunity, such as closing your eyes at the moment you press the shutter. In the fifth embodiment, photographic images before and after the moment when the shutter is pressed are stored, and attached to the photographic image information when the shutter is pressed as supplementary information. In the image storage / display section, if the photographic image at the moment of pressing the shutter is incomplete, an appropriate one is selected from the previous and subsequent photographic images, and this is recorded in the album information. From the next display, an appropriate photographic image is displayed based on the album information.

  If you look at the photo later, it is often out of focus. In the sixth embodiment, after pressing the shutter, a photographic image defocused is taken and attached to the photographic image information when the shutter is pressed as supplementary information. In the image storage / display unit, when the focus of the photographic image at the moment of pressing the shutter is shifted, an appropriate one is selected from the shifted photographic images, and this is recorded in the album information. From the next display, an appropriate photographic image is displayed based on the album information.

  If you look at the photo later, the aperture is often not right. In the seventh embodiment, after pressing the shutter, a photographic image with a shifted aperture is taken and attached to the photographic image information with the shutter pressed as supplementary information. When the aperture of the photographic image at the moment the shutter is pressed is not appropriate, the image storage / display unit selects an appropriate one from the photographic images shifted in the aperture, and records that fact in the album information. From the next display, an appropriate photographic image is displayed based on the album information.

  A photo is a still image, but if you add a sound around it or a voice comment, it will be more impressive and attractive. In the eighth embodiment, sounds before and after the moment the shutter is pressed are stored and attached to the photographic image information as supplementary information. The image storage / display unit can reproduce audio information, which is supplementary information, when displaying a photographic image.

  The first to eighth embodiments can be implemented singly or in combination.

  A first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a first embodiment of the recording / reproducing apparatus of the present invention. The image recording / reproducing apparatus includes two parts, an image photographing unit 101 and an image storage / display unit 102.

  The image capturing unit 101 captures image information and temporarily stores the information until it is sent to the image storage / display unit 102. The imaging unit 103 captures image information from the outside and converts it into electronic photographic image information. The photographic image information is sent to the storage unit 104 and stored therein. The storage unit 104 includes a semiconductor memory, a magnetic disk device, a flexible disk device, or an optical disk device. An IC card with a backup power source using a semiconductor memory is optimal because it does not have a mechanically movable part and only needs to be temporarily stored until information is sent to the image storage and display part. The operation input unit 105 inputs an operation to the image photographing unit 101 such as a shutter that determines the timing for capturing image information. The output of the operation input unit 105 is sent to the shooting control unit 106, and a control signal for controlling the image shooting unit 101 is generated. The clock unit 107 outputs the date and time. The date and time when the image information is taken in becomes the incidental information of the image information and is stored in the storage unit 104 together with the image information.

The image storage / display unit 102 receives and stores image information and supplementary information from the image capturing unit and displays the image information. The image storage / display unit 102 receives information from the image capturing unit through the interface 108. When the storage unit 104 of the image photographing unit 101 cannot be removed as in the magnetic disk device, the image photographing unit 101 and the image storage / display unit 102 are directly connected, and image information and supplementary information in the magnetic disk are read through the interface. When the storage unit of the image capturing unit uses a removable medium such as an IC card, a flexible disk, or an optical disk, a corresponding drive device is attached instead of the interface 108 of the image storage display unit 102. Just keep it. The captured image information and incidental information are stored in the storage unit 109. The storage unit 109 of the image storage / display unit 102 uses a magnetic tape device, a magnetic disk device, or an optical disk device because it needs to store image information and supplementary information semipermanently and requires a large capacity. An optical disk device is most suitable because of quick access and medium exchange. The operation input unit 110 inputs an operation to the image storage display unit 102 using a switch, a pen tablet, or the like. The output of the operation input unit 110 is sent to the storage display control unit 111, and a control signal for controlling the image storage display unit 102 is generated. Also, album information for display is created from the image information and supplementary information captured in the storage unit 109. Such information will be described later. The display control unit 112 creates display data based on the supplementary information and the album information and sends it to the display unit 113. The display unit 113 displays image data and uses, for example, a color LCD (liquid crystal display). Of course, a CRT display may be used, or a monitor may be connected outside the image storage display unit 102.

  Information transfer from the image capturing unit 101 to the image storage / display unit 102 need not be performed every time one piece of image information is captured. That is, images may be continuously captured as long as they can be stored in the storage unit 104 of the image capturing unit 101 and transferred to the image storage / display unit 102 collectively. In FIG. 1, the image capturing unit 101 and the image storage / display unit 102 can be separated, but may be integrated as a matter of course. In this case, the storage unit 104 for temporary storage of the image photographing unit 101 is not necessary, and image information and supplementary information are directly written into the storage unit 109 of the image storage display unit 102.

FIG. 2 shows details of the imaging unit 103 in the image photographing unit 101 shown in FIG. Light from the outside passes through the diaphragm 201 and the lens 202 and forms an image on a CCD (charge coupled device) 203. The aperture control unit 204 changes the aperture of the aperture 201 based on a command from the imaging control unit 106 in FIG. The focus control unit 205 also moves the lens 202 based on a command from the imaging control unit 106. The diaphragm 201 and the lens 202 are automatically controlled by the photographing control unit 106 in FIG. 1 so that an appropriate exposure and focus image are formed on the CCD 203. The CCD control unit 206 transfers the image information converted into an electrical signal by the CCD 203 to the storage unit based on a command from the imaging control unit 106. The image information converted into an electrical signal by the CCD 203 is also sent to an EVF (Electronic Viewfinder) 207 so that the image information can be visually confirmed.

  FIG. 3 shows an example of the appearance of the image photographing unit in the present invention. The image capturing unit has a shape similar to that of a camera using a normal silver salt film. The front lens 301 is the same as the lens 202 shown in FIG. This lens is driven by a zoom button 302 and can change an image capturing range. The shutter is a two-stage shutter, and includes a first shutter 303 that is pressed first, and a second shutter 304 that is pressed following the first shutter 303. The rear liquid crystal panel 305 is used for the output of the EVF 207 in FIG. 2 and displays an image to be photographed. The liquid crystal panel 305 is also used as a display panel when performing an operation input to the image photographing unit. The operation input is performed by selecting a menu displayed on the liquid crystal panel 305 with the input button 306. The connector 307 connects a cable when reading out image information and incidental information temporarily stored in the storage unit 104 of the image capturing unit 101 shown in FIG. When a device capable of taking out a medium such as a flexible disk, an optical disk, or an IC card is used as the storage device 104 of the image photographing unit 101, information may be moved by these media.

FIG. 4 shows an example of the appearance of the image storage / display unit in the present invention. In order to provide portability, the image storage / display unit uses a liquid crystal panel 401 as a display unit, and is about the size of an A4 document file. The switch 402 is an activation switch, and all operations other than activation use the pen input device 403. Speakers 404 are provided on the left and right above the liquid crystal panel 401, and sound output is also possible. FIG. 4 shows an example in which an optical disk device is used as the storage unit 109 of the image storage / display unit 102 in FIG. A cable is connected to the connector 406 to read image information and incidental information from the image capturing unit. When the storage unit 104 of the image capturing unit 101 in FIG. 1 is an optical disk device, the image information and the accompanying information can be moved by inserting the optical disk into the slot on the side surface of the image storage / display unit. When the storage unit 104 of the image photographing unit 101 is a flexible disk device or an IC card device, if these devices are provided in the image storage / display unit, information can be moved without using a cable.

  FIG. 5 to FIG. 9 show examples of display screens on the image storage display unit in the present invention. All operations on the screen are performed with a pen.

  When the image storage display unit is activated, an initial screen in the form of a bookshelf in FIG. 5 is displayed. The photographic images are classified into the album 501 format and arranged on the bookshelf 502. These albums are generated based on the album list for later use. When the camera icon 503 is clicked, a mode for capturing image information and supplementary information from the image capturing unit is entered. When the film icon 504 is clicked, a mode for editing a film list that is a set of image information and incidental information is entered. When a blank album icon 505 is clicked, a mode for creating a new album is entered, and an album list is generated from the film list. The film list and album list will be described later. When the end icon 506 is clicked, the system is turned off.

  In FIG. 5, when the back cover of the album to be viewed is clicked, the screen is switched to the screen of FIG. The selected album is displayed closed. Here, in addition to the album cover 601, an editing tool icon 602, a bookshelf icon 603, and page turning icons 604 and 605 are displayed. Note that the edit tool icon 602 is not selectable. When the bookshelf icon 603 is clicked, the screen returns to the bookshelf initial screen shown in FIG. By clicking the page turning icons 604 and 605, the album can be turned left and right.

  When the page turning icon 604 is clicked in FIG. 6, a table of contents screen 701 shown in FIG. 7 is displayed. The table of contents screen is an icon in which the table of contents name and page are paired. Clicking on it will take you to that page. When the table of contents icon or the page turning icon 604 is clicked, a photo screen 801 shown in FIG. 8 is displayed.

  On the photo screen 801, immediately after the album list is generated, the photos are arranged in a fixed form as shown in FIG. This is sufficient for normal photo appreciation. However, by clicking the edit mode icon 602, an edit operation can be performed on the photographic image. The operations that can be performed in the edit mode include enlargement / reduction, rotation, trimming, movement, or writing of comments with a pen. An example of the editing operation is shown in FIG.

  FIG. 10 shows a data structure in the image photographing unit. The plurality of pieces of photo information 1001 are stored in the storage unit in the order of shooting.

  FIG. 11 shows details of the photographic information. The photograph information 1001 includes image information 1101 that is image data itself and incidental information 1102 related to the image information. Image information 1101 is image data itself captured by the photographing unit, and incidental information 1102 contains attribute information about the image. In the first embodiment, the supplementary information 1102 includes a photo number 1103 given in the order of shooting, a shooting year 1104, a shooting month 1105, and a shooting date when the photo output from the clock unit 107 in FIG. 1 was shot. 1106 and shooting time 1107.

  FIG. 12 shows an example of the incidental information in FIG. Only the incidental information is extracted and tabulated.

  10 is transferred to the image storage / display unit 102 when it has accumulated to some extent in the storage unit 104 in the image photographing unit 101 of FIG. The image storage / display unit 102 generates a film list 1301 as shown in FIG. 13 from the transferred photographic information. The film list 1301 includes a film header 1302 and photographic information 1001. The photographic information is the same as that shown in FIG. The film header 1302 includes a film number 1303 and the number of photographs 1304 included in the film list, a transfer year 1305 transferred, a transfer month 1306, and a transfer date 1307. The film list 1301 is a source for creating an album list, which will be described later, and when displaying using the album list, the image information included in the film list 1301 is read and displayed. The film list 1301 is stored in the storage unit 109 in the image storage / display unit 102 of FIG.

  FIG. 14 shows an example of the film header. Only the film header is taken out and tabulated.

  FIG. 15 shows the data structure of the album list 1501. The album list 1501 includes an album header 1502 and one or more page lists 1503.

  FIG. 16 shows details of the data structure of the album header 1502. The album number 1601 is assigned in the order in which the album list is created, and is unique within the image storage / display unit. Following that, an album name 1602, an album page number 1603, vertical and horizontal widths 1604 and 1605, a cover color 1606 and a pattern 1607 are included.

FIG. 17 shows details of the data structure of the page list 1503. There is one page list 1503 for each page of the album. The page list 1530 includes a page header 1701 and a photo list 1702. The page header 1701 includes a page number 1703, a page name 1704, and a page mount color 1705. The page number 1703 indicates the page number of the album, and is unique in the album list 1501.

  FIG. 18 shows the details of the data structure of the photo list 1702. One photo list 1702 exists for each photo existing in the page. A photo list 1702 includes a frame number 1801, a film number 1802, a photo number 1803, a trim start position X1804, a trim start position Y1805, a trim range W1806, a trim range H1807, an enlargement / reduction ratio 1808, a rotation angle 1809, a display position X1810, and a display position. Y1811. The frame number 1801 indicates the number of a photograph displayed on the page, and is unique in the page list 1503. For example, when three photos are displayed on one page, frame numbers 1 to 3 exist. The film number 1802 and the photo number 1803 specify the film list and the photos in the film list. When displaying, the image information of the photos is read from the film list. The trim start position X1804 and the trim start position Y1805 indicate the position where the trimming of a photograph is started by coordinates. A trim range W1806 and a trim range H1807 indicate the width and height of trimming, and are trimmed with this width and height from the coordinates (X, Y) of the trimming start positions 1804 and 1805 described above. The enlargement / reduction ratio 1808 indicates the display magnification of the image after trimming. The rotation angle 1809 indicates how many times the image is rotated and displayed. A display position X1810 and a display position Y1811 are coordinates in a page indicating a position for displaying a photograph.

FIG. 19 shows a flowchart for generating an album list. First, an album generation condition is set 1901. Based on this, the corresponding photo is identified 1902, an album list is created 1903, and the created album list is saved 1904 in the storage unit. Further, it is determined whether or not to display 1905, and when the display is not performed, the processing is ended as it is. When album display is performed, image information is read from the film list based on the album list and album display 1906 is performed. When the display is completed, it is determined whether or not the album list has been changed by performing album editing or the like. If the album list has been changed, the album list is saved 1908. If not, the process ends. This flow occurs when a blank back cover album 505 is selected on the initial screen shown in FIG. 5, and a new album is created.

  FIG. 20 is a flowchart when the album list already exists. An album list is read from the storage unit of the storage display unit 2001, and based on this, image information is read from the film list and an album display 2002 is performed. When the display is finished, it is determined whether or not the album list has been changed by performing album editing or the like. If the album list has been changed, the album list is saved 2004, and if not, the process ends. This flow occurs when the created album 501 is selected on the initial screen shown in FIG.

  An example of creating an album list will be described with reference to FIGS. 21, 21, 22, and 12. In the incidental information shown in FIG. 12, it is assumed that the shooting dates from the photo numbers 14 to 24 are continuous, and these photos can be collected on the theme of travel, for example. Therefore, it is specified that a group of photos whose dates are consecutive from the 13th are collected, and that the album is generated by changing the page for each date.

  FIG. 21 is a table showing a photograph list generated under these conditions. Eleven photos meet the requirements and are allocated over four pages. The italic part is automatically generated according to the conditions, and the other parts are default values.

FIG. 22 is a table showing the page list according to FIG. The page attribute includes a condition for creating the page, that is, a date on which a photo in the page was taken. The color of the mount is the default. Page attributes can be changed freely. That is, a title can be added instead of a date.

  FIG. 23 is an album header according to FIGS. 21 and 22. The part of the album name with the underline drawn is the part entered by the creator, and is displayed on the display of the album and on the back cover.

FIG. 24 shows an example of a table of contents screen displayed based on this album list, particularly the page list shown in FIG. FIG. 25 shows an example of a screen in a state where pages 1 and 2 of the album are opened. In addition to photos, page numbers and page attributes are also displayed.

  As in the display example of FIG. 25, the image is not always upright. The photographs 2501 and 2502 that are not upright may be rotated in the edit mode after being displayed, but this is automatically performed in the second embodiment of the present invention. Hereinafter, the second to eighth embodiments will be described with a focus on the differences from the first embodiment, and the rest will be the same as the first embodiment.

  In the second embodiment, the image capturing unit is provided with an orientation detection unit of the image capturing unit, and the orientation of the image capturing unit at the time of capturing a photographic image is added to the photographic image information as supplementary information. FIG. 26 is a block diagram showing the second embodiment. The posture detection unit 2601 detects how the image capturing unit is facing when a photographic image is captured using gravity as a reference. The resolution of the posture is not so necessary, and a resolution of about 45 degrees may be used. The output of the posture detection unit 2601 is sent to the storage unit 104 together with the output of the clock unit 107, becomes supplementary information of the image information, and is stored in the storage unit 104 together with the image information. The blocks other than the posture detection unit 2601 are the same as those in the first embodiment.

  FIG. 27 shows an example of photographic information in the second embodiment. In addition to the supplementary information described in the first embodiment, a photographing posture 2701 of the photographing unit at the time of photographing an image is added.

  FIG. 28 shows an example of incidental information in the second embodiment. Only the incidental information is extracted and tabulated. In FIG. 12, a column 2801 of the shooting posture is added.

  FIG. 29 is a table showing a photo list in the album list created based on the supplementary information example of FIG. 28 in the second embodiment. The generation conditions were the same as in the first example. The italic part is automatically generated according to the conditions, and the other parts are default values. The data in the column 2901 of the rotation angle when displaying the image is automatically created from the photographing posture in the accompanying information.

  FIG. 30 shows an example of a screen in a state where pages 1 and 2 of the album displayed based on the album list and the photo list shown in FIG. 29 are opened. Compared to FIG. 25, it can be seen that the photo is displayed in the correct orientation.

  If you take a photo, you will often not know where it was taken if you review it later. Also, when traveling, it is often classified according to the town where it was photographed.

  In the third embodiment, the image photographing unit has a photographing location input unit, and the photographing location of the photographic image is attached to the photographic image information as incidental information. FIG. 31 is a block diagram showing the third embodiment. The shooting location input unit 3101 inputs a location where a photographic image is to be taken from outside, and holds it until the next input is received. The output of the shooting location input unit 3101 is sent to the storage unit 104 together with the output of the clock unit 107. When a photograph is taken, it becomes supplementary information of the image information and is stored in the storage unit 104 together with the image information. The blocks other than the shooting location input unit 3101 are the same as those in the first embodiment.

  FIG. 32 shows an example of photographic information in the third embodiment. In addition to the supplementary information described in the first embodiment, a shooting location 3201 at the time of image shooting is added.

  FIG. 33 shows an example of incidental information in the third embodiment. Only the incidental information is extracted and tabulated. In FIG. 12, a shooting location column 3301 is added.

  FIG. 34 is a table showing a photo list in the album list created based on the supplementary information example of FIG. 33 in the third embodiment. The generation condition is that the shooting location is “Chiba”. The italic part is automatically generated according to the conditions, and the other parts are default values.

  When one image photographing unit is used by a plurality of people, photographs taken by each person are mixed. In particular, when the image capturing unit has a large storage capacity and hundreds of images are included, this tendency becomes stronger.

  In the fourth embodiment, a photographer input unit is included in the image photographing unit, and the photographer of the photographic image is attached to the photographic image information as incidental information. FIG. 35 is a block diagram showing the fourth embodiment. The photographer input unit 3501 inputs a person who takes a photographic image from the outside and holds it until the next input is received. The output of the photographer input unit 3501 is sent to the storage unit 104 together with the output of the clock unit 107. When a photograph is taken, it becomes supplementary information of the image information and is stored in the storage unit 104 together with the image information. The blocks other than the photographer input unit 3501 are the same as those in the first embodiment.

  FIG. 36 shows an example of photographic information in the fourth embodiment. In addition to the supplementary information described in the first embodiment, an image photographer 3601 is added.

  FIG. 37 shows an example of incidental information in the fourth embodiment. Only the incidental information is extracted and tabulated. In FIG. 12, a photographer column 3701 is added.

  FIG. 38 is a table showing a photo list in the album list created based on the supplementary information example of FIG. 37 in the third embodiment. The generation condition is that the photographer is “Kiyoshi Matsumoto”. The italic part is automatically generated according to the conditions, and the other parts are default values.

  Often you miss a photo opportunity, such as closing your eyes at the moment you press the shutter. In the fifth embodiment, a sub photographic image is taken at a time in the vicinity of the moment when the main photographic image is taken, and attached to the main photographic image information as supplementary information of the main photographic image. Further, a desired image is selected from the main photographic image information or auxiliary photographic image information which is auxiliary information, and is displayed on the image storage / display unit.

  If you look at the photo later, it is often out of focus. In the sixth embodiment, a sub photographic image with a different focus is taken at a time in the vicinity of the moment when the main photographic image is taken, and is added to the main photographic image information as supplementary information of the main photographic image. Further, a desired image is selected from the main photographic image information or auxiliary photographic image information which is auxiliary information, and is displayed on the image storage / display unit.

  If you look at the photo later, the aperture is often not right. In the seventh embodiment, a secondary photographic image with a different aperture is taken at a time in the vicinity of the moment when the main photographic image is taken, and is attached to the main photographic image information as supplementary information of the main photographic image. Further, a desired image is selected from the main photographic image information or auxiliary photographic image information which is auxiliary information, and is displayed on the image storage / display unit.

FIG. 39 is a block diagram showing the recording / reproducing apparatus in the fifth, sixth and seventh embodiments. In the image capturing unit 3901, the image capturing unit 3902 captures an image from the outside and converts it into electronic image information. The image information is sent to the buffer 3903 and stored. The buffer 3903 can store a plurality of photographic images. The difference calculator 3904 reads the image information from the buffer 3903 and calculates the difference between the images. The difference calculator 3904 also has a function of passing image information without performing difference calculation. The output of the difference calculator 3904 is sent to the image compression unit 3905 and compressed. The output of the image compression unit 3905 is sent to the storage unit 3906 and stored therein. The clock unit 3907 and the storage unit 3906 are the same as those in the first embodiment. For the image storage / display unit 3908, an image expansion unit 3909 is provided. This is because the image compressed by the image photographing unit 3901 is decompressed. Other parts are the same as those in the first embodiment.

The operation of the fifth embodiment will be described with reference to FIG. 40, FIG. 2, FIG. 3, and FIG. In the image photographing unit shown in FIG. 3, when the first shutter 303 is pressed, the aperture control unit 204 and the focus control unit 205 in FIG. 2 start operating, and the subject is automatically focused and focused. Thereafter, information from the imaging unit in FIG. 39 is taken into the buffer 3903 at a certain time interval, for example, 0.3 second interval. The buffer 3903 is a FIFO (First In First Out). When the buffer 3903 is full, old image information is discarded. When the second shutter 304 in FIG. 3 is pressed, the image at that time is set as a main image and captured, and several subsequent images are captured. Thereafter, the difference calculator 3904 performs a calculation between the main image as a reference image and the sub-images before and after the main image. FIG. 40 shows an example in which a reference image and two images before and after the reference image are used. The main image when the second shutter 304 is pressed is set as a reference image 4001, and the previous image-2 (4002), image-1 (4003), the subsequent image + 1 (4004), and the image +2 (4005) are displayed. Accumulate in buffer 3903. Buffer 39
03 sends the reference image 4001 to the difference calculator 3904 first. The difference calculator 3904 passes this image and sends it to the image compression unit 3905. The difference calculator 3904 then outputs the image-1 (
4003) and the reference image 4001 are calculated, and the result is sent to the image compression unit 3905. Similarly, the difference between the image +1 (4004), the image −2 (4002), the image +2 (4005), and the reference image is calculated and sent to the image compression unit 3905. The image compression unit 3905 compresses the sent image and sends it to the storage unit 3906.

The operation of the sixth and seventh embodiments will be described with reference to FIG. 41, FIG. 2, FIG. 3, and FIG. In the image photographing unit shown in FIG. 3, when the first shutter 303 is pressed, the aperture control unit 204 and the focus control unit 205 in FIG. 2 start to operate, and the subject is automatically focused and focused. When the second shutter 304 is pressed, the image at that time is set as a main image, and the subsequent image is acquired as a sub image at several screens at short time intervals. As for the sub-image, the focus is shifted in the sixth embodiment and the aperture is shifted in the seventh embodiment as compared with the case where the main image is captured. After capturing the image, the main image is set as a reference image, and the difference calculator 3904 performs calculation with the sub-image. FIG. 41 shows an example in which a main image is used as a reference image and the subsequent four sub-images are used. A main image when the second shutter 304 is pressed is set as a reference image 4101, and an image −1 (4102) and an image +1 behind the reference image 4101 are displayed.
(4103), image-2 (4104), and image + 2 (4105) are stored in the buffer 3903. -Indicates that the focus or stop is moved in the negative direction, and + indicates that the focus or stop is moved in the positive direction. 1 and 2 indicate the degree of movement. That is, +2 indicates that the movement is larger in the positive direction than +1. The buffer 3903 first sends the reference image 4101 to the difference calculator 3904. The difference calculator 3904 passes this image and sends it to the image compression unit 3905. Next, the difference calculator 3904 calculates the difference between the image-1 (4102) and the reference image 4101 and sends the result to the image compression unit 3905. Similarly, image + 1 (4103), image-2 (4104), image + 2 (4105)
) And the reference image are calculated and sent to the image compression unit 3905. The image compression unit 3905 compresses the sent image and sends it to the storage unit 3906.

FIG. 42 is a diagram showing a data structure of photographic information in the fifth, sixth and seventh embodiments. Reference information obtained by compressing the reference image (4001 or 4101) is included in the image information 4201, and image-1 (4003 or 4102), image + 1 (4004 or 4103), image-2 (4002) is included in the accompanying information. Or 4104), image +2 (4005 or 4105)
) And the reference image (4001 or 4101), the difference information-1 (4202) obtained by compressing the difference
, Difference information + 1 (4203), difference information-2 (4204), and difference information + 2 (4205) are arranged.

FIG. 43 is an example in which the photo list in the album list in the fifth, sixth and seventh embodiments is tabulated. Except that a display number column 4301 is provided, the present embodiment is the same as the first embodiment. Immediately after the album list is generated, the default display number is 0. That is, this indicates that the main image is displayed. However, if the image of the main image is not good and the sub-image is better, the sub-image can be selected. The number of the selected secondary image is recorded in the display number column. For example, the numbers in FIG. When the album list is read out next time and the album is displayed, a secondary image is displayed instead of the main image.

  A photo is a still image, but if you add a sound around it or a voice comment, it will be more impressive and attractive. In the eighth embodiment, audio information at the shooting location is recorded at a time in the vicinity of the moment when the photograph image is taken, and is added to the photograph image information as supplementary information of the photograph image. Furthermore, when this photographic image information is displayed, audio information which is supplementary information can be reproduced.

  FIG. 44 is a block diagram showing a recording / reproducing apparatus in the eighth embodiment. The image photographing unit 4401 is provided with a microphone 4402, which captures sound from the outside and converts it into electronic sound information. The audio information is sent to the buffer 4403 and stored. The buffer 4403 can store audio information of about 10 seconds. The output of the buffer 4403 is sent to and stored in the storage unit 4405 together with image information from the imaging unit. Other parts are the same as those in the first embodiment. For the image storage / display unit 4407, an audio output unit 4408 is provided. This is because the audio information is reproduced. Other parts are the same as those in the first embodiment.

The operation of the eighth embodiment will be described with reference to FIGS. 45, 3 and 44. FIG. In the image photographing unit shown in FIG. 3, when the first shutter 303 is pressed, the sound 4501 from the microphone 4402 in FIG. Buffer 4403 is a FIFO (Firs
t In First Out), the old image information is discarded when the buffer 4403 is full. When the second shutter 304 in FIG. 3 is pressed, the captured image is captured and the subsequent audio 4501 is captured for several seconds. Thereafter, the audio 4501 before and after the moment when the image is captured is taken out of the buffer 4403 and sent to the storage unit 4405 together with the image information.

  FIG. 46 is a diagram showing a data structure of photographic information in the eighth embodiment. Audio information 4601 is added to the accompanying information.

  FIG. 47 is an example in which the photo list in the album list in the eighth embodiment is tabulated. The second embodiment is the same as the first embodiment except that an audio information column 4701 is provided. When generating the album list, the presence of the voice information is checked, and 1 is entered when the voice information is present, and 0 is entered when it is not present. When the album is displayed, the audio information column 4701 is checked, and the audio can be reproduced for the photo in which the audio exists.

  As described above, the first to eighth embodiments can be implemented independently or in combination.

The block diagram of a 1st Example. The detailed block diagram of an imaging part. The top view which shows the example of the external appearance of an image pick-up part. The top view which shows the example of the external appearance of an image preservation | save display part. The top view which shows the example of a screen display. The top view which shows the example of a screen display. The top view which shows the example of a screen display. The top view which shows the example of a screen display. The top view which shows the example of a screen display. The data structure figure in an image photographing part. Detailed data structure diagram of photographic information. The chart figure which shows the example of incidental information. Data structure diagram of film list. The chart which shows the example of a film header. Data structure diagram of album list. Data structure diagram of album header. FIG. 6 is a data structure diagram of a page list. Data structure diagram of photo list. The flowchart of album list generation. The flowchart of a display when an album list exists. A table showing an example of a photo list. A table showing an example of a page list. The table which shows the example of an album header. The top view which shows the example of a table of contents screen. The top view which shows the example of a screen display. The block diagram of a 2nd Example. The data block diagram which shows the example of photograph information. An example of incidental information. An example of a photo list. Display screen example. The block diagram of a 3rd Example. An example of photo information. An example of incidental information. An example of a photo list. The block diagram of a 4th Example. An example of photo information. An example of incidental information. An example of a photo list. The block diagram of the 5th, 6th, 7th Example. The figure explaining operation | movement of a 5th Example. The figure explaining the operation | movement of the 6th, 7th Example. Data structure of photographic information. An example of a photo list. The block diagram of an 8th Example. The figure explaining operation | movement of an 8th Example. Data structure diagram of photographic information. A table showing an example of a photo list.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... Image pick-up part, 102 ... Image preservation | save display part, 103 ... Imaging part, 104 ... Memory | storage part, 105 ... Operation input part, 106 ... Shooting control part, 107 ... Clock part, 108 ... Interface, 109 ... Memory | storage part , 110 ... operation input unit, 111 ... storage display control unit, 112 ... display control unit, 113 ... display unit, 201 ... aperture, 202 ... lens, 203 ... CCD, 204 ... aperture control unit, 205 ... focus control unit, 206 DESCRIPTION OF SYMBOLS ... CCD control part, 207 ... EVF, 301 ... Lens, 302 ... Zoom button, 303 ... 1st shutter, 304 ... 2nd shutter, 305 ... Liquid crystal panel, 306 ... Operation button, 307 ... Connector, 401 ... Liquid crystal panel, 402 ... Switch, 403 ... Pen input device, 404 ... Speaker, 405 ... Optical disk, 406 ... Connector, 501 ... Album icon 502 ... Bookshelf, 503 ... Camera icon, 504 ... Film icon, 505 ... Blank paper icon, 506 ... End icon, 601 ... Cover, 602 ... Edit icon, 603 ... Bookshelf icon, 604 ... Turning icon, 605 ... Turning icon, 1001 ... Photo information, 1101 ... Image information, 1102 ... Additional information, 1301 ... Film list, 1302 ... Film header, 1501 ... Album list, 1502 ... Album header, 1503 ... Page list, 1701 ... Page header, 1702 ... Photo list, 2601: Posture detection unit, 2701 ... Posture information, 3101 ... Shooting location input unit, 3201 ... Shooting location, 3501 ... Photographer input unit, 3601 ... Photographer, 3901 ... Image shooting unit, 3902 ... Imaging unit, 3903 ... Buffer, 3904: Difference calculator 39 5 ... Image compression unit, 3906 ... Storage unit, 3907 ... Clock unit, 3908 ... Image storage / display unit, 3909 ... Image decompression unit, 4001 ... Reference image, 4101 ... Reference image, 4201 ... Image information, 4401 ... Image photographing unit, 4402: Microphone, 4403: Buffer, 4404: Imaging unit, 4405 ... Storage unit, 4406 ... Clock unit, 4407 ... Image storage / display unit, 4408 ... Audio output unit, 4501 ... Audio, 4601 ... Audio information.

Claims (20)

  Means for acquiring supplementary information related to an image together with the image information at the time of image capture in an image recording / playback apparatus comprising an image capturing unit that captures an image and converts the image information into image information, and an image storage display unit that stores and displays the captured image information Is provided in the image photographing unit, the image information is added to the image information, and the image storage and display unit displays the image information based on the acquired additional information.   The image recording unit according to claim 1, wherein an image photographing unit that converts the image into captured information can be separated from an image storage display unit that stores the captured image information and performs live display. Playback device.   The image recording / reproducing apparatus according to claim 2, wherein the image photographing unit includes an imaging unit that captures an image and converts the image information into image information, and a storage unit that retains the image information.   2. The image recording / reproducing apparatus according to claim 1, wherein the image photographing unit is provided with a clock, and the date and time when the image information is acquired is attached to the image information as supplementary information.   5. The image recording / reproducing apparatus according to claim 4, wherein the image storage / display unit classifies and displays the image information based on supplementary information which is a date and time when the image information is acquired.   2. The image recording / reproducing apparatus according to claim 1, wherein the image photographing unit includes means for detecting the posture of the image pickup unit, and the posture of the image pickup unit at the time of image information acquisition is attached to the image information as supplementary information.   The image recording / reproducing apparatus according to claim 6, wherein the image storage / display unit changes a display direction of the image information based on incidental information that is an attitude of the imaging unit when the image information is acquired.   2. The image recording / reproducing apparatus according to claim 1, further comprising means for inputting a location where the image information is acquired in the image photographing unit, and adding the location where the image information is acquired as additional information to the image information.   9. The image recording / reproducing apparatus according to claim 8, wherein the image storage / display unit classifies and displays the image information based on incidental information that is a place where the image information is acquired.   2. The image recording / reproducing apparatus according to claim 1, further comprising means for inputting a person who has photographed image information in the image photographing unit, and adding the person who photographed the image information to the image information as supplementary information.   11. The image recording / reproducing apparatus according to claim 10, wherein the image storage / display unit classifies and displays the image information based on incidental information that is a person who has photographed the image information.   The image photographing unit includes means for obtaining image information of a photographed main image and means for obtaining a sub image related to the main image, and adding the sub image to the image information as supplementary information. The image recording / reproducing apparatus according to claim 1, wherein:   13. The image recording / reproducing apparatus according to claim 12, wherein the image capturing unit acquires the sub-image information with a time shift from the main image information.   13. The image recording / reproducing apparatus according to claim 12, wherein the image photographing unit obtains the sub-image information by shifting a focus from the time of obtaining the main image information.   13. The image recording / reproducing apparatus according to claim 12, wherein the image capturing unit acquires the sub-image information by shifting a focus from the time of acquiring the main image information.   16. The image recording / reproducing apparatus according to claim 13, wherein a difference between the sub-image information and the main image information is taken, and the difference is compressed and attached to the main image information as auxiliary information.   13. The image recording / reproducing apparatus according to claim 12, wherein the image storing / reproducing unit displays an optimum one of the main image and sub-image.   2. The image capturing unit according to claim 1, further comprising means for acquiring image information and means for acquiring audio information related to the image information, and adding the audio information to the image information as supplementary information. Image recording / playback device.   19. The image recording / reproducing apparatus according to claim 18, wherein the audio information is acquired over a period of time before and after the time when the image information is acquired. 19. The image recording / reproducing apparatus according to claim 18, wherein the image storing / reproducing unit reproduces audio information related to the displayed image information when the image information is displayed.

Images