JP2003179861A - Image recording and reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image recording and reproducing device that can easily arrange and store a huge amount of photographed images, display them for appreciation and reduce the opportunities of failures in photographing the images. <P>SOLUTION: In the image recording and reproducing device comprising an image photographing section and an image storage display section, the image photographing section is provided with a means that attaches attached information with respect to the photographing image to the photographing image when the device photographs the image. Further, the image storage display section is provided with a means for displaying the image on the basis of the attached information in the case of displaying the image. Further, the image photographing section uses no silver salt film but uses a device such as a CCD (Charge Coupled Device) to adopt a method of capturing image information as electronic data. Adopting also the attached information as the electronic data allows the image recording and reproducing device to process the information in a unified way. The image storage display section has a data storage section to store image data or the like and also has an image display section to display the image electronically in a form of an album. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

INDUSTRIAL APPLICABILITY The present invention electronically records an image on a storage element such as a semiconductor memory or a magnetic disk without using a film. The present invention relates to a so-called electrophotographic system.

[0002]

2. Description of the Related Art Usually, photographs are taken by using a silver salt film. The photographed film is developed and printed on photographic paper for viewing.

On the other hand, electronic still cameras have recently been put into practical use. This does not use a film, but electronically records an image in a storage element such as a semiconductor memory or a magnetic disk. The reproduction can be performed on an external TV screen, or can be transferred to a computer for DTP (desktop publishing).

[0004]

The number of photographs taken by an individual has been increasing rapidly in recent years. Individuals can order dozens of copies per year, and hundreds of copies per family. There are many opportunities to take photos, especially if you are newlywed, at the birth of your child, or when you travel abroad.
It may be close to one.

Organizing and storing these photographs is a rather tedious task. Therefore, most of them are simply inserted into a pocket-type album, or are stored separately. If that happens, it is difficult to find the photo you want to see, and if it is stored in pieces, you may lose it.

In order to organize and store the photographs, an album of a type in which the photographs are attached to a mount is usually used. You can also divide the photos by theme and add comments. However, in order to organize and save in an album, editing and organizing work requires considerable effort. That is, the photographs are classified, rearranged, and arranged on the mount in a well-balanced manner. In addition, add comments such as date and place. It may not be too painful if you do this every time you take a picture, but once you have accumulated unorganized pictures, it becomes difficult to organize them. The photo itself
In many cases, it wasn't taken well. That is, there are many things that are useless because they are out of focus or are not exposed.

[0007] The purpose of this research is to provide an image recording / reproducing apparatus capable of easily organizing and storing photographic images and displaying them for viewing. .

[0008]

To solve the above problems, in an image recording / reproducing apparatus including an image capturing section and an image storage / display section, when capturing a photographic image, supplementary information about the image is added to the photographic image. A means for doing so is provided in the image capturing section. Further, when the photographic image is displayed, a means for displaying the photographic image on the basis of the incidental information is provided in the image storage display section. Further, in the image capturing section, a device such as a CCD (charge coupled device) is used instead of a silver salt film to electronically capture image information as data. The incidental information can be handled in a unified manner by using electronic data. The image storage / display unit has a data storage unit to store image data and the like, and also has an image display unit to electronically display images in the form of an album.

In the first embodiment, the image capturing section is provided with means for adding the date and time when the photographic image was captured to the photographic image information as supplementary information. Further, based on this supplementary information, the image storage display section performs a classification display.

In the second embodiment, a posture detecting unit of the image pickup unit is provided in the image pickup unit, and means for adding the posture of the image pickup unit at the time of photographing the photographic image to the photographic image information as supplementary information is provided in the image pickup unit. It was Furthermore, the direction in which the image is displayed on the image storage display unit is changed based on this additional information.

In the third embodiment, the image shooting section has a shooting location input section, and the image shooting section is provided with means for adding the shooting location of the photographic image to the photographic image information as additional information. Further, based on this supplementary information, the image storage display section performs a classification display.

In the fourth embodiment, the image capturing section has a photographer input section, and means for adding the photographer of the photographic image to the photographic image information as supplementary information is provided in the image capturing section. further,
Classification display is performed on the image storage display unit based on the additional information.

In the fifth embodiment, a means for shooting a sub-photo image at a time near the time the main photo image is taken and adding it to the main photo image information as supplementary information of the main photo image is taken. Provided in the department. Further, a desired image is selected and displayed from the main photographic image information or the auxiliary photographic image information which is the supplementary information in the image storing and displaying section.

In the sixth embodiment, a sub-photo image whose focus is changed is photographed at a time near the moment when the main photographic image is photographed, and is added to the main photographic image information as incidental information of the main photographic image. Means were provided in the image capturing section. Further, a desired image is selected and displayed from the main photographic image information or the auxiliary photographic image information which is the supplementary information in the image storing and displaying section.

In the seventh embodiment, a sub-photo image with a different aperture is photographed at a time near the moment when the main photo image is photographed, and is added to the main photo 0 image information as supplementary information of the main photographic image. A means for doing so is provided in the image capturing section. Further, a desired image is selected and displayed from the main photographic image information or the auxiliary photographic image information which is the supplementary information in the image storing and displaying section.

In the eighth embodiment, the image photographing unit has means for recording voice information at a photographing place at a time close to the moment the photograph image is photographed and adding it to the photograph image information as supplementary information of the photograph image. Set up in. Further, when displaying the photographic image information on the image storage display unit, the audio information which is the supplementary information is reproduced.

[0017]

[Operation] When taking a photographic image, the supplementary information about the photographic image is added to the photographic image information. This information is temporarily stored in the storage unit in the image capturing unit and then transferred to the image storage display unit. The image storage display section temporarily stores the photographic image information and the incidental information. Further, album information for performing a classification display is created based on this additional information data.
When displaying, classification display is performed in the form of an album based on the additional information and the album information. further,
When displaying, the display form is changed based on the supplementary information. In order to organize photos, they are often classified according to themes such as athletic meet and overseas travel. However, when targeting an individual or a family, these are events that can be separated in time series, and for example, an athletic meet and an overseas trip are not performed at the same time. Therefore, if classified by the date when the photograph was taken, or by the chunk of time, it is classified by theme. In the first embodiment, each time a photographic image is taken, the date and time are recorded as supplementary information. The image storage / display unit automatically performs classification display in the album format based on the supplementary information and album information created from this.

The photographic image has vertical and horizontal directions. When displaying in the album, the orientation of the photo image must be adjusted so that the photo image is upright. In the second embodiment,
At the time of taking a photographic image, the attitude of the imaging unit is recorded as supplementary information. In the image display section, based on this additional information,
The image is automatically displayed so that it is upright.

In the first embodiment, the information is classified according to the incidental information such as the date and time, but it may be classified according to the photographing location. In the third embodiment, the shooting location is recorded as supplementary information when the photographic image is taken. The image storage / display unit automatically performs classification display in the album format based on the supplementary information and album information created from this. For example, in order to make an album of overseas travels, it is possible to make an album of the entire overseas travels in the first embodiment and classify the albums in the third embodiment by shooting locations, for example, towns.

When the photograph images taken by the family are mixed, it is possible to make an individual album by classifying the photographers. In the fourth embodiment, the photographer is recorded as the supplementary information when the photographic image is captured. The image storage / display unit automatically displays the albums in the form of albums classified by the photographer based on the supplementary information and the album information created from this.

It often happens that the user misses a photo opportunity, such as closing his eyes at the moment of pressing the shutter. In the fifth embodiment, the photographic images before and after the moment when the shutter is pressed are stored and added as supplementary information to the photographic image information when the shutter is pressed. In the image storage display unit, if the photographic image at the moment when the shutter is pressed is inadequate, an appropriate one is selected from the photographic images before and after, and the fact is recorded in the album information. From the next display, an appropriate photographic image is displayed based on this album information.

Later photographs are often out of focus. In the sixth embodiment, after the shutter is pressed, a photographic image that is out of focus is captured and added to the photographic image information when the shutter is pressed as supplementary information. When the photographic image at the moment of pressing the shutter is out of focus, the image storage display section selects a proper photographic image from the defocused images and records that fact in the album information. From the next display, an appropriate photographic image is displayed based on this album information.

When looking at photographs later, it is often the case that the aperture is not correct. In the seventh embodiment, after pressing the shutter, a photographic image with a shifted aperture is photographed and added to the photographic image information on which the shutter is pressed as supplementary information. If the aperture of the photographic image at the moment the shutter is pressed is not appropriate, the image storage display section selects an appropriate aperture from the photographic images and records that fact in the album information. From the next display, an appropriate photographic image is displayed based on this album information.

Although the photograph is a still image, it is more impressive and attractive if the surrounding sound at the time of photographing or a voice comment is added to the photograph. In the eighth embodiment, the sounds before and after the moment the shutter is pressed are stored and added to the photographic image information as supplementary information. When displaying a photographic image, the image storage / display unit can play back audio information that is incidental information.

The first to eighth embodiments can be carried out alone or in combination.

[0026]

EXAMPLE A first example of the present invention will be described. Figure 1
1 is a block diagram showing a first embodiment of a recording / reproducing apparatus of the present invention. The image recording / reproducing apparatus is composed of two parts, an image capturing section 101 and an image storage / display section 102.

The image photographing unit 101 captures the image information and temporarily stores the information until it is sent to the image storage display unit 102. The image capturing unit 103 takes in image information from the outside and converts it into electronic photographic image information. The photographic image information is sent to and stored in the storage unit 104. The storage unit 104 includes a semiconductor memory, a magnetic disk device, a floppy disk (R) device, or an optical disk device. An IC card with a backup power supply using a semiconductor memory is most suitable because it has no mechanically movable part and can be temporarily stored until information is sent to the image storage / display part. The operation input unit 105 inputs an operation to the image capturing unit 101, such as a shutter that determines the timing of capturing image information. The output of the operation input unit 105 is sent to the shooting control unit 106, and a control signal for controlling the image shooting unit 101 is created. The clock unit 107 outputs the date and time. The date and time when the image information is captured become the supplementary information of the image information and are stored in the storage unit 104 together with the image information.

The image storage / display unit 102 receives and stores image information and incidental information from the image photographing unit, and
Display image information. The image storage display unit 102 receives information from the image capturing unit through the interface 108. When the storage unit 104 of the image capturing unit 101 cannot be removed like a magnetic disk device, the image capturing unit 101
The image storage display unit 102 is directly connected to the image storage display unit 102, and image information and incidental information in the magnetic disk are read through the interface. When the storage unit of the image capturing unit uses a removable medium such as an IC card, a floppy disk (R), or an optical disk, the image storage display unit 102
Instead of the interface 108, a drive device corresponding to each may be attached. The captured image information and incidental information are stored in the storage unit 109. The storage unit 109 of the image storage / display unit 102 uses a magnetic tape device, a magnetic disk device, or an optical disk device because it is necessary to semi-permanently store image information and incidental information and a large capacity is required. The optical disk device is the most suitable because the access is fast and the medium can be exchanged. The operation input unit 110 is a switch, a pen tablet, or the like, and inputs an operation on the image storage display unit 102. The output of the operation input unit 110 is the storage display control unit 111.
And a control signal for controlling the image storage display unit 102 is generated. Further, album information for display is created from the image information and the incidental information taken in the storage unit 109. These pieces of information will be described later. The display control unit 112 creates display data based on the incidental information and the album information and sends it to the display unit 113. The display unit 113 is a unit that displays image data, and uses, for example, a color LCD (liquid crystal display). of course,
A CRT display may be used, or a monitor may be connected outside the image storage / display unit 102.

From the image photographing unit 101 to the image storage / display unit 10
The transfer of information to 2 does not need to be performed every time one image information is captured. That is, the storage unit 1 of the image capturing unit 101
Images may be captured continuously as long as they can be stored in 04, and collectively transferred to the image storage display unit 102. Also in FIG.
The image capturing unit 101 and the image storage display unit 102 can be separated, but of course they may be integrated. In that case, the storage unit 104 for temporary storage of the image capturing unit 101 is not necessary, and the image information and the incidental information are directly written in the storage unit 109 of the image storage display unit 102.

FIG. 2 shows details of the image pickup section 103 in the image pickup section 101 shown in FIG. The light from the outside is the diaphragm 2
An image is formed on a CCD (charge coupled device) 203 through 01 and a lens 202. The aperture control unit 204 changes the aperture of the aperture 201 based on a command from the imaging control unit 106 in FIG. The focus control unit 205 also moves the lens 202 based on a command from the imaging control unit 106.
The diaphragm 201 and the lens 202 are automatically controlled by the photographing control unit 106 in FIG. 1 so that an appropriate exposure and focus image is formed on the CCD 203. CCD control unit 206
Is based on a command from the photographing control unit 106
The image information converted into the electric signal in 3 is transferred to the storage unit. The image information converted into an electric signal by the CCD 203 is E
It is also sent to a VF (electronic view finder) 207 so that the image information can be visually confirmed.

FIG. 3 shows an example of the external appearance of the image photographing section in the present invention. The image capturing section has a shape similar to that of a camera using a normal silver salt film. Front lens 301
Is the same as the lens 202 shown in FIG. This lens is driven by the zoom button 302, and the capturing range of the image can be changed. 2 shutters
The shutter is a multi-stage shutter, and includes a first shutter 303 that is pressed first and a second shutter 304 that is pressed subsequent to the first shutter 303. The liquid crystal panel 305 on the rear surface is used for the output of the EVF 207 of FIG. 2, and the image to be captured is displayed. The liquid crystal panel 305 is also used as a display panel when performing an operation input to the image capturing unit. The operation input is the liquid crystal panel 305.
This is done by selecting the menu displayed on the screen with the input button 306. The connector 307 connects a cable when the image information and the incidental information temporarily stored in the storage unit 104 of the image capturing unit 101 shown in FIG. 1 are read out to the outside. When a device such as a floppy disk (R), an optical disk, or an IC card that can be taken out is used as the storage device 104 of the image capturing unit 101, information may be moved by these media.

FIG. 4 shows an example of the external appearance of the image storage / display section in the present invention. The image storage / display unit uses the liquid crystal panel 401 as the display unit in order to have portability, and has a file size of an A4 document. Switch 402
Is a start switch, and the pen input device 403 is used for all operations other than start. Speakers 404 are provided on the left and right above the liquid crystal panel 401, and audio output is also possible.
FIG. 4 is an example in which an optical disc device is used as the storage unit 109 of the image storage / display unit 102 of FIG. 1, and the optical disc 405 is inserted from the side slot. A cable is connected to the connector 406 to read image information and incidental information from the image capturing unit. Storage unit 10 of image capturing unit 101 in FIG.
When the optical disc device 4 is an optical disc device, the image information and the incidental information can be moved by inserting the optical disc into the slot on the side surface of the image storing and displaying section. Image capturing unit 101
When the storage unit 104 is a floppy disk (R) device or an IC card device, if these devices are provided in the image storage display unit, it is possible to move information without using a cable.

FIGS. 5 to 9 show examples of display screens in the image storage / display section in the present invention. The following screen operations are
Do everything with a pen.

When the image storage / display section is activated, an initial screen in the form of a bookshelf shown in FIG. 5 is displayed. Photo image is album 5
The files are classified into the 01 format and arranged on the bookshelf 502.
These albums are created based on the album list, as described below. When the camera icon 503 is clicked, the mode becomes a mode in which the image information and the incidental information from the image capturing unit are fetched. When the film icon 504 is clicked, a mode for editing a film list, which is a set of image information and incidental information, is entered. Blank album icon 50
Clicking 5 enters a mode for creating a new album and creates an album list from the film list. The film list and album list will be described later. Clicking the exit icon 506 will power down the system.

In FIG. 5, when the spine of the album to be viewed is clicked, the screen is switched to the screen of FIG. The selected album is displayed in a closed state. Here, in addition to the album cover 601, an editing tool icon 602, a bookshelf icon 603, and page turning icons 604 and 605.
Is displayed. The editing tool icon 602 is not selectable. Clicking on the bookshelf icon 603 returns to the initial screen of the bookshelf shown in FIG. By clicking the page-turning icons 604 and 605, the album can be turned left or right.

In FIG. 6, page turning icon 604
When is clicked, a table of contents screen 701 shown in FIG. 7 is displayed. The table of contents screen is an icon that pairs the table of contents name with the page, and you can click on it to jump to that page. When the user clicks the table of contents icon or the page turning icon 604, the photograph screen 801 of FIG. 8 is displayed.

Immediately after the album list is generated, the photograph screen 801 has photographs arranged in a fixed form as shown in FIG. It is enough for normal photo viewing. However, by clicking the edit mode icon 602, the edit operation can be performed on the photographic image. The operations that can be performed in the edit mode are scaling of photo images,
For example, rotation, trimming, moving, or writing a comment with a pen. An example of the editing operation is shown in FIG.

FIG. 10 shows the structure of data in the image capturing section. The plurality of pieces of photo information 1001 are stored in the storage unit in the order in which they were taken.

FIG. 11 shows details of the photograph information. The photo information 1001 is the image information 1 which is the image data itself.
101 and auxiliary information 1102 related to the image information. The image information 1101 is the data of the image itself captured by the photographing unit, and the supplementary information 1102 contains the attribute information about the image. In the first embodiment, the incidental information 1102 includes the photograph number 1103 given in the order of photographing, and the photographing year 1104 and the photographing month 11 when the photograph output from the clock unit 107 in FIG. 1 is photographed.
05, shooting date 1106, and shooting time 1107.

FIG. 12 shows an example of the incidental information in FIG. This is a table format in which only the supplementary information is extracted.

Photo information consisting of the image information and the incidental information of FIG. 10 is stored in the storage unit 104 in the image photographing unit 101 of FIG.
When it has accumulated to some extent, it is transferred to the image storage display unit 102. In the image storage / display unit 102, the film list 1301 as shown in FIG.
To generate. The film list 1301 includes a film header 1302 and photographic information 1001. The photographic information is the same as that shown in FIG. Film header 130
2 is the film number 1303, the number of photos 1304 included in the film list, the transfer year 1305 transferred,
It consists of a transfer month 1306 and a transfer date 1307. The film list 1301 is a source for creating an album list described later, and when the album list is used for display,
The image information included in the film list 1301 is read and displayed. The film list 1301 is stored in the storage unit 109 in the image storage display unit 102 of FIG.

FIG. 14 shows an example of the film header. Only the film header is taken out and tabulated.

FIG. 15 shows the data structure of the album list 1501. The album list 1501 includes an album header 1502 and one or more page lists 1503.

FIG. 16 shows details of the data structure of the album header 1502. The album number 1601 is assigned in the order in which the album list is created, and is unique within the image storage display unit. This is followed by an album name 1602, the number of pages in the album 1603, a page width 1604 and a page width 1605, a cover color 1606, and a pattern 1607.

FIG. 17 shows details of the data structure of the page list 1503. There is one page list 1503 for each page of the album. Page list 1530
Is composed of a page header 1701 and a photograph list 1702. The page header 1701 has a page number 1703, a page name 1704, and a page mount color 1
It consists of 705. The page number 1703 indicates the page number of the album and is unique in the album list 1501.

FIG. 18 shows details of the data structure of the photograph list 1702. There is one photo list 1702 for each photo existing in the page. Photo list 1
702 is a frame number 1801, a film number 1802,
Photo number 1803, trim start position X1804, trim start position Y1805, trim range W1806, trim range H1807, enlargement / reduction ratio 1808, rotation angle 180
9, display position X1810, and display position Y1811. The frame number 1801 indicates the number of the photograph displayed on the page and is unique within the page list 1503. For example, when displaying 3 photos on 1 page,
There are 1 to 3 frame numbers. Film number 18
02 and the photo number 1803 specify the film list and the photos in the film list.
The image information of the photograph is read from the film list. Trim start position X1804 and trim start position Y
Reference numeral 1805 indicates the position at which the trimming of the photo is started by coordinates. A trim range W1806 and a trim range H1807 indicate trimming widths and heights, and trimming is performed with the widths and heights from the coordinates (X, Y) of the trimming start positions 1804 and 1805 described above.
The scaling ratio 1808 indicates the display magnification of the image after trimming. The rotation angle 1809 indicates how many times the image is rotated and displayed. Display position X18
10 and the display position Y1811 are coordinates on the page indicating the position where the photograph is displayed.

FIG. 19 shows a flowchart for generating the album list. First, the album generation condition is set 1901. Based on this, the corresponding photo is identified 1902, an album list is created 1903, and the created album list is saved 1904 in the storage unit. Further, it is judged 1905 whether or not the display is further carried out. When the album display is performed, the image information is read from the film list based on the album list and the album display 1906 is performed. At the end of display,
Album editing or the like is performed to determine 1907 whether or not the album list has been changed. If the album list has been changed, the album list is saved 1908. If not, the processing ends. This flow occurs when the blank spine cover album 505 is selected on the initial screen shown in FIG. 5, and a new album is created.

FIG. 20 shows a flowchart when the album list already exists. The album list is read from the storage unit of the storage display unit 2001, and based on this, image information is read from the film list to display the album display 2
002 is performed. At the end of the display, album editing is performed to determine if there is a change in the album list 2003, and if so, save 2004 of the album list,
If not, the process ends. This flow occurs when the created album 501 is selected on the initial screen shown in FIG.

An example of creating an album list will be described with reference to FIGS. 21, 21, 22 and 12. In the supplementary information shown in FIG. 12, it is assumed that the photo dates of photo numbers 14 to 24 are consecutive, and these photos can be summarized under the theme of travel, for example. Therefore, it is specified that the photos whose dates are continuous from the 13th are grouped together, and that pages are changed for each date to generate an album.

FIG. 21 is a table showing a photograph list generated under these conditions. 11 photos correspond to the conditions and are allocated over 4 pages. The italicized part is the part automatically generated according to the conditions, and the other parts are the default values.

FIG. 22 is a table showing the page list of FIG. As the page attribute, the condition for creating the page, that is, the date when the photograph in the page is taken is included. Also, the color of the mount is the default.
Page attributes can be changed freely. That is, a title or the like can be attached instead of the date.

FIG. 23 is an album header according to FIGS. 21 and 22. The underlined part of the album name is the part entered by the creator and is displayed on the display of the album and on the spine.

FIG. 24 shows this album list, especially FIG.
6 is an example of a table of contents screen displayed based on the page list shown in FIG. FIG. 25 is an example of a screen in which pages 1 and 2 of the album are opened. Not only the photo but also the page number and page attributes are displayed.

As in the display example of FIG. 25, the image is not always upright. Photo 2501, not upright,
Although the 2502 may rotate the photo in the edit mode after displaying it, the second embodiment of the present invention automatically does this. Hereinafter, the second to eighth embodiments will be described focusing on the parts different from the first embodiment, and the other points will be the same as the first embodiment.

In the second embodiment, the image pickup unit is provided with the posture detection unit of the image pickup unit, and the posture of the image pickup unit at the time of shooting the photographic image is added to the photographic image information as supplementary information. FIG. 26 shows the second
It is a block diagram showing an example of. Posture detection unit 2601
Detects how the image capturing unit faces when a photographic image is captured based on gravity. The resolution of the posture is not so required, and the resolution may be about every 45 degrees, for example. The output of the attitude detection unit 2601 is
It is sent to the storage unit 104 together with the output of 07, and becomes the supplementary information of the image information and is stored in the storage unit 104 together with the image information. The blocks other than the posture detection unit 2601 are the same as those in the first embodiment.

FIG. 27 shows an example of photographic information in the second embodiment. In addition to the additional information described in the first embodiment, the shooting attitude 2701 of the shooting unit at the time of shooting an image is added as additional information.

FIG. 28 shows an example of incidental information in the second embodiment. This is a table format in which only the supplementary information is extracted. A shooting posture column 2801 is added to FIG.

FIG. 29 shows the configuration of FIG. 28 in the second embodiment.
4 is a table showing a list of photos in the album list created based on the example of the supplementary information. The generation conditions were the same as in the first embodiment. The italicized part is the part automatically generated according to the conditions, and the other parts are the default values. The data of the rotation angle column 2901 at the time of displaying an image is automatically created from the shooting posture in the accompanying information.

FIG. 30 shows one of the albums displayed on the basis of this album list, the photo list shown in FIG.
It is an example of a screen with two pages opened. Compared to FIG. 25, it can be seen that the photo is displayed in the correct orientation.

In many cases, when a photograph is taken, it is difficult to know where it was taken by reviewing it later. In addition, when traveling, the towns are often classified according to the photographed town.

In the third embodiment, the image shooting section has a shooting location input section, and the shooting location of the photographic image is added to the photographic image information as additional information. FIG. 31 is a block diagram showing a third embodiment. The shooting location input unit 3101 inputs a location where a photographic image is to be shot from the outside and holds it until the next input. The output of the shooting location input unit 3101 is sent to the storage unit 104 together with the output of the clock unit 107, and when a picture is taken, the output becomes supplementary information of the image information and is stored in the storage unit 104 together with the image information. Shooting location input unit 310
The blocks other than 1 are the same as those in the first embodiment.

FIG. 32 shows an example of photographic information in the third embodiment. In addition to the additional information described in the first embodiment, the shooting location 3201 at the time of shooting an image is added as additional information.

FIG. 33 shows an example of the incidental information in the third embodiment. This is a table format in which only the supplementary information is extracted. A column 3301 of shooting locations is added to FIG.

FIG. 34 shows the configuration of the third embodiment shown in FIG.
4 is a table showing a list of photos in the album list created based on the example of the supplementary information. The generation condition was that the shooting location was "Chiba". The italicized part is the part automatically generated according to the conditions, and the other parts are the default values.

When one image photographing section is used by a plurality of persons, the photographs taken by the persons are mixed. This tendency becomes stronger especially when the storage capacity of the image capturing unit is large and several hundred images can be stored.

In the fourth embodiment, the image capturing section has a photographer input section and the photographer of the photographic image is added to the photographic image information as supplementary information. FIG. 35 is a block diagram showing the fourth embodiment. The photographer input unit 3501 inputs a person who takes a photographic image from the outside and holds it until the next input. The output of the photographer input unit 3501 is the clock unit 107.
Is sent to the storage unit 104 together with the output of, and when a photograph is taken, it becomes supplementary information of the image information and is stored in the storage unit 104 together with the image information. The blocks other than the photographer input unit 3501 are the same as those in the first embodiment.

FIG. 36 shows an example of photograph information in the fourth embodiment. In addition to the supplementary information described in the first embodiment, the photographer 3601 of the image is added.

FIG. 37 shows an example of the incidental information in the fourth embodiment. This is a table format in which only the supplementary information is extracted. A photographer's column 3701 is added to FIG.

FIG. 38 shows the configuration of FIG. 37 in the third embodiment.
4 is a table showing a list of photos in the album list created based on the example of the supplementary information. The generation condition was that the photographer was “Mr. Kiyoshi Matsumoto”. The italicized part is the part automatically generated according to the conditions, and the other parts are the default values.

It is common to miss a photo opportunity, such as closing one's eyes at the moment the shutter is pressed. In the fifth embodiment, a sub photographic image is taken at a time close to the moment when the main photographic image is taken,
It is added to the main photographic image information as supplementary information of the main photographic image. Further, a desired image is selected from the main photographic image information or the sub photographic image information which is the supplementary information, and the selected image is displayed on the image storage display section.

When looking at the photograph later, it is often out of focus. In the sixth embodiment, a sub-photo image whose focus is changed is photographed at a time near the moment when the main photo image is photographed, and is added to the main photo image information as supplementary information of the main photo image. Further, a desired image is selected from the main photographic image information or the sub photographic image information which is the supplementary information, and the selected image is displayed on the image storage display section.

When looking at photographs later, it is often the case that the aperture is not appropriate. In the seventh embodiment, a sub-photo image with a different aperture is photographed at a time near the moment when the main photo image is photographed, and is added to the main photo image information as supplementary information of the main photo image. Further, a desired image is selected from the main photographic image information or the sub photographic image information which is the supplementary information, and the selected image is displayed on the image storage display section.

FIG. 39 is a block diagram showing the recording / reproducing apparatus in the fifth, sixth and seventh embodiments. In the image capturing unit 3901, the image capturing unit 3902 captures an image from the outside and converts it into electronic image information. The image information is sent to the buffer 3903 and stored. Buffer 39
03 can store a plurality of photographic images. The difference calculator 3904 reads the image information from the buffer 3903 and calculates the difference between the images. Difference calculator 3904
Has a function of passing image information without performing difference calculation. The output of the difference calculator 3904 is the image compression unit 3905.
Sent to and compressed. The output of the image compression unit 3905 is sent to the storage unit 3906 and stored therein. Clock part 3907,
The storage unit 3906 is the same as in the first embodiment. For the image storage / display unit 3908, the image decompression unit 3
909 is provided. This is for expanding the image compressed by the image capturing unit 3901. Other parts are the same as those in the first embodiment.

The operation of the fifth embodiment will be described with reference to FIGS. 40, 2, 3, and 39. In the image capturing unit shown in FIG. 3, when the first shutter 303 is pressed, the aperture control unit 204 and the focus control unit 205 in FIG. 2 start operating, and the subject is automatically focused and focused. After that, the information from the image pickup unit in FIG. 39 is loaded into the buffer 3903 at certain time intervals, for example, at 0.3 second intervals. The buffer 3903 is a FIFO (First In First Ou).
t), and when the buffer 3903 is full, old image information is discarded. Second shutter 3 of FIG.
When 04 is pressed, the image at that time becomes the main image,
Along with the capture, several screens of subsequent images are captured. After that, the main image is used as the reference image, and the difference calculator 3904 calculates the difference between the main image and the sub images before and after the reference image. Figure 40
Is an example of using a reference image and two images before and after the reference image. The main image when the second shutter 304 is pressed is the reference image 4001, and the previous image-2 (4
002), image-1 (4003), and the subsequent image +1
(4004), image + 2 (4005) in the buffer 390
Accumulate to 3. The buffer 3903 starts with the reference image 400.
1 is sent to the difference calculator 3904. Difference calculator 3904
Passes this image and sends it to the image compression unit 3905.
The difference calculator 3904 then calculates the difference between the image-1 (4003) and the reference image 4001 and sends the result to the image compressor 3905. Similarly, the differences between the image + 1 (4004), the image-2 (4002), the image + 2 (4005) and the reference image are calculated and sent to the image compression unit 3905.
The image compressing unit 3905 compresses the sent image and sends it to the storage unit 3906.

The operation of the sixth and seventh embodiments will be described with reference to FIGS. 41, 2, 3, and 39. When the first shutter 303 is pressed in the image capturing unit shown in FIG. 3, the aperture control unit 204 and the focus control unit 205 in FIG. 2 start to operate, and the subject is automatically focused and focused. When the second shutter 304 is pressed, the image at that time is taken as the main image, and the subsequent images are taken as sub-images in several screens at short time intervals. Regarding the sub-image, the focus is shifted in the sixth embodiment and the aperture is shifted in the seventh embodiment as compared with when the main image is captured. After the image is captured, the main image is used as the reference image and the difference calculator 39 with the sub image is used.
The calculation is performed by 04. FIG. 41 is an example in which a main image is used as a reference image and four subsequent sub-images are used.
The main image when the second shutter 304 is pressed is the reference image 4101 and the image behind it is image-1 (410).
2), image +1 (4103), image-2 (4104),
The image + 2 (4105) is stored in the buffer 3903. −
Indicates that the focus or diaphragm is moved in the negative direction, and + indicates that it is moved in the positive direction. 1 and 2 indicate the degree of movement. That is, +2 means to move more in the positive direction than +1. The buffer 3903 first sends the reference image 4101 to the difference calculator 3904. The difference calculator 3904 passes this image and sends it to the image compression unit 3905. The difference calculator 3904 then calculates the image-1 (4102) and the reference image 41.
The difference of 01 is calculated, and the result is sent to the image compression unit 3905. Similarly, image +1 (4103), image-2 (41
04), the difference between the image + 2 (4105) and the reference image is calculated and sent to the image compression unit 3905. The image compression unit 3905 compresses the received image, and the storage unit 390
Send to 6.

FIG. 42 is a diagram showing the data structure of photographic information in the fifth, sixth and seventh embodiments. Image information 4
Reference information obtained by compressing the reference image (4001 or 4101) is entered in 201, and the image-1
(4003 or 4102), image +1 (4004 or 4103), image-2 (4002 or 4104),
Image +2 (4005 or 4105) and reference image (40
01 or 4101) compressed difference information-1
(4202), difference information + 1 (4203), difference information−
2 (4204) and difference information +2 (4205) are arranged.

FIG. 43 is an example in which the photo lists in the album list in the fifth, sixth and seventh embodiments are tabulated. Similar to the first embodiment except that a display number column 4301 is provided. Immediately after the album list is generated, the default display number is 0. That is, this indicates that the main image is displayed. However, when the image of the main image is not good and the sub image is better, the sub image can be selected. The number of the selected sub image is recorded in the display number column. The underlined numbers in FIG. 43 are examples. When you read the album list next time and display the album,
The secondary image is displayed instead of the primary image.

Although the photograph is a still image, it is more impressive and attractive if the surrounding sound at the time of photographing or a voice comment is added to the photograph. In the eighth embodiment, the voice information at the shooting location is recorded at a time close to the moment when the photographic image is taken, and is added to the photographic image information as supplementary information of the photographic image. Furthermore, when this photographic image information is displayed, it is possible to reproduce audio information that is incidental information.

FIG. 44 is a block diagram showing a recording / reproducing apparatus in the eighth embodiment. The image capturing unit 4401 is provided with a microphone 4402, which captures voice from the outside and converts it into electronic voice information. The voice information is sent to the buffer 4403 and stored. The buffer 4403 can store about 10 seconds of audio information. The output of the buffer 4403 is sent to the storage unit 4405 and stored together with the image information from the imaging unit. For other parts,
It is similar to the first embodiment. A voice output unit 4408 is provided for the image storage display unit 4407. This is to reproduce the audio information. Other parts are the same as those in the first embodiment.

The operation of the eighth embodiment will be described with reference to FIGS. 45, 3 and 44. When the first shutter 303 is pressed in the image capturing unit shown in FIG. 3, the sound 4501 from the microphone 4402 in FIG. 44 starts to be taken into the buffer 4403. The buffer 4403 is a FIFO (Firs
t In First Out), and when the buffer 4403 is full, old image information is discarded. When the second shutter 304 in FIG. 3 is pressed, the captured image is captured and the subsequent sound 4501 is captured for several seconds. After that, the sound 4501 before and after the moment when the image is captured is taken out from the buffer 4403 and is stored together with the image information in the storage unit 440.
Send to 5.

FIG. 46 is a diagram showing a data structure of photographic information in the eighth embodiment. Voice information 4601 is added to the supplementary information.

FIG. 47 is an example in which the photograph list in the album list in the eighth embodiment is tabulated. It is the same as the first embodiment except that a voice information column 4701 is provided. When generating the album list, the presence of voice information is checked, and 1 is entered if the voice information is present, and 0 is entered if it is not present. When displaying the album, the column 4701 of this audio information is checked, and the audio can be reproduced for the photo in which the audio exists.

The first to eighth embodiments described above can be carried out independently or in combination.

[0084]

As described above, according to the present invention, it is possible to provide an image recording / reproducing apparatus capable of easily organizing and storing photographic images and displaying the photographic images for viewing. You can Further, it is possible to provide an image recording / reproducing device capable of reducing the failure of taking a photographic image.

[Brief description of drawings]

FIG. 1 is a block diagram of a first embodiment.

FIG. 2 is a detailed block diagram of an image pickup unit.

FIG. 3 is a plan view showing an example of the appearance of an image capturing unit.

FIG. 4 is a plan view showing an example of the external appearance of an image storage display unit.

FIG. 5 is a plan view showing a screen display example.

FIG. 6 is a plan view showing a screen display example.

FIG. 7 is a plan view showing a screen display example.

FIG. 8 is a plan view showing a screen display example.

FIG. 9 is a plan view showing a screen display example.

FIG. 10 is a data structure diagram in the image capturing unit.

FIG. 11 is a detailed data structure diagram of photographic information.

FIG. 12 is a chart showing an example of incidental information.

FIG. 13 is a data structure diagram of a film list.

FIG. 14 is a chart showing an example of a film header.

FIG. 15 is a data structure diagram of an album list.

FIG. 16 is a data structure diagram of an album header.

FIG. 17 is a data structure diagram of a page list.

FIG. 18 is a data structure diagram of a photograph list.

FIG. 19 is a flowchart of album list generation.

FIG. 20: Flow chart of display when album list exists
Figure.

FIG. 21 is a table showing an example of a photograph list.

FIG. 22 is a table showing an example of a page list.

FIG. 23 is a table showing an example of an album header.

FIG. 24 is a plan view showing an example of a table of contents screen.

FIG. 25 is a plan view showing a screen display example.

FIG. 26 is a block diagram of the second embodiment.

FIG. 27 is a data configuration diagram showing an example of photographic information.

FIG. 28 is an example of additional information.

FIG. 29 is an example of a photograph list.

FIG. 30 is an example of a display screen.

FIG. 31 is a block diagram of a third embodiment.

FIG. 32 is an example of photographic information.

FIG. 33 shows an example of additional information.

FIG. 34 is an example of a photo list.

FIG. 35 is a block diagram of a fourth embodiment.

FIG. 36 is an example of photographic information.

FIG. 37 shows an example of additional information.

FIG. 38 is an example of a photo list.

FIG. 39 is a block diagram of fifth, sixth and seventh embodiments.

FIG. 40 is a diagram for explaining the operation of the fifth embodiment.

FIG. 41 is a diagram for explaining the operation of the sixth and seventh embodiments.

FIG. 42 is a data structure of photographic information.

FIG. 43 is an example of a photo list.

FIG. 44 is a block diagram of an eighth embodiment.

FIG. 45 is a diagram for explaining the operation of the eighth embodiment.

FIG. 46 is a data structure diagram of photographic information.

FIG. 47 is a table showing an example of a photograph list.

[Explanation of symbols]

101 ... Image photographing unit, 102 ... Image storage display unit, 103
... image pickup unit, 104 ... storage unit, 105 ... operation input unit, 10
6 ... Shooting control section, 107 ... Clock section, 108 ... Interface, 109 ... Storage section, 110 ... Operation input section, 111
... save display control unit, 112 ... display control unit, 113 ... display unit, 201 ... diaphragm, 202 ... lens, 203 ... CCD,
204 ... Aperture control unit, 205 ... Focus control unit, 206 ... C
CD control unit, 207 ... EVF, 301 ... Lens, 302
... Zoom button, 303 ... First shutter, 304 ...
Second shutter, 305 ... Liquid crystal panel, 306 ... Operation button, 307 ... Connector, 401 ... Liquid crystal panel, 40
2 ... switch, 403 ... pen input device, 404 ... speed
F, 405 ... Optical disc, 406 ... Connector, 501 ...
Album icon, 502 ... bookshelf, 503 ... camera icon, 504 ... film icon, 505 ... blank icon, 506 ... end icon, 601 ... cover page, 602 ... edit icon, 603 ... bookshelf icon, 604 ... turning icon, 605 ... turning icon , 1001 ... Photo information, 1101 ... Image information, 1102 ... Supplementary information, 130
1 ... Film list, 1302 ... Film header, 15
01 ... Album list, 1502 ... Album header, 1
503 ... page list, 1701 ... page header, 17
02 ... Photo list, 2601 ... Attitude detection unit, 2701 ...
Posture information, 3101 ... Shooting place input unit, 3201 ... Shooting place, 3501 ... Photographer input unit, 3601 ... Photographer, 3
901 ... Image shooting unit, 3902 ... Imaging unit, 3903 ... Buffer, 3904 ... Difference calculator, 3905 ... Image compression unit, 3906 ... Storage unit, 3907 ... Clock unit, 3908 ...
Image storage / display unit, 3909 ... Image decompression unit, 4001 ... Reference image, 4101 ... Reference image, 4201 ... Image information, 4
401 ... Image capturing unit, 4402 ... Microphone, 4403 ... Buffer, 4404 ... Imaging unit, 4405 ... Storage unit, 440
6 ... Clock part, 4407 ... Image storage display part, 4408 ... Audio output part, 4501 ... Audio, 4601 ... Audio information.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) // H04N 101: 00 H04N 5/91 J (72) Inventor Kazuto Senda 1-280, Higashi Koikeku, Kokubunji, Tokyo Address F-term in Central Research Laboratory of Hitachi, Ltd. (reference) 5C022 AA13 AB21 AC42 AC69 5C052 AB05 AC08 CC01 DD02 5C053 FA10 GB06 GB11 GB21 HA29 JA03 JA16 KA24 LA01 5D044 AB05 AB08 AB09 DE17 DE49 EF05 FG18 GK08 GK12 5D110 DA25 A27 AA27 A27 DA17 DC16 EA07 FA02 FA08

Claims (20)

[Claims] 1. An image recording / reproducing apparatus comprising an image capturing section for capturing an image and converting it into image information, and an image storing / reproducing section for storing and displaying the captured image information, and an accessory for the image together with the image information when capturing the image. An image recording / reproducing apparatus, characterized in that a means for acquiring information is provided in an image capturing section, additional information is added to the image information, and the image storage / display section displays the image information based on the acquired additional information. 2. An image capturing unit for converting the image into captured information and an image storage display unit for storing the captured image information and performing live display can be separated from each other. 1. The image recording / reproducing apparatus described in 1. 3. The image information recording / reproducing apparatus according to claim 2, wherein the image capturing unit includes an image capturing unit that captures an image and converts the image into image information, and a storage unit that stores the image information. 4. The image information recording / reproducing apparatus according to claim 1, wherein the image capturing section is provided with a clock, and the date and time when the image information is acquired is added to the image information as supplementary information. 5. The image information recording according to claim 4, wherein the image storing and displaying section classifies and displays the image information based on incidental information which is the date and time when the image information is acquired. Playback device. 6. The image capturing section is provided with means for detecting the orientation of the image capturing section, and the orientation of the image capturing section at the time of acquiring the image information is added to the image information as supplementary information.
The described image information recording / reproducing apparatus. 7. The image information according to claim 6, wherein the image storage / display unit changes a display direction of the image information based on incidental information which is a posture of the image pickup unit when the image information is acquired. Recording / playback device. 8. The image according to claim 1, further comprising means for inputting a place where the image information is obtained to the image photographing unit, and the place where the image information is obtained is added to the image information as supplementary information. Information recording / reproducing apparatus. 9. The image information recording / reproducing apparatus according to claim 8, wherein the image storage / display unit classifies and displays the image information based on incidental information which is a place where the image information is acquired. . 10. The image according to claim 1, further comprising means for inputting a person who has photographed the image information to said image photographing section, and adding the person who has photographed the image information to the image information as supplementary information. Information recording / reproducing apparatus. 11. The image information recording / reproducing apparatus according to claim 10, wherein the image storage / display unit classifies and displays the image information based on incidental information of a person who has photographed the image information. . 12. The image capturing unit comprises means for acquiring image information of a captured main image, and means for acquiring a secondary image related to the primary image, and image information using the secondary image as supplementary information. The image information recording / reproducing apparatus according to claim 1, wherein the image information recording / reproducing apparatus is provided. 13. The image information recording / reproducing apparatus according to claim 12, wherein the image capturing section acquires the sub-image information with a time lag with respect to the main image information. 14. The image information recording / reproducing apparatus according to claim 12, wherein the image capturing section acquires the sub-image information while shifting the focus from the time of acquiring the main image information. 15. The image information recording / reproducing apparatus according to claim 12, wherein the image capturing section acquires the sub-image information by shifting a focus of an aperture from a time when the main image information is acquired. 16. The image information recording according to claim 13, wherein a difference between the sub image information and the main image information is calculated, and the difference is compressed and added to the main image information as supplementary information. Playback device. 17. The image information recording / reproducing apparatus according to claim 12, wherein the image storing / reproducing section displays an optimum one of the main image and the sub image. 18. The image capturing section comprises means for acquiring image information and means for acquiring voice information related to the image information, wherein the voice information is added to the image information as supplementary information. The image information recording / reproducing apparatus according to claim 1. 19. The image information recording / reproducing apparatus according to claim 18, wherein the audio information is acquired over a time period before and after the time when the image information is acquired. 20. The image information recording / reproducing apparatus according to claim 18, wherein the image storing / reproducing unit reproduces the audio information related to the displayed image information when the image information is displayed.