JP2003196318A - Method and device for displaying image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable arrangement/appreciation of still images by an electronic album and to enable rough retrieval and detailed retrieval of the still images. <P>SOLUTION: Reduced images 601 are displayed on a negative film display area 600 by a list, the reduced images 601 are sequentially switched, displayed in response to user's requests, when the electronic album is creased, a reduced image 601 selected by a user is converted into an image 561 for album with default size, arranged at a position specified by the user or a default position of the page picture 560, when the electronic album is appreciated, the image 561 for album is displayed on the page picture 560 based on album management information 43, pages are turned by switching the page picture 560 in response to the user's request, the image 561 for album selected by the user is converted into a magnified image 581, displayed in a magnified image display area 580, other magnified images 581 are sequentially displayed in response to the user's request, when the magnified image 581 is edited, it is re-converted into the image 561 for inverted album and displayed on the page picture 560. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a still image display method and device for displaying still images such as digitized photographic images on a display device, and more particularly to an electronic album intended for general household users. The present invention relates to a still image display method for organizing and viewing still images in a device (hereinafter, electronic album device).

[0002]

2. Description of the Related Art As the basic technology for digitizing photographic images has been completed, such as the cost reduction of electronic cameras and the spread of photo CDs (a service for writing films taken by ordinary cameras to CD-ROMs), the digitized stillness has been established. Expectations are high for a still image filing system that saves, retrieves, edits, and displays images. In particular, in general households, there is a demand for an electronic album device that easily organizes, edits, and stores a large number of photograph images taken every year, and quickly retrieves and displays a desired photograph.

As a technique related to such an electronic album device, Nikkei Trendy No. 63 December 1992 issue,
There are those described in P90 to P93. Photo CD above
The above still image is displayed on the TV screen, and it also has editing functions such as scaling, rotation, and movement of the image. Here, as a first still image display method, a method is used in which the user specifies the ID number given to the still image and displays it one by one on the entire screen.

Further, in a general still image filing system, the main purpose is to find out what a user wants from stored still images and display it. Therefore, as a second still image display method, a still image display method has been proposed in which reduced images of still image data are displayed as a list on a display and the reduced images selected by the user are enlarged and displayed.

Furthermore, there is a third still image display method for displaying an electronic album in which at least one or more still images are arranged in a specific area, such as an album for silver halide photography (Japanese Patent Laid-Open No. Hei 5 (1993) -58). 108732). This method has the effect that visually organized still images can be enjoyed as easily as an album of silver halide photographs.

[0006]

In the first method,
While the user can search for a still image in detail, in order to specify the still image, the user must remember the ID number or see the correspondence table between the ID number and the reduced image. Therefore, if the ID number is forgotten or the correspondence table is lost, it is troublesome to display all the still images in the storage device and search for the target still image. Moreover, in the method of displaying still images one by one on the entire screen, it takes a long time to display, and still images cannot be searched effectively. Even in the method of searching for and displaying the keyword added to the still image, the same problem as described above occurs when the keyword is forgotten.

Therefore, there is a method in which the user actually looks at the reduced image of the still image and retrieves it, as in the second method.
Since it is a reduced image, it can be displayed on the display in large numbers, and scrolling is faster than the original image. Since the selected reduced image can be easily converted into an enlarged image, the user can also view the still images one by one.

On the other hand, in the electronic album apparatus intended for general household users, there is a demand for organizing still images based on a certain purpose. For example, it is a matter of course for the user to organize the pictures taken when he or she went there and to post a comment along with the pictures. On the album of silver halide photos, the user organizes the photos by freely pasting the photos on the page.

Further, once the still images are sorted, it is possible to search for the still images based on the sorted contents. For example, in an album of silver halide photographs, a search is performed by flipping through the albums using the spatial information in which the photographs are arranged and comments added to the photographs as keys.

Therefore, a first object of the present invention is to quickly search for a still image, to search for a still image in detail, and to search using still visual contents organized visually as a key. It is to provide a still image display method effective for one use.

However, in the silver halide photo album,
There is also a problem that it takes a certain amount of time to organize the photos and create the album, which is troublesome.
Generally, when a child is born for the first time, he often takes a lot of photographs and arranges them frequently, but as the child grows up, he often piles up the photographs in a closet.

The third method has the merit that the electronic album can be viewed with the same ease as the silver halide photograph album, but on the other hand, the album included in the silver halide photograph album is created. It also has the problem of labor.

Therefore, a second object of the present invention is to provide a still image display method for a user to easily organize and edit still images to create an electronic album.

[0014]

Therefore, according to the present invention, in a still image display device for displaying a still image stored in a storage device in response to a request from a user, the still image stored in the storage device is displayed. A first reduced image whose size is fixed with respect to one still image, a second reduced image which is variable in size and editable, and an enlarged image whose resolution is larger than the two types of reduced images are created. The first reduced image is displayed in a regular array, the second reduced image is displayed in a predetermined layout, and the enlarged image is displayed when the user requests.

Since the first reduced image is displayed in a regular array and the process for scrolling the first reduced image in response to the user's request is provided, the user actually sees the reduced image of the still image. However, you can search roughly and quickly. The second reduced image is arranged and displayed by being edited in advance by the user or by defining the layout, and the second display area is scrolled in response to the user's request. Therefore, the user can not only view the electronic album as easily as a silver salt album, but also search with the organized contents as a key. In the third display area, the enlarged images are displayed one by one, and the enlarged images are sequentially switched and displayed in response to a request from the user, so that the user can perform a detailed search to see the details of the still image.

Further, according to the present invention, the first reduced image selected by the user is automatically converted into the second reduced image of a predetermined size, and the second reduced image is displayed in the second display area. Since it is arranged at the position specified by the user or the position specified by the program, it is possible to save the trouble of creating an electronic album.

Further, according to the present invention, since the processing for converting the second reduced image and the enlarged image into each other is provided, the second reduced image is enlarged and edited or viewed in detail, and the edited result is obtained. Can be reflected again in the second reduced image.

[0017]

1 is a diagram showing a still image display method according to the present invention and an electronic album apparatus using the method. The main components of the electronic album device are a display 1 for displaying a still image, a CPU 2 for controlling the whole, an input device 3 for a user to input a command, a memory 4 for storing programs and data, a still image and an album. An image database 5 for managing information. In addition, as a peripheral device for data input / output, a microphone / speaker 11 for inputting / outputting sound data and an HDTV 12 for outputting a high-definition still image
And a color printer that prints still images or albums 1
3, a color scanner 14 that digitizes still images stored as paper data, an IC card 15 that stores still images captured by an electronic camera, and a photograph captured by a normal camera is electronically printed. The photo CD 16 is provided, and these are controlled by the peripheral device interface 10.

The first feature of this embodiment is that the display 1
A negative film search process 21 for displaying a list of reduced images 601 in the upper negative film display area 600, a negative film scroll process 31 for sequentially switching and displaying the reduced images 601 in response to a user's request, and a page screen on the display 1. An album display process 23 for displaying an image 561 for an album on the basis of the album management information 43 in 560;
A page turning process 33 for switching and displaying the page screen 560 according to a user's request, an enlarged image display process 26 for displaying one enlarged image 581 in the enlarged image display area 580 on the display 1, and a request from the user The electronic album program 20 holds the enlarged image scroll processing 36 for sequentially displaying another enlarged image 581 according to the above.

The second feature of this embodiment is that the electronic album program 20 includes a negative film display area 60.
There is provided the album creating process 22 for converting the reduced image 601 selected by the user at 0 into the image 561 for the album of the default size and arranging this at the position designated by the user or the default position in the page screen 560. . Note that the album creating process 22 can also automatically determine the default position based on the photo attribute information 42.

Furthermore, the third feature of this embodiment is that the electronic album program 20 has an enlarged image 581 from the album image 561 selected by the user on the page screen 560.
The photo selection processing 25 for converting the image into the enlarged image display area 580 and the enlarged image 581 is edited and then converted again into the album image 561 and displayed on the page screen 560. Has been established.

The electronic album program 20 analyzes the command input by the user from the input device 3 and activates an appropriate program. Further, in the image database 5, the original photograph storage unit 51 for storing and managing the original images of the reduced image 601, the album image 561, and the enlarged image 581.
An album management information storage unit 52 that stores and manages the album management information 43 and a photo attribute information storage unit 53 that stores and manages the photo attribute information 42 are provided. Although it is conceivable to store each image data as it is in the image database instead of the original photo, in the present embodiment, each image data is created at the time of execution from the original photo in the image database 5 and stored in the memory. I will explain how to do.

FIG. 2 shows the appearance of an electronic album device using the still image display method of the present invention. Electronic album device 60
Uses the liquid crystal display 61 and the pen input device 62 in consideration of the portable type. In addition, the electronic album device 60
Is a storage medium 63 such as a photo CD or an electronic camera IC
A card or the like can be inserted to input still image data or moving image data, and further, a microphone 64 for inputting sound data and a speaker 65 for outputting sound data are provided. With such a configuration, not only can it be operated as easily as a silver salt photo album, but it can also handle video data and sound data that could not be handled by a silver salt photo album by adding it to still image data. You can

The data structure of this embodiment is designed with reference to the data model shown in FIG. As shown here, the electronic album program 20 according to the present embodiment has two types of data groups, that is, material data and album management data (album management information 43).

First, as material data, an original photograph 74 and a negative film 72 corresponding to a frame and a negative of a silver halide photograph.
There is. The negative film 72 manages the original photograph 74 as a list (original photograph list 73). For example, forty-eight original photographs 74 are combined into one negative film 72. The electronic album program 20 holds a plurality of negative films 72 and manages them as a negative film list 71. Further, in the original photograph 74, photograph attribute information 75 such as photographing date / time, photographing place, photographer, and subject can be defined.

On the other hand, the album management information 43 corresponds to the layout information and editing information of the photos in the electronic album.
The electronic album program 20 has at least one album 81 and all albums in the album list 80.
Manage as. One album 81 has a title 82
It has a table of contents 83 and at least one page 85, and manages all pages as a page list 84. Also, the page has at least one or more photographs 88, and manages them as a photograph list 87. Further, a page background image 86 to which text or handwritten input data is pasted as bitmap data is held on the page.

In the image database 5 shown in FIG.
A negative film list file 76 for saving the negative film list 71 and an original photo list file 77 for saving the original photo list 73 are managed by the original photo storage unit 51. Also, an album list file 90 that saves the album list 80, a page list file 91 that saves the page list 84, a photo list file 93 that saves the photo list 87, and a page background image file 92 that saves the page background image 86. Are managed by the album management information storage unit 52. Further, the photo attribute information file 78 storing the photo attribute information 75 is managed by the photo attribute information storage unit 53.

4 to 10 are tables showing details of each data structure. First, FIG. 4 is a table of the negative film list 71. Each record includes a negative ID 100 that is unique within the electronic album program 20, a negative name 101 that can be defined by the user, a creation date 102 and a creator 103 that created the negative film 72, and a negative film 72.
The number of photographs 104 registered within and the negative film 72
Access authority 105 that defines the users who can access the
And are registered for each negative film 72. The access authority 105 indicates the read authority and the write authority of the creator, the read authority and the write authority of the group user to which the creator belongs, and the read authority and the write authority of other users, respectively, from the upper bits, and 1 is acceptable and 0 is not. means.

FIG. 5 is a diagram schematically showing the original photograph list 73. A plurality of original photographs 74 are collectively managed as an original photograph list 73, and a unique I within the negative film 72 is managed.
It has a D number (frame ID 112). Since each original photo is fixed to a fixed size (720 × 480 in this embodiment), the order in which each original photo is stored corresponds to the frame ID 112. Also, the electronic album program 20 is the original photo 7.
Since 4 is managed by a set of the negative ID 100 and the frame ID 112, the original photo list file 77 has a file name uniquely determined from the negative ID 100 of the negative film 72. For example, if the negative ID 100 is 0001,
The original photo list file contains nega0001. Give it a name such as pst. The reduced image 601 in FIG. 1 has a size defined by the program (180 × 12 in this embodiment).
The original photo 73 is thinned out so as to be 0), and the album image 561 is created by editing the original photo 73 based on the content defined by the photo list 87. Further, the enlarged image data 581 is also created by editing the original photo 73 based on the content defined by the photo list 87. However, the enlargement / reduction ratio 169 shown in FIG. 9 is not referred to, and the size of the original photo 73 is edited as it is.

FIG. 6 shows a table of photograph attribute information 75 defined for each original photograph 74. In the present embodiment, the photograph date / time 122, the photographer 123, and
The shooting location 124 and the subject 125 can be defined. Also, each record 126 in the table has a negative ID 1
00 and the frame ID 112 can be associated with each original photograph 74. Since recent cameras can print the date on a photograph, the shooting date / time 122 can be automatically registered by providing a means for automatically recognizing the date. However, other attributes need to be directly input by the user at the present time, so it is not necessary to have all four attributes for each original photograph 74.

FIG. 7 is a table of the album list 80. Each album 81 has a unique album ID 130 in the electronic album program 20 as shown by each record 140 in FIG. 7, and the album name 1 defined by the user 1
31, album creation date 132 and creator 133
, Page number 134, page width 135 and page width 136, album cover color 137 and style 1
38 and access authority 139. Here, the page number 134 includes one cover page and two index pages. The unit of the page vertical width 135 and the horizontal width 136 is the number of dots on the screen. The style of the cover page is selected from those defined in advance by the electronic album program 20, but can be defined by the user. Also, access authority 139
The numbers are as described in FIG. 4 above. For an album that is desired to be kept secret even to others and family, it is sufficient to set 110000 to this access right 173.

FIG. 8 is a table of the page list 84. Each record 156 corresponds to the page 85, and is identified by the album ID 130 and the page number 151 unique in the album. The cover page and table of contents page are not included in this page number. Each record 156 includes a page name 152 defined by the user, a page creation date 153,
The color 154 of the page mount and the number of photographs 155 pasted in the page are recorded. In addition, page name 152
The page that defines is the table of contents. In the example of FIG. 8, page numbers are displayed on the table of contents screen with page numbers 0001, 0003, and 0004 as the table of contents. Also, the color of the page mount 1
Although the program automatically defines white as a default value by 54, the user can freely change it, which further deepens the impression of the page.

FIG. 9 is a table of the photograph list 87. Each record 174 corresponds to the photograph 88, and is identified by the album ID 130, the page number 151, and the photograph ID 162 unique in the album. The photograph 88 does not have a substantial image, and the original photograph 74 acquired from the negative ID 100 and the frame ID 112 is trimmed from the X coordinate 165 and the Y coordinate 166 by the width 167 and the height 168, and the enlargement / reduction ratio 169 is obtained.
According to the above, interpolation or thinning is performed, the image is rotated clockwise by the angle described in the rotation angle 170, and displayed at the position indicated by the X coordinate 171 and the Y coordinate 172 on the page screen. In this embodiment, the page screen size is defined as 1024 × 768. Further, the coordinate values and ranges in FIG. 9 are in units of the number of dots, and the upper left is the origin. When the user edits the page screen, the original picture 74 is not directly changed, but the original picture 74 shown in FIG.
The data in each record 174 therein is changed to create the album image 561 or the enlarged image 581. Further, the access right 173 allows the user to set a photograph that he / she wants to hide even in other people and family. Further, although not shown in FIG. 9, the mask type and size can be registered as the mask information of the photograph 88.

The page background image 86 holds text to be displayed on each page and bitmap data of handwriting input. The text code is managed in the table shown in FIG.
Create bitmap data from this table. That is, the electronic album program 20 manages each record with a unique text ID 182 in the album, recognizes the page to be displayed from the album ID 130 and page number 151 held for each record 190, and sets the character string 183 to the font 184. It is arranged at the position indicated by the X coordinate 187 and the Y coordinate 188 of the page screen according to the size 185 and the typeface 186.

Next, the processing of the program in this embodiment will be described with reference to the PADs shown in FIGS. 11 to 21 and the screen examples shown in FIGS. 22 to 36. (1) Start / End Processing When the electronic album program 20 is started, first, FIG.
The start / end processing shown in is executed. In step 201, GUI (Graphical User Interface) initialization processing necessary for executing the electronic album program 20 and user identification by password input are performed.
Next, in step 202, the album list is loaded into the table, and in step 203, a bookshelf screen 500 as shown in FIG. 21 is created and displayed. The bookshelf screen 500 displays an image 501 of a bookshelf that has been created in advance, and a spine cover icon 502 of each album is displayed on the image 501. At this time, the appearance of the icon is created from the cover color 137 and the cover style 138 of the album list table shown in FIG. 7, and the album name 131 is set in the center 50 of the icon.
Display in 3. Further, in step 204, the following processing is executed until the end button 507 in FIG. 21 is selected.

First, the user selects each spine cover icon 50.
Select the album you want to see by picking 2. When an album is selected, the program executes album processing 220. The bookshelf screen 500 also displays a blank album icon 504, a camera icon 505, and a film icon 506. When each is picked, the blank album icon 504 causes the new album creation process 206 for creating a new album to be performed by the camera icon 50.
In FIG. 5, image input processing 207 from the photo CD 16, the electronic camera IC card 15 and the color scanner 14 shown in FIG.
With the negative film icon 506, a negative film editing process 208 for editing or deleting the original photo 74 is activated. Further, the position of each icon can be changed by the user dragging (bookcase processing 209). When each process ends, the bookshelf screen is displayed again in step 211, and the process waits until the user selects the next process. When the end button 507 at the lower left of the bookshelf screen is clicked, the end processing 212 is executed to exit the processing selection loop 204 and return to the basic GUI window. (2) Album Processing When the user picks an arbitrary album icon 502 on the bookshelf screen 500 of FIG. 21, the album processing shown in FIG. 12 is executed. In the initialization of step 221, first, referring to FIG.
Editing tool button 531 and display tool button 5 shown in 2
34, the negative film search button 537, the keyword search button 540, the bookshelf button 543, and the page turning buttons 520 and 521 are created. When displaying the album cover, the edit tool button 531 and the display tool button 534 are not selectable. Next, in step 222, the page list 84 and the photo list 87 are loaded into the table, and steps 223 and 224 are performed.
Then, an album cover screen 510 and an album thickness image 515 as shown in FIG. 22 are created and displayed. Like the previous album icon, the design of the album cover is created from the cover color 137 and the cover style 138 defined in the album list 80. Also, the album list 80
A cover title 511 is created from the inside album name 131, and an album thickness image 515 is created from the number of pages 134. Further, in step 225, any one of the following processes (3) to (7) is executed until the bookshelf button 543 in FIG. 22 is selected. When the bookshelf button 543 is selected and the loop 225 is exited, if the edit is performed in the loop of step 224, the page list and the photo list are saved in the file from the table, and the edit is not performed again. Returns to the bookshelf screen 500 of FIG. 21 without doing anything (step 228). (3) Album display processing When the user picks the page turning button 520 or 521, the album display processing 23 is activated. Less than,
This will be described with reference to FIG.

First, when the page-turning button is simply picked, the page-turning process 33 is executed to display the page-turning animation. In this case, button 5
When 20 is picked, it turns over in the forward direction and button 52
At 1, it flips in the opposite direction. This animation can be about sliding the page screen horizontally,
This has the effect of explicitly informing the user that the page screen has been switched and displayed. If the page-turning button is dragged, a page jump is executed. Since the thickness of the button corresponds to the thickness of the album, in step 250, the page number to jump from the drag start position is calculated, and in step 251, an animation that flips a plurality of pages at the same time is displayed. This animation can also slide horizontally on multiple pages at the same time.

Next, a page screen is created and displayed. The display method of the page screen changes depending on whether the current page is a cover page, a table of contents, or another page. If the current page is the cover, the album cover color 137, the style 138, and the album name 131 are acquired from the album list 80 in step 262, and the album cover screen 510 (FIG. 22) is created and displayed in step 263. .
If the current page is the table of contents, the page number 151 and the page name 152 of the page for which the page name 152 is defined are acquired from the page list 84 in step 264, and step 26
In step 5 and step 266, the table of contents icon 551 displaying the page name 152 and the page number 151 is created by the number of tables of contents, and the table of contents screen 550 as shown in FIG. 23 is displayed. For a normal page, page number 1 in step 268.
The photograph ID 162 is acquired with the key 51. Then, in step 269, the processes from step 270 to step 272 are repeated for the number of photographs displayed on the page. First, in step 270, the negative I of the photograph list 87 is displayed.
The original photograph 74 is acquired from D100 and the frame ID 112, the original photograph is edited based on the editing information of the photograph list 87 in step 271, and the edited image is edited in step 272 with the X coordinate 171 and Y of the display position of the photograph list 87. Coordinate 1
It is arranged on the page screen based on 72. Further, in step 273, the page background image 86 is loaded and displayed on the page screen 560 in an overlapping manner. In this case, the photograph 87 is displayed with priority over the page background image 86. Step 27
4, images 515 and 516 corresponding to the thickness of the album are created and displayed according to the page number. The edit tool button 531 and the display tool button 534 on the album cover screen and the table of contents screen are not selectable because they do not edit or display the photo on the cover or table of contents.

When one page is turned forward from the album cover shown in FIG. 22, a table of contents screen 550 shown in FIG. 23 is displayed. As described above, the table of contents icon 55 with the page name 152 and the page number 151 written on the table of contents screen 550.
1 is displayed in a list.

When the user picks a button as indicated by 552 in FIG. 23, the page is jumped to the corresponding page in FIG.
The page screen 560 of 4 is displayed (step 22).
6). The page screen 560 shows the thickness image 515 of the album.
And 516, an album image 561, text data 563, and handwritten input data 562. (4) Keyword search processing When the user picks a keyword search button 540, the original photo is searched for a keyword and a keyword for displaying the photo of the search result is displayed on either the negative film display area 600, the page screen 560 or the enlarged image display area 580. The search process 280 is executed. Hereinafter, description will be given with reference to FIGS. 14 and 15.

First, in step 281, the keyword search window 570 is displayed, and in step 282, the search enable flag is turned off. This flag remains off until the user sets a keyword. Step 283
Then step 28 until the end button 576 is picked
The process shown in step 290 from 5 is selected and executed.

In the attribute name designation area 571 of the keyword search window 570, the date, photographer, photographing place, and subject are displayed as the attributes of the original photograph. When the user picks one of them, in step 285, a list of attribute values corresponding to the designated attribute name is displayed in the attribute value designation area 572.
To display. At this time, it is considered that the keyword has been reset, and the searchable flag is turned off (step 28).
6). When the user selects one attribute value, step 28
At 7, the searchable flag is turned on. By this,
The search can be executed by the keyword that sets the attribute name and attribute value set by the user. Then, when the search execution button 573 is picked up, the keyword search execution shown in step 300 of FIG. 15 is started. First, step 301
In step 302, the photograph attribute information is loaded into the table (or when the program is started). In step 302, the table is searched for the corresponding original photograph from the attribute name and attribute value set designated by the user. In step 303, the search result is displayed for each active window. If the negative film display area 600 (described later) is active, a frame image 601 is created from the original photograph group of the search result in step 304, and a list is displayed in the negative film display area 600 in step 305. If the page screen is active, the photo of the search result is searched in the currently displayed album in step 306, and the page is automatically jumped to the page in which the corresponding photo is displayed in step 307. In FIG. 27, the photograph 564 as the search result is highlighted. Further, when the enlarged image display area 580 is active, enlarged images 581 are created from the original photograph group of the search result in step 308, and are displayed one by one in the enlarged image display area in step 309.

Returning to FIG. 14, when the NEXT button 574 is picked up, in step 288, forward scroll processing is executed for each active window. For example, if the page screen is active,
Executes the page turning process in the forward direction. Similarly, PRE
If the V button 575 is picked, step 289
Executes the reverse scrolling process for each window. Further, when the end button 576 is picked, the loop 283 is ended in step 290, and step 291 is executed.
Use to close the keyword search window. (5) When you look at a photo while turning over the photo selection processing page, you want to enlarge it further and see it in detail, add a voice memo or attribute of the photo and use it later, clipping the VTR as well as the photo There are requests to keep it. Therefore, the electronic album program 20 has a function of enlarging and displaying a picture on the entire screen, a function of displaying on an HDTV, a function of inputting and listening to a voice memo, a function of inputting and displaying a photo attribute, and a video. It has a playback function. These functions will be described with reference to FIGS. 16 and 17 and FIG.

First, when the user picks the display tool button 534, the enlarged display button 59 as shown in FIG.
0, HDTV display button 591, voice memo input / output button 592, video playback button 593, and photo attribute input / output button 594.
89 is displayed (step 321). In step 322, step 323, in which the user picks a photo on the page screen, and then step 324, in which one of the five buttons is picked and any of steps 325 to 328 is executed, is repeatedly executed.

When the enlarged display button 590 is picked, the enlarged image display processing of step 26 is executed. (FIG. 17) First, in step 331, the enlarged display area 330 of FIG. 26 is displayed. In step 332, the negative ID 100 and frame ID 112 of the photograph designated by the user are obtained to search the original photograph, and in step 333, an enlarged image is created and displayed. If it is desired to reflect the editing information of the album image also in the enlarged image, the photograph list 87 is displayed in step 332.
The original photo is processed based on the editing information of (the enlargement / reduction ratio is not referred to and remains 1). In step 334, an event from the user is obtained and a scroll operation is executed. When the user picks the next button 582, the next enlarged image registered is searched (step 335) and the screen is switched and displayed (step 336). Switching between these screens may be page turning or fade-in / fade-out. Similarly, when the user picks the previous button 583, the registered enlarged image is searched (step 337) and the screen is switched and displayed (step 338). If you pick the end button 584,
The loop 334 is exited in step 339, and step 340
The enlarged display area 580 is erased with.

When the HDTV display button 591 is picked, the HDTV display processing of step 325 is executed. First, the negative ID 100 and the frame ID 112 of the photograph designated by the user are obtained, and the HDTV image data is searched. The HDTV image data has a larger resolution (about 2048 × 1152) than the data displayed on the display surface of the electronic album device, and thus is managed as a file separate from the original photograph. When the corresponding image data is found, the image data is transferred to the HDTV interface and displayed on the HDTV. If there is no corresponding image data, a message to that effect is displayed and the user waits for confirmation input.

When the voice memo input / output button 592 is picked, the voice memo input / output processing of step 326 is executed. This is for inputting a voice memo to the photograph specified by the user or outputting a voice memo that has already been registered. Similarly, when the moving image reproduction button 593 is picked, the moving image reproduction processing 327 of step 328 is executed. This plays a video that is linked to a photo specified by the user.
The voice and the moving image are saved with a file name uniquely determined from the photo ID 162.

When the photograph attribute input / output button 594 is picked, the photograph attribute input / output processing of step 328 is executed. This is to input or display the attributes of the photograph (photographing date, photographing place, photographer, subject) designated by the user. (6) Negative Film Search Processing As described with reference to FIG. 3, the electronic album program 20 manages the original photograph 74 in units of 72 negative films. In the negative film search process 21, a list of reduced images of the original photograph 74 is displayed for each negative film 72. The negative film search process 360 will be described below with reference to FIG.

First, the user selects the negative film search button 5
When 37 is picked, a negative film selection window 610 shown in FIG. 27 is displayed (step 361). Since the negative name 101 is displayed in the negative name display area 611 of the window, the user selects one of them to view the button 6
Press 12. Then, in step 363, the negative film 7
Reduced image from the original image 74 in 2 (hereinafter frame image 601)
Is created, and eight frame images 601 are displayed as a list in the negative film display area 600 in step 364. Step 3
The process of searching a negative film from the negative name of 63 and step 364 can be repeated until the user picks the close button 613 and step 365 is executed (step 362). In step 366, the negative film selection window is erased, and then the process for searching the frame image 601 is started.

In the frame selection of step 381, the album creating process 22 and the negative film scrolling process are repeated until the user selects the close button 604.
There are two types of album creation processing, manual and automatic.

First, when the user drags the frame image 601 and drops it on the page screen 560, the frame image 601 selected by the user has a default size (180 × 1).
It is converted into an album image 561 of 20 dots and displayed at the position dropped on the page screen (step 2).
2). The state of this processing is shown in FIG. Where 700
Represents a cursor, and 604 represents an image for album 561 of the default size displayed when a reduced image is picked.
Represents the appearance of. Of course, the photo list table is updated at the same time. The user creates the album 81 by repeating this drag and drop.

In addition, the user can select one or more frame images 601.
And the automatic button 603 is picked, all the frame images 601 are converted into album images 561 of the default size, displayed at the default position on the page screen 560, and the photo list table is updated (step 3
85). The result is shown in FIG. Here, all frame images 6 displayed in the negative film display area 600 are displayed.
01 is the target of the automatic album creating process 385. The automatic album creating process 385 is assumed to be an automated process of putting a photo in the pocket of a conventional pocket album. The electronic album program 20
It also has multiple pocket albums and the user can select them. In addition, the original photos 74 are not only stored in the pockets in the order registered in the negative film 72.
Can also be grouped based on the photo attribute information 75 and stored in a pocket. For example, when looking at the shooting date / time 122 of each original photo 74 and grouping the photos taken within a certain time range into a pocket,
Use different pages for each group to clearly identify each group. Similar grouping can be performed for each attribute.

Further, in step 31, the user can scroll within the negative film display area 600 by picking and dragging the scroll bar 602 to the left and right to see all the pictures in the negative film 72. If the user picks the close button 604,
The frame selection loop 381 is terminated (step 386) and the negative film display area is erased (step 387). (8) Album editing process The user can freely edit the photo on the screen. For this editing, it is conceivable to edit the appearance of the photographic image or edit the image quality. Here, the former will be described in detail. Hereinafter, description will be given with reference to FIGS. 19 and 20.

First, when the editing tool button 533 is picked, the editing operation designation palette 619 shown in FIG. 30 is displayed in step 401, and the editing mode is entered in step 402. Until the user picks the edit tool button 630 again, the edit mode is set, and the album display process 23 and the photo selection process 25 cannot be performed. Also,
In the editing operation designation palette 619, the page screen editing process 420, the photo trimming process 405, and the photo rotation process 40 are performed.
6. Pen input processing 407 and eraser processing 408 can be executed. The above process is repeated until the user re-picks the edit button (step 403).

In the page screen editing process 420, movement, enlargement / reduction, cutting, copying, and pasting of the album image 561 on the page screen 560 are executed. Below, FIG.
It will be described using 0. When the album image 561 is picked and the cut button 630 is pressed, the album image 561 on the page screen 560 is stored in the buffer in step 432, and the album image 561 is deleted in step 433 (FIG. 30). . Reference numeral 702 represents the album image 561 that was displayed before being cut. Similarly, pick the image 561 for the album and press the copy button 6
When 32 is pressed, in step 434, the album image 561 on the page screen 560 is stored in the buffer without being erased. The album image 561 in the buffer is displayed in step 435 by pressing the paste button 634.
As shown in, it is pasted on the last picked location on the page screen 560. When the album image 561 is picked and dragged, in step 423 the cursor 70
The frame 701 of the album image 561 moves in accordance with the movement of 0, and in step 424, the album image 561 is arranged and redisplayed at the position where the dragging ends (FIG. 3).
1). When the four corners of the album image 561 are picked and dragged inward, the frame 701 of the album image 561 is reduced in accordance with the movement of the cursor 700 in step 426, and the album image 561 is reduced when the dragging ends in step 427. The rate is determined, and the album image 561 is edited and displayed based on the rate. Similarly, when the four corners of the album image 561 are picked and dragged inward, in step 426, the frame 701 of the album image 561 is reduced in accordance with the movement of the cursor 700, and in step 427, the album image when the dragging is completed. 56
Image size for album 5
61 is edited and displayed (FIG. 32). When each editing process ends, in step 436, the album image 561 list table is changed. In addition, the above processing is for pallet 6
It can be repeatedly executed until another button on 19 is selected.

Trimming button 62 in palette 619
When 3 is selected, the trimming mode is entered, and the trimming button 623 changes to an OK button 624 as shown in FIG. When the album image 561 is dragged, the rubber band 703 is drawn according to the movement of the cursor 700. When the pen is up, the trimming range is fixed and O
When the K button 624 is pressed, the part outside the range is deleted. O
You can specify the range as many times as you want until you press the K button. Even when the trimming has failed, the album image 561 before trimming is stored in the buffer, so that the trimmed album image 561 can be restored by picking. (End of step 405) Pallet 619
Picking the rotation button 625 inside enters the rotation mode. The album image 561 rotates 90 degrees in the same clockwise direction each time it is picked (FIG. 34). 702
Indicates the display position before the album image 561 is rotated. (Step 406) When the pen input button 627 in the palette 619 is picked, the pen input mode is entered and the cursor changes to the pen cursor 704. Dots are displayed on the page background image 86 in accordance with the movement of the cursor 704. (Step 407 above) Similarly, when the eraser button 629 is picked, the eraser mode is entered and the cursor changes to the eraser cursor 705.
The dots on the page background image 86 are erased in accordance with the movement of the cursor 705. (Step 408) When the album editing process is completed, the editing mode is released in Step 411, and the editing operation designation palette is erased in Step 412.

[0056]

As described above, according to the present invention,
You can perform a rough search by displaying a list of thumbnail images and browsing, a detailed search by displaying a magnified image and a detailed search by browsing, and a search based on the contents organized by browsing an electronic album in which images are spatially organized. The effect is that it can be executed according to the user's purpose.

Further, by dragging and dropping the reduced image to the electronic album or by automatically pasting it by the program, there is an effect that the labor for creating the electronic album can be saved.

Further, according to the present invention, since the process for converting the album image into the enlarged image is provided, there is an effect that the still image can be enlarged for detailed editing or viewing.

[Brief description of drawings]

FIG. 1 is a diagram showing an electronic album program according to the present invention and an electronic album device using the program.

FIG. 2 is a diagram showing an external appearance of an electronic album device using an electronic album program according to the present invention.

FIG. 3 is a diagram showing a data model of an electronic album program according to the present invention.

FIG. 4 is a table of negative film lists handled by the electronic album program.

FIG. 5 is a diagram schematically showing the original photograph list.

FIG. 6 is also a table of photograph attribute information.

FIG. 7 is also a table of album lists.

FIG. 8 is also a page list table.

FIG. 9 is also a table of photograph lists.

FIG. 10 is a table which similarly manages text codes.

FIG. 11 is a PAD showing start / end processing of the electronic album program.

FIG. 12 is also a PAD showing album processing.

FIG. 13 is also a PAD showing an album display process.

FIG. 14 is also a PAD showing a keyword search process.

FIG. 15 is also a PAD showing execution of a keyword search.

FIG. 16 is also a PAD showing a photograph selection process.

FIG. 17 is also a PAD showing an enlarged image display process.

FIG. 18 is also a PAD showing a negative film search process.

FIG. 19 is also a PAD showing an album editing process.

FIG. 20 is also a PAD showing a page screen editing process.

FIG. 21 is a diagram showing an initial screen of the electronic album program.

FIG. 22 is a diagram showing an album cover screen in the same manner.

FIG. 23 is a diagram similarly showing an index list screen.

FIG. 24 is a diagram similarly showing a page screen.

FIG. 25 is a diagram for explaining a keyword search similarly.

FIG. 26 is a diagram for explaining the enlarged image display process, similarly.

FIG. 27 is a diagram for explaining the negative film search process.

FIG. 28 is a diagram for similarly explaining the album creating process.

FIG. 29 is a diagram for explaining the album automatic creation processing similarly.

FIG. 30 is a diagram for explaining cutting of photographs in the same album editing process.

FIG. 31 is a diagram for explaining movement of photos in the same album editing process.

FIG. 32 is a diagram for explaining enlarging / reducing a photograph in the same album editing process.

FIG. 33 is a diagram for explaining trimming of a photograph in the same album editing process.

FIG. 34 is a diagram for explaining rotation of a photograph in the same album editing process.

FIG. 35 is a diagram for explaining handwriting input in the album editing process.

FIG. 36 is a diagram for explaining erasing the screen background of the album editing process.

[Explanation of symbols]

1: Display, 2: CPU, 3: Input device, 4: Memory, 5: Image database, 10: Peripheral device interface, 11: Microphone / speaker, 12: HDTV, 1
3: Color printer, 14: Color scanner, 15: IC card for electronic camera, 16: Photo CD, 20: Electronic album program main body, 21: Negative film search processing, 22: Album (automatic) creation processing, 23: Album display Processing, 24: Album editing processing, 25: Photo selection processing, 26: Enlarged image display processing, 31: Negative film scroll processing, 33: Page turning processing, 36: Enlarged image scroll processing, 42: Photo attribute information, 43: Album Management information, 51: original photo storage unit, 52: album management information storage unit, 53: photo attribute information storage unit, 560: page screen, 561: image for album, 580: enlarged image display area, 581: enlarged image, 600 : Negative film list display area, 601: Frame image.

─────────────────────────────────────────────────── ─── Continued Front Page (51) Int.Cl. ⁷ Identification Code FI Theme Coat (Reference) H04N 5/76 H04N 5/76 B 5E501 5/91 5/91 N J (72) Inventor Keiji Kojima Kanagawa Prefecture 1099, Ozenji, Aso-ku, Kawasaki-shi, Hitachi, Ltd. System Development Laboratory, Ltd. (72) Inventor, Katsuhiko Yuura 1099, Ozenji, Aso-ku, Kawasaki, Kanagawa, Ltd., Hitachi, Ltd., System Development Laboratory (72) Inventor, Kazuto Senda Tokyo 1-280, Higashi Koigokubo, Kokubunji-shi F-Term (Central), Central Research Laboratory, Hitachi, Ltd. (reference) DD02 EE03 5C053 FA06 FA07 FA14 FA17 HA29 HA30 5C076 AA02 AA12 AA15 AA16 AA17 AA19 AA21 AA22 AA24 CA02 CB02 5E501 AA02 AC15 BA05 CA03 CB07 EA10 EA13 EA17 FA14 FA22 FB04 FB34 FB43

Claims (19)

[Claims] 1. A still image display device for displaying a still image stored in a storage device in response to a request from a user, wherein the size is fixed with respect to the still image stored in the storage device. One reduced image, a second reduced image whose size is variable and editable, and an enlarged image whose resolution is larger than those of the two types of reduced images are created, and the first reduced images are displayed in a regular array. The second reduced image is displayed in a predetermined layout, and the enlarged image is displayed when a user requests it. 2. The still image display method according to claim 1, wherein at least one of the first reduced image and the second reduced image is sequentially switched and displayed when there is a request from a user. Still image display method characterized by. 3. The still image display method according to claim 1, wherein a user selects the first reduced images arranged regularly, and the selected first reduced images are displayed in a second image of a predetermined size. The reduced image is converted into the reduced image, and the converted second reduced image is arranged at a position designated by the user. 4. The still image display method according to claim 1, wherein the user selects at least one of the displayed first reduced images, and selects the selected first reduced image of a predetermined size. The still image display method according to claim 1, wherein the second reduced image is converted into a second reduced image, and the converted second reduced image is arranged at a predetermined position. 5. The still image display method according to claim 4, wherein attribute information, which is information about each still image, is added to the still images stored in advance in the storage device, and the second information is added based on the attribute information. Still image display method characterized by automatically arranging reduced images of. 6. The still image display method according to claim 5, wherein a user searches the still image stored in the storage device by a keyword based on the attribute information, and the retrieved still image is a first reduced image. A still image display method characterized in that the program automatically switches the second display area until the second reduced image is displayed, and at least one of the enlarged display of the search results is displayed. . 7. The still image display method according to claim 5, wherein the attribute information is at least one of a creation date and time of the still image, a creation location, a creator, and the information recorded in the still image. Still image display method. 8. The still image display method according to claim 7, wherein when the still image creation date is stored as the attribute information, the second reduced image is arranged at different intervals according to the interval of the creation date and time. A still image display method characterized by displaying. 9. The still image display method according to claim 1, wherein the user selects one from the displayed second reduced images and converts the selected second reduced image into an enlarged image, A still image display method, comprising displaying the converted enlarged image. 10. The still image display method according to claim 9, wherein the displayed enlarged image is edited according to a user's preference, and the edited enlarged image is converted into a second reduced image. A still image display method characterized by displaying the second reduced image in place of the second reduced image before conversion into an enlarged image. 11. The still image display method according to claim 1, wherein the second reduced image is displayed in a region divided into page units. 12. The method for displaying a still image according to claim 11, wherein the page is arranged in a one-page type or a spread type of a book, and the second reduced image group is displayed on the page to meet a user request. A still image display method, wherein the page is switched and displayed in accordance with the display. 13. The still image display method according to claim 12, wherein when the pages are switched and displayed, a page turning animation is displayed. 14. The still image display method according to claim 11, wherein an image corresponding to the thickness of the book is displayed according to the number of displayed pages, and the thickness of the book is displayed when the pages are switched and displayed. A still image display method characterized in that the corresponding image is also changed according to the number of displayed pages. 15. The still image display method according to claim 1, wherein text data or handwritten data corresponding to the second reduced image is displayed. 16. The still image display method according to claim 1, wherein a table of contents or index is displayed, and when the user specifies a specific table of contents or index, the program automatically switches the second display area and the corresponding portion. Is displayed, The still image display method according to claim 1. 17. The still image display method according to claim 1, wherein at least one of sound data and moving image data is stored according to the still image stored in the storage device, and the displayed second reduced image is displayed. A still image display method characterized in that one of the sound data and the moving image data is reproduced according to the specified second reduced image. 18. A still image display device for displaying a still image stored in a storage device according to a request from a user, wherein the size of one still image is larger than that of the still image stored in the storage device. A first reduced image that is fixed, a second reduced image that is variable in size and editable, and an image creating unit that creates an enlarged image whose resolution is larger than the two types of reduced images; It is characterized by further comprising display means for displaying the second reduced images in a predetermined layout in a regular array of reduced images and for displaying the enlarged images when a user requests. Still image display method. 19. A storage unit for storing a pre-digitized photo image and album management information which is information relating to arrangement and editing of the photo image, and a photo image stored in the storage unit in response to a user request. An image creating unit for creating a reduced image that can be sequentially switched, an image for an album of a default size, and an enlarged image having a resolution larger than the reduced image, and a negative film display area for sequentially switching and displaying the reduced image according to a user's request And a page screen for displaying the album image based on the album management information stored in the storage means, and a display means including an enlarged image display area for displaying the album image designated by the user as the enlarged image. An electronic album device having.