WO2014156560A1 - Electronic album missing image retrieval device and method for controlling operation thereof - Google Patents

Electronic album missing image retrieval device and method for controlling operation thereof Download PDF

Info

Publication number
WO2014156560A1
WO2014156560A1 PCT/JP2014/055962 JP2014055962W WO2014156560A1 WO 2014156560 A1 WO2014156560 A1 WO 2014156560A1 JP 2014055962 W JP2014055962 W JP 2014055962W WO 2014156560 A1 WO2014156560 A1 WO 2014156560A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
captured
imaging
electronic album
determined
Prior art date
Application number
PCT/JP2014/055962
Other languages
French (fr)
Japanese (ja)
Inventor
哲弥 高森
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Publication of WO2014156560A1 publication Critical patent/WO2014156560A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders

Definitions

  • This invention relates to an electronic album shortage image search device, its operation control method, and its operation control program.
  • Information terminal devices that display various information on a display screen and can be operated using a touch panel or the like are becoming popular.
  • the technology for creating album information by managing image information from users is also advancing.
  • an image data is uploaded via a service terminal and an image album is created (Patent Document 1)
  • an image is searched using search information attached to image information and an album is created (Patent Document 2)
  • an album is created (Patent Document 3).
  • Patent 3770884 Patent No. 3915106 JP 2009-169546
  • This invention is intended to find a desired image relatively easily.
  • An electronic album deficient image search apparatus includes an imaging position determination unit that determines imaging positions of a plurality of captured images included in a captured image group, and an imaging theme that determines an imaging theme of a plurality of captured images included in the captured image group.
  • a plurality of captured images that are images captured at the imaging position determined by the determination unit and the imaging position determination unit and that match the imaging theme determined by the imaging theme determination unit and are included in the captured image group
  • the present invention is characterized by comprising a deficient image search means for finding a deficient image that is deficient in the search, and a display means for displaying at least one deficient image found by the deficient image search means.
  • This invention also provides an operation control method suitable for an electronic album shortage image search device. That is, in this method, the imaging position determination unit determines the imaging positions of a plurality of captured images included in the captured image group, and the imaging theme determination unit determines the imaging themes of the plurality of captured images included in the captured image group.
  • the deficient image search means is an image captured at the imaging position determined by the imaging position determination means, and is an image that matches the imaging theme determined by the imaging theme determination means, and is included in the captured image group A deficient image that is lacking in the plurality of captured images is found by searching, and the display means displays at least one deficient image found by the deficient image searching means.
  • the present invention also provides a program for controlling the computer of the electronic album shortage image search device.
  • a recording medium storing such a program may also be provided.
  • the imaging position of a captured image group including a plurality of captured images is determined.
  • the imaging theme of a plurality of captured images included in the captured image group is also determined.
  • An insufficient image that is an image captured at the determined imaging position and that matches the determined imaging theme and that is lacking in the plurality of captured images included in the captured image group is found by the search.
  • At least one missing image found by the search is displayed on the display screen of the display means. Find images that were missing from the electronic album and use them in the electronic album.
  • a captured image grouping means for grouping a large number of captured images into a plurality of captured image groups for each imaging date and time may be further provided.
  • the imaging position determination means will determine the imaging position for each group grouped by the captured image grouping means, for example.
  • the deficient image search means is, for example, an image captured at an imaging position determined by the imaging position determination means that matches at least one of a sightseeing spot represented by a plurality of captured images or an imaging scene of the plurality of captured images, An image that matches the imaging theme determined by the imaging theme determination unit and that is insufficient for a plurality of captured images included in the captured image group is found by searching.
  • a determination unit that determines whether the imaging position determined by the imaging position determination unit is outdoor or indoor may be further provided.
  • the insufficient image search means finds an outdoor insufficient image when it is determined that the outdoor is determined by the determining means, and finds an indoor insufficient image when it is determined that the indoor is determined by the determining means.
  • the display means may display a plurality of images included in the captured image group and a deficient image found by the deficient image search means on the display screen.
  • the first designation means for designating at least one of the plurality of images displayed on the display screen and included in the captured image group, and displayed on the display screen and found by the missing image search means.
  • the image forming apparatus further includes second specifying means for specifying at least one missing image. Then, the used image determining means will determine an image that uses the image specified by the first specifying means and the insufficient image specified by the second specifying means for the electronic album.
  • FIG. 1 shows an embodiment of the present invention, and is a block diagram showing an electrical configuration of an electronic album creating apparatus 1.
  • the overall operation of the electronic album creating apparatus 1 is controlled by the control device 20.
  • the electronic album creating apparatus 1 includes a CD-ROM (compact disc-read only memory) drive 21.
  • a CD-ROM 22 storing a program for controlling the operation of the electronic album creating apparatus 1 is loaded into the CD-ROM drive 21, the program stored in the CD-ROM 22 is read by the CD-ROM drive 21. .
  • the read program is installed in the electronic album creating apparatus 1.
  • the electronic album creating apparatus 1 may have a communication function, receive a program transmitted via a network, and install the received program in the electronic album creating apparatus.
  • the electronic album creating device 1 also includes an image input device 5.
  • the image input device 5 is connected to a memory card reader 2, a digital camera 3, and an image database 4.
  • a memory card in which image files representing a large number of images are stored is loaded in the memory card reader 2
  • the image file stored in the memory card is read and the image input device 5 is read.
  • a large number of image files stored in the memory of the digital camera 3 are read by the image input device 5.
  • a large number of image files input to the image input device 5 are input to the captured image grouping device 6.
  • the captured image grouping device 6 divides a large number of images represented by a large number of input image files into a plurality of captured image groups based on the imaging date and time.
  • a large number of image files are stored in the display device 7, the imaging position determination device 9, the imaging theme determination device 10, the sightseeing spot determination device 11, the imaging scene determination device 12, the layout creation device 15, and the insufficient image extraction device 13 for each captured image group. Given.
  • the imaging position determination device 9 determines the imaging positions of a plurality of captured images included in each captured image group for each captured image group.
  • the imaging position is recorded in the header of an image file representing the captured image. Since the captured image group is divided based on the imaging date and time, the plurality of captured images included in the captured image group are of substantially the same imaging date and time. For this reason, the imaging positions of the plurality of captured images should be substantially the same, but are not strictly the same.
  • the imaging position determining device 9 determines a large number of imaging positions among a plurality of imaging positions of a plurality of captured images included in the captured image group as imaging positions of the captured image group. Of course, an average position of a plurality of imaging positions of a plurality of captured images included in the captured image group may be determined as the imaging position of the captured image group, or the imaging position may be determined by other methods. May be.
  • the imaging theme determination device 10 determines the imaging theme of a plurality of captured images included in each captured image group for each captured image group.
  • the imaging theme is determined by analyzing the characteristics of each captured image of a plurality of captured images included in the captured image group. From this analysis, if the subject of the captured image is a person, if it is a person, what kind of person is there, how many people are there, how many people are there, whether there are many groups, whether there are many individuals, if it is a landscape, if it is a landscape , Image information such as what kind of scenery is common. Based on this analysis, an imaging theme is determined for each captured image group.
  • the sightseeing spot determination device 11 determines a sightseeing spot represented by a plurality of captured images included in each captured image group for each captured image group.
  • a tourist spot can be obtained by using the positional information of the captured images included in the captured image group to detect where the tourist spot is located.
  • the imaging scene determination device 12 determines, for each imaging group, imaging scenes of a plurality of captured images included in those captured image groups. If a captured scene is recorded in the header included in the image file representing the captured image, the captured scene can be used. If the captured scene is not recorded in the header, the image is analyzed as described above. Thus, it can be determined whether the subject is a person, a landscape, etc., and an imaging scene can be determined using the analysis result.
  • the data is given to the missing image extraction device 13.
  • the shortage image extracting device 13 is also provided with an image file representing a captured image included in the captured image group divided by the captured image grouping device 6.
  • the insufficient image extraction device 13 creates an electronic album using captured images included in the captured image group, an image considered to be insufficient is determined, and the determined image is stored in the image library 14. Can be found from.
  • the image capturing date / time is autumn and the image capturing theme of the captured image group is determined to be “travel”, but the captured image group does not include the image of autumn leaves, the image of the autumn leaves is insufficient. And the image of the autumn leaves is extracted from the image library.
  • the deficient images extracted by the deficient image extraction device 13 and the images included in the captured image group are given to the display device 7 and displayed on the display screen.
  • An image displayed on the display screen is selected by the touch panel 8, and an image file representing the selected image is given to the layout creating device 15.
  • the layout creating device 15 generates electronic album data representing the electronic album.
  • FIG. 2 and 3 are flowcharts showing a processing procedure of the electronic album creating apparatus 1.
  • a large number of captured images are input to the electronic album creating apparatus 1 (step 31). Then, it is divided into a plurality of captured image groups on the basis of the captured date and time of a large number of captured images (step 32).
  • FIG. 4 shows a state in which a large number of captured images i input to the electronic album creating apparatus 1 are arranged according to the imaging date and time.
  • the imaging date and time are newer from the left side to the right side.
  • a large number of images i increase the number of images when there is an event. For this reason, when a large number of images are grouped based on the shooting date and time, the captured images included in the captured image group represent a common event, and the imaging theme is determined for each captured image group as described above. become able to.
  • a large number of captured images i are divided into four captured image groups G1 to G4 based on the captured date and time.
  • the captured image group G1 includes captured images I1 to I18.
  • the number of groups can be more or less than four.
  • FIG. 5 is an example of a captured image table. This captured image table is generated in the control device 20.
  • the captured positions and the like are stored in the captured image table corresponding to the captured image groups.
  • the captured position, captured theme, sightseeing spot, and captured scene of the captured image group are determined for each captured image group. (Steps 33, 34, 35, 36).
  • the imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group do not necessarily have to be determined in the order shown in FIG. 2, or may be determined in parallel.
  • Information such as the imaging position determined in this way is stored in the captured image group table corresponding to the captured image group (see FIG. 5).
  • the imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group G1 are position ⁇ , travel, Miyajima and scenery, and a person, respectively.
  • the imaging position, the imaging theme, the sightseeing spot, and the imaging scene of the captured image group G2 are the position ⁇ , the athletic meet, the elementary school, and the person, respectively, and the imaging position, the imaging theme, the sightseeing spot, and the imaging scene of the captured image group G3 are the position ⁇ , respectively. , New Year, residential area and person.
  • the imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group G4 are position ⁇ , cherry-blossom viewing, Ueno Park, person, and landscape, respectively.
  • the captured image included in the captured image group may be determined whether the captured image included in the captured image group is captured indoors or outdoors, and information indicating the determination result may be added to the imaging position. If almost all of the captured images included in the captured image group are captured outdoors, the captured location of the captured image group is outdoors, and almost all of the captured images included in the captured image group are captured indoors. If it is a thing, the imaging location of the captured image group is indoors.
  • An image that matches the imaging position or the like is extracted from the image library 14 (step 36).
  • the captured image group G1 forgets to capture images even though the imaging position, the imaging theme, the sightseeing spot, and the imaging scene are the position ⁇ , travel, Miyajima and landscape, and a person. Therefore, if the captured image group G1 does not include Itsukushima Shrine, Torii, Five-storied Pagoda, Autumn leaves (when the imaging date is autumn) that symbolizes Miyajima, those images are included. The missing image is determined and extracted from the image library 14 (step 36).
  • Image scoring is performed on each of the shortage image extracted in this way and the captured image included in the captured image group (step 37 in FIG. 3).
  • the score of the image indicates the degree suitable for the image used in the electronic album.
  • the brightness, darkness, and compositional accuracy (such as whether the main subject is not cut out) and the focus are not blurred. It is calculated on the basis of
  • the captured images included in the captured image group and the extracted insufficient images are displayed on the display screen of the display device 7.
  • FIG. 6 is an example of an image displayed on the display screen 50 of the display device 7.
  • the left side of the display screen 50 is a captured image display area 51, and the right side of the display screen 50 is an insufficient image display area 52.
  • FIG. 6 shows captured images I1 to I9 included in the captured image group G1.
  • the captured images I10 to I18 that are not displayed in the captured image display area 51 are also displayed in the captured image display area 51.
  • An asterisk indicating a score is displayed on the upper left of these captured images I1 to I9. The higher the score, the more stars are displayed. The lower the score, the less the stars.
  • the star is an image suitable for an electronic album, and the user can select a captured image to be included in the electronic album with reference to the star.
  • the extracted insufficient images are displayed in descending order of score (not necessarily in the order of high score).
  • some of the extracted insufficient images P1 to P9 are illustrated.
  • shortage images other than the displayed shortage images P1 to P9 are displayed.
  • an instruction area 53 is formed at the bottom.
  • an image insertion area 61 in which the characters “Place in electronic album” are described, a confirmation area 62 in which the characters “Confirm image” are described, and a character “End” are described.
  • An end region 63 is formed.
  • the captured image or the insufficient image displayed in the captured image display area 51 or the insufficient image display area 52 is dragged and dropped into the image insertion area 61, the dragged and dropped image forms an electronic album. This is an image constituting a spread page (or one page).
  • the confirmation area 62 is touched, the contents of the images included in the spread pages constituting the electronic album can be confirmed.
  • the end area 63 is touched, the electronic album creation process ends.
  • the selected image is an image included in a spread page constituting the electronic album.
  • the spread page of the electronic album for the captured image group is laid out (step 41). For example, if the captured images I1, I3, and I8 shown in FIG. 6 are selected and the shortage images P1 and P2 are selected, the selected images are laid out as images constituting a spread page of the electronic album.
  • the user designates the captured image (first designation) and the insufficient image (second designation).
  • the user does not necessarily have to designate the electronic album creating apparatus. May be specified. In that case, it is specified that at least one captured image among a plurality of captured images included in the captured image group is used for the electronic album.
  • the electronic album creating apparatus may specify that at least one captured image and at least one insufficient image among the plurality of captured images are included in the electronic album.
  • the electronic album creating apparatus selects and creates an electronic album. Thereafter, each page of the electronic album is displayed on the display screen 50, and the user displays each page. You may make it replace the image contained in.
  • the captured image group corresponds to the spread page (one page) of the electronic album, but the captured image included in the captured image group is used for the entire electronic album instead of the spread page. May be. An electronic album having the imaging theme of the captured image group is created.
  • the missing image is extracted from the image library 14, but when the image library 14 is connected to a server on the network, the missing image is communicated with the server. You may make it download the image file to represent.
  • the image file input to the electronic album creating apparatus 1 may also be uploaded from a storefront terminal device or a personal computer placed in a supermarket.
  • Electronic album creation device (electronic album shortage image search device) 6 Captured Image Grouping Device 7 Display Device 9 Imaging Position Determination Device 10 Imaging theme determination device 11 Sightseeing place determination device 12 Imaging scene determination device 13 Missing image extraction device

Abstract

The objective is to enable a replacement for a missing image (which the user failed to photograph) to be found in a relatively simple manner. A large number of images are input to a grouping device and grouped on the basis of the photograph time. A photograph location, a photograph theme, and the like are determined for each group of photographed images. On the basis of the photograph location, the photograph theme, and the like, an image which is missing from the photographed images included in a photographed image group is determined. The missing image is read from an image library by a missing image extraction device. An electronic album is created from the missing image that has been read and the photographed images included in the photographed image group.

Description

電子アルバム不足画像検索装置およびその動作制御方法Electronic album insufficient image search device and operation control method thereof
　この発明は，電子アルバム不足画像検索装置ならびにその動作制御方法およびその動作制御プログラムに関する。 This invention relates to an electronic album shortage image search device, its operation control method, and its operation control program.
　表示画面に様々な情報を表示し，タッチ・パネルなどを利用して操作可能な情報端末装置が普及してきている。また，利用者からの画像情報を管理してアルバム情報を作成する技術も進歩している。また，サービス端末経由で画像データがアップロードされ，画像アルバムを作成するもの（特許文献１），画像情報に付与された検索用情報で画像を検索しアルバムを作成するもの（特許文献２），アルバムに日時情報，観光地情報などを掲載するもの（特許文献３）などもある。 Information terminal devices that display various information on a display screen and can be operated using a touch panel or the like are becoming popular. In addition, the technology for creating album information by managing image information from users is also advancing. In addition, an image data is uploaded via a service terminal and an image album is created (Patent Document 1), an image is searched using search information attached to image information and an album is created (Patent Document 2), an album In addition, there are those that publish date and time information, sightseeing spot information, etc. (Patent Document 3).
特許第3737084号Patent 3770884 特許第3915106号Patent No. 3915106 特開2009-169546号公報JP 2009-169546
　旅行などに行った際に，その旅行の画像を集めて電子アルバムを作成するような場合に電子アルバムに含ませたいような画像を撮り忘れたり，撮影を失敗していたりすることがある。そのような場合に，電子アルバムに含ませる画像を自動的に見つけ出すと，電子アルバムに含まれる画像の傾向と異なる傾向の画像が見つけられることがある。そのような画像が，電子アルバムに追加されると，電子アルバムの統一性が乱されてしまうことがある。また，取り忘れた画像の代替画像を利用者が見つけるようにすると，膨大な画像の中から見つけなければならず，極めて面倒なこととなる。 When you go on a trip, you may forget to take an image that you want to include in the electronic album when you collect the images of the trip and create an electronic album. In such a case, if an image included in the electronic album is automatically found, an image having a tendency different from the tendency of the image included in the electronic album may be found. When such an image is added to an electronic album, the uniformity of the electronic album may be disturbed. In addition, if the user tries to find a substitute image for an image that has been forgotten, it must be found from an enormous amount of images, which is extremely troublesome.
　この発明は，比較的簡単に所望の画像を見つけ出すことを目的とする。 This invention is intended to find a desired image relatively easily.
　この発明による電子アルバム不足画像検索装置は，撮像画像グループに含まれる複数の撮像画像の撮像位置を決定する撮像位置決定手段，撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定する撮像テーマ決定手段，撮像位置決定手段によって決定された撮像位置で撮像された画像であり，撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つける不足画像検索手段，および不足画像検索手段により見つけられた少なくとも一つの不足画像を表示する表示手段を備えていることを特徴とする。 An electronic album deficient image search apparatus according to the present invention includes an imaging position determination unit that determines imaging positions of a plurality of captured images included in a captured image group, and an imaging theme that determines an imaging theme of a plurality of captured images included in the captured image group. A plurality of captured images that are images captured at the imaging position determined by the determination unit and the imaging position determination unit and that match the imaging theme determined by the imaging theme determination unit and are included in the captured image group The present invention is characterized by comprising a deficient image search means for finding a deficient image that is deficient in the search, and a display means for displaying at least one deficient image found by the deficient image search means.
　この発明は，電子アルバム不足画像検索装置に適した動作制御方法も提供している。すなわち，この方法は，撮像位置決定手段が，撮像画像グループに含まれる複数の撮像画像の撮像位置を決定し，撮像テーマ決定手段が，撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定し，不足画像検索手段が，撮像位置決定手段によって決定された撮像位置で撮像された画像であり，撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つけ，表示手段が，不足画像検索手段により見つけられた少なくとも一つの不足画像を表示することを特徴とする。 This invention also provides an operation control method suitable for an electronic album shortage image search device. That is, in this method, the imaging position determination unit determines the imaging positions of a plurality of captured images included in the captured image group, and the imaging theme determination unit determines the imaging themes of the plurality of captured images included in the captured image group. The deficient image search means is an image captured at the imaging position determined by the imaging position determination means, and is an image that matches the imaging theme determined by the imaging theme determination means, and is included in the captured image group A deficient image that is lacking in the plurality of captured images is found by searching, and the display means displays at least one deficient image found by the deficient image searching means.
　この発明は，電子アルバム不足画像検索装置のコンピュータを制御するプログラムも提供している。そのようなプログラムを格納した記録媒体も提供するようにしてもよい。 The present invention also provides a program for controlling the computer of the electronic album shortage image search device. A recording medium storing such a program may also be provided.
　この発明によると，複数の撮像画像を含む撮像画像グループの撮像位置が決定される。また，撮像画像グループに含まれる複数の撮像画像の撮像テーマも決定される。決定された撮像位置で撮像された画像であり，決定された撮像テーマに合致した画像であって，かつ撮像画像グループに含まれる複数の撮像画像に不足している不足画像が検索により見つけられる。検索により見つけられた少なくとも一つの不足画像が表示手段の表示画面に表示される。電子アルバムに不足していた画像を見つけ出し，電子アルバムに使用できるようになる。 According to the present invention, the imaging position of a captured image group including a plurality of captured images is determined. In addition, the imaging theme of a plurality of captured images included in the captured image group is also determined. An insufficient image that is an image captured at the determined imaging position and that matches the determined imaging theme and that is lacking in the plurality of captured images included in the captured image group is found by the search. At least one missing image found by the search is displayed on the display screen of the display means. Find images that were missing from the electronic album and use them in the electronic album.
　多数の撮像画像を，撮像日時ごとに複数の撮像画像グループにグループ分けする撮像画像グループ分け手段をさらに備えてもよい。この場合，撮像位置決定手段は，たとえば，撮像画像グループ分け手段によってグループ分けされたグループごとに撮像位置を決定するものとなろう。 A captured image grouping means for grouping a large number of captured images into a plurality of captured image groups for each imaging date and time may be further provided. In this case, the imaging position determination means will determine the imaging position for each group grouped by the captured image grouping means, for example.
　不足画像検索手段は，たとえば，複数の撮像画像によって表わされる観光地または複数の撮像画像の撮像シーンの少なくとも一方が合致し，撮像位置決定手段によって決定された撮像位置で撮像された画像であり，撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つけるものである。 The deficient image search means is, for example, an image captured at an imaging position determined by the imaging position determination means that matches at least one of a sightseeing spot represented by a plurality of captured images or an imaging scene of the plurality of captured images, An image that matches the imaging theme determined by the imaging theme determination unit and that is insufficient for a plurality of captured images included in the captured image group is found by searching.
　撮像位置決定手段によって決定された撮像位置が屋外か屋内かを判定する判定手段をさらに備えてもよい。この場合，不足画像検索手段は，たとえば，判定手段によって屋外と判定されたことにより屋外の不足画像を見つけ，判定手段によって屋内と判定されたことにより屋内の不足画像を見つけるものである。 A determination unit that determines whether the imaging position determined by the imaging position determination unit is outdoor or indoor may be further provided. In this case, for example, the insufficient image search means finds an outdoor insufficient image when it is determined that the outdoor is determined by the determining means, and finds an indoor insufficient image when it is determined that the indoor is determined by the determining means.
　撮像画像グループに含まれる複数の画像および不足画像検索手段により見つけられた不足画像の中から撮像画像グループに含まれる複数の画像のうちの少なくとも一つの画像が含まれるように電子アルバムに使用する画像を決定する使用画像決定手段をさらに備えてもよい。 Images used in the electronic album so that at least one of the plurality of images included in the captured image group is included among the plurality of images included in the captured image group and the insufficient images found by the insufficient image search means. Use image determining means for determining
　表示手段は，撮像画像グループに含まれる複数の画像および不足画像検索手段により見つけられた不足画像を表示画面に表示するものでもよい。この場合，表示画面に表示され，かつ撮像画像グループに含まれる複数の画像のうちの少なくとも一つの画像を指定する第１の指定手段，および表示画面に表示され，かつ不足画像検索手段により見つけられた少なくとも一つの不足画像を指定する第２の指定手段をさらに備えることが好ましい。そして，使用画像決定手段は，第１の指定手段により指定された画像と第２の指定手段により指定された不足画像とを電子アルバムに使用する画像を決定するものとなろう。 The display means may display a plurality of images included in the captured image group and a deficient image found by the deficient image search means on the display screen. In this case, the first designation means for designating at least one of the plurality of images displayed on the display screen and included in the captured image group, and displayed on the display screen and found by the missing image search means. It is preferable that the image forming apparatus further includes second specifying means for specifying at least one missing image. Then, the used image determining means will determine an image that uses the image specified by the first specifying means and the insufficient image specified by the second specifying means for the electronic album.
電子アルバム作成装置の電気的構成を示すブロック図である。It is a block diagram which shows the electric constitution of an electronic album production apparatus. 電子アルバム作成装置の処理手順を示すフローチャートである。It is a flowchart which shows the process sequence of an electronic album production apparatus. 電子アルバム作成装置の処理手順を示すフローチャートである。It is a flowchart which shows the process sequence of an electronic album production apparatus. 撮像画像をグループ分けした様子を示している。A state where captured images are grouped is shown. 撮像画像グループ・テーブルの一例である。It is an example of a captured image group table. 表示画面に表示される画像の一例である。It is an example of the image displayed on a display screen.
　図１は，この発明の実施例を示すもので，電子アルバム作成装置１の電気的構成を示すブロック図である。 FIG. 1 shows an embodiment of the present invention, and is a block diagram showing an electrical configuration of an electronic album creating apparatus 1.
　電子アルバム作成装置１の全体の動作は，制御装置20によって統括される。 The overall operation of the electronic album creating apparatus 1 is controlled by the control device 20.
　電子アルバム作成装置１には，CD-ROM（コンパクト・ディスク-リード・オンリ・メモリ）ドライブ21が含まれている。電子アルバム作成装置１の動作を制御するプログラムが格納されているCD-ROM22が，CD-ROMドライブ21に装填されると，CD-ROMドライブ21によってCD-ROM22に格納されているプログラムが読み取られる。読み取られたプログラムが電子アルバム作成装置１にインストールされる。もっとも，電子アルバム作成装置１に通信機能を持たせ，ネットワークを介して送信されてきたプログラムを受信し，受信したプログラムが電子アルバム作成装置にインストールされるようにしてもよい。 The electronic album creating apparatus 1 includes a CD-ROM (compact disc-read only memory) drive 21. When a CD-ROM 22 storing a program for controlling the operation of the electronic album creating apparatus 1 is loaded into the CD-ROM drive 21, the program stored in the CD-ROM 22 is read by the CD-ROM drive 21. . The read program is installed in the electronic album creating apparatus 1. Of course, the electronic album creating apparatus 1 may have a communication function, receive a program transmitted via a network, and install the received program in the electronic album creating apparatus.
　電子アルバム作成装置１には，画像入力装置５も含まれている。この画像入力装置５には，メモリ・カード・リーダ２，ディジタル・カメラ３および画像データベース４が接続されている。メモリ・カード・リーダ２に，多数の画像を表わす画像ファイルが格納されているメモリ・カードが装填されることにより，そのメモリ・カードに格納されている画像ファイルが読み取られ,画像入力装置５に与えられる。同様に，ディジタル・カメラ３のメモリに格納されている多数の画像ファイルが画像入力装置５によって読み取られる。さらに，画像データベース４に格納されている多数の画像ファイルも画像入力装置５に入力する。メモリ・カード・リーダ２によって読み取られた画像ファイル，ディジタル・カメラ３から読み取られた画像ファイル，画像データベース４から読み取られた画像ファイルのすべてが画像入力装置５に入力せずに，いずれか（または他の装置）から与えられた画像ファイルが画像入力装置５に入力するようにしてもよい。 The electronic album creating device 1 also includes an image input device 5. The image input device 5 is connected to a memory card reader 2, a digital camera 3, and an image database 4. When a memory card in which image files representing a large number of images are stored is loaded in the memory card reader 2, the image file stored in the memory card is read and the image input device 5 is read. Given. Similarly, a large number of image files stored in the memory of the digital camera 3 are read by the image input device 5. Further, a large number of image files stored in the image database 4 are also input to the image input device 5. All of the image file read by the memory card reader 2, the image file read from the digital camera 3, and the image file read from the image database 4 are either input to the image input device 5 (or An image file given from another device may be input to the image input device 5.
　画像入力装置５に入力した多数の画像ファイルは，撮像画像グループ分け装置６に入力する。撮像画像グループ分け装置６は，入力した多数の画像ファイルによって表わされる多数の画像を，撮像日時にもとづいて複数の撮像画像グループに分けるものである。 A large number of image files input to the image input device 5 are input to the captured image grouping device 6. The captured image grouping device 6 divides a large number of images represented by a large number of input image files into a plurality of captured image groups based on the imaging date and time.
　多数の画像ファイルは，撮像画像グループごとに表示装置７，撮像位置決定装置９，撮像テーマ決定装置10，観光地決定装置11，撮像シーン決定装置12，レイアウト作成装置15および不足画像抽出装置13に与えられる。 A large number of image files are stored in the display device 7, the imaging position determination device 9, the imaging theme determination device 10, the sightseeing spot determination device 11, the imaging scene determination device 12, the layout creation device 15, and the insufficient image extraction device 13 for each captured image group. Given.
　撮像位置決定装置９は，撮像画像グループごとに，それらの撮像画像グループに含まれる複数の撮像画像の撮像位置を決定するものである。撮像位置は，撮像画像を表わす画像ファイルのヘッダに記録されている。撮像画像グループは，撮像日時にもとづいて分けられているから，撮像画像グループに含まれている複数の撮像画像はほぼ同じ撮像日時のものである。このために，これらの複数の撮像画像の撮像位置はほぼ同じである筈だが厳密には同じでないことが多い。撮像位置決定装置９は，撮像画像グループに含まれている複数の撮像画像の複数の撮像位置のうち，多い撮像位置をその撮像画像グループの撮像位置と決定する。もちろん，撮像画像グループに含まれている複数の撮像画像の複数の撮像位置の平均的な位置を，その撮像画像グループの撮像位置と決定してもよいし，その他の方法により撮像位置を決定してもよい。 The imaging position determination device 9 determines the imaging positions of a plurality of captured images included in each captured image group for each captured image group. The imaging position is recorded in the header of an image file representing the captured image. Since the captured image group is divided based on the imaging date and time, the plurality of captured images included in the captured image group are of substantially the same imaging date and time. For this reason, the imaging positions of the plurality of captured images should be substantially the same, but are not strictly the same. The imaging position determining device 9 determines a large number of imaging positions among a plurality of imaging positions of a plurality of captured images included in the captured image group as imaging positions of the captured image group. Of course, an average position of a plurality of imaging positions of a plurality of captured images included in the captured image group may be determined as the imaging position of the captured image group, or the imaging position may be determined by other methods. May be.
　撮像テーマ決定装置10は，撮像画像グループごとに，それらの撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定するものである。撮像テーマは，撮像画像グループに含まれる複数の撮像画像のそれぞれの撮像画像の特徴を解析することにより決定される。この解析により，撮像画像の被写体が人物なのか，人物であれば，どのような人物が多いのか，年齢はいくつ位か，集団が多いか，個人が多いか，風景なのか，風景であれば，どのような風景が多いか，などの画像情報が分る。この解析にもとづいて，撮像テーマが，撮像画像グループごとに決定される。 The imaging theme determination device 10 determines the imaging theme of a plurality of captured images included in each captured image group for each captured image group. The imaging theme is determined by analyzing the characteristics of each captured image of a plurality of captured images included in the captured image group. From this analysis, if the subject of the captured image is a person, if it is a person, what kind of person is there, how many people are there, how many people are there, whether there are many groups, whether there are many individuals, if it is a landscape, if it is a landscape , Image information such as what kind of scenery is common. Based on this analysis, an imaging theme is determined for each captured image group.
　観光地決定装置11は，撮像画像グループごとに，それらの撮像画像グループに含まれる複数の撮像画像が表わす観光地を決定するものである。観光地は，撮像画像グループに含まれる撮像画像の位置情報を利用して，その位置がどこの観光地かを検出することにより得られる。 The sightseeing spot determination device 11 determines a sightseeing spot represented by a plurality of captured images included in each captured image group for each captured image group. A tourist spot can be obtained by using the positional information of the captured images included in the captured image group to detect where the tourist spot is located.
　撮像シーン決定装置12は，撮像グループごとに，それらの撮像画像グループに含まれる複数の撮像画像の撮像シーンを決定するものである。撮像画像を表わす画像ファイルに含まれるヘッダに撮像シーンが記録されていれば，その撮像シーン利用することができるし，ヘッダに撮像シーンが記録されていなければ，上述のように画像を解析することにより，被写体が人物，風景かなどが分るので，その解析結果を利用して撮像シーンを決定できる。 The imaging scene determination device 12 determines, for each imaging group, imaging scenes of a plurality of captured images included in those captured image groups. If a captured scene is recorded in the header included in the image file representing the captured image, the captured scene can be used. If the captured scene is not recorded in the header, the image is analyzed as described above. Thus, it can be determined whether the subject is a person, a landscape, etc., and an imaging scene can be determined using the analysis result.
　撮像位置決定装置９において決定された撮像位置，撮像テーマ決定装置10において決定された撮像テーマ，観光地決定装置11において決定された観光地および撮像シーン決定装置12において決定された観光地をそれぞれ表わすデータは不足画像抽出装置13に与えられる。上述のように不足画像抽出装置13には撮像画像グループ分け装置６において分けられた撮像画像グループに含まれる撮像画像を表わす画像ファイルも与えられている。不足画像抽出装置13において，撮像画像グループに含まれる撮像画像を利用して電子アルバムを作成した場合に，不足していると考えられる画像が決定され，その決定された画像が画像ライブラリ14の中から見つけられる。たとえば，撮像日時が秋であり，撮像画像グループの撮像テーマが「旅行」と決定されたにもかかわらず，その撮像画像グループに紅葉の画像が含まれていない場合には紅葉の画像が不足画像として決定され，その紅葉の画像が画像ライブラリから抽出される。 The imaging position determined by the imaging position determination device 9, the imaging theme determined by the imaging theme determination device 10, the sightseeing spot determined by the sightseeing spot determination device 11, and the sightseeing spot determined by the imaging scene determination device 12, respectively. The data is given to the missing image extraction device 13. As described above, the shortage image extracting device 13 is also provided with an image file representing a captured image included in the captured image group divided by the captured image grouping device 6. When the insufficient image extraction device 13 creates an electronic album using captured images included in the captured image group, an image considered to be insufficient is determined, and the determined image is stored in the image library 14. Can be found from. For example, if the image capturing date / time is autumn and the image capturing theme of the captured image group is determined to be “travel”, but the captured image group does not include the image of autumn leaves, the image of the autumn leaves is insufficient. And the image of the autumn leaves is extracted from the image library.
　不足画像抽出装置13において抽出された不足画像および撮像画像グループに含まれる画像は，表示装置７に与えられ，その表示画面に表示される。表示画面に表示されている画像がタッチ・パネル８によって選択され，選択された画像を表わす画像ファイルがレイアウト作成装置15に与えられる。レイアウト作成装置15によって電子アルバムを表わす電子アルバム・データが生成される。 The deficient images extracted by the deficient image extraction device 13 and the images included in the captured image group are given to the display device 7 and displayed on the display screen. An image displayed on the display screen is selected by the touch panel 8, and an image file representing the selected image is given to the layout creating device 15. The layout creating device 15 generates electronic album data representing the electronic album.
　上述の各装置は，ハードウエアで構成されているが，ソフトウエアで実施できるようにしてもよいのはいうまでもない。 Each device described above is configured by hardware, but it goes without saying that it may be implemented by software.
　図２および図３は，電子アルバム作成装置１の処理手順を示すフローチャートである。 2 and 3 are flowcharts showing a processing procedure of the electronic album creating apparatus 1. FIG.
　上述のように，多数の撮像画像が電子アルバム作成装置１に入力する（ステップ31）。すると，多数の撮像画像の撮像日時にもとづいて複数の撮像画像グループに分けられる（ステップ32）。 As described above, a large number of captured images are input to the electronic album creating apparatus 1 (step 31). Then, it is divided into a plurality of captured image groups on the basis of the captured date and time of a large number of captured images (step 32).
　図４は，電子アルバム作成装置１に入力した多数の撮像画像ｉを撮像日時にしたがって配置した様子を示している。 FIG. 4 shows a state in which a large number of captured images i input to the electronic album creating apparatus 1 are arranged according to the imaging date and time.
　図４において，左側から右側となるにつれて撮像日時が新しくなっている。多数の画像ｉは，イベントがあると撮像枚数が多くなる。このために，多数の画像が撮像日時にもとづいてグループ分けされると，撮像画像グループに含まれる撮像画像は，共通のイベントを表わすこととなり，上述のように撮像画像グループごとに撮像テーマを決定できるようになる。 In FIG. 4, the imaging date and time are newer from the left side to the right side. A large number of images i increase the number of images when there is an event. For this reason, when a large number of images are grouped based on the shooting date and time, the captured images included in the captured image group represent a common event, and the imaging theme is determined for each captured image group as described above. become able to.
　図４においては，多数の撮像画像ｉが撮像日時にもとづいて，撮像画像グループＧ１からＧ４の４つに分けられている。たとえば，撮像画像グループＧ１には，撮像画像Ｉ１からＩ18が含まれている。グループの数は，４つより多くても少なくもとよい。 In FIG. 4, a large number of captured images i are divided into four captured image groups G1 to G4 based on the captured date and time. For example, the captured image group G1 includes captured images I1 to I18. The number of groups can be more or less than four.
　図５は，撮像画像テーブルの一例である。この撮像画像テーブルは，制御装置20において生成される。 FIG. 5 is an example of a captured image table. This captured image table is generated in the control device 20.
　上述ように撮像画像グループが決定すると，それらの撮像画像グループに対応して撮像位置等が撮像画像テーブルに格納される。 When the captured image groups are determined as described above, the captured positions and the like are stored in the captured image table corresponding to the captured image groups.
　図２に戻って，撮像日時にもとづいて撮像画像グループが形成されると，上述のように，撮像画像グループごとに，その撮像画像グループの撮像位置，撮像テーマ，観光地および撮像シーンが決定される（ステップ33，34，35，36）。撮像画像グループの撮像位置，撮像テーマ，観光地および撮像シーンは，必ずしも図２に示す順序で決定されなくともよいし，並行して決定されるようにしてもよい。このようにして決定された撮像位置等の情報が，撮像画像グループに対応して，撮像画像グループ・テーブルに格納されることとなる（図５参照）。 Returning to FIG. 2, when a captured image group is formed based on the captured date and time, as described above, the captured position, captured theme, sightseeing spot, and captured scene of the captured image group are determined for each captured image group. (Steps 33, 34, 35, 36). The imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group do not necessarily have to be determined in the order shown in FIG. 2, or may be determined in parallel. Information such as the imaging position determined in this way is stored in the captured image group table corresponding to the captured image group (see FIG. 5).
　たとえば，撮像画像グループＧ１の撮像位置，撮像テーマ，観光地および撮像シーンは，それぞれ位置α，旅行，宮島および風景，人物である。撮像画像グループＧ２の撮像位置，撮像テーマ，観光地および撮像シーンは，それぞれ位置β，運動会，小学校および人物となり，撮像画像グループＧ３の撮像位置，撮像テーマ，観光地および撮像シーンは，それぞれ位置γ，お正月，住宅地および人物となる。また，撮像画像グループＧ４の撮像位置，撮像テーマ，観光地および撮像シーンは，それぞれ位置δ，花見，上野公園および人物，風景となる。 For example, the imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group G1 are position α, travel, Miyajima and scenery, and a person, respectively. The imaging position, the imaging theme, the sightseeing spot, and the imaging scene of the captured image group G2 are the position β, the athletic meet, the elementary school, and the person, respectively, and the imaging position, the imaging theme, the sightseeing spot, and the imaging scene of the captured image group G3 are the position γ, respectively. , New Year, residential area and person. In addition, the imaging position, imaging theme, sightseeing spot, and imaging scene of the captured image group G4 are position δ, cherry-blossom viewing, Ueno Park, person, and landscape, respectively.
　また，撮像画像グループに含まれる撮像画像が屋内で撮像されたか屋外で撮像されたかを判断し，その判断結果を示す情報を撮像位置に付加するようにしてもよい。撮像画像グループに含まれる撮像画像のほぼすべてが屋外で撮像されたものであれば，その撮像画像グループの撮像場所は屋外となり，撮像画像グループに含まれる撮像画像のほぼすべてが屋内で撮像されたものであれば，その撮像画像グループの撮像場所は屋内となる。 Further, it may be determined whether the captured image included in the captured image group is captured indoors or outdoors, and information indicating the determination result may be added to the imaging position. If almost all of the captured images included in the captured image group are captured outdoors, the captured location of the captured image group is outdoors, and almost all of the captured images included in the captured image group are captured indoors. If it is a thing, the imaging location of the captured image group is indoors.
　つづいて，上述ようにして決定された撮像画像グループの撮像位置，撮像テーマ，観光地および撮像シーンを利用して（必要に応じて，上述した屋外，屋内の情報も利用して），それらの撮像位置等に合致した画像が画像ライブラリ14から抽出される（ステップ36）。たとえば，撮像画像グループＧ１は，上述のように，撮像位置，撮像テーマ，観光地および撮像シーンは，位置α，旅行，宮島および風景，人物であったにもかかわらず，撮像することを忘れてしまったために，撮像画像グループＧ１の中には，宮島を象徴するような厳島神社，鳥居，五重塔，紅葉（撮像日時が秋の場合）などが含まれていなかった場合には，それらの画像が不足画像として決定され，画像ライブラリ14から抽出される（ステップ36）。 Subsequently, using the imaging position, imaging theme, sightseeing spot, and imaging scene of the imaging image group determined as described above (using the above-mentioned outdoor and indoor information as necessary), An image that matches the imaging position or the like is extracted from the image library 14 (step 36). For example, as described above, the captured image group G1 forgets to capture images even though the imaging position, the imaging theme, the sightseeing spot, and the imaging scene are the position α, travel, Miyajima and landscape, and a person. Therefore, if the captured image group G1 does not include Itsukushima Shrine, Torii, Five-storied Pagoda, Autumn leaves (when the imaging date is autumn) that symbolizes Miyajima, those images are included. The missing image is determined and extracted from the image library 14 (step 36).
　このようにして抽出された不足画像と，撮像画像グループの中に含まれる撮像画像と，のそれぞれにおいて，画像のスコア付けが行われる（図３ステップ37）。画像のスコアは，電子アルバムに利用される画像として適している程度を示すもので，画像の明るさ，暗さ，構図の的確性（主要被写体が切れていないかなど），ピントがぼけていないかなどにもとづいて算出される。 Image scoring is performed on each of the shortage image extracted in this way and the captured image included in the captured image group (step 37 in FIG. 3). The score of the image indicates the degree suitable for the image used in the electronic album. The brightness, darkness, and compositional accuracy (such as whether the main subject is not cut out) and the focus are not blurred. It is calculated on the basis of
　画像のスコア付けが終わると，撮像画像グループ内に含まれている撮像画像と，抽出された不足画像とが表示装置７の表示画面に表示される。 When the scoring of the images is completed, the captured images included in the captured image group and the extracted insufficient images are displayed on the display screen of the display device 7.
　図６は，表示装置７の表示画面50に表示された画像の一例である。 FIG. 6 is an example of an image displayed on the display screen 50 of the display device 7.
　表示画面50の左側は撮像画像表示領域51であり，表示画面50の右側は不足画像表示領域52である。 The left side of the display screen 50 is a captured image display area 51, and the right side of the display screen 50 is an insufficient image display area 52.
　撮像画像表示領域51には，一つの撮像画像グループに含まれている撮像画像が撮像日時順に表示される（必ずしも撮像日時順で無くともよい）。図６には，撮像画像グループＧ１に含まれている撮像画像Ｉ１からＩ９が図示されている。スクロールされることにより，撮像画像表示領域51に表示されていない撮像画像Ｉ10からＩ18も撮像画像表示領域51に表示されることとなる。これらの撮像画像Ｉ１からＩ９の左上にはスコアを示す星印が表示されている。スコアが高いほど多くの星印が表示されており，スコアが低いと星印が無い。星印は電子アルバムに適した画像であり，その星印を参考にして利用者は，電子アルバムに含ませるべき撮像画像を選択できる。 In the captured image display area 51, captured images included in one captured image group are displayed in the order of imaging date and time (not necessarily in the order of imaging date and time). FIG. 6 shows captured images I1 to I9 included in the captured image group G1. By being scrolled, the captured images I10 to I18 that are not displayed in the captured image display area 51 are also displayed in the captured image display area 51. An asterisk indicating a score is displayed on the upper left of these captured images I1 to I9. The higher the score, the more stars are displayed. The lower the score, the less the stars. The star is an image suitable for an electronic album, and the user can select a captured image to be included in the electronic album with reference to the star.
　不足画像表示領域52には，抽出された不足画像がスコアの高い順に表示される（必ずしもスコアの高い順でなくともよい）。不足画像表示領域52には，抽出された不足画像のうちの一部の不足画像Ｐ１からＰ９が図示されている。不足画像表示領域52においてもスクロールすることにより，表示されている不足画像Ｐ１からＰ９以外の不足画像が表示されるようになる。また，不足画像Ｐ１からＰ９の左上にもスコアが高いほど多くの星印が表示されている。星印を参考にして利用者は，電子アルバムに含ませるべき不足画像を選択できる。 In the insufficient image display area 52, the extracted insufficient images are displayed in descending order of score (not necessarily in the order of high score). In the insufficient image display area 52, some of the extracted insufficient images P1 to P9 are illustrated. By scrolling also in the shortage image display area 52, shortage images other than the displayed shortage images P1 to P9 are displayed. Further, the higher the score is, the more stars are displayed on the upper left of the deficient images P1 to P9. With reference to the star, the user can select the missing images to be included in the electronic album.
　表示画面50には，下部に指示領域53が形成されている。この指示領域53には，「電子アルバムに入れる」の文字が記載されている画像挿入領域61，「画像の確認」の文字が記載されている確認領域62および「終了」の文字が記載されている終了領域63が形成されている。撮像画像表示領域51または不足画像表示領域52に表示されている撮像画像または不足画像が画像挿入領域61にドラッグ・アンド・ドロップされると，そのドラッグ・アンド・ドロップされた画像が電子アルバムを構成する見開きのページ（または１ページ）を構成する画像となる。確認領域62がタッチされると，電子アルバムを構成する見開きのページに含まれる画像の内容が確認できる。終了領域63がタッチされると，電子アルバム作成処理が終了する。 In the display screen 50, an instruction area 53 is formed at the bottom. In this instruction area 53, an image insertion area 61 in which the characters “Place in electronic album” are described, a confirmation area 62 in which the characters “Confirm image” are described, and a character “End” are described. An end region 63 is formed. When the captured image or the insufficient image displayed in the captured image display area 51 or the insufficient image display area 52 is dragged and dropped into the image insertion area 61, the dragged and dropped image forms an electronic album. This is an image constituting a spread page (or one page). When the confirmation area 62 is touched, the contents of the images included in the spread pages constituting the electronic album can be confirmed. When the end area 63 is touched, the electronic album creation process ends.
　図３を参照して，上述したように，撮像画像グループ内の撮像画像と不足画像とが選択されると（ステップ39），選択された画像が電子アルバムを構成する見開きのページに含まれる画像として決定される（ステップ40）。このようにして画像が決定されると，その撮像画像グループについての電子アルバムの見開きページがレイアウトされる（ステップ41）。たとえば，図６に示す撮像画像Ｉ１，Ｉ３，Ｉ８が選択され，不足画像Ｐ１およびＰ２が選択されたとすると，これらの選択された画像が電子アルバムの見開きのページを構成する画像としてレイアウトされる。 Referring to FIG. 3, as described above, when a captured image and a deficient image in a captured image group are selected (step 39), the selected image is an image included in a spread page constituting the electronic album. (Step 40). When the image is determined in this way, the spread page of the electronic album for the captured image group is laid out (step 41). For example, if the captured images I1, I3, and I8 shown in FIG. 6 are selected and the shortage images P1 and P2 are selected, the selected images are laid out as images constituting a spread page of the electronic album.
　他の画像グループＧ２，Ｇ３およびＧ４についても同様の処理が繰り返されて電子アルバムが生成される（ステップ42）。 The same processing is repeated for the other image groups G2, G3, and G4 to generate an electronic album (step 42).
　上述の実施例では，利用者に撮像画像の指定（第１の指定）と不足画像の指定（第２の指定）をさせていたが，必ずしも利用者に指定させなくともよく，電子アルバム作成装置が指定するようにしてもよい。その場合には，撮像画像グループに含まれる複数の撮像画像のうち少なくとも一つの撮像画像が電子アルバムに利用されるように指定される。また，複数の撮像画像のうち少なくとも一つの撮像画像と，少なくとも一つの不足画像と，が電子アルバムに含まれるように電子アルバム作成装置が指定するようにしてもよい。また，利用者に撮像画像と不足画像とを選択させる前に電子アルバム作成装置が選択して電子アルバムを作成し，その後，電子アルバムの各ページを表示画面50に表示し，利用者が各ページに含まれる画像を差し替えるようにしてもよい。また，上述の実施例では，撮像画像グループが電子アルバムの見開きページ（１ページ）に対応しているが，見開きページではなく撮像画像グループに含まれる撮像画像が電子アルバム全体に利用されるようにしてもよい。撮像画像グループの撮像テーマをもつ電子アルバムが作成されるようになる。 In the above-described embodiment, the user designates the captured image (first designation) and the insufficient image (second designation). However, the user does not necessarily have to designate the electronic album creating apparatus. May be specified. In that case, it is specified that at least one captured image among a plurality of captured images included in the captured image group is used for the electronic album. Further, the electronic album creating apparatus may specify that at least one captured image and at least one insufficient image among the plurality of captured images are included in the electronic album. In addition, before the user selects a captured image and an insufficient image, the electronic album creating apparatus selects and creates an electronic album. Thereafter, each page of the electronic album is displayed on the display screen 50, and the user displays each page. You may make it replace the image contained in. In the above-described embodiment, the captured image group corresponds to the spread page (one page) of the electronic album, but the captured image included in the captured image group is used for the entire electronic album instead of the spread page. May be. An electronic album having the imaging theme of the captured image group is created.
　また，上述の実施例では，不足画像は，画像ライブラリ14から抽出されているが，画像ライブラリ14がネットワーク上のサーバなどに接続されている場合には，そのサーバと通信することにより不足画像を表わす画像ファイルをダウンロードするようにしてもよい。また，電子アルバム作成装置１に入力する画像ファイルも，スーパーなどに置かれる店頭端末装置またはパーソナル・コンピュータなどからアップロードされてもよい。 In the above-described embodiment, the missing image is extracted from the image library 14, but when the image library 14 is connected to a server on the network, the missing image is communicated with the server. You may make it download the image file to represent. The image file input to the electronic album creating apparatus 1 may also be uploaded from a storefront terminal device or a personal computer placed in a supermarket.
１　電子アルバム作成装置（電子アルバム不足画像検索装置）
６　撮像画像グループ分け装置
７　表示装置
９　撮像位置決定装置
10　撮像テーマ決定装置
11　観光地決定装置
12　撮像シーン決定装置
13　不足画像抽出装置 1 Electronic album creation device (electronic album shortage image search device)
6 Captured Image Grouping Device 7 Display Device 9 Imaging Position Determination Device
10 Imaging theme determination device
11 Sightseeing place determination device
12 Imaging scene determination device
13 Missing image extraction device

Claims (8)

  1. 　撮像画像グループに含まれる複数の撮像画像の撮像位置を決定する撮像位置決定手段，
    　上記撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定する撮像テーマ決定手段，
    　上記撮像位置決定手段によって決定された撮像位置で撮像された画像であり，上記撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ上記撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つける不足画像検索手段，および
    　上記不足画像検索手段により見つけられた少なくとも一つの不足画像を表示する表示手段，
    　を備えた電子アルバム不足画像検索装置。     Imaging position determining means for determining imaging positions of a plurality of captured images included in the captured image group;
    Imaging theme determining means for determining imaging themes of a plurality of captured images included in the captured image group;
    A plurality of captured images that are images captured at the imaging position determined by the imaging position determination unit and that match the imaging theme determined by the imaging theme determination unit and that are included in the captured image group A deficient image search means for finding a deficient image deficient in the search, and a display means for displaying at least one deficient image found by the deficient image search means,
    Electronic album shortage image search device equipped with.
  2. 　多数の撮像画像を，撮像日時ごとに複数の撮像画像グループにグループ分けする撮像画像グループ分け手段をさらに備え，
    　上記撮像位置決定手段は，
    　上記撮像画像グループ分け手段によってグループ分けされたグループごとに撮像位置を決定するものである，
    　請求項１に記載の電子アルバム不足画像検索装置。     A captured image grouping means for grouping a large number of captured images into a plurality of captured image groups for each imaging date and time;
    The imaging position determining means includes
    The imaging position is determined for each group grouped by the captured image grouping means.
    The electronic album shortage image search device according to claim 1.
  3. 　上記不足画像検索手段は，
    　上記複数の撮像画像によって表わされる観光地または上記複数の撮像画像の撮像シーンの少なくとも一方が合致し，上記撮像位置決定手段によって決定された撮像位置で撮像された画像であり，上記撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ上記撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つけるものである，
    　請求項１または２に記載の電子アルバム不足画像検索装置。     The above missing image search means
    At least one of a sightseeing spot represented by the plurality of captured images or an imaging scene of the plurality of captured images is an image captured at an imaging position determined by the imaging position determination unit, and the imaging theme determination unit A search is performed to find a shortage image that matches the image pickup theme determined by the above and is insufficient for a plurality of image pickup images included in the image pickup image group.
    The electronic album shortage image search device according to claim 1 or 2.
  4. 　上記撮像位置決定手段によって決定された撮像位置が屋外か屋内かを判定する判定手段をさらに備え，
    　上記不足画像検索手段は，
    　上記判定手段によって屋外と判定されたことにより屋外の上記不足画像を見つけ，上記判定手段によって屋内と判定されたことにより屋内の上記不足画像を見つけるものである，
    　請求項１から３のうち，いずれか一項に記載の電子アルバム不足画像検索装置。     Determination means for determining whether the imaging position determined by the imaging position determination means is outdoor or indoor,
    The above missing image search means
    When the determination means determines that the outdoor image is insufficient, and when the determination means determines that the image is indoor, the indoor image is insufficient.
    The electronic album shortage image search device according to any one of claims 1 to 3.
  5. 　上記撮像画像グループに含まれる複数の画像および上記不足画像検索手段により見つけられた不足画像の中から上記撮像画像グループに含まれる複数の画像のうちの少なくとも一つの画像が含まれるように電子アルバムに使用する画像を決定する使用画像決定手段をさらに備えた請求項１から４のうち，いずれか一項に記載の電子アルバム不足画像検索装置。 The electronic album includes at least one of a plurality of images included in the captured image group among a plurality of images included in the captured image group and a shortage image found by the shortage image search unit. The electronic album deficient image search device according to any one of claims 1 to 4, further comprising a use image determination unit that determines an image to be used.
  6. 　上記表示手段は，
    　上記撮像画像グループに含まれる複数の画像および上記不足画像検索手段により見つけられた不足画像を表示画面に表示するものであり，
    　上記表示画面に表示され，かつ上記撮像画像グループに含まれる複数の画像のうちの少なくとも一つの画像を指定する第１の指定手段，および
    　上記表示画面に表示され，かつ上記不足画像検索手段により見つけられた少なくとも一つの不足画像を指定する第２の指定手段をさらに備え，
    　上記使用画像決定手段は，上記第１の指定手段により指定された画像と上記第２の指定手段により指定された不足画像とを電子アルバムに使用する画像を決定するものである，
    　請求項５に記載の電子アルバム不足画像検索装置。     The display means is
    Displaying a plurality of images included in the captured image group and a deficient image found by the deficient image search means on a display screen;
    First specifying means for specifying at least one of a plurality of images displayed on the display screen and included in the captured image group; and displayed on the display screen and found by the missing image search means. A second designating means for designating at least one missing image provided;
    The used image determining means determines an image that uses the image specified by the first specifying means and the insufficient image specified by the second specifying means for the electronic album.
    The electronic album shortage image search device according to claim 5.
  7. 　撮像位置決定手段が，撮像画像グループに含まれる複数の撮像画像の撮像位置を決定し，
    　撮像テーマ決定手段が，上記撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定し，
    　不足画像検索手段が，上記撮像位置決定手段によって決定された撮像位置で撮像された画像であり，上記撮像テーマ決定手段によって決定された撮像テーマに合致した画像であって，かつ上記撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つけ，
    　表示手段が，上記不足画像検索手段により見つけられた少なくとも一つの不足画像を表示する，
    　電子アルバム不足画像検索装置の動作制御方法。     The imaging position determining means determines imaging positions of a plurality of captured images included in the captured image group,
    The imaging theme determining means determines imaging themes of a plurality of captured images included in the captured image group,
    The deficient image search means is an image captured at the imaging position determined by the imaging position determination means, is an image that matches the imaging theme determined by the imaging theme determination means, and is included in the captured image group. Find the missing images that are missing in the multiple captured images by searching,
    Display means displays at least one missing image found by the missing image search means;
    Operation control method of electronic album shortage image search device.
  8. 　電子アルバム不足画像検索装置のコンピュータを制御するコンピュータが読み取り可能なプログラムであって，
    　撮像画像グループに含まれる複数の撮像画像の撮像位置を決定させ，
    　上記撮像画像グループに含まれる複数の撮像画像の撮像テーマを決定させ，
    　決定された撮像位置で撮像され，決定された撮像テーマに合致した画像であって，かつ上記撮像画像グループに含まれる複数の撮像画像に不足している不足画像を，検索により見つけ，
    　見つけられた少なくとも一つの不足画像を表示するように電子アルバム不足画像検索装置のコンピュータを制御するプログラム。     A computer-readable program for controlling the computer of the electronic album shortage image search device,
    The imaging positions of a plurality of captured images included in the captured image group are determined,
    The imaging theme of a plurality of captured images included in the captured image group is determined,
    A search is performed to find a deficient image that is captured at the determined imaging position and that matches the determined imaging theme and is lacking in the plurality of captured images included in the captured image group.
    A program for controlling a computer of an electronic album missing image search device to display at least one found missing image.
PCT/JP2014/055962 2013-03-28 2014-03-07 Electronic album missing image retrieval device and method for controlling operation thereof WO2014156560A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013-068200 2013-03-28
JP2013068200A JP2014192795A (en) 2013-03-28 2013-03-28 Electronic album insufficient image retrieval device and method for controlling operation of the same

Publications (1)

Publication Number Publication Date
WO2014156560A1 true WO2014156560A1 (en) 2014-10-02

Family

ID=51623546

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/055962 WO2014156560A1 (en) 2013-03-28 2014-03-07 Electronic album missing image retrieval device and method for controlling operation thereof

Country Status (2)

Country Link
JP (1) JP2014192795A (en)
WO (1) WO2014156560A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016099900A (en) * 2014-11-25 2016-05-30 キヤノン株式会社 Device and method of searching images

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6494503B2 (en) 2015-08-07 2019-04-03 キヤノン株式会社 Image processing apparatus, image processing method, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000287164A (en) * 1999-03-31 2000-10-13 Ricoh Co Ltd Work album support system, and computer-readable recording medium recording data and program for the same system
JP2002163264A (en) * 2000-08-18 2002-06-07 Eastman Kodak Co System and method for acquiring related graphical material in digital graphics album
WO2010013424A1 (en) * 2008-07-29 2010-02-04 パナソニック株式会社 Image search device and image search method
JP2012088886A (en) * 2010-10-19 2012-05-10 Panasonic Corp Display device, display method, and program
JP2013015907A (en) * 2011-06-30 2013-01-24 Canon Inc Image classification device, control method for image classification device, and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000287164A (en) * 1999-03-31 2000-10-13 Ricoh Co Ltd Work album support system, and computer-readable recording medium recording data and program for the same system
JP2002163264A (en) * 2000-08-18 2002-06-07 Eastman Kodak Co System and method for acquiring related graphical material in digital graphics album
WO2010013424A1 (en) * 2008-07-29 2010-02-04 パナソニック株式会社 Image search device and image search method
JP2012088886A (en) * 2010-10-19 2012-05-10 Panasonic Corp Display device, display method, and program
JP2013015907A (en) * 2011-06-30 2013-01-24 Canon Inc Image classification device, control method for image classification device, and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016099900A (en) * 2014-11-25 2016-05-30 キヤノン株式会社 Device and method of searching images

Also Published As

Publication number Publication date
JP2014192795A (en) 2014-10-06

Similar Documents

Publication Publication Date Title
US9507506B2 (en) Automatic target box in methods and systems for editing content-rich layouts in media-based projects
US7900161B2 (en) Data display apparatus, data display method, data display program and graphical user interface
US11068133B2 (en) Electronic album apparatus and method of controlling operation of same
US20060039674A1 (en) Image editing apparatus, method, and program
JP5883843B2 (en) Image evaluation apparatus, image evaluation method, image evaluation program, and recording medium storing the program
JP5216591B2 (en) Method and apparatus for enabling browsing of images
US20060126963A1 (en) Frame classification information providing device and program
JP5859471B2 (en) Electronic album creating apparatus and electronic album manufacturing method
US20110191720A1 (en) Method and apparatus for displaying menus
JP6054330B2 (en) Image layout generation apparatus, image product generation system, image layout generation method, image layout generation program, and recording medium
US11080913B2 (en) Page image display control system, page image display control method, and program therefor
KR101747299B1 (en) Method and apparatus for displaying data object, and computer readable storage medium
US20140149885A1 (en) System and method for providing a tapestry interface with interactive commenting
JP2014052915A (en) Electronic apparatus, display control method, and program
US9779306B2 (en) Content playback system, server, mobile terminal, content playback method, and recording medium
WO2014156560A1 (en) Electronic album missing image retrieval device and method for controlling operation thereof
US20180349024A1 (en) Display device, display program, and display method
JP2010128754A (en) Information processing apparatus, display control method, and program
JP2007058686A (en) Electronic apparatus, computer program and method for generating retrieving picture
EP3467830B1 (en) Information processing method for displaying images, information processing apparatus, and program
JP2006060652A (en) Digital still camera
JP2009055272A (en) Image processing apparatus, image processing method, and image processing program
JP2007104326A (en) Content creating device and content creating method
US20170208358A1 (en) Device for and method of tv streaming and downloading for personal photos and videos presentation on tv that seamlessly integrates with mobile application and cloud media server
JP6572054B2 (en) Image processing apparatus and image processing method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14774223

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14774223

Country of ref document: EP

Kind code of ref document: A1