JP2007079867A - Electronic album display system, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reproduce songs in such a way that they are comfortable to users, while automatically selecting the songs to be replayed in a slide show. <P>SOLUTION: An electronic album display system for displaying a plurality of images in sequence while reproducing songs, is provided including: an image storage part for storing the plurality of images in association with image attribute information; an image selecting part for selecting at least some of the images as an image group; a song storage part for storing the plurality of songs in association with song attribute information; a song selecting part for selecting songs, based on the relevance of the image attribute information corresponding to each of the images included in the image group, and to the song attribute information corresponding to each of the plurality of songs; an image display part for displaying in sequence the images included in the image group; and a song reproducing part for reproducing the selected songs when the images are displayed in sequence. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an electronic album display system, an electronic album display method, and an electronic album display program. In particular, the present invention relates to an electronic album display system, an electronic album display method, and an electronic album display program that sequentially display a plurality of images while reproducing a music piece.

  Conventionally, an electronic album display system that sequentially displays a plurality of images as a slide show is known. Furthermore, there is known an electronic album display system that aims to improve user satisfaction by playing music as BGM (Background Music) along with image display. However, in these electronic album display systems, in many cases, it is necessary for the user to manually specify the music to be played, and there has been a concern that the burden on the user is heavy.

Therefore, for each image to be displayed, when displaying a music suitable for the image capturing date and time in the image, for example, an image captured in winter, it is used by playing a music registered as “winter music” A technique is disclosed that can reproduce music suitable for an image to be displayed while keeping the burden on the user low (see, for example, Patent Document 1).
JP-A-9-22416

  Generally, the display time of one image in a slide show is about several seconds. Also, general music is often produced on the assumption that it will be played for a longer time rather than a short time such as 5 seconds or 10 seconds. Therefore, when the music to be BGM is selected for each image as in the electronic album display system according to Patent Document 1, switching of the music to be played frequently occurs, so that the user can play the music. In many cases, music is often felt as annoying, and the objective of improving user satisfaction by reproducing the music as BGM may not be sufficiently achieved.

  Accordingly, an object of the present invention is to provide an electronic album display system, an electronic album display method, and an electronic album display program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, in the first embodiment of the present invention, an electronic album display system that sequentially displays a plurality of images while playing a music piece, each of the plurality of images is unique to the image. And selecting at least a part of images as an image group that are displayed in the order of a predetermined display schedule among a plurality of images and an image storage unit that is stored in association with image attribute information that is information of An image selection unit, a music storage unit storing each of a plurality of songs in association with music attribute information that is information unique to the music, and an image storage in association with each of the images included in the image group A music piece is selected from a plurality of music pieces based on the degree of association between the image attribute information stored in the music piece information section and the music attribute information stored in the music piece storage section in association with each of the plurality of music pieces. A music selection unit, an image display unit that sequentially displays images included in the image group, and an image display unit that sequentially displays images included in the image group, the music selection unit selects the image group. A music playback unit for playing back the music.

  The image storage unit stores each of the plurality of images in association with imaging date / time information indicating the imaging date / time of the image, and the music storage unit determines each of the plurality of songs for the music in advance. The music selection unit selects the music corresponding to the period information indicating the period including the imaging date and time of all the images included in the image group from a plurality of music. May be. The image storage unit stores each of the plurality of images in association with imaging point information indicating an imaging point of the image, and the music storage unit stores each of the plurality of songs in an area related to the music. The music selection unit includes a plurality of music selection units based on the relevance of the local information in each of the regions including the image pickup points of all images included in the image group. A song may be selected from the songs.

  The image storage unit stores each of the plurality of images in association with image content information indicating the content of the image, and the music storage unit stores each of the plurality of songs with the music content indicating the content of the music The music selection unit stores a plurality of pieces of music based on the image content information common to all images included in the image group and the degree of relevance of the music content information in each of the plurality of pieces of music. You may select a song from The image storage unit stores each of the plurality of images in association with a keyword indicating the feature of the image, and the song storage unit associates each of the plurality of songs with a keyword indicating the feature of the song. The music selection unit selects a music from a plurality of music based on a keyword common to all images included in the image group and a degree of relevance of the keyword corresponding to each of the plurality of music. Also good.

  The image selection unit, in at least some of the plurality of images displayed in the order of the display schedule, when the relevance in the image attribute information of each image is equal to or higher than a predetermined reference value, Some images may be selected as an image group. The image selection unit determines, from among a plurality of pieces of image attribute information associated with each of a plurality of images, which image attribute information to select an image group based on the degree of association in the image attribute information. You may determine based on whether the sum total of the display time in each of the images contained in the image group selected based on becomes more than a predetermined reference value. The image display unit may control the display time in each of the images included in the image group so that the total display time in each of the images included in the image group is equal to or greater than a predetermined reference value.

  For each image included in the image group, the image attribute information stored in the image storage unit in association with the image, and the music attribute information stored in the music storage unit in association with each of a plurality of music pieces. A music candidate selection unit that selects a music candidate that is a candidate for music to be played from a plurality of music based on the music candidates selected for each of the images included in the image group; Alternatively, the music candidate selected most frequently may be selected as the music to be played. The music candidate selection unit selects a plurality of music candidates for each of the images included in the image group, and each of the selected music candidates includes image attribute information in the image and music attribute information in the music candidate. A weight based on the degree of association is given, and the music selection unit selects the music to be played based on each of the weights given to each of the plurality of music candidates selected for each of the images included in the image group May be.

  According to a second aspect of the present invention, there is provided an electronic album display method for sequentially displaying a plurality of images while playing a music, wherein the image storage unit assigns each of the plurality of images to the image. The music storage unit stores each of the plurality of songs in association with the song attribute information, which is information unique to the song, and stores the electronic album. The display method associates each of the images included in the image group with an image selection stage in which at least some of the images displayed in the order of a predetermined display schedule are selected as an image group. Multiple pieces of music based on the degree of association between the image attribute information stored in the image storage unit and the music attribute information stored in the music storage unit in association with each of the plurality of pieces of music. A music selection stage for selecting music, an image display stage for sequentially displaying images included in the image group, and a music selection stage for the image group when images included in the image group are sequentially displayed in the image display stage. And a music playback stage for playing back the music selected in.

  For each image included in the image group, the image attribute information stored in the image storage unit in association with the image, and the music attribute information stored in the music storage unit in association with each of a plurality of music pieces. A music candidate selection stage for selecting a music candidate that is a candidate for music to be played from a plurality of music based on the music candidates selected for each of the images included in the image group; Alternatively, the music candidate selected most frequently may be selected as the music to be played.

  According to a third aspect of the present invention, there is provided an electronic album display program that causes a computer to function as an electronic album display system that sequentially displays a plurality of images while reproducing a music piece. Are stored in association with image attribute information, which is information unique to the image, and at least some images displayed in the order of a predetermined display schedule among a plurality of images. An image selection unit that selects an image group, a music storage unit that stores each of a plurality of pieces of music in association with music attribute information that is information unique to the music, and each of the images included in the image group Image attribute information stored in the image storage unit in association with each other and music stored in the music storage unit in association with each of a plurality of songs. Based on the degree of association of attribute information, a music selection unit that selects music from a plurality of music, an image display unit that sequentially displays images included in the image group, and an image that is included in the image group are sequentially displayed by the image display unit. If it is, the electronic album display system includes a music playback unit that plays back the music selected by the music selection unit for the image group.

  The electronic album display system stores, for each image included in an image group, image attribute information stored in the image storage unit in association with the image and a music storage unit in association with each of a plurality of music pieces. A music candidate selection unit that selects a music candidate that is a candidate for a music to be played from a plurality of music based on the music attribute information that the music selection unit selects for each of the images included in the image group Of the selected music candidates, the most frequently selected music candidate may be selected as the music to be played.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, the music can be reproduced comfortably for the user while automatically selecting the music to be reproduced in the slide show based on the displayed image.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 is a block diagram showing an example of the configuration of an electronic album display system 10 according to the first embodiment of the present invention. The electronic album display system 10 sequentially displays a plurality of images in a slide show while playing music. The electronic album display system 10 may be an information processing system such as a personal computer. For example, the electronic album display system 10 sequentially outputs image data recorded on a recording medium such as a flash memory as a video signal and outputs the image data to the recording medium or the like. A video / audio processing apparatus capable of sequentially outputting recorded music data as an audio signal, a television receiver or the like capable of displaying the output video signal as a video and emitting the output audio signal as audio And an audio / video processing system including the output device. The video / audio processing apparatus may output the video signal and the audio signal to a storage medium such as a CD, a DVD, or a semiconductor memory. For example, the video / audio processing apparatus may output slide show data including the video signal and the audio signal to a CD or a DVD in a Video CD format or a DVD-Video format, respectively. In addition, the video / audio processing apparatus may output the video signal and the audio signal to a communication line such as the Internet. The output device may receive the video signal and the audio signal via a storage medium or a communication line and display the received video signal, and at the same time, may output the received audio signal as audio. The video / audio processing apparatus may be a kiosk terminal provided in a store such as a convenience store or a digital photoshop.

  When displaying a plurality of images as a slide show, the electronic album display system 10 according to the first embodiment of the present invention automatically selects a BGM song based on the displayed image, The purpose is to reproduce music that is comfortable to listen to. Further, based on images displayed as a slide show selected by the user, a music that is a BGM that can be played comfortably for the user is automatically selected to generate electronic album data, and the generated electronic album data is An object of the present invention is to provide a video / audio processing apparatus to be provided to a user.

  The electronic album display system 10 includes an image storage unit 100, an image selection unit 110, a music storage unit 120, a music selection unit 130, an image display unit 140, and a music playback unit 150. The image storage unit 100 stores each of a plurality of images displayed in the slide show in association with image attribute information that is information unique to the image. The image storage unit 100 may be a storage device such as a hard disk drive, for example, and may be a recording medium such as a semiconductor recording medium such as a flash memory, an optical recording medium such as a CD-ROM, or a magneto-optical recording medium such as an MO. A recording apparatus using a medium may be used. Further, the image attribute information associated with each image may be, for example, imaging date / time information indicating the imaging date / time of the image, imaging point information indicating an imaging point of the image, or the like.

  The image selection unit 110 selects, as an image group, at least a part of images displayed in the order of a predetermined display schedule among a plurality of images stored in the image storage unit 100. For example, the image selection unit 110 includes, in at least some images displayed in the order of a predetermined display schedule among a plurality of images stored in the image storage unit 100, the relationship in the image attribute information of each image. When the degree is equal to or greater than a predetermined reference value, the at least some images are selected as an image group. Here, the predetermined display schedule is information including the display order of a plurality of images in the slide show. Then, the image selection unit 110 outputs the images included in the selected image group and the image attribute information associated with each image to the image group attribute information determination unit 115 and the image display unit 140. The image group attribute information determination unit 115 is characteristic attribute information in the image group selected by the image selection unit 110 based on the image attribute information associated with the image included in the image group selected by the image selection unit 110. To extract. For example, the image group attribute information determination unit 115 includes images that have a degree of association equal to or higher than a predetermined reference value among image attribute information associated with images included in the image group selected by the image selection unit 110. The attribute information may be extracted as characteristic attribute information in the image group.

  The music storage unit 120 stores each of a plurality of music reproduced in the slide show in association with music attribute information that is information unique to the music. The music storage unit 120 may be a storage device such as a hard disk drive, and may be a recording medium such as a semiconductor recording medium such as a flash memory, an optical recording medium such as a CD-ROM, or a magneto-optical recording medium such as an MO. A recording apparatus using a medium may be used. The music attribute information may be, for example, a period indicating a season suitable for the content of the music.

  The music selection unit 130 includes image attribute information corresponding to each of the images included in the image group selected by the image selection unit 110, and music attributes stored in the music storage unit 120 in association with each of a plurality of music. Based on the degree of association with the information, a music piece to be played back during the display of the images included in the image group is selected from the plurality of music pieces. For example, the music selection unit 130 corresponds to the music attribute information having the highest degree of association with the characteristic attribute information in the image group extracted by the image group attribute information determination unit 115 among the music attribute information in each of the plurality of music. A music piece is selected as a music piece to be played back while an image included in the image group is displayed. Then, the music selection unit 130 outputs the selected music to the music playback unit 150.

  The image display unit 140 sequentially displays images included in the image group selected by the image selection unit 110. When the images included in the image group selected by the image selection unit 110 are sequentially displayed by the image display unit 140, the music reproduction unit 150 reproduces the music selected by the music selection unit 130 for the image group. To do. Note that the video / audio processing apparatus replaces the image display unit 140 and the music playback unit 150 in the components included in the electronic album display system 10 with images included in the image group selected by the image selection unit 110 and the image group. An electronic album data storage unit may be provided that stores electronic album data associated with the music selected by the music selection unit 130 at the same time as the images are sequentially displayed. The video / audio processing apparatus may further include an output unit that outputs the electronic album data stored in the electronic album data storage unit. Specifically, the electronic album data storage unit stores electronic album data including video signals and audio signals such as slide show data, and the output unit stores electronic album data stored in the electronic album data storage unit. And output to a communication line such as a storage medium or the Internet.

  According to the electronic album display system 10 according to the first embodiment of the present invention, music that has a high degree of association between image attribute information and music attribute information of an image included in an image group is displayed on the image included in the image group. Can be played inside. As a result, compared to the case of using a conventional electronic album display system that selects music to be reproduced for each image, the music suitable for the image to be displayed is long enough that the user does not feel uncomfortable. Can be played. As described above, the user can strongly feel the sense of unity between the image to be displayed and the music to be played back as BGM without using a method that causes the user to select the music, which is a burden on the user. High slide show can be provided to users.

  In addition, by selecting an image group based on the degree of association of image attribute information, music suitable for the content can be reproduced as BGM for the group of content, so the image to be displayed and BGM The user can feel a sense of unity with the image to be reproduced more strongly.

  FIG. 2 shows a first example of the image storage unit 100 according to the first embodiment of the present invention. FIG. 3 shows a first example of the music storage unit 120 according to the first embodiment of the present invention. For example, as illustrated in FIG. 2, the image storage unit 100 stores each of a plurality of images displayed in the slide show in association with imaging date / time information indicating the imaging date / time of the image, which is an example of image attribute information. ing. Here, the imaging date / time information may be, for example, information acquired by a calendar function and a clock function included in the digital camera when each image is captured by the digital camera. Further, the imaging date and time information may be stored in association with the image as tag information in an Exif (Exchangeable image file) format in each image, for example.

  In addition, as shown in FIG. 3, for example, the music storage unit 120 corresponds to each of a plurality of music played in a slide show with period information indicating a period predetermined for the music, which is an example of music attribute information. It is attached and stored. Here, the period indicated by the period information may be a period indicating a season suitable for the contents of each song such as “winter song”, for example, and “a song popular in 1980”, for example. It may be a period indicating an era or age related to each piece of music. Then, the music selection unit 130 displays the music corresponding to the period information indicating the period including the imaging date and time of all the images included in the image group selected by the image selection unit 110, and displays the images included in the image group. The music to be played back is selected from a plurality of music stored in the music storage unit 120. For example, when the imaging date and time of all the images included in the selected image group are included in the period from December 1 to February 28, the music selection unit 130 is displaying the images included in the image group. The music 300 is selected as the music to be reproduced.

  According to the electronic album display system 10 according to the first embodiment of the present invention, the season including the imaging date and time of the image selected as the image group, the music suitable for the annual event such as New Year and Christmas, and the image Music that was popular in the ages that includes the date and time of capturing images selected as a group can be reproduced as BGM. Thereby, it is possible to make the user feel a stronger sense of unity between the displayed image and the reproduced music.

  FIG. 4 shows a second example of the image storage unit 100 according to the first embodiment of the present invention. FIG. 5 shows a second example of the music storage unit 120 according to the first embodiment of the present invention. For example, as illustrated in FIG. 4, the image storage unit 100 stores each of a plurality of images displayed in the slide show in association with imaging point information indicating an imaging point of the image, which is an example of image attribute information. ing. Here, the imaging point information is, for example, information indicating the latitude and longitude of the imaging point acquired by a GPS (Global Positioning System) function included in the digital camera when the digital camera captures each image. It may be. Further, the imaging point information may be stored in association with the image as tag information in an Exif (Exchangeable image file) format in each image, for example.

  Further, as shown in FIG. 5, for example, the music storage unit 120 associates each of a plurality of music played in the slide show with area information indicating an area related to the music, which is an example of music attribute information. Storing. Here, the regional information may be information indicating the type of the region indicated by the content of each song, such as the content of the lyrics, such as “mountain song” and “sea song”, for example, Information indicating the place name indicated by the contents of each song, such as the contents of lyrics, such as “Tokyo songs” may be used. Then, the music selection unit 130 stores the music based on the relevance of the area information including the imaging points of all the images included in the image group selected by the image selection unit 110 and each of the plurality of music pieces. From among a plurality of music stored in the unit 120, music to be played back during display of images included in the image group is selected. For example, the music selection unit 130 has map information, and the type of the region including the imaging points of all the images included in the selected image group is, for example, a coast portion based on the map information. May be selected from a plurality of pieces of music 510 that have a higher degree of relevance to the detection result than other music pieces, for example, associated with regional information “sea”.

  According to the electronic album display system 10 according to the first embodiment of the present invention, a musical piece having a high degree of relevance to the type or place name of the area including the imaging point of the image selected as the image group is reproduced as BGM. can do. Thereby, it is possible to make the user feel a stronger sense of unity between the displayed image and the reproduced music.

  FIG. 6 shows a third example of the image storage unit 100 according to the first embodiment of the present invention. FIG. 7 shows a third example of the music storage unit 120 according to the first embodiment of the present invention. For example, as illustrated in FIG. 6, the image storage unit 100 stores each of a plurality of images displayed in the slide show in association with image content information indicating the content of the image, which is an example of image attribute information. Yes. Here, the image content information may be information indicating the type of subject included in the image, for example. Specifically, the image storage unit 100 uses a known image recognition technique to add a subject type extracted in advance for each of a plurality of images, for example, “sea” or “wedding dress” to the image. They may be stored in association with each other.

  In addition, the music storage unit 120 stores each of a plurality of music played in the slide show in association with music content information indicating the content of the music, which is an example of music attribute information. Here, the music content information may be information indicating, for example, the subject in the lyrics of the music, a scene where the music is frequently used, or the like. For example, the music storage unit 120 displays the music content information “Umi” when each song is a song with the theme of the ocean, and “marriage” when the song is a song often played at weddings. The music content information “expression” may be stored in association with the music. Then, the music selection unit 130 includes image content information common to all images included in the image group selected by the image selection unit 110, and music content information in each of the plurality of songs stored in the music storage unit 120. Is selected from the plurality of music pieces to be played back while the images included in the image group are being displayed. For example, when the music selection unit 130 detects “wedding dress” as image content information common to all images included in the selected image group, the degree of relevance to the image content information is higher than that of other music. The music piece 710 corresponding to the music content information “wedding” is selected as the music to be played back while the images included in the image group are displayed.

  In this example, it has been described that the image content information and the music content information are extracted in advance and stored in the image storage unit 100 or the music storage unit 120. Prior to selection, image content information in the image is extracted by performing image recognition processing on each of the images included in the selected image group, and a plurality of information stored in the music storage unit 120 is stored. For example, by extracting the music content information in the music by performing voice recognition processing or the like on each of the music of the music, the music played during the display of the images included in the image group can be selected. Good.

  According to the electronic album display system 10 according to the first embodiment of the present invention, it is possible to reproduce, as BGM, music having a high degree of association with the content of images selected as an image group. Thereby, it is possible to make the user feel a stronger sense of unity between the displayed image and the reproduced music.

  The image storage unit 100 and the music storage unit 120 store various image attribute information and music attribute information in addition to the image attribute information and the music attribute information described with reference to FIGS. Good. For example, the image storage unit 100 may store each of a plurality of images displayed in the slide show in association with a keyword indicating the feature of the image. For example, the music storage unit 120 may store each of a plurality of music played in the slide show in association with a keyword indicating the characteristics of the music. Here, the keyword may be, for example, a keyword associated with each image or music in advance by the user.

  In these cases, the music selection unit 130 includes a keyword common to all images included in the image group selected by the image selection unit 110 and a keyword corresponding to each of the plurality of music stored in the music storage unit 120. Is selected from the plurality of music pieces to be played back while the images included in the image group are being displayed. Specifically, the music selection unit 130 matches the keyword common to all the images included in the image group with the keyword corresponding to one music, or compared with keywords of other music. When the degree of relevance is high, the one music piece is selected as a music piece to be played back while an image included in the image group is displayed.

  Thereby, since the music which has a keyword with high relevance with respect to the keyword matched with the image selected as an image group can be reproduced as BGM, a sense of unity between the image to be displayed and the music to be reproduced is obtained. Users can feel stronger.

  In addition, each of the image storage units 100 described with reference to FIGS. 2 to 7 stores only a single image attribute information in association with an image. Instead, the image storage unit 100 includes a plurality of pieces of image attribute information. The image attribute information may be stored in association with one image. Similarly, the music storage unit 120 may store a plurality of music attribute information in association with one music.

  FIG. 8 is a flowchart illustrating an example of a process flow in the electronic album display system 10 according to the first embodiment of the present invention. First, the image selection unit 110 includes, in at least some of the images displayed in the order of a predetermined display schedule among the plurality of images stored in the image storage unit 100, the relationship in the image attribute information of each image. When the degree is equal to or more than a predetermined reference value, the at least some images are sequentially selected as an image group (S1000). For example, when image capturing date / time information indicating the image capturing date / time of each image is associated with the image as image attribute information, the image selecting unit 110 captures the image capturing date / time of two images before and after the plurality of images. A series of images whose difference is equal to or less than a predetermined reference value such as one day is selected as an image group. In addition, for example, when the image point information indicating the image point of each image is associated with the image as the image attribute information, the image selection unit 110 selects the image in the two preceding and following images among the plurality of images. A series of images in which the difference between the imaging points is equal to or less than a predetermined reference value such as 10 km is selected as an image group.

  Furthermore, when a plurality of image attribute information is associated with each of a plurality of images, the image selection unit 110 selects an image group based on the degree of association in any of the plurality of image attribute information. Is selected based on whether or not the total display time of each of the images included in the image group selected based on the degree of association in the image attribute information is equal to or greater than a predetermined reference value. Good. Here, the predetermined reference value for the sum of the display times in each of the images included in the image group is, for example, the shortest time that the user does not feel harsh when the music played back as BGM is switched. It may be. For example, it is assumed that the display time of each image on the image display unit 140 is predetermined as 3 seconds uniformly. Further, it is assumed that the reference value of the total display time in each image is predetermined as 30 seconds. That is, in this case, the number of images included in the image group is preferably 10 or more. The image storage unit 100 is assumed to store, for example, two pieces of image attribute information of imaging date / time information and imaging point information in association with each image. Here, when the image selection unit 110 selects an image group based on the imaging date / time information, there are eight images included in the selected image group, and when the image group is selected based on the imaging point information, the selection is performed. When the number of images included in the selected image group is 10, the image selection unit 110 sets the image group based on the imaging point information so that the total display time of each of the images included in the selected image group is equal to or greater than a reference value. Select. In this way, when a plurality of pieces of image attribute information are associated with each image, the music played back as BGM is played back for a long time so that the user does not feel uncomfortable. The image group can be selected as follows.

  Subsequently, the electronic album display system 10 repeats the following processing for each image group sequentially selected by the image selection unit 110 (S1010). First, the music selection unit 130 includes image attribute information corresponding to each of the images included in the image group, and music attribute information stored in association with each of a plurality of songs stored in the music storage unit 120. Based on the degree of relevance, a music piece to be reproduced during the display of the images included in the image group is selected from the plurality of music pieces (S1020). Subsequently, the music playback unit 150 plays back the music selected by the music selection unit 130 (S1030).

Subsequently, the image display unit 140 sequentially displays the images included in the image group (S1040). Here, the image display unit 140 is configured so that the total display time in each of the images included in the image group is greater than or equal to a predetermined reference value, such as 30 seconds, in each of the images included in the image group. For example, the display time may be controlled to be longer than a predetermined standard display time, for example, 3 seconds. By doing this, when the number of images included in the selected image group is not sufficiently large, the playback time of the music played back as BGM cannot be made so long that the user does not feel uncomfortable. Even if it exists, the display time of each image can be lengthened and the reproduction | regeneration time of a music can fully be lengthened.
Then, the electronic album display system 10 repeats the above processing for each image group sequentially selected by the image selection unit 110 (S1050).

  FIG. 9 is a block diagram showing an example of the configuration of the electronic album display system 20 according to the second embodiment of the present invention. The electronic album display system 20 sequentially displays a plurality of images by, for example, a slide show while playing music. The electronic album display system 20 may be, for example, an information processing system such as a personal computer. For example, the electronic album display system 20 sequentially outputs image data recorded on a recording medium such as a flash memory as a video signal and also outputs the image data to the recording medium or the like A video / audio processing apparatus capable of sequentially outputting recorded music data as an audio signal, a television receiver or the like capable of displaying the output video signal as a video and emitting the output audio signal as audio And an audio / video processing system including the output device.

  When displaying a plurality of images as a slide show, the electronic album display system 20 according to the second embodiment of the present invention automatically selects a BGM song based on the displayed image, The purpose is to reproduce music that is comfortable to listen to.

  The electronic album display system 20 includes an image storage unit 100, an image selection unit 110, a music storage unit 120, a music candidate selection unit 225, a music selection unit 230, an image display unit 140, and a music playback unit 150. Of the members shown in this figure, members having the same reference numerals as those of the electronic album display system 10 shown in FIGS. 1 to 8 are the same as the corresponding members in FIGS. 1 to 8. Since it has a function, description is abbreviate | omitted except a difference.

  The image selection unit 110 selects, as an image group, at least a part of images displayed in the order of a predetermined display schedule among a plurality of images stored in the image storage unit 100. Then, the image selection unit 110 outputs the images included in the selected image group and the image attribute information associated with the images to the music candidate selection unit 225 and the image display unit 140. The music candidate selection unit 225 includes, for each of the images included in the image group selected by the image selection unit 110, image attribute information stored in the image storage unit 100 in association with the image, and each of the plurality of songs. Based on the song attribute information stored in the song storage unit 120 in association with the song, a song candidate that is a song candidate to be played back during display of an image included in the image group is selected from the plurality of songs. To do. Then, the music candidate selection unit 225 outputs each of the selected music candidates to the music selection unit 230. The music selection unit 230 selects, for each of the images included in the image group selected by the image selection unit 110, the music candidate that is selected most frequently among the music candidates selected by the music candidate selection unit 225. This is selected as a music to be played back while displaying images included in the image group.

  According to the electronic album display system 20 according to the second embodiment of the present invention, in the images included in the image group, there is little bias in the image attribute information such as the shooting date and time, the shooting location, etc. Even when a piece of music having highly relevant music attribute information cannot be selected, playback is performed while an image included in the image group is displayed based on the music candidate selected for each image included in the image group. Music can be selected. Thereby, since the music suitable for more images among the images included in the image group can be reproduced as BGM during display of the image group, the user can select the music himself. Therefore, it is possible to provide the user with a high-quality slide show that can make the user feel a sense of unity between the image to be displayed and the music to be reproduced as BGM without using a method that is burdensome to the user.

  FIG. 10 shows an example of processing of the music candidate selection unit 225 according to the second embodiment of the present invention. In this example, it is assumed that the image selection unit 110 selects the image 800 and the image 810 as an image group. Here, in order to simplify the description, the image selection unit 110 selects two images. However, the operation of the image selection unit 110 is not limited to the content described in this example, and various numbers of images can be displayed. It is clear that you can choose as a group.

  Subsequently, the music candidate selection unit 225 selects the music A, the music B, and the music C as music candidates in descending order of the degree of association between the image attribute information and the music attribute information for the image 800 as shown in FIG. In addition, for the image 810, the music B, the music C, and the music A are selected as music candidates. Here, the music candidate selection unit 225 selects music corresponding to the music attribute information having a high degree of association with the image attribute information by using the same method as that described with reference to FIGS. 2 to 7 for the electronic album display system 10. You may choose as However, unlike the music selection unit 130 described with reference to FIGS. 2 to 7, the music candidate selection unit 225 includes image attribute information in a plurality of images included in the image group and music attribute information in each of the plurality of music. Rather than selecting a song based on the degree of association, for each image included in the image group, a song candidate is selected based on the degree of association between the image attribute information of the image and the song attribute information of each of a plurality of songs To do. For example, the music candidate selection unit 225 captures the image for each image included in the image group when the image storage unit 100 stores each of the plurality of images in association with the imaging date and time of the image. A song having period information corresponding to a period including the date and time is selected as a song candidate.

  In addition, when selecting a plurality of music candidates for each of the images included in the image group, the music candidate selection unit 225 includes the image attribute information in the image and the music candidates for each of the selected music candidates. A weight based on the degree of association with the music attribute information may be given. For example, the music candidate selection unit 225 may assign three-stage weights of 3, 2, and 1 in descending order of the degree of association between the image attribute information and the music attribute information, as shown in FIG. And the music selection part 230 is based on each of the weight provided to each of the some music candidate selected by the music candidate selection part 225 about each of the image contained in the image group selected by the image selection part 110. Thus, the music to be played back is displayed during the display of the images included in the image group. For example, the music selection unit 230 calculates the sum of the weights assigned to the music candidates for each of the music candidates selected by the music candidate selection unit 225, and reproduces the music candidate having the largest calculated sum. May be selected as the song to be played. Specifically, when the music selection unit 230 assigns a weight to each song as shown in the figure, the sum of the weights in the song A is 4, the sum of the weights in the song B is 5, Since the sum of the weights in the music piece C is 3, the music piece B is selected as a music piece to be reproduced.

  According to the electronic album display system 20 according to the second embodiment of the present invention, even when a plurality of music candidates are selected for each image included in the image group, more music can be reproduced as BGM. Since the music can be selected as a more suitable music for the image, it is possible to make the user feel a stronger sense of unity between the displayed image and the music played back as BGM.

  FIG. 11 is a flowchart showing an example of a process flow in the electronic album display system 20 according to the second embodiment of the present invention. First, the image selection unit 110 sequentially selects, as an image group, at least some images displayed in the order of a predetermined display schedule among a plurality of images stored in the image storage unit 100 (S1100). ). Then, the electronic album display system 20 repeats the following processing for each image group sequentially selected by the image selection unit 110 (S1110).

  Furthermore, the electronic album display system 20 repeats the following processing for each image included in the image group (S1120). First, the music candidate selection unit 225 includes image attribute information stored in the image storage unit 100 in association with the image, music attribute information corresponding to each of a plurality of music stored in the music storage unit 120, and From the plurality of songs, a song candidate that is a song candidate to be played back during display of images included in the image group is selected (S1130). Subsequently, the music candidate selection unit 225 assigns a weight based on the degree of association between the image attribute information of the image and the music attribute information of the music to each of the music candidates selected for the image (S1140). Then, the electronic album display system 20 repeats the processing from S1130 to S1140 for each image included in the image group (S1150).

  Subsequently, the music selection unit 230 is reproduced during display of the images included in the image group based on the weights assigned to the respective music candidates selected for the images included in the image group. The music to be selected is selected (S1160). Subsequently, the music playback unit 150 plays back the music selected by the music selection unit 230 (S1170). Subsequently, the image display unit 140 sequentially displays the images included in the image group (S1180). Then, the electronic album display system 20 repeats the processing from S1120 to S1180 for each image group sequentially selected by the image selection unit 110 (S1190).

  FIG. 12 is a block diagram showing an example of a hardware configuration of a computer 1500 according to the embodiment of the present invention. A computer 1500 according to an embodiment of the present invention includes a CPU peripheral unit having a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a host controller 1582 by an input / output controller 1584. I / O unit having a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 connected to the I / O, and a legacy input having a ROM 1510, a flexible disk drive 1550, and an I / O chip 1570 connected to the I / O controller 1584. And an output unit.

  The host controller 1582 connects the RAM 1520 to the CPU 1505 and the graphic controller 1575 that access the RAM 1520 at a high transfer rate. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the communication interface 1530, the hard disk drive 1540, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The communication interface 1530 communicates with other devices via a network. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the computer 1500. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the computer 1500 is started up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the hard disk drive 1540 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 1540 in the computer 1500 via the RAM 1520, and executed by the CPU 1505. A program installed and executed on the computer 1500 operates on the CPU 1505 and the like to cause the computer 1500 to function as the electronic album display system 10 or the electronic album display system 20 described with reference to FIGS.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1500 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a block diagram which shows an example of a structure of the electronic album display system 10 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 1st example of the image storage part 100 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 1st example of the music storage part 120 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 2nd example of the image storage part 100 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 2nd example of the music storage part 120 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 3rd example of the image storage part 100 which concerns on the 1st Embodiment of this invention. It is a figure which shows the 3rd example of the music storage part 120 which concerns on the 1st Embodiment of this invention. It is a flowchart which shows an example of the flow of a process in the electronic album display system 10 which concerns on the 1st Embodiment of this invention. It is a block diagram which shows an example of a structure of the electronic album display system 20 which concerns on the 2nd Embodiment of this invention. It is a figure which shows an example of a process of the music candidate selection part 225 which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows an example of the flow of a process in the electronic album display system 20 which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the computer 1500 concerning embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 electronic album display system, 20 electronic album display system, 100 image storage part, 110 image selection part, 115 image group attribute information determination part, 120 music storage part, 130 music selection part, 140 image display part, 150 music reproduction part, 225 music candidate selection unit, 230 music selection unit

Claims (14)

An electronic album display system that sequentially displays a plurality of images while playing music,
An image storage unit that stores each of the plurality of images in association with image attribute information that is information unique to the image;
An image selection unit that selects, as an image group, at least a part of the images displayed in the order of a predetermined display schedule among the plurality of images;
A music storage unit that stores each of the plurality of music pieces in association with music attribute information that is information unique to the music piece;
The image attribute information stored in the image storage unit in association with each of the images included in the image group, and the music stored in the music storage unit in association with each of the plurality of music pieces Based on the degree of association of attribute information, a music selection unit that selects the music from the plurality of music,
An image display unit for sequentially displaying the images included in the image group;
An electronic album display system comprising: a music playback unit that plays back the music selected by the music selection unit for the image group when the images included in the image group are sequentially displayed by the image display unit. The image storage unit stores each of the plurality of images in association with imaging date / time information indicating the imaging date / time of the image,
The music storage unit stores each of the plurality of music in association with period information indicating a predetermined period for the music,
The electronic device according to claim 1, wherein the music selection unit selects, from the plurality of music pieces, the music piece corresponding to the period information indicating the period in which imaging dates and times of all the images included in the image group are included. Album display system. The image storage unit stores each of the plurality of images in association with imaging point information indicating an imaging point of the image,
The music storage unit stores each of the plurality of music in association with area information indicating an area related to the music,
The music selection unit is configured to select the music from the plurality of music based on the area including the imaging points of all the images included in the image group and the relevance of the area information in each of the plurality of music. The electronic album display system according to claim 1 to be selected. The image storage unit stores each of the plurality of images in association with image content information indicating the content of the image,
The music storage unit stores each of the plurality of music in association with music content information indicating the content of the music,
The music selection unit, based on the image content information common to all the images included in the image group, and the relevance of the music content information in each of the plurality of music, the music from the plurality of music The electronic album display system according to claim 1. The image storage unit stores each of the plurality of images in association with a keyword indicating a feature of the image,
The music storage unit stores each of the plurality of music in association with a keyword indicating the characteristics of the music,
The music selection unit selects the music from the plurality of music based on a keyword common to all the images included in the image group and a relevance degree of the keyword corresponding to each of the plurality of music. Item 4. The electronic album display system according to Item 1.   The image selection unit has a degree of relevance in the image attribute information of each image that is greater than or equal to a predetermined reference value in at least some of the plurality of images displayed in the order of the display schedule. The electronic album display system according to claim 1, wherein in some cases, at least some of the images are selected as the image group.   The image selection unit selects which image group is to be selected based on the degree of relevance in the image attribute information among the plurality of image attribute information associated with each of the plurality of images. The determination according to claim 6, wherein the display time is determined based on whether or not a total sum of display times in each of the images included in the image group selected based on the degree of association in the attribute information is equal to or greater than a predetermined reference value. Electronic album display system.   The said image display part controls the display time in each of the said image included in the said image group so that the sum total of the display time in each of the said image included in the said image group may become more than the predetermined reference value. The electronic album display system according to 1. For each of the images included in the image group, the image attribute information stored in the image storage unit in association with the image and the music storage unit in association with each of the plurality of music pieces. A music candidate selection unit that selects a music candidate that is a candidate for the music to be played from the plurality of music based on the music attribute information
2. The music selection unit selects, as the music to be reproduced, the music candidate that is selected most frequently among the music candidates selected for each of the images included in the image group. The electronic album display system described in 1. The music candidate selection unit selects a plurality of music candidates for each of the images included in the image group, and each of the selected music candidates includes the image attribute information and the music in the image. Giving weight based on the degree of association of the music attribute information in the candidate,
The music selection unit selects the music to be played based on each of the weights assigned to each of the plurality of music candidates selected for each of the images included in the image group. The electronic album display system described in 1. An electronic album display method for sequentially displaying a plurality of images while playing a music,
The image storage unit stores each of the plurality of images in association with image attribute information that is information unique to the image,
The song storage unit stores each of the plurality of songs in association with song attribute information that is information unique to the song,
The electronic album display method is
An image selection step of selecting at least some of the plurality of images displayed in the order of a predetermined display schedule as an image group;
The image attribute information stored in the image storage unit in association with each of the images included in the image group, and the music stored in the music storage unit in association with each of the plurality of music pieces A music selection step of selecting the music from the plurality of music based on the degree of association of attribute information;
An image display step for sequentially displaying the images included in the image group;
An electronic album display system comprising: a music playback stage for playing back the music selected in the music selection stage for the image group when the images included in the image group are sequentially displayed in the image display stage. For each of the images included in the image group, the image attribute information stored in the image storage unit in association with the image and the music storage unit in association with each of the plurality of music pieces. A music candidate selection step of selecting a music candidate that is a candidate for the music to be played from the plurality of music based on the music attribute information being
12. The music selection step selects, as the music to be played, the music candidate that is selected most frequently among the music candidates selected for each of the images included in the image group. The electronic album display method described in 1. An electronic album display program for causing a computer to function as an electronic album display system that sequentially displays a plurality of images while playing a music,
The computer,
An image storage unit that stores each of the plurality of images in association with image attribute information that is information unique to the image;
An image selection unit that selects, as an image group, at least a part of the images displayed in the order of a predetermined display schedule among the plurality of images;
A music storage unit that stores each of the plurality of music pieces in association with music attribute information that is information unique to the music piece;
The image attribute information stored in the image storage unit in association with each of the images included in the image group, and the music stored in the music storage unit in association with each of the plurality of music pieces Based on the degree of association of attribute information, a music selection unit that selects the music from the plurality of music,
An image display unit for sequentially displaying the images included in the image group;
An electronic album display system comprising: a music playback unit that plays back the music selected by the music selection unit for the image group when the images included in the image group are sequentially displayed by the image display unit Electronic album display program to function. The electronic album display system includes:
For each of the images included in the image group, the image attribute information stored in the image storage unit in association with the image and the music storage unit in association with each of the plurality of music pieces. A music candidate selection unit that selects a music candidate that is a candidate for the music to be played from the plurality of music based on the music attribute information
The music selection unit selects, as the music to be played, the music candidate that is selected most frequently among the music candidates selected for each of the images included in the image group. The electronic album display program according to claim 13.

Images