JP2006135895A - Image recording/reproducing system and electronic album creation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image recording/reproducing system capable of easily cross-referencing a photographed image with music related to a photographed place of the image and easily reproducing the cross-referenced music at reproduction of the photographed image so as to allow a user to be able to reminisce about the recollection at the time of photographing with deep emotion thereby enhancing the appreciation effect and to provide an electronic album creating system. <P>SOLUTION: The image recording/reproducing system is compoed of: a photographing place cross-reference means 8 for cross-referencing location information data being information with respect to a place at which an image is photographed; a means 24 for searching music data related to the location at which the image is photographed from a database 2 wherein various music data are stored; and a reproduction means 40 for simultaneously reproducing the music data searched by the searching means 24 and the image data. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image recording / reproducing system and an electronic album creating system suitable for recording or reproducing an image taken by a user in combination with music.

  Prior to the popularization of digital cameras, still images were simply printed on paper. However, with the recent spread of digital cameras, digital data is becoming common as captured images. As a result, it has become possible to reproduce music that has been previously digitized by CD, MD, and the like and a captured image that is digital data in combination. Furthermore, since DVD players, HD players, and the like are now in widespread use as playback devices, it can be said that the infrastructure for multimedia playback is already in place.

  However, it has been technically difficult for a general user to independently perform reproduction with BGM added at the time of image reproduction by combining a photographed image and the optimal music corresponding to the photographed image.

  For example, Patent Document 1 discloses a technology that can easily confirm where a photograph was taken by outputting the photographed image data and map image data indicating the photographing location in association with each other.

Further, Patent Document 2 discloses a technology of a navigation device that can easily search for facilities, points, regions, and the like on a map associated with music. According to this technique, it becomes easy to search for an area or the like on a map associated with music.
JP-A-9-139906 JP 2002-311986 A

  However, with the technique disclosed in Patent Document 1, it is possible to easily check where the image was taken by outputting a combination of image data taken by the user and map image data indicating the shooting location. However, nothing is devised for appreciating the captured images.

  Further, the technique disclosed in Patent Document 2 is a navigation device that can easily search a region on a map associated with music, and associates music with map information. Furthermore, it does not go into the image appreciation by the combination with the image recording / reproducing apparatus.

  The present invention has been made in view of the above circumstances, so that a photographed image can be easily associated with music related to the photographing location of the image, and the associated music can be reproduced at the same time when the photographed image is reproduced. Another object of the present invention is to provide an image recording / reproducing system and an electronic album creating system capable of deeply recollecting memories at the time of shooting and enhancing the appreciation effect.

  In order to achieve the above object, the image recording / reproducing apparatus according to the first aspect of the present invention relates to a shooting point that associates location information data that is information relating to a point at which an image was shot and image data that is a shot image. Means for searching for music data related to the spot where the image was taken from a database in which the music data is stored, and means for searching, using the location information associated with the image data; And reproducing means for simultaneously reproducing the music data retrieved by the above and the image data.

  In order to achieve the above object, an image recording / reproducing system according to the second aspect of the present invention includes location information input means for inputting the position of a shooting location, captured image data, and location information data by the location information input means. A data association means for associating the music data, a database in which the music data is stored, a search means for searching music data closely related to the location information data from the database, the music data searched by the search means, and the image And reproducing means for simultaneously reproducing data.

  In order to achieve the above object, the electronic album creating system according to the third aspect of the present invention is a recording means in which photographed image data associated with location information data, which is information relating to a location where an image was photographed, is recorded. The location information data is extracted from the captured image data recorded in the recording means, and music data related to the location where the image was captured is stored as music data based on the extracted location information data. A search means for searching from a database in which is stored, and a control means for associating the music data searched by the search means with the photographed image data and recording them in the recording means or recording medium. It is characterized by doing.

  In order to achieve the above object, an electronic album creating system according to a fourth aspect of the present invention extracts the shooting location data from shooting image data associated with shooting location data, which is information relating to the location where the image was shot. And a place name extraction unit that extracts a place name corresponding to the place where the image was taken based on the extracted shooting place data, and a place name extracted by the place name extraction unit is related to the place where the image was taken. A transmission / reception unit that inquires the music data of the music that the server has and receives the music data from the server; an albuming unit that associates the music data received by the transmission / reception unit with the photographed image data and records the data in the recording unit; It has the transmission-and-reception means which consists of.

  In order to achieve the above object, an electronic album creating system according to a fifth aspect of the present invention is a shooting point that associates location information data that is information about a point at which an image was shot with image data that is a shot image. Means for searching for music data related to the spot where the image was taken from a database in which the music data is stored, and means for searching, using the location information associated with the image data; Control means for associating the music data retrieved by the above-mentioned image data with the image data.

  According to the present invention, a photographed image can be easily associated with music related to the photographing location of the image, and the associated music can be reproduced at the same time when the photographed image is reproduced. It is possible to provide an image recording / playback system and an electronic album creation system that can be deeply recollected and enhance the appreciation effect.

  Currently, search engine technology has already been developed, and it is easy to search for music containing a place name as a keyword on the Internet. Further, a similar system can be achieved by a communication technology such as a mobile phone without using the Internet.

  By utilizing this technology effectively, the inventor of the present invention can combine the optimal music for the image only by connecting the recording means for recording the image taken during the trip to the Internet, for example. We learned that it would be possible to regenerate.

  In the present invention, when this environment is used and a trip or the like is performed, the music related to the region is combined with the photographed image so that the music flows as BGM when the image is reproduced. Make sure you can remember the time and enjoy the atmosphere.

  For example, there is always music related to the region, such as Strauss Waltz in Vienna, Chanson in Paris and Flamenco in Madrid. Enlivening human emotions with music is often done, for example, in sightseeing buses and restaurants. In addition, as represented by various theaters, movies, or operas, it can be said that when video and music are combined, auditory stimulation and visual stimulation are effectively combined to have a strong impact on the viewer.

[First Embodiment]
Hereinafter, an image recording / reproducing system and an electronic album creating system according to a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing the configuration of an image recording / playback system and an electronic album creation system according to the first embodiment of the present invention. In the present embodiment, for example, a digital camera is assumed as the image recording / reproducing apparatus. The configuration of the image recording / playback system and the electronic album creation system according to the first embodiment of the present invention will be described below with reference to FIG.

  In the drawing, a broken line portion represents an image recording / reproducing apparatus 2 (hereinafter referred to as a digital camera since a digital camera is assumed in the present embodiment as described above) 2. First, the configuration of the digital camera 2 will be described.

  The digital camera 2 is provided with a control unit 1 that controls its operation. An operation unit 1a is connected to the control unit 1, and operation control of the digital camera 2 is performed according to an operation state of the operation unit 1a by a user.

  In addition, the image capturing unit 4 captures an image under the control of the control unit 1. The image data photographed by the photographing means 4 is recorded in the recording means 6 as a recording member in association with the location information data by the data associating means 8 similarly provided in the digital camera 2. Here, the location information data is information relating to the shooting location of the image, and is input by the user operating the switch 10a provided in the location information input means 10. It should be noted that the operation may be performed while using the display unit 12 for this input. Further, the input to the location information input means 10 is not manual input by the user as described above, but GPS (Global Positioning System) information 14 is received by the receiving circuit 16 via the antenna 16a, and this is received by the location information. Of course, the information may be input to the information input means 10.

  As means for connecting the digital camera 2 having the above-described configuration and the Internet 20, the image recording / playback system and the electronic album creating system include transmission / reception means 18. The transmission / reception means 18 includes a connector such as a USB or a wireless communication means, and can transmit image data associated with location information data related to the shooting location to the base station 22 via the Internet 20. For example, a personal computer may be used as the transmission / reception means 18.

  The base station 22 is provided with place name information extracting means 24, and using the place information data transmitted from the digital camera 2 by the transmitting / receiving means 18 as described above, music data corresponding to the place information data is obtained. , Select from the database 26 provided in the base station 22. In selecting the music data, the music data of the music having the title including the place name related to the above-mentioned place information data is selected, or the music data or the song of the singer is the work of the composer related to the place of the place name. A piece of music data or the like is a candidate.

  The music data that is the digital audio signal selected in this way is provided in the base station 22 in association with the transmitted image data by the association means 28 provided in the base station 22. Recorded in the recording means 30.

  Further, the image data associated with the music data as described above is sent again to the electronic album memory unit provided in the electronic album unit 32 surrounded by the one-dot chain line in FIG. 34 can be recorded.

  In addition, as a method of recording image data in which music data is associated with the electronic album memory unit 34 in this way, not all data is transmitted via the Internet 20, but only a part thereof is transmitted via the Internet 20. There is a way to do it. For example, a system that directly transmits from the control unit 1 of the digital camera 2 to the electronic album unit 32 without using the Internet 20 and transmits only audio data through the Internet 20 and records them in association with each other is possible. That is, only the searched music data is transmitted to the viewer (not shown) in the electronic album unit 32 and the electronic album memory unit 34 via the Internet 20, and the image data is directly sent from the digital camera 2 to the electronic album unit 32. It is a system to input to. When the capacity of the image data is large, it is better to use a system for recording in the electronic album memory unit 34 without using the Internet 20 as described above. Even if the image data capacity is not large, it is of course possible to use a system that records such image data in the electronic album memory unit 34 without going through the Internet 20.

  The electronic album unit 32 may be a separate device from the digital camera 2 as in the present embodiment, or may be an integrated device.

  In addition, by providing the electronic album unit 32 with, for example, a large display and a large speaker as the image reproduction unit 36 and the audio reproduction unit 38, high image quality and high sound quality can be enjoyed. In order to adopt such a configuration, it is better to separate the digital camera 2 and the electronic album unit 32 from each other. When separate, the digital camera 2 and the electronic album unit 32 are connected to each other using, for example, a connector, and the user operates the electronic album operation unit 40a, and the electronic album is operated according to the operation state. The album control means 40 performs control such as selecting data in the electronic album memory unit 34 and switching the reproduction method.

  Hereinafter, the operation control of the digital camera 2 from the photographing operation to associating the image data with the location information data will be described with reference to the flowchart shown in FIG.

  First, S1 is a step for performing photographing. In S1, the control unit 1 determines and controls the operation state of the switch 1a by the user, and the photographing unit 4 performs photographing. In subsequent S2, input to the location information input means 10 is performed. This is because the GPS (global positioning system) information 14 is received by the receiving circuit 16 via the antenna 16a provided in the digital camera 2 even if the user manually inputs the information by the location information input operation means 10a. An input by using the input means 10 may be used. In this way, after inputting the location information of the shooting location in S2, the process proceeds to S3.

  S3 is a step of associating the image data with the location information data. In S <b> 3, under the control of the control unit 1, each captured image data is associated with location information data indicating the shooting location.

  FIG. 3 is a flowchart showing operation control for associating the image data associated with the location information data and the music data as described above. Note that the flowchart in FIG. 3 shows operation control in the base station 22. Therefore, before performing the operation control in the flowchart of FIG. 3, it is assumed that the image data associated with the location information data is transmitted to the base station 22 via the transmission / reception means 18 and the Internet 20 as described above. And The operation control for associating the image data associated with the location information data with the music data will be described below using the flowchart of FIG.

  First, in S5, the place name information extracting means 24 refers to the place information data associated with the image data, searches the database 26 for music data corresponding to the place information data and selects it.

  In subsequent S 6, a song name list of candidate songs of the song data selected in S 5 is created and transmitted to the transmission / reception means 18 via the Internet 20. Since this song name list sends a song having a name associated with the land, a composer's work, a song of a singer's song, and the like as character data, the data capacity required for communication can be reduced. The actual selection screen based on this list is displayed as shown in FIG. 4, for example. As a result, the user can immediately select a favorite music piece on the screen of the transmission / reception means (for example, personal computer) 18.

  In step S7, the user operates the operation unit 18a (for example, a keyboard or a mouse) of the transmission / reception unit (for example, a personal computer) 18 to select which image from the image samples to be associated displayed in step S6. Select the song that corresponds to. Here, as shown in FIG. 4, a plurality of images can be selected, and processing such as adding a frame for emphasis around the selected image is performed. When a plurality of images are selected, the plurality of images are displayed while the same song flows. It should be noted that the music list may of course not only indicate the specific music titles of the candidate music but also indicate notation that implies the music tone at the same time. Of course, only the notation implying the tune may be shown.

  If the selection operation as described above is performed in S7, the process proceeds to S12. In S <b> 12, the base station 22 transmits music data to the transmission / reception means 18 via the Internet 20 based on the selection result in S <b> 7. Further, the transmission / reception means 18 transmits the music data to the electronic album memory unit 34 in the electronic album unit 32. In S7, the music data may be transmitted to the recording unit 30 in the base station 22 instead of the electronic album memory unit 34 in the electronic album unit 32 as described above.

  In S7, the image data and the music data are also associated with each other. However, when a personal computer is used as the transmission / reception means 18, the operation control for associating the music data with the image data according to a user instruction is performed on the personal computer. Can do. On the other hand, when the transmission / reception unit 18 is configured not to use a personal computer, the association unit 28 in the base station 22 performs operation control for associating the image data with the music data. It should be noted that even if a personal computer is used as the transmission / reception means 18, the association means 28 may perform the association.

  If the predetermined selection operation is not performed in S7 described above, the process proceeds to S8. Here, if it is not necessary to pay for communication, S8 is branched into Y and the process proceeds to S9 to select all candidate songs. Then, the process proceeds to S12 described above. As a result, as shown in FIG. 5, various versions of the electronic album in which different music data are added to the same image data are created in the electronic album unit 32. Of course, the recording means 30 in the base station 22 may be used as the creation location of the electronic album. Increasing media capacity in recent years has made it possible to record multiple versions of electronic albums.

  In addition, if the user determines that selecting all the candidate songs in this way is not preferable due to the communication time, communication cost, and license fee, the user operates the operation means 18a, The process branches from S8 to S10, and proceeds to the step of selecting a music piece by referring to the image data (N is branched from S8 to S10).

  In S10, the association means 28 of the base station 22 refers to the image data. In step S11, the association unit 28 of the base station 22 analyzes the subject of the image data and selects music data corresponding to the image data from the database 26.

  With regard to such image data analysis, in recent years, a technique for person authentication has been widely studied, and a technique for identifying a person from image data has been developed. In the present invention, an algorithm that applies the person authentication technique to identify a human face part from an image and identifies the number of persons as subjects is used. It should be noted that when the number of persons is specified by this person authentication, it is of course possible to make a determination by using information at the time of shooting (information such as subject distance) added to the image data sent from the digital camera 2 as well. FIG. 6 shows a flowchart of music data selection performed using such a technique. In the present embodiment, data other than location data is also used to associate optimum music data corresponding to image data with image data. Hereinafter, a description will be given using the flowchart of FIG.

  First, in S20, the association unit 28 in the base station 22 determines whether or not there are a plurality of image data photographed at the same place in a plurality of image data transmitted from the digital camera 2. Here, if it is determined that there are a plurality, the Y branch is taken and the process proceeds to S30.

  In S30, the associating means 28 collects image data shot at the same place. In this step, when there are multiple image data shot at the same place, by combining these images, multiple images that are related to the song data that would take several minutes per song Can be made to correspond. In other words, it can be said that the appreciation of the photographed image is a step that takes into consideration that a few seconds per image is sufficient.

  In step S31, the association unit 28 determines whether or not there are a plurality of central persons in the images grouped by the shooting location in step S30. Here, if it is determined that there are a plurality, the Y branch is taken and the process proceeds to S35.

  In S35, the association unit 28 further determines whether or not a landscape photograph is included. If it is determined that a landscape photograph is included, it is determined that the photograph is taken on a trip, S35 is branched into Y, and the process proceeds to S36.

  In the subsequent S36, the associating unit 28 determines whether the photograph is a couple. Here, when it is determined that the photograph is a couple, it is determined that the trip is a couple, and the process proceeds to S43. Therefore, in S43, the associating unit 28 selects music data having a romantic tone that takes the shooting location into consideration.

  If it is determined in S36 that the couple is not a couple, it is determined that the trip is a normal trip, and the process proceeds to S42. Therefore, in S <b> 42, the association unit 28 selects music data that is a trendy music considering the place name. In this way, if you include a landscape photo and it is not a photo of a couple, you can judge that it is a normal group trip, so the song data to be associated is not a romantic song but a bright, nimble and generally known It was decided to select popular songs.

  On the other hand, if it is determined in S35 that the landscape photograph is not included, the process proceeds to S38. In S <b> 38, the association unit 28 determines whether the photograph is a couple. Here, when it is determined that the photograph is a couple, it is determined that it is not a trip but a simple date, and a branch is made to Y to proceed to S40. Therefore, in S40, music data having a romantic tone is selected without considering the place name.

  On the other hand, if it is determined in S38 that the photograph is not a couple, the process proceeds to S41. As described above, when the image does not include a landscape and is not a couple photo, the association unit 28 selects a medley of a popular song at that time as an image taken at a banquet.

  As described above, in addition to determining whether the photograph is a travel photograph based on the presence or absence of a landscape photograph, if the base station database has information on the user's residence, the location at the time of shooting is Of course, it may be determined whether or not it is a photograph of a trip by determining whether or not it is 50 km or more away from the user's residence.

  Further, in the above-described S31, in the image grouped according to the shooting location in S30, if the association unit 28 determines that there are not a plurality of central persons, the shot image taken by one person As a result, the process proceeds to the N branch S32.

  In S32, the associating means 28 determines whether or not a landscape photograph is included, and if it includes a landscape photograph, the process branches to Y45 and proceeds to S45. In S45, the associating means 28 selects the healing music, particularly with the music related to the land where the image was taken.

  On the other hand, if the associating means 28 determines that the landscape photograph is not included in S32, it branches N and proceeds to S46. In S46, the association means 28 selects healing music as a photo in a personal album.

  In S20 described above, if the associating unit 28 determines that a plurality of image data photographed at the same place does not exist, the process branches to N21 after branching N. In S21, images taken on the same date are grouped, and the process proceeds to S22. In this step, if there are multiple images taken on the same date, they can be grouped together to create multiple images that are related to each other for playing music that would take several minutes per song. It is for making it correspond. Appreciation of the captured image is a step that takes into account that a few seconds per image is sufficient.

  In the subsequent S22, the associating means 28 determines whether or not many landscape photographs are included. Here, when it is determined that many landscape photographs are included, S22 is branched into Y and then branched to S24. In S24, the place name of the place where the landscape photograph was taken is specified and the process branches to S31 so that the music data can be selected in consideration of the place of photography. Thereafter, the steps after S31 described above are followed, but when selecting the final music data, the music data is selected in consideration of the place name specified in S24.

  If it is determined in S22 that there are not many landscape photographs, the process branches to S23 after branching N. In S23, the association unit 28 determines whether the subject person is a photograph of a couple. Here, when it is determined that the photograph is a couple's photograph, the process branches to Y and proceeds to S40. In S40, the associating means 28 selects music data having a romantic tune. On the other hand, if it is determined in S23 that the photograph is not a couple's photograph, it is determined that the photograph is a personal photograph, and N branches and proceeds to S46. Therefore, in S46, the association means 28 selects music data having a high healing effect.

  As described above, after the step (S41, S42, S43, S45, S46) in which the association means 28 selects appropriate music data for the image data of the photographed image, the process proceeds to S45. In S45, the association unit 28 collects a plurality of pieces of image data and associates the image data with the music data of the music selected in the above step.

  As described above, according to the first embodiment of the present invention, one piece of appropriate music is associated with a plurality of images that are related to each other. You can easily create an electronic album that can be viewed in a natural way without chopping it up. Also, the music data selected for the image data is the music data most suitable for the image data, so that the viewing effect is enhanced. In addition, as with an electronic album created using the present invention, music that is deeply related to a captured image is added when the captured image is reproduced, so that memories at the time of shooting can be recollected deeply.

  In other words, the image recording / playback system and the electronic album creation system according to the present embodiment constitute image data that has been photographed with a digital camera on a trip or the like but has been rarely viewed as a work suitable for viewing. Can be easily done. In addition, the user can create the image without performing the troublesome task of selecting music for each captured image. During playback, viewing can be performed using the functions of a DVD player, HD player, etc. effectively.

  The music data, which is the selected digital audio data, is recorded in the recording unit 30 provided in the base station 22 in association with the captured image data by the association unit 28 provided in the base station 22. It is possible to do this. Therefore, by reproducing the contents of the recording means 30, it is possible to create a multimedia electronic album that can be viewed on the Internet.

[Second Embodiment]
Next, an image recording / reproducing system and an electronic album creating system according to the second embodiment of the present invention will be described.

  In this embodiment, in order to minimize the time and communication charge for transmission / reception of image data with a large file size through the communication line, the system configuration is configured to minimize the amount of data transmitted / received to / from the base station. . Hereinafter, an image recording / reproducing system and an electronic album creating system according to the present embodiment will be described with reference to the drawings.

  FIG. 7 is a diagram showing a configuration of an image recording / playback system and an electronic album creation system according to the present embodiment. Hereinafter, the configuration of the image recording / reproducing system and the electronic album creating system according to the present embodiment will be described with reference to FIG. Note that illustrations and descriptions of the same components as the image recording / playback system and the electronic album creation system according to the first embodiment, such as a portion for playing back the created electronic album, are partially omitted.

  In the image recording / playback system and the electronic album creation system of the present embodiment, the image recording / playback apparatus 2 has a function of inputting place name data, which is data representing the place name. The transmission / reception means 18 includes a place name extraction unit 18b, an albuming unit 18d, and a transmission / reception unit 18e. Here, the place name extraction unit 18b refers to a place name database 18c that is a database of information on place names, and is a configuration unit that determines a shooting place from shooting place data provided by the image recording / reproducing apparatus 2. The albuming unit 18d is a configuration unit that associates image data with music data, and records the associated data in the electronic album unit 32. The transmission / reception unit 18e is a component that performs transmission / reception of data with the Internet 20.

  Here, a personal computer is assumed as the transmission / reception means 18. Further, the place name database 18c and the electronic album unit 32 may be provided in the image recording / reproducing apparatus 2 or the transmitting / receiving means 18 without being separated from the image recording / reproducing apparatus 2 and the transmitting / receiving means 18, as shown in FIG. Of course.

  The database search unit 42 is a database that stores music data and the like, and searches music data of the corresponding candidate music based on the place name data representing the place name transmitted from the transmission / reception means 18 via the Internet 20.

  FIG. 8 is a flowchart showing album creation operation control in the image recording / playback system and electronic album creation system according to the present embodiment. Hereinafter, the operation control of the image recording / reproducing system and the electronic album creating system according to the present embodiment will be described with reference to the flowchart of FIG.

  First, S50 in the flowchart of FIG. 8 is a step of determining a shooting location of image data to be converted into an electronic album. The place name extraction unit 18b of the transmission / reception means 18 refers to the image data and determines the shooting location (map coordinates) where the image data was shot.

  Subsequently, in S51, the place name extraction unit 18b refers to the place name database 18c and extracts place name data representing the place name of the shooting place. As the place name data, the place name extracting unit 18b uses place names of rough areas such as “Lake Biwa” or “Shiga Prefecture”. Of course, specific place names such as “Omihachiman”, “Gokaso”, and “Hikone” may be used.

  Here, the place name extraction function is provided in the transmission / reception means 18, but the database search unit 42 may of course have the place name extraction function. In that case, the system is such that the shooting location (map coordinate) data is transmitted to the database search unit 42 via the Internet 20. In addition, when the representative place name is selected by the database search unit 42 composed of a large computer, an accurate search becomes possible, and it is not necessary to have a large system by an individual.

  In subsequent S52, the place name extraction unit 18b groups the image data for each place name. Next, in S53, the transmitting / receiving unit 18e transmits only the representative place name data, which is the representative place name data grouped in S52, to the database searching unit 42 via the Internet 20. As described above, since only the representative place name data is transmitted, it is possible to eliminate time-consuming waste that occurs when a large image data file is transmitted.

  Next, in S54, the database search unit 42 selects music data of music that is a candidate for electronic album from the representative place name data transmitted in S53, and transmits the music data to the transmission / reception means 18. Then, the transmission / reception unit 18e of the transmission / reception means 18 receives the music data of the candidate music transmitted by the database search unit 42.

  In subsequent S55, the albuming unit 18d of the transmission / reception means 18 associates the music data acquired in S54 with the image data grouped in S52 and assigns music to each image group. Further, the data associated in this way is recorded in the electronic album unit 32 by the albuming unit 18d. Finally, in S56, an index representing the representative place name is assigned to each image group.

  The album created by the system according to the present embodiment as described above can reproduce music and images as shown in the schematic diagram of FIG. That is, music data of music closely related to each image group is added and reproduced, and each time the displayed image group is switched, the place name index for the next image group to be reproduced and displayed is displayed. .

  As described above, according to the second embodiment of the present invention, image data is not included in data communicated using a mobile phone or a communication line, and only place name data and music data are transmitted. Compared with the case of transmitting and receiving, the communication becomes less efficient and the communication becomes efficient.

  That is, in the present embodiment, despite the small amount of communication data, the music data of appropriate music can be easily associated with the captured image data, and the associated music is reproduced when the captured image is reproduced. An image recording / reproducing system and an electronic album creating system can be provided. In addition, like an electronic album created using the present invention, music data of deeply related music is added to the image data captured during playback of the captured image, so that memories at the time of shooting can be recollected deeply. .

  As mentioned above, although embodiment of this invention was described, in the range which does not deviate from the summary of this invention other than embodiment mentioned above, this invention can be variously modified.

It is a figure which shows the structure of the image recording / reproducing system which concerns on 1st Embodiment of this invention, and an electronic album production system. 6 is a flowchart showing photographing control in an image recording / reproducing apparatus (a digital camera is assumed in the present embodiment). It is the flowchart which showed the step which the correlation means of a base station matches audio | voice data with respect to the image data to which location information was added. It is a figure which shows the example of a screen display of the actual selection screen by a song name list. It is a figure which shows the album of various versions which added the different music with respect to the same image pattern. It is a flowchart of the music data selection performed using a person authentication technique. It is a figure showing the structure of the image recording / reproducing system and electronic album production system which concern on 2nd Embodiment. It is a flowchart of album creation in 2nd Embodiment. It is a schematic diagram showing the reproduction | regeneration condition of the electronic album produced with the image recording / reproducing system and electronic album production system which concern on 2nd Embodiment.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 1 ... Control part, 2 ... Image recording / reproducing apparatus, 2a ... Operation means, 4 ... Imaging | photography means, 6 ... Recording means, 8 ... Data correlation means, 10 ... Location information input means, 10a ... Location information input operation means, 12 ... Display unit, 14 ... GPS information, 16a ... antenna, 16 ... receiving circuit, 18 ... transmission / reception means, 18a ... operation means, 18b ... place name extraction unit, 18c ... place name database, 20 ... internet, 22 ... base station, 24 ... place name Information extraction means, 26 ... database, 28 ... association means, 30 ... recording means, 32 ... electronic album section, 34 ... electronic album memory section, 36 ... image reproduction section, 38 ... audio reproduction section, 40a ... electronic album operation means 40 ... Electronic album control means, 42 ... Database search section.

Claims (16)

A shooting point associating means for associating location information data that is information relating to a point at which an image was shot and image data that is a shot image;
Means for searching for music data related to the spot where the image was taken from a database in which music data is stored, using the location information associated with the image data;
Reproduction means for simultaneously reproducing the music data searched by the searching means and the image data;
An image recording / reproducing system comprising:   2. The search unit according to claim 1, wherein the searching unit further performs image analysis of the image data, and searches the music data in consideration of the analysis result of the image analysis when searching for the music data. Image recording and playback system.   The music data stored in the database includes music data that is a composer's work related to the location information data, music data that is a singer's song related to the location information data, and a song name related to the location information data The image recording / reproducing system according to claim 1, wherein the image recording / reproducing system includes at least one piece of music data.   It further has a global positioning system function, the global positioning system function and the photographing point association means are components of a camera unit, and the location information data is acquired by the global positioning system. The image recording / reproducing system according to claim 1.   5. The image recording / reproducing system according to claim 4, further comprising data converting means for adding the location information data acquired by the global positioning system function to the image data at the time of image capturing.   The database has a plurality of pieces of music data corresponding to the place information data for one piece of place information data, and music data associated with the image data can be selected from the plurality of pieces of music data. The image recording / reproducing system according to claim 1, further comprising a selection unit.   When selection is not made at the time of music data selection by the selection means, the same image data is associated with each of the plurality of music data to create a plurality of versions of an electronic album The image recording / reproducing system according to claim 6. Location information input means for inputting the position of the shooting location;
Data association means for associating photographed image data with location information data by the location information input means;
A database storing music data;
Search means for searching music data closely related to the location information data from the database;
An image recording / reproducing system comprising reproduction means for simultaneously reproducing the music data searched by the search means and the image data.   9. The image recording / reproducing system according to claim 8, further comprising selection means for performing image analysis of the image data and selecting music data associated with the image data according to the analysis result of the image analysis.   The music data stored in the database includes music data that is a composer's work related to the location information data, music data that is a singer's song related to the location information data, and a song name related to the location information data The image recording / reproducing system according to claim 8, wherein the image recording / reproducing system includes at least one piece of music data.   11. A plurality of music data can be acquired as candidates by searching by the search means, and music data to be associated with the image data can be selected from the plurality of candidate music data. The image recording / reproducing system according to any one of the above.   If selection is not made when selecting music data from the candidate music data, a plurality of versions of the electronic album are created by associating a plurality of music data with the same image data. The image recording / reproducing system according to claim 11. Global positioning system function,
The image recording / reproducing system according to any one of claims 8 to 10, further comprising data association means for adding location information data from the global positioning system function to the image data. Recording means for recording captured image data associated with location information data, which is information relating to the location where the image was taken,
The location information data is extracted from the photographed image data recorded in the recording means, and the song data stores the song data of the music related to the place where the image was photographed based on the extracted location information data. Search means for searching from a database that is stored,
Control means for associating the music data searched by the search means with the photographed image data and recording them in the recording means or recording medium;
An electronic album creation system comprising: The shooting location data is extracted from the shooting image data associated with the shooting location data, which is information relating to the location where the image was taken, and the place name corresponding to the location where the image was shot is based on the extracted shooting location data. A place name extraction unit to extract;
A transmission / reception unit that inquires of the server about music data related to the place where the image was photographed by the place name extracted by the place name extraction unit, and receives music data from the server;
An albuming unit for associating the music data received by the transmission / reception unit with the captured image data and recording it in a recording unit;
An electronic album creating system comprising: a transmitting / receiving means comprising: A shooting point associating means for associating location information data that is information relating to a point at which an image was shot and image data that is a shot image;
Means for searching for music data related to the spot where the image was taken from a database in which music data is stored, using the location information associated with the image data;
Control means for associating the music data searched by the searching means with the image data;
An electronic album creating system characterized by comprising:

Images