JP2007005985A - Imaging apparatus, program, information terminal, and information communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of reproducing the slide show of a captured image easily. <P>SOLUTION: The imaging apparatus 1 calculates the degree of conformity between sound/image data to be reproduced simultaneously based on information on the designated image/music data obtained by referring to image/music information tables 171, 172, and a conformity degree determination table 173 when the slide show is reproduced based on the image data or music data designated by an input 14 from the music and image data stored into a storage section 17, and uses the sound/image data selected according to the degree of conformity for reproducing the slide show. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging device, a program, an information terminal, and an information communication system that perform slide show reproduction in which images and sound are reproduced in synchronization.

  2. Description of the Related Art Conventionally, some imaging devices such as digital cameras include a display unit such as a finder display for confirming a captured image in real time at the time of imaging and an LCD (Liquid Crystal Display) for confirming an image captured after imaging. In the display of the captured image on the display unit, what is displayed so that the user can enjoy and enjoy it by so-called slide show playback in which the playback order of the captured image is designated and played back is known.

Furthermore, in slide show reproduction, there are some that can be enjoyed and enjoyed by the user by synchronizing and reproducing a plurality of captured image data according to music data in addition to simply viewing the captured image.
This is based on slide show information that specifies in advance which captured image data is to be played back corresponding to each part of the music data (or music data to be played back is specified in advance corresponding to the playback order of the captured image data). Data and a plurality of captured image data are reproduced in synchronization.
For example, Patent Document 1 discloses a technique for displaying an image associated with audio information and generating a sound based on the associated audio information.
JP 2003-1116099 A

However, in the above-described prior art, the image data corresponding to each part of the music data is directly and fixedly associated with the slide show information, so new image data and new music data are sequentially added to the device. In such an environment, the newly added data cannot be included in the slide show reproduction based on the previously set slide show information.
In other words, in a digital camera or the like that can be captured and easily acquired, each time a newly captured image is included in a previous slide show playback, the correspondence between each piece of music data and the image data is specified. It is necessary for the user to perform correction work, and although it is possible to easily acquire an image, it is troublesome to perform a slide show reproduction based on the image.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an imaging apparatus capable of easily reproducing slide images of captured images.

  In order to solve the above-mentioned problem, the invention described in claim 1 is characterized in that image data storage means for storing a plurality of image data picked up by the image pickup means and given the first attribute information, and the second attribute information Voice data storage means for storing a plurality of assigned voice data, voice designation means for designating voice data to be reproduced from a plurality of voice data stored in the voice data storage means, and designation by the voice designation means Based on the second attribute information given to the audio data and the first attribute information given to the image data stored in the image data storage means at the time of audio reproduction based on the obtained audio data The degree of matching between the designated audio data and the image data is calculated and selected from a plurality of image data stored in the image data storage means according to the calculated degree of matching. Reproducing means for performing display based on the image data, characterized by comprising a.

  According to a second aspect of the present invention, in the first aspect of the invention, the image data storage unit sequentially adds and stores image data sequentially captured by the imaging unit, and the reproduction unit includes the audio. The fitness is calculated for a plurality of image data stored in the image data storage means at the time when audio data to be reproduced is designated by the designation means.

  According to a third aspect of the present invention, there is provided image data storage means for storing a plurality of image data picked up by the image pickup means and provided with the first attribute information, and a plurality of sound data provided with the second attribute information. Audio data storage means, image designation means for designating image data to be reproduced from a plurality of image data stored in the image data storage means, and image display based on the image data designated by the image designation means At the time of the designation based on the first attribute information given to the designated image data and the second attribute information given to the voice data stored in the voice data storage means The degree of fit between the image data and the sound data is calculated, and the sound data selected from the plurality of sound data stored in the sound data storage means according to the calculated degree of fit Reproducing means for performing audio reproduction of brute, characterized by comprising a.

  The invention according to claim 4 is the invention according to claim 3, further comprising audio data acquisition means for acquiring audio data from the outside, wherein the audio data storage means is sequentially acquired by the audio data acquisition means. Audio data is sequentially added and stored, and the reproduction unit targets a plurality of audio data stored in the audio data storage unit when the image data to be reproduced is designated by the image designation unit. The fitness is calculated.

  The invention according to claim 5 is the invention according to claim 4, further comprising communication means for communicating with a server via a communication line, wherein the voice data acquisition means receives voice data from the server by the communication means. It is characterized by acquiring.

  The invention according to claim 6 is the invention according to any one of claims 1 to 5, wherein the sound data storage means stores a plurality of sound data to which the second attribute information is assigned for each reproduction section. When the reproduction means reproduces any reproduction section of the selected audio data, the reproduction attribute is designated by the second attribute information given to the reproduction section of the audio data and the image designation means. Based on the first attribute information given to the image data, the matching degree between the designated image data and the reproduction classification of the audio data is calculated, and the display based on the image data corresponding to the calculated matching degree It is characterized by performing.

  The invention according to claim 7 is the first conformity indicating the conformity relationship between the first attribute information and the second attribute information in the invention according to any one of claims 1 to 6. First fitness information storage means for storing information is further provided, and the calculation of the fitness between the first attribute information and the second attribute information is stored in the first fitness information storage means. It is based on the first matching information.

  The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein second matching information indicating a correspondence relationship between the second attribute information and any image processing is stored. And second reproduction information storage means for performing the reproduction based on the audio data and the display based on the image data, and the second attribute information added to the audio data and the second attribute information. The display based on the image data is performed by image processing based on the second matching information stored in the matching relationship storage means.

  The invention according to claim 9 is the invention according to claim 8, wherein any one of the image processes is a display switching process based on image data, and the image process in the reproduction means is the second attribute. The display of the image is switched at a speed based on the information and the second matching information.

  According to a tenth aspect of the present invention, in the invention according to the eighth or ninth aspect, the second attribute information is information indicating a tempo of audio data, and the image processing in the reproduction means is performed according to the tempo. The display is based on the image data by the image processing.

  The invention according to claim 11 is the invention according to claim 7, further comprising first conformity information setting means for setting the first conformity information stored in the first conformity information storage means. Features.

  The invention described in claim 12 is the invention described in claim 8, further comprising second conformity information setting means for setting the second conformity information stored in the second conformity information storage means. Features.

  The invention according to claim 13 is the invention according to any one of claims 1 to 12, further comprising first attribute information setting means for setting the first attribute information.

  The invention described in claim 14 is the invention described in any one of claims 1-13, further comprising a second attribute information setting means for setting the second attribute information.

  According to the fifteenth to seventeenth aspects of the present invention, a program for realizing the main functions shown in the first, third, and sixth aspects of the present invention is provided in the computer of the imaging apparatus.

  According to an eighteenth aspect of the present invention, the imaging apparatus according to any one of the first to fourteenth aspects of the present invention and communication means for performing communication via a communication line are provided.

  The invention according to claim 19 is an information communication system in which the information terminal according to claim 18 and a server are connected to each other via a communication line, and the server has the first attribute information Storage means for storing a plurality of assigned image data, and the second attribute information assigned to the voice data designated by the voice designation means, are received and stored in the second attribute information and the storage means. On the basis of the first attribute information given to the image data, the degree of matching between the designated audio data and the image data is calculated, and stored in the storage means according to the calculated degree of matching 19. The information terminal according to claim 18, further comprising data communication means for transmitting image data selected from the image data, wherein the information terminal receives the image data transmitted from the server and is designated by the voice designation means. During sound reproduction based on audio data, and performing a display based on the received image data.

  The invention according to claim 20 is an information communication system in which the information terminal according to claim 18 and a server are connected to each other via a communication line, and the server has second attribute information Storage means for storing a plurality of assigned audio data and the first attribute information assigned to the image data designated by the image designation means are received and stored in the first attribute information and the storage means. On the basis of the second attribute information given to the voice data, the degree of matching between the designated image data and the voice data is calculated, and the voice stored in the storage means according to the calculated degree of matching 19. An information terminal according to claim 18, further comprising: a data communication unit that transmits audio data selected from the data; the information terminal according to claim 18 receives the audio data transmitted from the server; and the image specified by the image designating unit. When displayed based on the data, and performing audio reproduction based on the audio data thus received.

  According to the first and fifteenth aspects of the present invention, it is possible to display image data suitable for the audio data only by designating the audio data to be reproduced, and simultaneously for each audio data. Since it is not necessary to specify in advance the information of the image data to be displayed, the audio data to be played back is always available even in the environment where new image data or new audio data is added. It is possible to display image data suitable for each part of the audio data simply by designating.

  According to the second aspect of the present invention, the image stored in the image data storage means is an image that is sequentially added by imaging, and the reproduction means at the time when the audio data to be reproduced is designated by the audio designation means. Since the degree of fitness is calculated with respect to the image data stored in the image data storage means, when the audio data to be reproduced is designated and the image data suitable for the audio data is displayed, the image data is sequentially captured. Even in the situation where an image is added, it is possible to perform display based on the latest image data at the designated time point by simply designating audio data to be reproduced.

  According to the third and sixteenth aspects of the present invention, it is possible to perform audio reproduction based on audio data suitable for the image data simply by specifying the image data to be displayed, and each image data Since there is no need to specify in advance the information of the audio data to be played back, the display target is always available even in the environment where new image data or new audio data is added. Only by designating the image data to be, audio reproduction based on audio data suitable for the image data can be performed.

  According to the invention described in claim 4, the audio data stored in the audio data storage means is data acquired sequentially from the audio data acquisition means, and the reproduction means designates the image data to be reproduced by the image designation means. Since the degree of conformity is calculated with respect to the sound data stored in the sound data storage means at the time of being played, the sound data suitable for the image data is reproduced when the image data is designated and reproduced. Even in a situation where the sound is sequentially acquired and stored, the sound reproduction based on the latest sound data at the designated time point can be performed only by designating the image data to be reproduced.

  According to the fifth aspect of the present invention, voice data can be obtained by communication with a server via a communication line.

  According to the sixth and 17th aspects of the present invention, it is possible to display image data suitable for each reproduction category when sound is reproduced based on sound data, and an image suitable for the situation of sound to be reproduced more. Can be displayed.

  According to the seventh aspect of the present invention, even if the attribute information of the music data and the attribute information of the image data are attribute information given independently, the music data attribute information is based on the two attribute information. Image data suitable for each part can be associated.

  According to the invention described in claim 8, the image display based on the image data at the time of sound reproduction based on the sound data is performed by performing image processing corresponding to the second attribute information given to the sound data. Thus, it is possible to display an image with a visual presentation suitable for more reproduced audio.

  According to the ninth aspect of the present invention, the image to be displayed can be switched at a speed corresponding to the second attribute information given to the audio data, and the image can be displayed with a visual effect suitable for the reproduced audio. Display can be made.

  According to the tenth aspect of the present invention, it is possible to display an image based on image data in accordance with the tempo at the time of sound reproduction based on the sound data, and display the image with a visual effect suitable for the sound to be reproduced. It can be performed.

  According to the invention described in claims 11 to 14, since the configuration includes means for setting the first matching information, the second matching information, the first attribute information, or the second attribute information, the degree of matching is determined. It is possible to set to the user's preference, and it is possible to reproduce with a combination of image data and audio data that more suits the user's preference.

  According to the invention of the eighteenth aspect, the present invention can also be implemented in an information terminal that performs communication via a communication line.

  According to the inventions of claims 19 and 20, when audio data to be reproduced / image data to be displayed is designated and audio reproduction or image display is performed, image data for displaying an image suitable for the audio reproduction from the server. / Audio data for reproducing sound suitable for image display is received, and display and audio reproduction based on the received image data / audio data are performed. For this reason, the information terminal only needs to hold information of either audio data or image data.

[First Embodiment]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the embodiments. The embodiment of the present invention shows the most preferable mode of the invention, and the terminology of the invention is not limited to this.

  First, the structure of the imaging device 1 which is this invention is demonstrated, referring FIGS. FIG. 1A is an external view illustrating a front external appearance of the imaging apparatus 1, FIG. 1B is an external view illustrating a rear external appearance of the imaging apparatus 1, and FIG. FIG. 3 is a block diagram schematically showing the configuration, FIG. 3 is a block diagram showing details of the imaging unit 11, FIG. 4A is a diagram illustrating the contents of the image information table 171, and FIG. FIG. 5B illustrates the contents of the music information table 172, FIG. 5A illustrates the contents of the fitness determination table 173a, and FIG. 5B illustrates the fitness determination table 173b. It is a figure which illustrates the content of.

  As shown in FIG. 1A, the imaging apparatus 1 includes a lens 120 that forms an image on the imaging surface of an imaging element inside the subject, which is a subject to be photographed. A shutter 141 is provided at an upper position where the right hand can be easily pressed with the right index finger when the right hand is gripped with the right hand.

  The imaging apparatus 1 includes a microphone 191 that mainly inputs external audio in the front direction, an audio input terminal 192 that can input an audio signal from an external microphone or an audio reproduction device, and a speaker 193 that reproduces audio. An audio unit 19 is provided, and performs audio recording based on audio data stored at the time of video recording, recording of music reproduced by an external device, or audio data stored in the apparatus.

  As shown in FIG. 1B, the imaging apparatus 1 is configured such that when the user holds the display screen 121, which is an LCD (Liquid Crystal Display) that displays a captured image, and the right hand as with the shutter 141 described above. A key operation unit 142 that can be easily operated with the thumb of the right hand is provided at the back position.

  As shown in FIG. 2, the imaging device 1 includes a control unit 10, an imaging unit 11, a display unit 12, a finder unit 13, an input unit 14, a memory card I / F 15, an image processing unit 16, a storage unit 17, a communication I / O. F18 and the audio | voice part 19 are provided, and each part is mutually connected electrically by the bus | bath 20. FIG.

  The control unit 10 includes a CPU (Central Processing Unit), an internal RAM (Random Access Memory), a ROM (Read Only Memory), and the like (not shown), and the CPU is stored in the ROM with a predetermined area of the internal RAM as a work area. Based on various control programs or various data, control signals are sent to the above-described units to control the overall operation of the imaging apparatus 1. The storage area of the work area and various programs described above may be the storage unit 17 described later. Specifically, the control unit 10 reads the stored program, and sets music information setting processing, image information setting processing, fitness level determination table setting processing, slide show creation processing, fitness level determination processing, effect fitness level, which will be described later. Judgment processing or slide show reproduction processing is performed.

  Further, the control unit 10 includes a photographing lens system, a lens / mirror block such as a mirror, an image sensor such as a CCD (Charge Coupled Device), a driving system thereof, a distance measuring sensor, a light quantity sensor, an analog processing circuit, a signal processing circuit, and the like. The imaging operation of the imaging apparatus 1 is controlled by adjusting and controlling the optical zoom of the imaging unit 11 including the above, or by controlling drive control during autofocus, shutter drive control, exposure, white balance, and the like.

  Note that the imaging operation of the imaging apparatus 1 is performed in various shooting modes such as “person mode” suitable for portrait photography, “night scene mode” suitable for night scene photography, and “daytime mode” suitable for daytime photography. The above control may be performed accordingly.

  In addition, the control unit 10 sends the image data captured by the imaging unit 11 and subjected to signal processing to the image processing unit 16, and stores the image data subjected to predetermined image processing in the storage unit 17 or the display unit 12 or the finder. The display on the display screen 121 by the unit 13 is performed. Further, the control unit 10 has a function of measuring the current time by counting clock signals by crystal oscillation at a constant frequency at all times.

  The display unit 12 includes a display screen 121 such as an LCD, and is used as an image reproduction screen, an input operation screen, and a message screen. The resolution of the display unit 12 is substantially the same as the resolution of the image sensor in the imaging unit 11. It is a high definition display.

  The finder unit 13 displays an image obtained by combining the image data captured by the imaging unit 11 with a frame, a field frame, a marker such as a marker indicating a focus target, and numerical values such as an aperture / shutter speed on the display screen 121 in real time. (Through / finder image display).

  The finder unit 13 has an objective lens that receives light from the imaging direction, in addition to a configuration that displays the captured image as a finder image on the display screen 121, and a finder unit that displays the above signs and numerical values according to instructions from the control unit 10. The optical viewfinder may be an LCD, an eyepiece that guides the incident light beam to the user's eye, and a prism that guides light from the objective lens and light from the finder LCD and guides it to the eyepiece.

  The input unit 14 includes a shutter 141 that can be pressed with a two-stage stroke of “half press” or “full press”, a key operation unit 142 that performs various settings, selections, and the like by pressing a selection key or a determination key. Then, a signal corresponding to the pressing operation is transmitted to the control unit 10.

  The memory card I / F 15 is an interface to which a memory card, which is a recording medium capable of reading and writing data (not shown), is detachably mounted, and writes image data and the like to the memory card. The memory card is a non-volatile recording medium, and specifically, a smart media, an IC card, or the like.

  The image processing unit 16 includes an image processing DSP (Digital Signal Processor) or the like, and performs enlargement / reduction processing, pixel interpolation, luminance value adjustment, color conversion, and color conversion based on image data and control signals input from the control unit 10. Various image processing such as cutting out a predetermined area is performed, and converted image data and calculation result values are output to the control unit 10.

  The storage unit 17 is a nonvolatile memory or the like that can be electrically erased and rewritten by an instruction from the control unit 10, and has a program storage area, a data storage area, and a work area. The program storage area stores a program or the like for realizing an operation related to the present embodiment according to an operation procedure shown in a flowchart described later. The data storage area stores an image information table 171, a music information table 172, a suitability determination table 173, slide show information 174, and image data and music data (audio data) (not shown).

  As shown in FIG. 4A, the image information table 171 includes “image group”, “shooting date”, “mood”, “image” for each image data stored in the storage unit 17 with the name “image”. It is a table for storing data to which attribute information such as “favorite degree”, “color”, “shooting distance”, or “shooting mode” is given. In addition to the table format shown in the figure, the attribute information for each image data is stored as tag information in the header / footer portion of each image data, for example, additional information in Exif (Exchangeable Image File Format) format image data It may be configured to be stored in.

  Note that “image group” in the attribute information is information indicating the category to which the image data belongs, and “mood”, “favorite”, and “hue” are information indicating the user's impression of the captured image, both after imaging Set by the user when confirming “Shooting date” is the time information at the time of imaging, “Shooting distance” and “Shooting mode” are the shooting mode at the time of shooting, the distance value output by the sensor unit 111, and the like. It is.

  As shown in FIG. 4B, the music information table 172 includes “reproduction time”, “popular time”, “image” for each reproduction part for each music data stored in the storage unit 17 as “music name”. It is a table for storing data to which attribute information such as “,” “classification” or “tempo” is assigned. The attribute information for each music data may be stored as tag information in the header / footer portion of each music data, similar to the attribute information for the image data described above.

  The degree-of-fit determination table 173 includes information indicating a matching relationship between any of the attribute information of music and any of the attribute information of the image, and matching of any of the image effects with any of the attribute information of the music. Stores information indicating the relationship. As shown in FIG. 5 (a), the conformity relationship in the previous stage is the degree of fitness between the music “image” and the image “mood”, and the music “tempo” and the image “tone”. There is a suitability determination table 173a that stores a music-to-image match relationship such as degree in a plurality of items. Further, as shown in FIG. 5B, the compatibility relationship in the latter stage is the degree of compatibility between the music “tempo” and the switching speed of the image effect, and the switching of the music “classification” and the image effect. There is a fitness determination table 173b that stores the compatibility relationship between music and effects, such as the fitness with the mode, in a plurality of items.

  As shown in FIG. 5, the information related to the conformity relationship may be configured such that a plurality of items are stored together in a table indicating the conformity, but may be configured to provide a table for each item comparison. Also, as shown in the figure, the compatibility relationship between music vs. image or music vs. effect is one image, as opposed to the attribute information or effect compatibility relationship of a plurality of images for one music attribute information. The attribute information or effect of the music may be compatible with a plurality of pieces of music attribute information, and is not particularly limited.

  The slide show information 174 is information indicating the music data to be played back, the image data to be displayed for each playback portion of the music data, and the display effect (effect) by the image processing when the image is displayed. Created. The slide show information 174 may be configured to manage the above information in a time table and to reproduce a plurality of music data and image data.

  The communication I / F 18 is an interface to which a data processing apparatus such as a PC (Personal Computer) is connected as an external device, and performs data communication with the external device by a predetermined communication protocol by wired or wireless communication. .

  The audio unit 19 includes a microphone 191, an audio input terminal 192, and a speaker 193. The audio unit 19 outputs audio data to the control unit 10 based on an audio signal input through the microphone or the terminal, and is based on the input audio data. Perform audio playback. Specifically, the audio unit 19 digitally converts an audio signal input from the microphone 191 or the audio input terminal 192, and then performs a predetermined process such as an AVI (Audio Video Interleave) format, an MPEG (Moving Picture Experts Group) format, or a WAV format. Is converted into audio data (music data) of the format and output to the control unit 10. Also, the audio data of the above format input from the control unit 10 is decoded, converted into an analog signal, and output from the microphone 191.

  As shown in FIG. 3, the imaging unit 11 includes a sensor unit 111, an optical system driving unit 112, a driving circuit 113, an imaging element 114, an analog processing circuit 115, an A / D circuit 116, a buffer 117, a signal processing circuit 118, and a compression. An expansion circuit 119, a lens 120, and an aperture 1121 are provided, and image data that is a moving image or a still image that is captured with a predetermined focal length in accordance with an instruction from the control unit 10 is converted into image data of a predetermined format to generate an image. The data is output to the processing unit 16.

  The sensor unit 111 is configured to output a distance value and an exposure value of an imaging target in the imaging direction. For example, the sensor unit 111 includes a distance measuring circuit including an infrared light projecting unit and a light receiving unit (not shown) and a photoelectric conductor such as CdS. It consists of an exposure circuit.

  The optical system driving unit 112 is a circuit that drives a lens 120 and a diaphragm 1121 described later by a stepping motor or the like, and in accordance with an instruction from the imaging unit 11 according to a distance value or an exposure value obtained by the sensor unit 111 described above, an imaging element The lens 120 is moved so that the image formed at 114 is focused on the object to be imaged, and the exposure is controlled by the aperture 1121 so that the amount of light incident on the image sensor 114 is appropriate.

  The drive circuit 113 sequentially takes out the charge corresponding to each pixel photoelectrically converted by the image sensor 114 as an image signal, and gives it to the analog processing circuit 115. The image sensor 114 is configured by an optical sensor such as a CCD or a CMOS (Complementary Metal Oxide Semiconductor), and outputs an image formed on an image pickup surface on the image sensor as an image signal corresponding to each pixel. In addition, each pixel in the image sensor 114 is configured with pixels for three colors including RGB (Red, Green, Blue) filters as one unit pixel.

  The analog processing circuit 115 includes a CDS (Correlated Double Sampling) circuit that reduces noise of an image signal output from the image sensor 114, an AGC (Automatic Gain Control) circuit that amplifies the signal, A color separation circuit that separates the color difference components of R, G, and B using the difference of the color difference signals in the input image signal and the balance of the color difference components of R, G, and B are made equal. Predetermined analog signal processing is performed by the adjusted white balance control circuit and the like, and an analog image signal is output to the A / D circuit 116.

  The A / D circuit 116 converts the analog image signal output from the analog processing circuit 115 into a digital image signal and outputs the digital image signal to the buffer 117. The buffer 117 temporarily stores the digital image signal converted by the A / D circuit 116 and sequentially outputs it to the signal processing circuit 118 or the compression / decompression circuit 119 in accordance with an instruction from the control unit 10.

The signal processing circuit 118 calculates the sharpness of a predetermined area of the image based on the input digital image signal and outputs the calculated sharpness to the control unit 10. Thereby, the control part 10 can focus in the predetermined area | region of an image by detecting the in-focus state which is sharpest and contrast becomes high.
The compression / decompression circuit 119 compresses or decodes the input digital image signal by a predetermined encoding method such as JPEG (Joint Photographic Experts Group), and outputs the signal to the control unit 10.

  The lens 120 is a lens that can be adjusted so that an image to be imaged is formed (focused) on the imaging surface on the imaging element 114 described above. The lens 120 may be configured to be able to adjust the angle of view by a combination of a plurality of lens groups. The display screen 121 is disposed between the lens 120 and the image sensor 114, and is configured to be able to control the opening diameter and the opening / closing time (exposure time) by a plurality of shutter blades.

  Next, music information, image information, and a fitness determination table setting process in the imaging apparatus 1 will be described with reference to FIGS. 6A is a flowchart showing a music information setting process performed by the control unit 10, FIG. 6B is a flowchart showing an image information setting process performed by the control unit 10, and FIG. It is a flowchart which shows the setting process of the suitability determination table which the control part 10 performs.

First, the music information setting process will be described.
As shown in FIG. 6A, the control unit 10 starts a music information setting process for music data to be input in response to an operation instruction from the input unit 14, and the trend time, image, Information related to music such as classification and tempo is received from the input unit 14 (step S11). In step S11, the music data may be divided every reproduction time and information related to the music may be input. Specifically, as shown in the figure, music data is reproduced when information related to music is received from the input unit 14, and further information is input to a reproduction portion that is divided at the timing of input from the user. It is the structure to do.

  Next, based on the input instruction from the input unit 14 and the setting information stored in the storage unit 17, it is determined whether or not information related to the input music is embedded in the music data (step S12). If not (step S12: NO), the input information is stored as a separate file in the music information table 172 (step S13), and the process ends (step S12: YES). The information input to the music data is embedded by a method using a watermark technique or the like (step S14), the music data in which the information is embedded is stored (step S15), and the process ends.

Next, image information setting processing will be described.
As shown in FIG. 6B, the control unit 10 captures an image with the imaging unit 11 (step S21), displays a confirmation screen of the captured image on the display unit 12 (step S22), and displays the image group name and mood. The information about the captured image, such as the degree of preference and the hue, is received from the input unit 14 (step S23), the captured image data is stored, and the input information is stored in the image information table 171 (step S24), and the process ends. To do.

  In addition to the information input from the input unit 14, the information related to the captured image is measured by the shooting unit based on the current time measured, the shooting mode at the time of shooting in the imaging unit 11, and the sensor unit 111. It may be a shooting distance based on a distance value to the shooting target.

Next, the fitness level determination table setting process will be described.
As shown in FIG. 7, the control unit 10 designates the attribute of the music data and the attribute of the image data based on the operation instruction from the input unit 14 (steps S31 and S32), and matches between the designated attributes. Is received (step S33), the degree of matching between the two attributes that have been designated and input is stored as the degree of matching judgment table 173a (step S34), and the setting is completed based on the presence or absence of an instruction to end the setting process. Steps S31 to S34 are performed until it is determined (step S35).

  Similarly, in the setting process related to the suitability determination table 173b, the effect is designated in step S32, and the suitability between the input music attribute information designated in step S34 and the effect is stored as the suitability determination table 173b. To do. The setting process of the suitability level determination table may be a process of replacing steps S31 and S32 and setting the suitability level of the music attribute information with respect to the image attribute information.

  The imaging apparatus 1 performs the above-described music information setting process, image information setting process, or fitness level determination table setting process to set information to be added to music data or image data according to the preference of the user, It is possible to set a conformity relationship based on information.

  Next, the slide show creation process will be described with reference to FIGS. FIG. 8 is a flowchart showing a slide show creation process performed by the control unit 10, FIG. 9A is a flowchart showing a fitness determination process performed by the control unit 10, and FIG. FIG. 10 is a flowchart showing a slide show reproduction process performed by the control unit 10.

  First, as shown in FIG. 8, the control unit 10 starts slide show creation processing in response to an operation instruction from the input unit 14, and music data or a plurality of image data is used as data that is the source of a slide show that is played back in synchronization. It waits until it is designated from the input unit 14 (steps S41 and S42).

  When a plurality of image data (image group) is designated as the data to be the source of the slide show to be played back synchronously (step S42: YES), the image data included in the image group is the slide show selection candidate data, Information corresponding to the image data in the image information table 171 is stored in the work area of the storage unit 17 (step S43), and fitness determination processing is performed in which the fitness of each music data with respect to the image group is determined ( In step S44, the music data having the highest fitness with respect to the designated image group is selected as music data during slide show reproduction (step S45).

  Here, the fitness determination processing in step S44 will be described in detail. As shown in FIG. 9A, the control unit 10 selects one of the items in the fitness determination table 173a (step S61), and determines the attribute information of the music data to be determined and the attribute information of the image data. The matching degree between the original image and music is acquired (step S62), and the acquired matching degree is accumulated for each music data and image data to be determined and stored in the work area of the storage unit 17 (step S63). Then, the presence / absence of an item for determining another fitness in the fitness determination table 173a is determined (step S64). If there is an item, steps S62 and S63 are performed based on the other item, and if there is no item, the total is accumulated. The matching level is stored as the matching level between the music data to be determined and the image data (step S65), and the process ends.

  In step S44, the above-described fitness determination processing is performed based on the average attribute information of the image group and the average attribute information of each reproduction portion of each music data, and the fitness for each music data of the image group is calculated. To do. As a result, the degree of matching of the music with respect to the image group can be indicated by the degree of matching. In addition, the calculation of the fitness between the image group and the music data is not only based on the average attribute information of the image group and the average of each reproduction part of the music data, but also each image data and music data belonging to the image group. In other words, the degree of conformity with each reproduction part may be calculated and accumulated.

  If music data is specified as the data to be the source of the slide show to be played back synchronously (step S41: YES), all the image data stored in the storage unit 17 is the selection candidate data for the slide show, and the image All of the information table 171 is stored in the work area of the storage unit 17 (step S46).

  Next, the suitability of each effect with respect to each portion (playback position) of music data designated as music during slide show playback is determined by effect suitability determination processing (step S47), and the highest fit in each portion of the music data. A degree of effect is assigned (step S48).

  Here, the effect suitability determination process in step S47 will be described in detail. As shown in FIG. 9B, the control unit 10 selects one of the items in the suitability determination table 173b (step S71), and attribute information and effects in each part of the music data to be determined. (Step S72), the obtained fitness is accumulated for each piece of music data to be determined and stored in the work area of the storage unit 17 (step S73), and the other in the fitness determination table 173b. If there is an item, the steps S72 and S73 are performed based on other items, and if there is no item, the accumulated fitness is determined as music data. Are stored as the degree of matching between each part and the effect (step S75), and the process ends.

  In this step S47, the effect suitability determination process described above is performed on all parts of the designated music data, so that the suitability of the effect for each reproduction part can be indicated by the suitability level.

  Next, the fitness of each image data that is a slide show selection candidate for each portion of the specified music data is determined by a fitness determination process that compares the image data with each portion of the music data, contrary to step S44. (Step S49), the image data necessary for the effect assigned in Step S48 is selected for each part of the music data in the order of the image data having the highest fitness (Step S50). Slide show information in which data and effects are associated is created and stored in the data storage area of the storage unit 17 (step S51).

  The slide show information created by the above processing will be described with reference to FIG. 11 illustrating the slide show information 174. As shown in the figure, the slide show information 174 is data including music data to be reproduced, image data corresponding to each part such as a prelude and rust in the music data, and an effect on the image data. The imaging apparatus 1 performs slide show reproduction in which music and images are synchronized based on the slide show information 174.

  For this reason, the imaging apparatus 1 can reproduce a more preferable slide show in which images and music are matched by using the slide show information 174 created by the above-described processing for slide show reproduction. For example, if the fitness level determination table 173a is set so that the fitness level is high when the preference level in the attribute information of the image data is high with respect to the rust portion of the music data, the favorite level corresponding to the setting is set. The image is played back in the rust portion. In addition, when the suitability determination table 173b is set so that the adaptability of the effect of switching the image slowly when the tempo is slow and fast when the tempo is fast, the image is switched with the effect according to the setting. Played.

After step S51, it is determined whether or not to immediately reproduce based on an instruction from the input unit 14 (step S52). When reproducing immediately, based on the slide show information created and stored up to step S51. Then, a slide show reproduction process is performed (step S53) and the process ends.
When not reproducing immediately, the slide show information stored here can be designated and reproduced at any time of the user.

  By the way, the number of stored image data constantly changes as new shooting and recording is performed or unnecessary image data is deleted. The number of stored music data is, for example, that new music data is read via a removable memory card, new music data is downloaded via a communication line, or unnecessary music data is stored. It is always changing by being deleted.

  In such an environment where information is constantly changing, if you want to synchronize and play the same image data each time for the specified music data, or if you want to synchronize and play the same music data for the specified image group every time The same slide show information stored here may be designated and reproduced each time. On the other hand, even when playback is performed by designating the same music data, it is always necessary to perform synchronized playback using a plurality of image data selected from the latest image data, or by designating the same image group. Even when playback is performed, if it is desired to always perform synchronized playback using a plurality of music data selected from the latest music data, the processing from step S41 may be executed immediately before performing synchronized playback.

  Here, the slide show reproduction process in step S53 will be described in detail. As shown in FIG. 10, the control unit 10 waits until the slide show information to be reproduced is designated by an instruction from the input unit 14 or the like (step S81). If designated, the control unit 10 is designated by the slide show information. The music data is acquired from the storage unit 17 (step S82), and reproduction of the music data is started (step S83).

  Next, based on the slide show information, information about the effect and image data designated corresponding to the current reproduction position of the music data being reproduced is acquired (step S84), and the acquired image data is designated. The processed image is processed and displayed on the display unit 12 (step S85), and the processes in steps S84 and S85 are performed until the end of the music data is detected, that is, until the reproduction is completed (step S85). S86: YES), the process ends.

  As described above, when the image capturing apparatus 1 performs the slide show reproduction based on the image data or the music data designated by the input unit 14 from the music data or the image data stored in the storage unit 17, the image information table is stored. 171, the fitness of audio data / image data to be reproduced at the same time is calculated based on the information on the designated image data / music data obtained by referring to the music information table 172 and the fitness determination table 173; Slide show reproduction is performed using the audio data / image data selected according to the degree of fitness.

  For this reason, the imaging apparatus 1 can perform slide show playback by designating either an image group or music data as the source data for playback during slide show playback, thereby enabling easy slide show playback.

  In addition, since the imaging apparatus 1 is configured to store information for each reproduction category of music data using the music information table 172, image data can be selected for each reproduction category when reproducing sound using music data. It is possible to display an image more in line with music.

  In addition, since the imaging apparatus 1 is configured to store information on the compatibility relationship between the information on the image data and the information on the music data in the fitness level determination table 173a, the compatibility relationship between the image and the music can be clearly associated. Further, since the degree-of-fit determination table 173b stores information related to the relationship between the music data and the display effect by the image processing and performs image processing of the image to be displayed based on the information, for example, according to the tempo of the music data. By changing the switching speed for displaying images, it is possible to produce visual effects that match the music, such as displaying images synchronized with the music tempo.

[Second Embodiment]
Next, as a second embodiment, a portable information terminal 2 that is a foldable mobile phone to which the present invention is applied and an information communication system 100 using the portable information terminal 2 are described with reference to FIGS. To explain. For simplification, the same components as those of the imaging device 1 described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

  Here, FIG. 12A is a front external view of the portable information terminal 2 in the opened state, FIG. 12B is a rear external view of the portable information terminal 2 in the opened state, and FIG. FIG. 14 is a diagram schematically illustrating a functional configuration of the portable information terminal 2, FIG. 14 is a schematic diagram illustrating an overview of a configuration of the information communication system 100, and FIG. FIG. 15B is a ladder chart showing processing of the portable information terminal 2 and the server 4, and FIG. 15B is a flowchart showing music information setting processing of the portable information terminal 2.

First, the portable information terminal 2 will be described in detail.
As shown in FIG. 12 (a), in the portable information terminal 2, an upper lid 101 and a lower lid 102 are rotatably joined by a hinge portion 103, and face each other on the front side with the hinge portion 103 as an axis. It is configured to fold like this. The portable information terminal 2 includes a display screen 121 and a speaker 193 on the front side of the upper lid 101, and a key operation unit 142 and a microphone 191 on the front side of the lower lid 102. This facilitates the operation of the key operation unit 142 and the screen confirmation of the display screen 121 in a state where the user holds the lower lid 102 facing the front side.

  In addition, as shown in FIG. 12B, the portable information terminal 2 includes a lens 120 on the back side of the upper lid 101 and speakers 193a and 193b on the back side of the lower lid 102. For this reason, stereo sound can be reproduced, and the user can easily capture images in the front direction and confirm the images while the user holds the lower lid 102 with the front side facing.

  As shown in FIG. 13, the portable information terminal 2 includes a communication unit 21 that is a communication circuit, and includes a GSM (Global System for Mobile communication) method, a GPRS (General Packet Radio System) method, a PDC. Standards and communications of various cellular phones and wireless modems such as (Personal Digital Cellular) method, CDMA (Code Division Multiple Access) method, PHS (Personal Handyphone System) method, Bluetooth wireless communication method, wireless LAN (Local Area Network) According to the method, communication such as data communication or a telephone call is performed with a wireless base station of a communication company.

  As described above, the portable information terminal 2 has the same configuration as that of the imaging device 1 described above, can perform slide show reproduction based on the captured images, and can perform a call or wireless communication by the communication unit 21. It is.

Next, the information communication system 100 will be described in detail.
As shown in FIG. 14, the information communication system 100 includes a server 4 such as a workstation or a PC (Personal Computer), a wireless station 3 and a portable information terminal 2 for wireless communication companies to communicate with a mobile phone. In this configuration, the various mobile phones and wireless modem standards, communication methods, and wired network N are connected so as to communicate with each other.

  The server 4 includes a control unit 410 that performs overall control of operations in the server 4, a communication unit 411 that communicates with an external information device electrically connected via the network N, a program executed by the control unit 410, The image information table 171, the music information table 172, the fitness determination table 173, a storage unit 412 that stores various data such as image data and music data, and various functional units that are not particularly illustrated. With the above configuration, the server 4 performs processing based on the data transmitted from the portable information terminal 2 and transmits data based on the result to the portable information terminal 2.

  Next, a slide show reproduction process performed in cooperation between the portable information terminal 2 and the information communication system 100 will be described with reference to FIG.

  First, the control unit 10 in the portable information terminal 2 receives image data (image group) or audio data to be played back as a slide show from the input unit 14, and refers to the image information table 171 or the music information table 172 for corresponding image information or music. Information is transmitted to the server 4 (step S91).

  Next, the control unit 410 in the server 4 receives image information or music information transmitted from the portable information terminal 2, creates slide show information based on the received information, and plays back the slide show information and the slide show. Necessary image data or music data is transmitted to the portable information terminal 2 (step S101). Specifically, the control unit 410 performs processing from the above-described steps S44 to S51 when image information is received, and processing from the above-described steps S46 to S51 when receiving music information. And the created slide show information and related image data or music data are transmitted to the portable information terminal 2.

  Next, the control unit 10 in the portable information terminal 2 receives the slide show information transmitted from the server 4 and the image data or music data related thereto, performs the above-described slide show reproduction process (step S92) and ends.

  Further, the music information setting process performed by the control unit 10 in the portable information terminal 2 may be configured as shown in FIG. As shown in the figure, the control unit 10 acquires music data (step S111), and based on the input instruction from the input unit 14 and the setting information stored in the storage unit 17 and the like, It is determined whether or not the user sets information related to the music (step S112). If so (step S112: YES), the music information setting process (steps S11 to S15) described above is performed and the process ends.

  If the user does not make the setting (step S112: NO), the music information providing service terminal provided by the record company or the like provides information specifying the music data such as the song title, the amount of music data, and the total playback time. By transmitting, the music information suitable for the music data is acquired (step S113), the music information is stored in the storage unit 17 (step S115), and the process ends. Specifically, in step S113, information specifying music data is transmitted to the server 4 that provides the music information providing service described above, and is stored in the storage unit 412 based on the information under the control of the control unit 410. Music information corresponding to the music data obtained by referring to the music information table 172 is transmitted to the portable information terminal 2.

  As in the information communication system 100 described above, the portable information terminal 2 and the server 4 perform a slide show creation process in cooperation with each other, and based on the music data when the portable information terminal 2 reproduces music data or image data. The configuration may be such that image data suitable for reproduction and audio data suitable for display based on the image data are received from the server 4 and reproduced. In this case, it suffices to hold only one of audio data and image data in the portable information terminal 2, and the storage area can be used more efficiently.

  The portable information terminal 2 may be configured to acquire and set music information in the music data from the server 4. In this case, the user can save time and effort for setting music information.

  Note that the description in the present embodiment shows an example of the present invention, and the present invention is not limited to this. The detailed configuration and detailed operation of the imaging device 1, the portable information terminal 2, or the information communication system 100 according to the present invention can be changed as appropriate without departing from the spirit of the present invention. For example, the image data described in the present embodiment may be either a moving image or a still image, and is not particularly limited.

  The imaging device 1 and the portable information terminal 2 may be information devices such as a PDA (Personal Digital Assistant) and a PC (Personal Computer) as well as a digital camera and a camera-equipped mobile phone, and are not particularly limited. .

(A) is an external view which shows the front external appearance of the imaging device 1 which is this invention, (b) is an external view which shows the back external appearance of the imaging device 1. FIG. 2 is a block diagram schematically illustrating a functional configuration of the imaging apparatus 1. FIG. 3 is a block diagram illustrating details of an imaging unit 11. FIG. (A) is a figure which illustrates the content of the image information table 171, and (b) is a figure which illustrates the content of the music information table 172. (A) is a figure which illustrates the content of the fitness determination table 173a, (b) is a figure which illustrates the content of the fitness determination table 173b. (A) is a flowchart which shows the setting process of music information, (b) is a flowchart which shows the setting process of image information. It is a flowchart which shows the setting process of a fitness determination table. It is a flowchart which shows a slide show creation process. (A) is a flowchart which shows a suitability determination process, (b) is a flowchart which shows an effect suitability determination process. It is a flowchart which shows a slide show reproduction | regeneration process. It is a figure which illustrates slide show information 174. (A) is a figure which shows the front external appearance of the portable information terminal 2 in the open state, (b) is a figure which shows the back external appearance of the portable information terminal 2 in the open state. 3 is a diagram schematically showing a functional configuration of a portable information terminal 2. FIG. 1 is a schematic diagram showing an outline of a configuration of an information communication system 100. FIG. (A) is a ladder chart which shows the process of the portable information terminal 2 and the server 4 in the information communication system 100, and (b) is a flowchart which shows the music information setting process of the portable information terminal 2.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Portable information terminal (information terminal)
3 Wireless station 4 Server N Network 10 Control unit (reproduction means)
11 Imaging unit (imaging means)
12 Display (reproduction means)
13 Finder part 14 Input part (Speech designation means, image designation means, first matching information setting means, second matching information setting means, first attribute information setting means, second attribute information setting means)
15 Memory card I / F
16 Image processing unit 17 Storage unit (image data storage unit, audio data storage unit, first matching information storage unit, second matching information storage unit)
18 Communication I / F
19 Audio part (reproduction means)
20 Bus 21 Communication unit (communication means)
DESCRIPTION OF SYMBOLS 100 Information communication system 101 Upper cover 102 Lower cover 103 Hinge part 111 Sensor part 112 Optical system drive part 1121 Diaphragm 113 Drive circuit 114 Image sensor 115 Analog processing circuit 116 A / D circuit 117 Buffer 118 Signal processing circuit 119 Compression / decompression circuit 120 Lens 121 Display screen 141 Shutter 142 Key operation unit 171 Image information table (first attribute information)
172 Music information table (second attribute information)
173, 173a, 173b fitness level determination table (first fitness information, second fitness information)
174 Slideshow information 191 Microphone (voice data acquisition means)
192 Voice input terminal (voice data acquisition means)
193, 193a, 193b Speaker 410 control unit (data communication means)
411 Communication unit (data communication means, communication means)
412 Storage unit (storage means)

Claims (20)

Image data storage means for storing a plurality of image data captured by the imaging means and provided with the first attribute information;
Audio data storage means for storing a plurality of audio data to which the second attribute information is assigned;
Voice designation means for designating voice data to be reproduced from a plurality of voice data stored in the voice data storage means;
During the audio reproduction based on the audio data designated by the audio designating means, the second attribute information given to the audio data and the first attribute given to the image data stored in the image data storage means. The degree of matching between the designated audio data and the image data is calculated based on the attribute information of the image data, and selected from the plurality of image data stored in the image data storage unit according to the calculated degree of matching Reproduction means for performing display based on image data;
An imaging apparatus comprising: The image data storage means sequentially adds and stores image data sequentially captured by the imaging means,
The reproduction means calculates the fitness for a plurality of image data stored in the image data storage means at the time when audio data to be reproduced is designated by the audio designation means. The imaging device according to claim 1. Image data storage means for storing a plurality of image data captured by the imaging means and provided with the first attribute information;
Audio data storage means for storing a plurality of audio data to which the second attribute information is assigned;
Image designation means for designating image data to be reproduced from a plurality of image data stored in the image data storage means;
At the time of image display based on the image data designated by the image designation means, the first attribute information given to the designated image data and the voice data stored in the voice data storage means Based on the second attribute information, the degree of matching between the designated image data and the voice data is calculated, and from the plurality of voice data stored in the voice data storage unit according to the calculated degree of matching Reproduction means for performing audio reproduction based on the selected audio data;
An imaging apparatus comprising: Voice data acquisition means for acquiring voice data from the outside,
The voice data storage means sequentially adds and stores voice data sequentially acquired by the voice data acquisition means,
The reproduction means calculates the fitness for a plurality of audio data stored in the audio data storage means when the image data to be reproduced is designated by the image designation means. The imaging device according to claim 3. A communication means for communicating with the server via a communication line;
The imaging apparatus according to claim 4, wherein the voice data acquisition unit acquires voice data from a server by the communication unit. The audio data storage means stores a plurality of audio data to which the second attribute information is assigned for each reproduction section,
When the reproduction means reproduces any reproduction section of the selected audio data, the second attribute information given to the reproduction section of the audio data and the image data designated by the image designation means On the basis of the first attribute information given to the image, the degree of matching between the designated image data and the reproduction section of the audio data is calculated, and display based on the image data corresponding to the calculated degree of matching is performed. The imaging apparatus according to any one of claims 1 to 5, wherein A first matching information storage unit that stores first matching information indicating a matching relationship between the first attribute information and the second attribute information;
The calculation of the degree of matching between the first attribute information and the second attribute information is based on the first matching information stored in the first matching information storage unit. The imaging device according to any one of 1 to 6. A second matching information storage unit that stores second matching information indicating a correspondence relationship between the second attribute information and any image processing;
The reproduction means stores the second attribute information given to the audio data and the second matching relation storage means stored in the second matching relation storage means at the time of audio reproduction based on the audio data and display based on the image data. The image pickup apparatus according to claim 1, wherein display based on the image data is performed by image processing based on the matching information. One of the image processes is a display switching process based on image data,
The image processing apparatus according to claim 8, wherein the image processing in the reproduction unit switches display of an image at a speed based on the second attribute information and the second matching information. The second attribute information is information indicating the tempo of the audio data,
The image pickup apparatus according to claim 8 or 9, wherein the image processing in the reproduction means performs display based on image data by image processing corresponding to the tempo.   The imaging apparatus according to claim 7, further comprising first matching information setting means for setting the first matching information stored in the first matching information storage means.   The imaging apparatus according to claim 8, further comprising second matching information setting means for setting second matching information stored in the second matching information storage means.   The imaging apparatus according to claim 1, further comprising first attribute information setting means for setting the first attribute information.   The imaging apparatus according to claim 1, further comprising a second attribute information setting unit configured to set the second attribute information. Image data storage means for storing a plurality of image data captured by the imaging means and provided with the first attribute information; and an audio data storage means for storing a plurality of audio data provided with the second attribute information. In the computer of the imaging device,
Voice designation means for designating voice data to be reproduced from a plurality of voice data stored in the voice data storage means;
During the audio reproduction based on the audio data designated by the audio designating means, the second attribute information given to the audio data and the first attribute given to the image data stored in the image data storage means. The degree of matching between the designated audio data and the image data is calculated based on the attribute information of the image data, and selected from the plurality of image data stored in the image data storage unit according to the calculated degree of matching Reproduction means for performing display based on image data;
A program characterized by having executed. Image data storage means for storing a plurality of image data captured by the imaging means and provided with the first attribute information; and an audio data storage means for storing a plurality of audio data provided with the second attribute information. In the computer of the imaging device,
Image designation means for designating image data to be reproduced from a plurality of image data stored in the image data storage means;
At the time of image display based on the image data designated by the image designation means, the first attribute information given to the designated image data and the voice data stored in the voice data storage means Based on the second attribute information, the degree of matching between the designated image data and the voice data is calculated, and from the plurality of voice data stored in the voice data storage unit according to the calculated degree of matching Reproduction means for performing audio reproduction based on the selected audio data;
A program characterized by having executed. The audio data storage means stores a plurality of audio data to which the second attribute information is assigned for each reproduction section,
When the reproduction means reproduces any reproduction section of the selected audio data, the second attribute information given to the reproduction section of the audio data and the image data designated by the image designation means On the basis of the first attribute information given to the image, the degree of matching between the designated image data and the reproduction section of the audio data is calculated, and display based on the image data corresponding to the calculated degree of matching is performed. The program according to claim 15 or 16, wherein: The imaging device according to any one of claims 1 to 14,
A communication means for performing communication via a communication line;
An information terminal comprising: An information communication system in which the information terminal according to claim 18 and a server are connected to each other via a communication line,
The server
Storage means for storing a plurality of image data to which the first attribute information is assigned, and the second attribute information given to the voice data designated by the voice designation means, and receiving the second attribute information Based on the first attribute information given to the image data stored in the storage means, the degree of matching between the designated audio data and the image data is calculated, and the degree of matching is calculated according to the calculated degree of matching. Data communication means for transmitting image data selected from the image data stored in the storage means;
The information terminal according to claim 18,
An information communication system which receives image data transmitted from the server and performs display based on the received image data at the time of sound reproduction based on the sound data designated by the sound designation means. An information communication system in which the information terminal according to claim 18 and a server are connected to each other via a communication line,
The server
Storage means for storing a plurality of audio data to which the second attribute information is assigned, and the first attribute information given to the image data designated by the image designation means, and receiving the first attribute information On the basis of the second attribute information given to the sound data stored in the storage means, the degree of matching between the designated image data and the sound data is calculated, and the storage is performed according to the calculated degree of matching. Data communication means for transmitting voice data selected from the voice data stored in the means;
The information terminal according to claim 18,
An information communication system comprising: receiving audio data transmitted from the server, and performing audio reproduction based on the received audio data when displaying based on the image data designated by the image designating means.

Images