JP4622600B2 - Imaging device, imaging method, program - Google Patents

Description

The present invention relates to a photographing apparatus , a photographing method, and a program that synthesize and record photographed image data and music data.

In recent years, photographing apparatuses such as a digital camera and a video camera have become widespread, and photographing apparatuses capable of recording sound detected by a microphone at the time of photographing / recording corresponding to an image are generalized. Also, recently, when shooting an object that does not have much sound, such as a landscape, a user-desired sound such as music is recorded on a recording medium in association with the captured image and recorded together with the music during playback. An imaging device that can appreciate images is disclosed (see Patent Document 1).
JP 2001-309221 A

  However, in the conventional photographing apparatus, when music data is combined with photographed image data, it is necessary to perform a mixing operation after photographing. Since this mixing operation takes time, there is a problem that most users do not perform the mixing operation without taking care of it. In addition, when the shooting is interrupted, the music is also interrupted at the same time. Therefore, when the shooting is resumed, there is a problem that the music is not connected and becomes unnatural.

  The object of the present invention is to synthesize music data and photographed image data without the need for mixing work after photographing, and further, even when photographing is started again after photographing is finished, music is not interrupted. Is to be able to record.

According to the first aspect of the present invention, there is provided an imaging means for photographing a subject and acquiring photographed image data, a first storage means for storing music data, intro pattern data which is music performance style data, normal pattern data, ending Second storage means for storing music pattern data composed of pattern data, and music data stored in the first storage means are stored in the second storage means when there is an instruction to start shooting. Based on the intro pattern data portion of the music pattern data, the intro pattern is reproduced for a predetermined time. When reproduction of the music data in the intro pattern is completed, the music stored in the first storage means is instructed until an instruction to end shooting is given. The data is reproduced in the normal pattern based on the normal pattern data portion of the music pattern data stored in the second storage means. And, playing when there is an imaging end instruction is the first music data stored in the storage means, in said second predetermined time ending pattern based on the ending pattern data portion of the music pattern data stored in the storage means And the music storage means for synthesizing the photographic image data acquired by the image pickup means and the music data reproduced by the intro pattern while the music data is being reproduced by the intro pattern. While the music data is being reproduced in the normal pattern, the photographed image data acquired by the imaging means and the music data reproduced in the normal pattern are combined and stored in the third storage means. While the music data is stored and reproduced in the ending pattern, the captured image data acquired by the imaging means during that time is reproduced. It characterized in that it comprises data and a synthesizes the reproduced music data ending pattern the third ∎ You can憶制control means stored in the storage means.

According to the eleventh aspect of the present invention, when there is an imaging step of capturing a subject and acquiring captured image data, and when there is an instruction to start capturing , the music data stored in the first storage means is stored in the second storage means. Based on the intro pattern data portion of the stored music pattern data, the intro pattern is reproduced for a predetermined time, and when the reproduction of the music data in the intro pattern is completed, it is stored in the first storage means until an instruction to end shooting is given. Music data is reproduced in the normal pattern based on the normal pattern data portion of the music pattern data stored in the second storage means, and the music stored in the first storage means is instructed to end shooting. data, be reproduced at a predetermined time ending pattern based on the ending pattern data portion of the music pattern data stored in said second storage means And music reproduction step, while the music data is being played intro pattern, the third storage means synthesizes the music data reproduced in the captured image data and the introduction pattern acquired by the imaging step therebetween While the music data is being reproduced in the normal pattern, the photographed image data acquired in the imaging step and the music data reproduced in the normal pattern are combined and stored in the third storage means. While the music data is being reproduced in the ending pattern, the photographed image data acquired in the imaging step and the music data reproduced in the ending pattern are combined and stored in the third storage means. And a storage control step.
According to a twelfth aspect of the present invention, there is provided an imaging means for photographing a subject and acquiring photographed image data, a first storage means for storing music data, intro pattern data which is music performance style data, normal pattern data, ending And a second storage means for storing music pattern data composed of pattern data . When there is an instruction to start shooting, the music data stored in the first storage means is stored in the first storage means. When the intro pattern is reproduced for a predetermined time based on the intro pattern data portion of the music pattern data stored in the second storage means, and the reproduction of the music data in the intro pattern is finished, the above-mentioned The normal pattern of the music data stored in the first storage means and the music pattern data stored in the second storage means When the normal pattern is reproduced based on the data portion and an instruction to end shooting is given, the music data stored in the first storage means and the ending pattern data portion of the music pattern data stored in the second storage means Music reproduction means for reproducing in a ending pattern for a predetermined time based on the image data, while the music data is being reproduced in the intro pattern, the photographed image data acquired by the imaging means and the music data reproduced in the intro pattern during that time While being synthesized and stored in the third storage means, while the music data is being reproduced in the normal pattern, the photographed image data acquired by the imaging means and the music data reproduced in the normal pattern are synthesized during that time. Is stored in the third storage means, and while the music data is being reproduced in the ending pattern, Characterized in that to function as storage control means for storing in said third storage means combines the reproduced music data in the captured image data and the ending pattern obtained by the image unit.

According to the present invention , a user can create a video with a high degree of perfection just by shooting.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
First, a configuration of main parts of the imaging device 100 according to the first embodiment will be described. As shown in FIG. 1, the photographing apparatus includes a CPU (Central Processing Unit) 1, a RAM (Random Access Memory) 2, a ROM (Read Only Memory) 3, a DSP (Digital Signal Processor) 4, an imaging unit 5, a display unit 6. , Voice control unit 7, input unit 8, storage unit 9 and the like.

  The CPU 1 is a central processing unit that executes processing based on a predetermined program in accordance with an input instruction and transfers instructions and data to each functional unit. Specifically, the CPU 1 reads a program stored in the RAM 2 in accordance with an operation signal input from the input unit 8 and executes processing according to the program. Then, the processing result is displayed on the display unit 6. For example, when an instruction to start photographing is input from the input unit 8 of the photographing apparatus 100, the operation of each unit is controlled according to a program for executing a recording process stored in the ROM.

  Further, the CPU 1 includes a decoder 14, an encoder 15, and an adder 16 (see FIG. 2). The decoder 14 is software that decodes encoded data based on a certain rule and extracts the original data. Performs decompression of compressed data and decryption of encryption. The encoder 15 is software that encodes data based on a certain rule. Performs data compression and encryption. The adder 16 synthesizes the data captured from the microphone 10 and converted into a digital signal and the music data decoded by the decoder 14.

  The RAM 2 develops various programs executed by the CPU 1 in a program storage area. The RAM 2 temporarily stores data such as processing results generated when various programs are executed in the work area.

  The ROM 3 stores data related to execution of a program necessary for the operation of the photographing apparatus 100. For example, various control programs such as key input signal processing, music reproduction processing, recording processing, and composition processing are stored. These programs are programs that do not need to be rewritten or programs that must not be rewritten.

  The DSP 4 is a microprocessor specialized for processing of voice, images, etc., and partially takes over the processing of the CPU 1.

  The imaging unit 5 performs imaging in accordance with control by the CPU 1 and acquires captured image data.

  The display unit 6 is configured by an LCD (Liquid Crystal Display) or the like, and displays and reproduces a moving image or a still image at the time of shooting or reproduction, and displays various setting data, guidance data for various operations, music data, and the like.

  The voice control unit 7 synthesizes the voice data detected by the microphone 10 and the music data stored in the storage medium 13 and outputs the synthesized data to the voice output unit (see FIG. 2).

  The input unit 8 includes various function keys such as a shutter key, and outputs an operation signal corresponding to the key pressing operation to the CPU 1.

  The storage unit 9 includes a recording medium 13 (see FIG. 2) in which programs, data, and the like are stored in advance, and the recording medium 13 is configured by a magnetic or optical recording medium or a semiconductor memory. . The recording medium 13 is fixedly attached to the storage unit 9 or is detachably mounted, and stores various processing programs, data processed by the various processing programs, and the like.

  Next, FIG. 2 shows an internal configuration of the CPU 1, the voice control unit 7, and the storage unit 9 constituting the photographing apparatus 100, and voice data processing will be described.

  As shown in FIG. 2, the audio control unit 7 includes a microphone 10, an amplifier 11, an ADC (Analog Digital Converter) 12, a DAC (Digital Analog Converter) 17, and a speaker 18.

  When shooting a moving image, the microphone 10 detects sound and converts it into an electrical signal. The audio signal is amplified by the amplifier 11 and then converted into a digital signal by the ADC. The audio data converted into a digital signal is input to the CPU 1. The music data to be combined with the photographed image data is stored in advance in the recording medium 13 (hereinafter referred to as an SD card), for example, in the MP3 compression format. The CPU 1 reads out audio data stored in the SD card 13 and inputs it to the decoder 14. Then, the music data is decoded by the decoder 14. The adder 16 combines the audio data detected by the microphone 10 and converted into a digital signal with the music data decoded by the decoder 14. The CPU 1 outputs the synthesized audio data to the encoder 15, converts it into a predetermined format, and then performs a process of writing to the SD card together with the captured image data. The music data synthesized by the CPU 1 is converted into an analog signal by the DAC 17, amplified by the amplifier 18, and output from the speaker 19.

  FIG. 3 shows the file structure 20 recorded on the SD card 13. As shown in FIG. 3, the SD card 13 stores a music data table 22, an end position memory 23, a shooting condition table 24, a moving image file 25, and the like.

  The music data table 22 stores various music data in advance. An example of music data stored in this music data table is shown in FIGS. As shown in FIGS. 4A and 4B, the music data table stores a plurality of shooting scene data so as to correspond to various shooting scenes (hereinafter referred to as shooting scenes). In this shooting scene data, shooting conditions optimum for each shooting scene are set (see FIG. 6). FIG. 4A is a table in the case where one piece of music is associated with each shooting scene. A night scene, a landscape, a person, and a child are set in advance as shooting scenes, and the music data that is most suitable for each shooting scene is registered with music NO (for example, BGM (background music) 01). Each of these photographic scenes is previously stored with a photographic scene ID (MODE 01 to 04). For example, if the shooting scene is a night view, BGM01 is a night atmosphere song, landscape is shot, BGM02 is a bright and fun song, and if a person is shot in a city or park, it is uploaded as BGM03. When a tempo song, a picture of the child's child, etc. are photographed, the child's song is registered as BGM4. For example, when shooting a night scene, if a shooting scene ID to be shot is selected, the shot image data and the corresponding music data are synthesized.

  FIG. 4B is a table in the case where a plurality of songs are associated with each shooting scene. As shown in FIG. 4B, a plurality of music pieces that are optimal for the shooting scene are registered in each shooting scene. When shooting the selected shooting scene, the registered music is played in order. Also, when a plurality of songs are stored, it is possible to enjoy different atmospheres by selecting different songs for the same shooting scene. Furthermore, for example, it is possible to deal with a case where different music data is synthesized for a plurality of night scene shooting scenes.

  The music data table is not limited to this configuration. A plurality of other shooting scenes are stored, and a plurality of music corresponding to each shooting scene is also stored. Further, although the music corresponding to each shooting scene is a night atmosphere music, a bright and fun music, or the like, it is not limited to this, and other configurations may be used.

  In FIG. 3, an end position memory 23 is a memory for recording end position data of music data to be combined with photographed image data at the end of photographing. The configuration of the end position memory 23 is shown in FIG. As shown in FIG. 5, the end position memory 23 includes a shooting scene NO, BGM NO, and end position data. The shooting scene NO and BGM NO correspond to MODE01 and BGM01 shown in FIG. The end position data may store elapsed time or may store data such as an address.

  The shooting condition table 24 stores image settings that are optimal for each shooting scene corresponding to each shooting scene. For example, when the user selects a landscape scene ID, settings such as increasing the saturation and setting the sharpness to hard are performed. This setting is automatically performed when a shooting scene is selected.

  The moving image file 25 stores composite data generated by combining captured image data and music data. When music data is not synthesized, only photographed image data is stored.

  Next, FIGS. 6A, 6B, and 6C show examples of the shooting scene selection screen. The storage unit 9 of the imaging apparatus 100 of the present invention stores a plurality of sample images of shooting scenes to be shot, together with shooting condition settings optimal for the shooting scenes. In addition, the photographing apparatus 100 is equipped with a best shot function in which, when the user selects a sample image of a photographing scene to be photographed, the setting of the photographing apparatus 100 is automatically set to a state optimal for the photographing. When this best shot function is set, as shown in FIG. 6, each shooting scene is registered with a description of a title and what setting is to be made, and these data are stored in the display unit 6 of the shooting apparatus 100. Is displayed. The user reads a plurality of titles and explanations displayed corresponding to the titles, and selects an optimal title corresponding to the image to be photographed. When a title is selected, the shooting conditions are automatically set to the optimum state. Then, the set data is displayed on the display screen, and the music registered in the shooting scene NO attached to the selected title is reproduced, and the user is associated with the setting condition and the selected shooting scene NO. Check the music data. The user confirms these and starts recording. If the user does not desire the best shot function, the user can freely change the setting by not selecting the function, and the user can take a picture under uniquely set conditions.

  FIG. 6A shows a shooting scene NO. It is a display screen displayed when 1 is selected. Shooting scene No. When 1 is selected, the display screen shown in FIG. 6A is displayed and music associated therewith is reproduced. When individual shooting scenes are displayed, music data for each shooting scene is automatically set, and performance is sequentially started from the music data table 22 accordingly. In addition, the settings for tone synthesis are displayed along with the title, description, and image setting data. Here, the user can select whether to synthesize music data. When it is set to synthesize music data, the time between songs is displayed, and “SONG LIST” is displayed as the shooting scene number. Music data set to 1 is displayed. When a plurality of music data are set, all the data are displayed.

  FIG. 6B shows the shooting scene number. 2, (c) shows a shooting scene No. 3 is a display screen at time 3, and a title and a description are displayed respectively. Since these structures are the same as those in FIG. 6A, description thereof is omitted.

  FIG. 7 shows the start and end of moving image shooting along the time axis when shooting music by combining music data. In the following description, it is assumed that song A and song B are registered in the music table associated with the shooting scene to be shot.

  When an instruction to start shooting is input from the input unit 8 of the shooting apparatus 100, the song A, which is the first song registered in the music data table 22 in FIG. Is synthesized. When a shooting end instruction is input in the middle 1 of the music piece A, the current position of the music piece A, that is, end position data is stored in the end position memory 23 of the SD card 13. Next, when an instruction to start shooting again is input, the end position data 1 of the song A stored in the end position memory 23 of the SD card 13 is read, and music is read from the position indicated by the read end position data 1. Replay data and resume synthesis. When an instruction to end shooting is input again in the middle 2 of the music piece A, the same processing as described above is repeated, and the end position data 2 is stored. This process can be executed any number of times. Further, when an instruction to start shooting again is input, the end position data 2 of the song A is read, and the composition of the music data is resumed from the position indicated by the read end position data 2, and the song is recorded during the shooting. A ends. When song A ends, the next song B is played and composition is started. Between the song A and the song B, a portion between the songs is sandwiched. Between the songs, silence is synthesized for a predetermined time. This interval between songs makes it easy to understand that the song has changed, and the setting of the interval between songs is set for each shooting scene as shown in FIG. When shooting is interrupted again during composition with the song B, the end position data 3 is stored. After this process, even if the power is turned off, the end position data 3 is stored in the end position memory 23. Therefore, when the power is turned on and the photographing is resumed, the stored end position data 3 is stored. The music data is reproduced from the position indicated by the read end position data 3 that has been read, and synthesis with the photographed image data is started.

  With reference to the flowchart of FIG. 8, the composition processing of the photographed image data and music data shown in FIG. 7 will be described.

  First, when a shooting scene selection screen is displayed on the display unit 6 of the shooting apparatus 100 (step S1), the user selects a shooting scene. When a shooting scene is selected, music data stored in association with the selected shooting scene is automatically selected (step S2). Then, the selected music data is reproduced (step S3). In step S3, when the music data set in the selected shooting scene is reproduced, the screen is switched to a display screen that displays the subject that the user wants to shoot (step S4). In step S4, when the user switches to a display screen that displays a subject to be photographed, it is determined whether or not the user has given a recording start instruction (step S5).

  If it is determined in step S5 that the user has not instructed recording start (step S5; NO), the process returns to step S3, and the processes of steps S3 to S5 are repeated again. If it is determined in step S5 that the user has instructed to start recording (step S5; YES), reading of the end position data is started (step S6). At this time, if the end position data is not stored in the end position memory 23, it can be confirmed that there is no music interrupted in the middle, so that the music is reproduced from the beginning. When the end position data is read in step S6, recording is started (step S7).

  In step S7, when recording is started, synthesis of photographed image data and music data is started accordingly (step S8). In step S8, when the synthesis of the photographed image data and the music data is started, the generated synthesized data is stored in the moving image file 25 of the SD card 13 (step S9). When the generated composite data is stored in the moving image file 25 of the SD card 13 in step S9, it is determined whether or not there has been a recording end instruction from the user (step S10).

  If it is determined in step S10 that the user has not instructed recording termination (step 10; NO), the process returns to step S8, and the processes in steps S8 to S10 are repeated again. If it is determined in step S10 that the user has instructed recording termination (step S10; YES), the recording is terminated (step S11), and if the synthesized song is in the middle, the end position data of the SD card 13 is terminated. Writing into the position memory 23 (step S12). When the end position data is written in the end position memory 23 in step S12, it is determined again whether or not a recording start instruction has been issued (step S13). If it is determined in step S13 that a recording start instruction has been issued again (step S13; YES), the process returns to step S6, and the processes in steps S6 to S13 are repeated again. If it is determined in step S13 that the recording start instruction has not been given again (step S13; NO), the recording process ends. Thereafter, even if the power of the photographing apparatus 100 is turned off by the user, the end position data is stored in the end position memory 23. Therefore, when the power is turned on next time, the end position data is read and read. The music data can be resumed from the position indicated by the end position data, and the photographed image data and the music data can be synthesized.

  As described above, music data that automatically becomes BGM and photographed image data are automatically synthesized only by repeating photographing, so that it is possible to enjoy a video work with BGM without editing. When shooting is completed, the music is also ended. By storing the end position data of the completed music, the end position data is read out together with the resumption of shooting, and the position indicated by the read end position data Since it is possible to play music from, it is possible to further save editing work. Further, if a shooting scene is selected, BGM and a combination thereof (SONG LIST) are automatically set, so that shooting can be started immediately without setting BGM one by one. Since the BGM and the music pattern can be confirmed in advance, a situation in which an undesired music flows can be avoided, and the work can be advanced promptly.

[Second Embodiment]
Next, the imaging device 100 according to the second embodiment will be described. Since the main part configuration of the imaging apparatus 100 according to the second embodiment is the same as that in FIG. 1, illustration and description thereof are omitted.

  In the first embodiment, for example, music data stored in an SD card in a compression format such as MP3 is combined with image data. In the second embodiment, music data and images generated by combining music pattern data, which is music performance format data stored in the built-in flash memory, and music data stored in an SD card, and combining various music pattern data. A method for synthesizing data will be described.

  First, FIG. 9 shows the internal configuration of the storage unit 9, the CPU 1, and the audio control unit 7 of the photographing apparatus 100 of the second embodiment, and audio data processing will be described. The voice control processing unit 7 has the same configuration as that shown in FIG.

  The storage unit 9 includes storage media 13a and 13b. The storage medium 13a is an SD card, in which music data and conditions necessary for shooting are stored in advance. The storage medium 13b is a built-in flash memory and stores music pattern data. This music pattern data is composed of standards such as MIDI (Musical Instruments Digital Interface). Since MIDI is publicly known, description thereof is omitted. The music pattern data includes an intro pattern, a normal pattern, an ending pattern, and the like. The music data combined with the intro pattern data has a music performance style such as starting from a small volume and gradually changing to a larger volume, and is synthesized in association with the photographed image data. The music pattern data is not limited to this, and a plurality of pieces are set.

  When the music pattern data of the recording medium 13 b and the music data of the recording medium 13 a are input to the CPU 1, the CPU 1 decodes these data by the decoders 14 b and 14 a and inputs them to the sound source processing unit 30. The sound source processing unit 30 synthesizes music pattern data and music data. By this synthesis, music data with various patterns is generated. The synthesized music data and the voice data from the microphone 10 are synthesized by the adder 16, and the synthesized data is input to the encoder 15. The synthesized music data and photographed image data are converted into a predetermined format by the encoder 15 and then stored in the moving image file 25 of the SD card 13.

  The photographing apparatus 100 has a function capable of executing a fade-in effect process and a fade-out effect process. The fade-in effect is an effect that when an instruction to start shooting is issued (shutter key pressed), the screen starts from a white screen, gradually displays a shot image, and changes to a normal screen. In contrast to the fade-in effect, the fade-out effect is an effect that the captured image gradually disappears from the normal screen and ends on a white screen. Similar to the fade-in effect, the fade-out effect is executed by an instruction from the input unit 8 (pressing the shutter key).

  Note that, at the start of the fade-in effect process and the end of the fade-out effect process, each screen is a white screen, but the present invention is not limited to this.

  FIG. 10 shows a photographing method for synthesizing image data photographed using the above-described effect and music data obtained by synthesizing music pattern data along the time axis.

  When the shutter key is pressed and shooting is started, fade-in effect processing is started at the same time. That is, it starts from a white screen and gradually changes to an image that is being taken. In accordance with this, an intro pattern is reproduced from the music data and synthesized with the photographed image data. Then, the intro pattern ends with the end of the fade-in effect processing. Note that the end of the fade-in effect process and the end of the intro pattern are not necessarily the same time. After the intro pattern is completed, the music data of the normal pattern is reproduced. As long as shooting continues, this normal pattern of music data is repeatedly reproduced. At this time, when the music data corresponding to the shooting scene being shot is one song, the song is repeated, and when a plurality of music data is set, the plurality of songs are sequentially reproduced.

  Next, when an instruction to end shooting, that is, when the shutter key is pressed again, fade-out effect processing is started. Then, the music data is transferred to the ending pattern when the measure of the normal pattern ends. In ending, it is important to synchronize the end of the song and the end of the fade-out effect process. Therefore, the end time of the ending pattern is predicted and the start time of the fade-out is adjusted. Note that the song time of music data obtained by combining ending patterns may be registered in advance, or a program that can handle this processing may be installed.

  Next, with reference to the flowchart of FIG. 11, the synthesis process of the captured image data and music data shown in FIG. 10 will be described.

    First, when a shooting scene selection screen is displayed on the display unit 6 of the shooting apparatus 100 (step T1), the user selects a shooting scene. When a photographic scene is selected, photographic scene compatible music data registered in association with the selected photographic scene is automatically selected (step T2). When music data associated with a shooting scene is automatically selected in step T2, music pattern data to be combined with the selected music data is selected (step T3). When the music pattern data is selected in step T3, music is reproduced with the selected pattern (step T4). In step T4, when music is played back with the selected pattern, the screen is switched to a display screen that displays the subject that the user wants to shoot (step T5). In step T5, when the user switches to a display screen that displays a subject to be photographed, it is determined whether or not the user has given a recording start instruction (step T6).

  If it is determined in step T6 that the user has not instructed recording start (step T6; NO), the process returns to step T4, and the processes of steps T4 to T6 are repeated again. If it is determined in step T6 that a recording start instruction has been given by the user (step T6; YES), feed-in effect processing is started (step T8). In step T8, when the feed-in effect process is started, the music data is reproduced by the intro pattern in accordance with the process, and the music data and the photographed image data are synthesized (step T9). In step T9, when the photographed image data and the music data based on the intro pattern are combined, the combined data is stored in the moving image file of the SD card 13 (step T10). In step T10, when the data combined in the process of step T9 is stored in the SD card 13, it is determined whether or not the fade-in effect process has ended (step T11).

  If it is determined in step T11 that the fade-in effect process has not ended (step T11; NO), the process returns to step T9, and the processes of steps T9 to T10 are repeated again. That is, the music data of the intro pattern and the photographed image data are synthesized until the fade-in effect processing is completed without shifting the music data to the normal pattern. If it is determined in step T11 that the fade-in effect processing has been completed (step T11; YES), it is determined whether or not the music data reproduction by the intro pattern has been completed (step T12). If it is determined in step T12 that the reproduction of the music data by the intro pattern has not ended (step T12; NO), the process returns to step T9, and the processes of steps T9 to T12 are repeated again. The end of the fade-in effect process and the end of the intro pattern do not necessarily have to be the same time. Therefore, even if the fade-in effect processing is completed, the music data by the normal pattern is not transferred until the music data by the intro pattern is completed.

  If it is determined in step T12 that the reproduction of the music data by the intro pattern has been completed (step T12; YES), then the intro pattern is changed to the music data by the normal pattern, and the photographed image data and the music data of the normal pattern are synthesized. (Step T13). When the photographed image data and the normal pattern music data are combined in step T13, the combined data is stored in the moving image file 25 of the SD card 13 (step T14). In step T14, when the data synthesized in the process of step T13 is stored in the moving image file 25 of the SD card 13, it is determined whether or not a recording end instruction has been given (step T15).

  If it is determined in step T15 that there is no instruction to end recording (step T15; NO), the process returns to step T13, and the processes of steps T13 to T14 are repeated again. This process is repeated until a shooting end instruction is given. If it is determined in step T15 that a recording end instruction has been issued (step T15; YES), the music data is shifted from the normal pattern to the ending pattern, and the photographed image data and the ending pattern music data are synthesized (step T16). In step T16, when the photographed image data and the music data of the ending pattern are combined, the combined data is stored in the moving image file 25 of the SD card 13 (step T17).

  The processing in step T16 and step T17 is continued, and then fade-out effect processing is started (step T18). The fade-out effect process is not executed simultaneously with the start of the ending pattern. If they are executed at the same time, the fade-out effect processing ends, and even if the display is shifted to a white display screen, there is a possibility that the music is not yet finished. As described above, synchronization between the end of the fade-out effect process and the end of the song is important. Therefore, the transition to the ending pattern of the music data is executed slightly earlier than the fade-out effect process so that they are synchronized.

  When the fade-out effect process is started in step T18, it is determined whether or not the fade-out effect process is completed (step T19). If it is determined in step T19 that the fade-out effect process has not ended (step T19; NO), this determination process is repeated. If it is determined in step T19 that the fade-out effect process has been completed (step T19; YES), the music is also terminated at the same time and the recording is terminated (step T20).

  As described above, when synthesizing captured image data and music data, by synchronizing them, it is possible to create a highly complete video work just by shooting, requiring editing after shooting. Therefore, it is possible to save a lot of time and effort. Since music can be selected according to the shooting scene, it can be used in various situations such as graduation ceremonies and entrance ceremonies. Furthermore, since it is a very simple operation of pressing the shutter key, it is possible to provide an imaging device that is easy to use for users of various ages.

[Modification of Second Embodiment]
Next, a modification of the imaging device 100 according to the second embodiment will be described. In this modification, a part of the first embodiment is combined with the photographing apparatus 100 according to the second embodiment. Therefore, the main part configuration is the same as that of FIG. Further, since the audio data processing units such as the audio control unit 7, the CPU 1, and the storage unit 13 have the same configuration, the illustration is omitted and the description is simplified.

  The photographing apparatus 100 according to this modification stores music pattern data in the built-in flash memory 13a in the storage medium of the storage unit 13, and the SD card 13b stores the music data table 22, the end, as in the first embodiment. A position memory 23, a shooting condition table 24, and a moving image file 25 are stored. When a moving image is shot by the shooting apparatus 100, when the shooting is finished, the music is also finished at the same time. At this time, the end position data of the music data is stored in the end position memory 23, and the next time shooting is resumed, the end position data is read from the end position memory 23, and the music data is read from the position indicated by the read end position data. Play. Further, since the music pattern data is stored in the built-in flash memory 13a, music data having various patterns is reproduced and synthesized in synchronism with the image data, as in the case of the photographing apparatus 100 according to the second embodiment.

  With reference to the flowchart of FIG. 12, the process which the imaging device 100 concerning the modification of the 2nd Example mentioned above performs is demonstrated.

  First, when a shooting scene selection screen is displayed on the display unit 6 of the shooting apparatus 100 (step P1), the user selects a shooting scene. When a shooting scene is selected, music data stored in association with the selected shooting scene is automatically selected (step P2). In step T2, when music data corresponding to the selected shooting scene is automatically selected, music pattern data to be combined with the selected music data is selected (step P3). When the music pattern data is selected in step T3, the music is reproduced with the selected pattern (step P4). In step T4, when music is reproduced with the selected pattern, the screen is switched to a display screen for displaying an image that the user wants to shoot (step P5). In step T5, when the screen is switched to a display screen on which an image captured by the user is displayed, it is determined whether or not a recording start instruction is issued by the user (step P6).

  If it is determined in step P6 that the user has not instructed recording start (step P6; NO), the process returns to step P4, and the processes of steps P4 to P6 are repeated again. If it is determined in step S5 that the user has instructed to start recording (step P6; YES), reading of the end position data is started (step P7). At this time, if the end position data is not stored in the end position memory 23, it can be confirmed that there is no song ended halfway, so the song is reproduced from the beginning. In step P7, when the end position data is read, recording starts from the position indicated by the read end position data (step P8).

  When recording is started in step P8, music data obtained by synthesizing the selected music pattern data and photographed image data are synthesized (step P9). In step P9, when the music data obtained by combining the selected music pattern data and the photographed image data are combined, the combined data is stored in the moving image file memory 25 of the SD card 13 (step P10). In step P10, when the data synthesized in step P9 is stored in the moving image file 25 of the SD card 13, it is determined whether or not the selected music pattern is completed (step P11). When there are a plurality of selected music patterns as shown in the second embodiment, the next selected music pattern is read. Therefore, if it is determined in step P11 that the music pattern has not ended (step P11; NO), the next selected music pattern is read (step P12), the process returns to step P9, and steps P9 to P12 are performed again. Repeat the process.

  If it is determined in step P11 that the selected music pattern has been completed (step P11; YES), it is determined whether or not there has been an instruction to end recording by the user (step P13). If it is determined in step P13 that the user has not instructed the end of recording (step P13; NO), the process returns to step P9, and the processes of steps P9 to P13 are repeated again. If it is determined in step P13 that the user has given an instruction to end recording (step P13; YES), the recording is ended (step P14). If the synthesized music is in the middle, the end position data is stored in the SD card 13. Writing to the end position memory 23 (step P15).

  In step P15, when the end position data is written in the end position memory 23, it is determined again whether or not a recording start instruction has been issued (step P16). If it is determined in step P16 that a recording start instruction has been issued again (step P16; YES), the process returns to step P7, and the processes in steps P7 to P16 are repeated again. If it is determined in step P16 that the recording start instruction has not been given again (step P16; NO), the recording process ends. Thereafter, even if the power of the photographing apparatus 100 is turned off, the end position data is stored in the end position memory 23. Therefore, when the power is turned on next time, the end position data is read and read. It is possible to resume the synthesis from the position indicated by the end position data.

  As described above, even when shooting is finished during shooting by a shooting device that stores music pattern data and synchronizes and synthesizes music data with various patterns and shot image data, the end position data of the music data is stored. By storing in the memory, it is possible to read out the end position along with the resumption of photographing, and to reproduce the music data from that position. Therefore, it is possible to create a highly complete video in which music data whose pattern changes according to a scene and photographed image data are synchronized without the music being interrupted.

  Although the SD card and the built-in flash memory are used as the recording medium, the present invention is not limited to this, and the same effect can be obtained with other configurations. The photographing apparatus includes a data processing device such as a digital camera, a camera-equipped mobile phone, a camera-equipped portable terminal (handy terminal), a camera-equipped PDA (Personal Digital Assistance), a camera-equipped PC (Personal Computer), Similar effects can be obtained with the configuration.

1 shows a main part configuration of a photographing apparatus according to a first embodiment. The internal structure of CPU, an audio | voice control part, and a memory | storage part which comprise the imaging device of FIG. 1 is shown. The file structure which the memory | storage part of the imaging device of FIG. 1 memorize | stores is shown. An example of data stored in the music data table in the file of FIG. 3 is shown. An example of the data stored in the end position memory in the file of FIG. 3 is shown. An example of the imaging | photography scene selection screen displayed on the display screen of the imaging device which concerns on 1st Embodiment is shown. The start and end of moving image shooting in the case of shooting with the shooting device of the first embodiment are shown along the time axis. It is a flowchart which shows the process performed in the imaging device of 1st Embodiment. The internal structure of CPU, an audio | voice control part, and a memory | storage part which comprise the imaging device which concerns on 2nd Embodiment is shown. The start and end of moving image shooting in the case of shooting with the shooting device according to the second embodiment are shown along the time axis. It is a flowchart which shows the process performed in the imaging device which concerns on 2nd Embodiment. It is a flowchart which shows the process performed in the imaging device which concerns on the modification of 2nd Embodiment.

Explanation of symbols

1 CPU
2 RAM
3 ROM
4 DSP
5 Imaging unit 6 Display unit 7 Audio control unit 8 Input unit 9 Storage unit 10 Microphone 11 Amplifier 12 ADC
13a, 13b Recording medium 14a, 14b Decoder 15 Encoder 16 Adder 17 DAC
18 Amplifier 19 Speaker 20 File 22 Music data table 23 End position memory 24 Shooting condition table 25 Movie file

Claims (12)

Imaging means for photographing a subject and obtaining photographed image data;
First storage means for storing music data;
Second storage means for storing music pattern data composed of intro pattern data, normal pattern data, and ending pattern data, which are music performance style data;
When there is an instruction to start shooting, the music data stored in the first storage means is reproduced in an intro pattern for a predetermined time based on the intro pattern data portion of the music pattern data stored in the second storage means, When the reproduction of the music data in the intro pattern is finished, the music data stored in the first storage means and the normal pattern data of the music pattern data stored in the second storage means until an instruction to end shooting is given. When the recording is instructed to be played back in accordance with the normal pattern and the shooting is instructed, the music data stored in the first storage means is stored in the ending pattern data section of the music pattern data stored in the second storage means. A music playback means for playing in a ending pattern for a predetermined time based on ;
While the music data is being reproduced in the intro pattern, the photographic image data acquired by the imaging means and the music data reproduced in the intro pattern during that time are synthesized and stored in the third storage means, and the music data Is reproduced in the normal pattern, the photographic image data acquired by the imaging means during that time and the music data reproduced in the normal pattern are combined and stored in the third storage means. while being reproduced in the ending pattern, combined with the third serial憶制control means Ru stored in the storage means music data reproduced by the captured image data and the ending pattern obtained by the image pickup means therebetween When,
An imaging apparatus comprising: Image processing means for sequentially performing a plurality of different image processing on the captured image data acquired by the imaging means;
Wherein the image processing means, after receiving an instruction of shooting start, the relative photographic image data obtained by the imaging means, after the to facilities the first image processing, an instruction of shooting ends, Performing second image processing different from the first image processing on the captured image data acquired by the imaging means;
The imaging device according to claim 1. The first image processing is processing for gradually switching from image data of a predetermined color to the captured image data as time passes,
The second image processing is processing for gradually switching from the captured image data to image data of a predetermined color with the passage of time.
The imaging apparatus according to claim 2. The end of the second image processing is synchronized with the end of reproduction of music data in the ending pattern;
The photographing apparatus according to claim 2 or 3, characterized in that: During playback of music data in the intro pattern, with the passage of time, and wolfberry have to increase the volume of the previous Kion music data,
The imaging device according to any one of claims 1 to 4, wherein: The transition from the normal playback of music data to the playback of the ending pattern is done when the normal pattern ends ,
The imaging device according to any one of claims 1 to 5, wherein: It said first storage means, in association with a plurality of scene data and a plurality of music data,
Selecting means for selecting the shooting scene data;
Said music reproducing means, the Ruoto music data are stored in association with the scene data selected by said selecting means, to play by reading from said first storage means,
The imaging device according to claim 1, wherein: It said first storage means, in association with a plurality of music data for each of the scene data,
Said music reproducing means is sequentially reproducing the plurality of music data stored in association with the scene data selected by said selecting means,
The imaging device according to claim 7. The first storage means stores a plurality of shooting scene data, a plurality of predetermined music data, and a plurality of shooting conditions in association with each other,
Setting means for setting shooting conditions stored in association with shooting scene data selected by the selection means;
The photographing apparatus according to claim 7 or 8, characterized in that: The captured image data is moving image data for displaying a moving image;
The imaging device according to any one of claims 1 to 9, wherein: An imaging step of capturing an image of a subject and acquiring captured image data;
When there is an instruction to start shooting, the music data stored in the first storage means is reproduced in the intro pattern for a predetermined time based on the intro pattern data portion of the music pattern data stored in the second storage means, and the intro pattern When the reproduction of the music data is finished, the music data stored in the first storage means is stored in the normal pattern data portion of the music pattern data stored in the second storage means until an instruction to end shooting is given. Based on the ending pattern data portion of the music pattern data stored in the second storage means and the music data stored in the second storage means when an instruction to end shooting is given. A music playback step for playing in a ending pattern for a predetermined time ;
While the music data is being reproduced in the intro pattern, the photographed image data acquired in the imaging step and the music data reproduced in the intro pattern are synthesized and stored in the third storage means during that time. Is reproduced in the normal pattern, the photographic image data acquired in the imaging step and the music data reproduced in the normal pattern are combined and stored in the third storage means during A storage control step for synthesizing the captured image data acquired in the imaging step and the music data reproduced in the ending pattern and storing them in the third storage means during playback in the ending pattern ;
A photographing method characterized by comprising: A music pattern comprising an imaging means for photographing a subject and acquiring photographed image data, a first storage means for storing music data, intro pattern data as music performance style data, normal pattern data, and ending pattern data A second storage means for storing data, and a computer of the photographing apparatus,
When there is an instruction to start shooting, the music data stored in the first storage means is reproduced in an intro pattern for a predetermined time based on the intro pattern data portion of the music pattern data stored in the second storage means, When the reproduction of the music data in the intro pattern is finished, the music data stored in the first storage means and the normal pattern data of the music pattern data stored in the second storage means until an instruction to end shooting is given. When the recording is instructed to be played back in accordance with the normal pattern and the shooting is instructed, the music data stored in the first storage means is stored in the ending pattern data section of the music pattern data stored in the second storage means. A music playback means for playing in a ending pattern for a predetermined time based on ,
While the music data is being reproduced in the intro pattern, the photographic image data acquired by the imaging means and the music data reproduced in the intro pattern during that time are synthesized and stored in the third storage means, and the music data Is reproduced in the normal pattern, the photographic image data acquired by the imaging means during that time and the music data reproduced in the normal pattern are combined and stored in the third storage means. A storage control means for synthesizing the captured image data acquired by the imaging means and the music data reproduced by the ending pattern and storing them in the third storage means during playback in the ending pattern ;
Program to function as.

Images