JP6229356B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

The present invention relates to an imaging apparatus, a IMAGING METHOD AND PROGRAM.

2. Description of the Related Art Conventionally, it has been practiced to shoot a moving image such as dancing while playing music and outputting sound with a speaker or headphones while dancing.
For example, a dance practice is performed by connecting a plurality of songs, changing the tempo, shooting a figure that is dancing to music edited for dance, and checking the video.
When playing back movies shot in this way, information such as the tempo change and music switching moments around the subject at the time of shooting is not reflected in the movie file. Even if it is desired to search to confirm the shooting state of the subject corresponding to the part where the tempo or the like has been changed, the moment when the music switches, etc., it cannot be said that there is only a method of rewinding by frame rewinding etc.
Here, Patent Document 1 discloses a technique for automatically reproducing audio corresponding to a captured image based on audio reproduction data recorded in a file together with the image.
The technology described in Patent Document 1 stores audio reproduction information indicating a location where audio during audio reproduction is stored together with a photographed image, and allows easy viewing of the image and audio simultaneously. To do.

JP 2001-28703 A

  However, in the technique described in Patent Document 1, the audio that is automatically played back by audio is a sound that is unrelated to the sound that flows around the subject at the time of shooting, and associates the sound at the time of shooting with the state of the subject. You can't search.

  The present invention has been made in view of such a situation, and an object of the present invention is to make it possible to easily search for a moving image of a portion corresponding to the timing at which the sound is switched in a moving image shot in accordance with the sound. .

In order to achieve the above object, an imaging device of one embodiment of the present invention includes:
A video recording means for recording a video in synchronization with a predetermined sound;
Timing information acquisition means for acquiring timing information output from an external device relating to the predetermined location of the predetermined sound;
Timing information storage means for storing the timing information acquired by the timing information acquisition means in association with a moving image shot by the moving image shooting means;
It is characterized by providing.

  ADVANTAGE OF THE INVENTION According to this invention, in the moving image image | photographed according to the audio | voice, it becomes possible to search easily the moving image of the part corresponding to the timing which a sound switches.

1 is a diagram illustrating a system configuration of an imaging system according to an embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the audio | voice output apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the hardware of the imaging device which concerns on one Embodiment of this invention. It is a functional block diagram which shows the functional structure for performing a music output process among the functional structures of an audio | voice output apparatus. It is a functional block diagram which shows the functional structure for performing a moving image | photographing process among the functional structures of an imaging device. It is a figure showing the example of the event which an event tag shows. It is a schematic diagram which shows the relationship between the music output by an audio | voice output apparatus, and the moving image imaged with an imaging device. It is a flowchart explaining the flow of the schematic operation example of the whole imaging system. 5 is a flowchart for explaining a flow of music output processing executed by the audio output device of FIG. 2 having the functional configuration of FIG. 4. 6 is a flowchart for explaining a flow of imaging processing executed by the imaging apparatus of FIG. 3 having the functional configuration of FIG. 5. It is a schematic diagram which shows the event tag recorded on the file different from the data of a moving image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
[Constitution]
FIG. 1 is a diagram showing a system configuration of an imaging system 1 according to an embodiment of the present invention.
In FIG. 1, the imaging system 1 is configured to include an audio output device 100 and an imaging device 200, and the audio output device 100 and the imaging device 200 are configured to be communicable. Communication between the audio output device 100 and the imaging device 200 can be performed by wireless communication such as WiFi, Bluetooth, infrared communication, or wired communication via a communication cable.

FIG. 2 is a block diagram showing a hardware configuration of the audio output device 100 according to the embodiment of the present invention.
The audio output device 100 is configured as a portable music player including a speaker, for example. Note that the audio output device 100 may be configured to output music via headphones instead of speakers.
The audio output apparatus 100 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, a bus 114, an input / output interface 115, an input unit 116, and an output unit. 117, a storage unit 118, a power supply control unit 119, a communication unit 120, and a drive 121.

  The CPU 111 executes various processes according to a program recorded in the ROM 112 or a program loaded from the storage unit 118 to the RAM 113. For example, the CPU 111 executes music output processing by decoding music data in a predetermined format (for example, MP3 format) according to a program for music output.

Further, when performing the music output process, the CPU 111 outputs event information associated with the music data to the imaging apparatus 200 at the set timing.
Here, the event information is information indicating the edited part (hereinafter referred to as “edit point” as appropriate) in the music data reproduced by the audio output device 100. Event information indicating a change location, a tempo change location, a song end location, or the like is set in association with music data.

  The RAM 113 appropriately stores data necessary for the CPU 111 to execute various processes.

  The CPU 111, ROM 112, and RAM 113 are connected to each other via a bus 114. An input / output interface 115 is also connected to the bus 114. An input unit 116, an output unit 117, a storage unit 118, a power supply control unit 119, a communication unit 120, and a drive 121 are connected to the input / output interface 115.

The input unit 116 includes various buttons such as a power button, a playback start button, and a playback stop button, and inputs various types of information according to user instruction operations.
The output unit 117 includes a display, a speaker, and the like, and outputs images and music.
The storage unit 118 includes a semiconductor memory such as a DRAM (Dynamic Random Access Memory), and stores various music, image data, and the like.
The power supply control unit 119 detects a state of charge of a battery (not shown) and outputs data indicating the state of charge to the CPU 111.
The communication unit 120 controls communication performed with the imaging device 200.

  A removable medium 131 made of a semiconductor memory or the like is appropriately attached to the drive 121. The program read from the removable medium 131 by the drive 121 is installed in the storage unit 118 as necessary. The removable medium 131 can also store various data such as music data stored in the storage unit 118 in the same manner as the storage unit 118.

FIG. 3 is a block diagram showing a hardware configuration of the imaging apparatus 200 according to an embodiment of the present invention.
The imaging device 200 is configured as a digital camera, for example.

  The imaging apparatus 200 includes a CPU 211, a ROM 212, a RAM 213, a bus 214, an input / output interface 215, an imaging unit 216, an input unit 217, an output unit 218, a storage unit 219, a communication unit 220, a power source A control unit 221 and a drive 222 are provided.

  The CPU 211 executes various processes according to a program recorded in the ROM 212 or a program loaded from the storage unit 219 to the RAM 213. Further, the CPU 211 receives an output signal of the imaging unit 216. The data represented by the output signal of the imaging unit 216 is hereinafter referred to as “captured image data”.

Further, the CPU 211 executes processing for continuously displaying captured images based on data of a plurality of captured images continuously output from the imaging unit 216. That is, the CPU 211 temporarily stores the captured image data sequentially output from the imaging unit 216 in the memory (such as the RAM 213) while the imaging operation by the imaging unit 216 is continued. Live view display is executed in which the captured image data is sequentially read and displayed on the display of the output unit 218. In the live view display, an image displayed on the display of the output unit 218 is hereinafter referred to as a “live view image”. The live view image is displayed on the entire display area on the display of the output unit 218.
Further, the CPU 211 executes a process of recording data of a plurality of captured images continuously output from the imaging unit 216 as moving image data in accordance with an instruction to record and record a moving image by pressing a shutter button or the like.

  The RAM 213 appropriately stores data necessary for the CPU 211 to execute various processes.

  The CPU 211, ROM 212, and RAM 213 are connected to each other via a bus 214. An input / output interface 215 is also connected to the bus 214. An imaging unit 216, an input unit 217, an output unit 218, a storage unit 219, a communication unit 220, a power supply control unit 221, and a drive 222 are connected to the input / output interface 215.

  Although not shown, the imaging unit 216 includes an optical lens unit including a focus lens and a zoom lens, and an image sensor.

The optical lens unit includes various lenses such as a focus lens and a zoom lens in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.

The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 216.
Data represented by such an output signal of the imaging unit 216 is appropriately supplied to the CPU 211, the RAM 213, and the like as captured image data.

The input unit 217 includes various buttons such as a power button and a shutter button, and inputs various information according to a user's instruction operation.
The output unit 218 includes a display, a speaker, and the like, and outputs an image and sound.
The storage unit 219 includes a hard disk or a DRAM (Dynamic Random Access Memory), and stores various image data.
The communication unit 220 controls communication performed with another device (not shown) via a network including the Internet.

The power supply control unit 221 detects the state of charge of a battery (not shown) and outputs data indicating the state of charge to the CPU 211.
A removable medium 231 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 222. The program read from the removable medium 231 by the drive 222 is installed in the storage unit 219 as necessary. The removable medium 231 can also store various data such as captured image data stored in the storage unit 219 in the same manner as the storage unit 219.

FIG. 4 is a functional block diagram showing a functional configuration for executing a music output process among the functional configurations of the audio output device 100.
Music output processing refers to music events that have been edited, such as concatenation of multiple songs, changes in tempo, etc., and event information associated with the editing points. A series of processing to be output.

When the music output process is executed, in the CPU 111, the photographing signal reception control unit 141, the music output unit 142, and the event transmission control unit 143 function.
The shooting signal reception control unit 141 receives a signal indicating the start of shooting of a moving image (shooting start signal) and a signal indicating the end of shooting (shooting end signal) transmitted from the imaging apparatus 200. Then, the shooting signal reception control unit 141 outputs the received shooting start signal or shooting end signal to the music output unit 142.

When the shooting start signal is input from the shooting signal reception control unit 141, the music output unit 142 starts reading out the music file of the music for which output is instructed by the user from the storage unit 118, and is included in the music file. Decode the music data that you have. Then, the music output unit 142 outputs the music obtained by decoding through the output unit 117. Also, the music output unit 142 ends the output of music when the shooting end signal is input from the shooting signal reception control unit 141.
Furthermore, the music output unit 142 detects event information set for music included in the music file, and outputs the detected event information to the event transmission control unit 143.
The event transmission control unit 143 transmits the event information input from the music output unit 142 to the imaging device 200 via the communication unit 220 at the timing when the event information is detected in accordance with the music to be output.

Next, a functional configuration of the imaging apparatus 200 will be described.
FIG. 5 is a functional block diagram illustrating a functional configuration for executing the moving image shooting process among the functional configurations of the imaging apparatus 200.
The moving image shooting process refers to a series of processes for shooting a moving image of a subject based on event information received from the audio output device 100 and associated with an event tag representing the event.

When the moving image shooting process is executed, in the CPU 211, the shooting signal transmission control unit 241, the event reception control unit 242, and the moving image data generation unit 243 function.
The shooting signal transmission control unit 241 transmits a shooting start signal to the audio output device 100 when an instruction to start shooting a moving image is given via the input unit 217. In addition, when the shooting signal transmission control unit 241 is instructed to end shooting of a moving image via the input unit 217, the shooting signal transmission control unit 241 transmits a shooting end signal to the audio output device 100.
When receiving event information via the communication unit 220, the event reception control unit 242 outputs the received event information and the received time to the moving image data generation unit 243.

When the moving image data generation unit 243 is instructed to capture a moving image via the input unit 217, the captured image data input from the imaging unit 216 is used as moving image data together with the operation of the imaging signal transmission control unit 241. Record.
Further, when the event information and the reception time are input from the event reception control unit 242, the moving image data generation unit 243 records the event tag of the event represented by the event information in association with the moving image data frame at the reception time. To do. For example, the moving image data generation unit 243 records the event tag by storing the event tag in the header area in the frame of the moving image data.
Here, the event tag is tag information indicating the content of the event represented by the event information, and is attached to the frame in the moving image data, so that the music output by the audio output device 100 at the timing of the frame is added. It indicates that a specific event has occurred.

FIG. 6 is a diagram illustrating an example of an event indicated by an event tag.
As shown in FIG. 6, in the present embodiment, as the event indicated by the event tag, the beginning of the song, the change of the song, the change of the tempo, the end of the song, the editing point set arbitrarily, and the like are defined.

FIG. 7 is a schematic diagram illustrating a relationship between music output by the audio output device 100 and a moving image captured by the imaging device 200.
In the music output by the audio output device 100 in FIG. 7, the music A starts at time T1 and shifts to music B at time T2. Further, the tempo of the music B is changed at the time T3, and the music C is shifted to the music C at the time T4.
In this case, the audio output device 100 has event information indicating the beginning of song A at time T1, event information indicating the beginning of song B at time T2, event information indicating change in tempo at time T3, and time T4. , Event information indicating the beginning of the song C is transmitted to the imaging apparatus 200.

Then, the imaging device 200 stores an event tag corresponding to the event information received from the audio output device 100 at each time in the header of the frame imaged at that time, and associates the event tag with the moving image data.
Thus, event tags are set in the moving image data generated by the moving image data generation unit 243 at the timing of the edit point of the music output by the audio output device 100.

Therefore, since it is possible to search for moving image data based on music editing points, for example, in a moving image obtained by shooting a scene dancing according to music, it is easy to search for a dance scene at a specific editing point in music. can do.
In addition, since the moving image data and the event tag are integrated into one file, the data can be easily managed.

[Operation]
Next, the operation will be described.
First, an outline of an operation example in the entire imaging system 1 will be described.
FIG. 8 is a flowchart illustrating a flow of a schematic operation example of the entire imaging system 1.
When the imaging system 1 operates, first, the imaging apparatus 200 is set to a mode for capturing moving images (moving image mode), and the audio output apparatus 100 is set to a mode for communicating with the imaging apparatus 200 (communication mode). Is done. Thereby, it will be in the standby state for operation | movement.

In step C1, the imaging device 200 transmits a signal (synchronization start signal) for synchronizing with the audio output device 100 such as matching the timers.
In step M1, the audio output device 100 sets a timer or the like according to the synchronization start signal transmitted from the imaging device 200, and starts synchronization.
In step C <b> 2, the imaging device 200 starts shooting a moving image in response to a user operation, and transmits a shooting start signal to the audio output device 100.

On the other hand, in step M2, the audio output device 100 starts playing the music file in response to receiving the shooting start signal from the imaging device 200.
Next, in step M3, when the audio output device 100 detects event information indicating the beginning of a song in the music file being reproduced, the audio output device 100 transmits the event information to the imaging device 200.
In step C3, the imaging apparatus 200 receives event information indicating the beginning of a song, and sets an event tag (the beginning of the song) corresponding to the received event information in the frame of the moving image being shot.

Next, in step M4, when the audio output device 100 detects event information indicating a change in music in the music file being reproduced, the audio output device 100 transmits the event information to the imaging device 200.
In step C4, the imaging apparatus 200 receives event information indicating change of music, and sets an event tag (change of music) corresponding to the received event information in a frame of a moving image being shot.

Next, in step M5, when the audio output device 100 detects event information indicating a tempo change in the music file being reproduced, the audio output device 100 transmits the event information to the imaging device 200.
In step C5, the imaging apparatus 200 receives event information indicating a change in tempo, and sets an event tag (tempo change) corresponding to the received event information in a frame of a moving image being shot.

Next, in step C <b> 6, the imaging device 200 transmits a shooting end signal to the audio output device 100 and ends shooting of the moving image.
After step C6, the imaging apparatus 200 ends the moving image mode.
In step M6, the audio output device 100 ends the reproduction of the music file in response to receiving the shooting end signal from the imaging device 200.
After step M6, the audio output device 100 ends the communication mode.

Next, specific processing of the audio output device 100 and the imaging device 200 for performing such operations will be described.
FIG. 9 is a flowchart for explaining the flow of music output processing executed by the audio output device 100 of FIG. 2 having the functional configuration of FIG.
The music output process is started when an imaging start signal is received from the imaging apparatus 200.
In step S1, the music output unit 142 sets a timer t to zero (t = 0). The value of the timer t is compared with a timer f (described later) transmitted from the imaging device 200 and used to synchronize with the imaging device 200.

In step S <b> 2, the music output unit 142 determines whether or not an instruction to end reproduction of the music file has been given (that is, whether or not a shooting end signal has been received from the imaging device 200).
If an instruction to end reproduction of the music file is given, it is determined YES in step S2, and the process ends.
On the other hand, if it is not instructed to end the reproduction of the music file, NO is determined in step S2, and the process proceeds to step S3.
In step S3, the music output unit 142 determines whether or not event information indicating the beginning of the song has been detected in the music file being played.

If event information indicating the beginning of the song is detected in the music file being reproduced, YES is determined in step S3, and the process proceeds to step S4.
On the other hand, if event information indicating the beginning of the song has not been detected, NO is determined in step S3, and the process proceeds to step S5.
In step S <b> 4, the music output unit 142 transmits event information indicating the beginning of the song to the imaging apparatus 200 via the event transmission control unit 143.
After step S4, the process proceeds to step S5.

In step S5, the music output unit 142 determines whether or not event information indicating a song change has been detected in the music file being played back.
If event information indicating a change in music is detected in the music file being played back, YES is determined in step S5, and the process proceeds to step S6.
On the other hand, if event information indicating a change in music is not detected in the music file being played back, NO is determined in step S5, and the process proceeds to step S7.

In step S <b> 6, the music output unit 142 transmits event information indicating a song change to the imaging device 200 via the event transmission control unit 143.
After step S6, the process proceeds to step S7.
In step S7, the music output unit 142 determines whether event information indicating a change in tempo has been detected in the music file being played.
If event information indicating a tempo change is detected in the music file being played back, YES is determined in step S7, and the process proceeds to step S8.
On the other hand, if event information indicating a change in tempo is not detected in the music file being played back, NO is determined in step S7, and the process proceeds to step S9.

In step S <b> 8, the music output unit 142 transmits event information indicating a change in tempo to the imaging apparatus 200 via the event transmission control unit 143.
After step S8, the process proceeds to step S9.
In step S9, the music output unit 142 determines whether event information indicating an arbitrarily set editing point has been detected in the music file being played back.
If event information indicating an arbitrarily set editing point is detected in the music file being played back, YES is determined in step S9, and the process proceeds to step S10.

On the other hand, if event information indicating an arbitrarily set editing point is not detected in the music file being played back, NO is determined in step S9, and the process proceeds to step S11.
In step S <b> 10, the music output unit 142 transmits event information indicating editing points arbitrarily set via the event transmission control unit 143 to the imaging apparatus 200.
After step S10, the process proceeds to step S11.
In step S11, the music output unit 142 increments the value of the timer t.
After step S11, the process returns to step S2.

Next, processing executed by the imaging apparatus 200 will be described.
FIG. 10 is a flowchart for explaining the flow of imaging processing executed by the imaging apparatus 200 of FIG. 3 having the functional configuration of FIG.
The imaging process is started when the user performs an operation on the input unit 217 to execute moving image shooting.
In step S <b> 21, the shooting signal transmission control unit 241 transmits a shooting start signal to the audio output device 100.
In step S22, the moving image data generation unit 243 creates a file that stores moving image data.

In step S23, the moving image data generation unit 243 sets the timer f to zero (f = 0). The value of the timer t is transmitted to the audio output device 100 as needed to synchronize with the audio output device 100.
In step S <b> 24, the moving image data generation unit 243 determines whether an operation for ending moving image shooting has been performed.
If an operation to end shooting of a moving image is performed, YES is determined in step S24, and the process proceeds to step S35.
On the other hand, if the operation for ending moving image shooting is not performed, NO is determined in step S24, and the process proceeds to step S25.

In step S <b> 25, the moving image data generation unit 243 creates a moving image frame from the captured image data input from the imaging unit 216. The frames created here are sequentially stored in a moving image file stored in the storage unit 219.
In step S <b> 26, the moving image data generation unit 243 determines whether event information indicating the beginning of a song has been received via the event reception control unit 242.
When event information indicating the beginning of a song is received via the event reception control unit 242, YES is determined in step S26, and the process proceeds to step S27.
On the other hand, if event information indicating the beginning of the song has not been received via the event reception control unit 242, it is determined NO in step S26, and the process proceeds to step S28.

In step S27, the moving image data generation unit 243 stores an event tag indicating the beginning of the song in the header of the frame.
After step S27, the process proceeds to step S28.
In step S <b> 28, the moving image data generation unit 243 determines whether or not event information indicating a song change has been received via the event reception control unit 242.
When event information indicating the change of music is received via the event reception control unit 242, YES is determined in step S28, and the process proceeds to step S29.
On the other hand, when event information indicating a change in music is not received via the event reception control unit 242, it is determined NO in step S28, and the process proceeds to step S30.

In step S29, the moving image data generation unit 243 stores an event tag indicating the change of music in the header of the frame.
After step S29, the process proceeds to step S30.
In step S <b> 30, the moving image data generation unit 243 determines whether event information indicating a change in tempo has been received via the event reception control unit 242.
If event information indicating a change in tempo is received via the event reception control unit 242, a determination of YES is made in step S30, and the process proceeds to step S31.
On the other hand, when event information indicating a change in tempo is not received via the event reception control unit 242, it is determined as NO in Step S30, and the process proceeds to Step S32.

In step S31, the moving image data generation unit 243 stores an event tag indicating a change in tempo in the header of the frame.
After step S31, the process proceeds to step S32.
In step S <b> 32, the moving image data generation unit 243 determines whether or not event information indicating an editing point arbitrarily set is received via the event reception control unit 242.
When event information indicating an arbitrarily set editing point is received via the event reception control unit 242, it is determined as YES in Step S32, and the process proceeds to Step S33.
On the other hand, when event information indicating an editing point arbitrarily set via the event reception control unit 242 is not received, it is determined as NO in Step S32, and the process proceeds to Step S34.

In step S33, the moving image data generation unit 243 stores an event tag indicating an arbitrarily set editing point in the header of the frame.
After step S33, the process proceeds to step S34.
In step S34, the moving image data generation unit 243 increments the timer f.
After step S34, the process returns to step S24.

In step S35, the moving image data generation unit 243 closes the file that stores the moving image data, and ends the creation of the file.
In step S <b> 36, the shooting signal transmission control unit 241 transmits a shooting end signal to the audio output device 100.
After step S36, the imaging process ends.

As described above, the imaging apparatus 200 according to the present embodiment includes the event reception control unit 242 and the moving image data generation unit 243.
The moving image data generation unit 243 records a moving image in synchronization with predetermined sound (for example, music included in a music file).
The event reception control unit 242 acquires editing information (event information) related to the edited portion of the sound being output from the external device (for example, the audio output device 100).
The moving image data generation unit 243 stores the editing information in association with the recorded moving image.
With this configuration, when editing songs such as connecting songs or changing the tempo, and shooting dances or other music in sync with the sound output from speakers or headphones, the song changes or tempo. By acquiring the editing information related to the edited portion of the audio such as the change of the video and controlling the recording operation of the moving image being recorded, it becomes easy to search for the timing at the time of moving image reproduction.
That is, according to the present invention, it is possible to easily search for moving images of portions corresponding to various editing portions of music in moving images shot in accordance with edited music.

In addition, the moving image data generation unit 243 records the moving image while recording the sound that is output as sound.
With such a configuration, it is possible to obtain a moving image with a sense of unity between video and audio and a sense of realism.

In addition, the moving image data generation unit 243 records the editing information as information indicating the position of the frame of the moving image recorded at the acquired timing.
With such a configuration, it is possible to search for a moving image based on editing information related to the edited portion of the audio. Therefore, when reproducing a moving image, it is possible to easily jump to the moment when the song switches or when the tempo of the song changes.

Also, the audio output is audio obtained by reproducing audio data that has been edited and recorded.
With such a configuration, it is possible to acquire editing information relating to the edited portion of the audio and record it in association with the moving image being recorded simply by reproducing the audio data that has been edited in advance.

In addition, the imaging apparatus 200 according to the present embodiment includes an imaging signal transmission control unit 241.
The shooting signal transmission control unit 241 controls the external device (the audio output device 100) to start or end the audio output in response to the start or end of the recording by the moving image data generation unit 243.
With such a configuration, simply by starting and ending recording on the imaging device 200 side, the start and end of music playback are automatically controlled, editing information relating to the audio editing location is acquired, and the video being recorded is recorded. Can be recorded in relation to

In addition, the moving image data generation unit 243 records the editing information embedded in the recorded moving image (for example, a frame header).
With such a configuration, since all data is recorded only in one moving image file, data management becomes easy.

The audio output device 100 according to the present embodiment includes a music output unit 142 and an event transmission control unit 143.
The music output unit 142 outputs sound in synchronization with a moving image recorded externally (the imaging device 200).
The event transmission control unit 143 outputs editing information related to the edited portion of the output sound to the external device.
With such a configuration, a voice editing location can be notified from a device that outputs sound to a device that shoots a moving image. Therefore, in a device that shoots a moving image, the voice editing location is recorded in association with the video. can do.

[Modification]
In the above-described embodiment, the audio output device 100 has been described as reproducing a music file in which editing such as connection of a plurality of songs and change of tempo is performed and event information is associated with the editing point.
On the other hand, the present invention can be applied even in a situation where a song, tempo, etc. are changed in real time (for example, music performance by a disc jockey).
That is, every time a song, tempo, or the like is changed, event information (information indicating editing points) corresponding to the event is transmitted to the imaging device 200 in association with the music, so that even in music that changes in real time. It is possible to shoot a moving image with an event tag set.

As described above, in the imaging apparatus 200 according to the present modification, the moving image data generation unit 243 records a moving image in synchronization with a predetermined sound, and the sound is sound of sound data edited in real time. Also good.
With such a configuration, even when audio output is edited flexibly as in the case of a club DJ, editing information relating to the audio editing location can be acquired and recorded in association with the video being recorded.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.
In the first embodiment, when the imaging apparatus 200 executes the imaging process, the event tag is stored in the header of the moving image frame.
That is, the moving image file generated by the imaging apparatus 200 is a file in which moving image data and an event tag are integrated.
On the other hand, when the imaging apparatus 200 executes an imaging process, moving image data and event tags can be recorded in separate files.

FIG. 11 is a schematic diagram showing event tags recorded in a separate file from moving image data.
In FIG. 11, the numbers indicating the event tags correspond to the types of events indicated by the event tags in FIG. 6, and show an example in which the event tag shown in FIG. 7 is a separate file.
As shown in FIG. 11, the time stamp (time (hour: minute: second) from the beginning) in the moving image data and the event tag are recorded in association with each other, thereby making the moving image data highly versatile. I can do it.

As described above, the moving image data generation unit 243 of the imaging apparatus 200 according to the present embodiment records the editing information as a separate file from the recorded moving image.
With this configuration, since the moving image file is not modified, the versatility of the moving image file can be increased.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

In the above-described embodiment, the imaging start signal and the shooting end signal are transmitted from the imaging device 200 to the audio output device 100, and the audio output device 100 starts playing the music file in response to receiving the shooting start signal. Or the playback of the music file is terminated in response to receiving the shooting end signal.
On the other hand, in response to receiving a signal (playback start signal) indicating that the image output device 100 has started playback of the music file from the audio output device 100, the imaging device 200 starts shooting a moving image, In response to receiving a signal (reproduction end signal) indicating that the reproduction of the video has been completed, the shooting of the moving image may be terminated.
In other words, the moving image data generation unit 243 in the imaging device 200 controls the start or end of moving image recording in accordance with the start or end of audio output in the external device (audio output device 100).
With such a configuration, simply start and end audio on the external device side, automatically control the start and end of recording, acquire information related to audio timing, and related to the video being recorded Can be recorded.
In the above-described embodiment, first, synchronization is performed between the imaging device 200 and the audio output device 100, and then transmission / reception of the start signal is performed. However, synchronization may be performed simultaneously with transmission / reception of the start signal. Good.

In the above-described embodiment, when the audio output device 100 detects event information indicating the beginning of a song or event information indicating change of a song, the song name or artist name is acquired, and the acquired song name or artist name is acquired. May be included in the event information and transmitted to the imaging apparatus 200.
In the above-described embodiment, the sound output from the sound output device 100 is described as music. However, the present invention is not limited to this, and may be a voice of a person who instructs dance choreography.
In the above-described embodiment, the event tag is set during the moving image shooting process. However, the type and timing of the event tag are temporarily stored during the moving image shooting, and the event tag is collectively collected after the moving image shooting ends. You may make it perform the setting of.

  In the above-described embodiment, the audio output device 100 has been described as performing both music output and event information transmission, but these may be performed by different devices. For example, music may be output by a portable music player, and event information associated with the music may be transmitted to the imaging apparatus 200 from an information processing apparatus such as a PC or a smartphone synchronized with the portable music player.

In the above-described embodiment, the audio output device 100 to which the present invention is applied has been described by taking a portable music player as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a music output function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game, a DJ (DISK JOKKEY) device, and the like. It is.

In the above-described embodiment, the imaging apparatus 200 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a photographing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIGS. 4 and 5 is merely an example, and is not particularly limited. That is, it is sufficient that the audio output device 100 or the imaging device 200 has a function capable of executing the above-described series of processes as a whole. What functional blocks are used to realize this function are particularly shown in FIG. It is not limited to 5 examples.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  A recording medium including such a program is not only configured by the removable media 131 and 231 of FIGS. 2 and 3 distributed separately from the apparatus main body in order to provide the program to the user, but is also preinstalled in the apparatus main body. It is composed of a recording medium provided to the user in a recorded state. The removable media 131 and 231 are configured by, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray Disc (Blu-ray Disc) (registered trademark), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. The recording medium provided to the user in a state of being incorporated in the apparatus main body is included in, for example, the ROMs 112 and 212 in FIGS. 2 and 3 and the storage units 118 and 219 in FIGS. Hard disk etc.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the order, but is not necessarily performed in chronological order, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall apparatus configured by a plurality of devices, a plurality of means, and the like.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalents thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
A video recording means for recording a video in synchronization with a predetermined sound;
Timing information acquisition means for acquiring timing information output from an external device relating to the predetermined location of the predetermined sound;
Timing information storage means for storing the timing information acquired by the timing information acquisition means in association with a moving image shot by the moving image shooting means;
An imaging apparatus comprising:
[Appendix 2]
The predetermined sound is output as sound from the external device,
The imaging apparatus according to appendix 1, wherein the moving image capturing unit captures the moving image while recording a sound output from the external device.
[Appendix 3]
The imaging according to appendix 1 or 2, wherein the timing information storage unit records the timing information as information indicating a position of a frame of the moving image shot at a timing acquired by the timing information acquisition unit. apparatus.
[Appendix 4]
The imaging apparatus according to any one of appendices 1 to 3, wherein the predetermined sound is a sound obtained by reproducing sound data that has been edited and recorded.
[Appendix 5]
The imaging apparatus according to appendix 4, further comprising: an audio output control unit that causes an external device to control the start or end of audio output in accordance with the start or end of shooting by the moving image shooting unit.
[Appendix 6]
The imaging apparatus according to any one of appendices 1 to 3, wherein the predetermined sound is a sound of sound data edited in real time.
[Appendix 7]
The imaging apparatus according to appendix 4 or 6, wherein the moving image shooting unit controls the start or end of shooting of the moving image according to the start or end of audio output in an external device.
[Appendix 8]
The imaging apparatus according to appendix 4 or 6, wherein the timing information storage unit records the timing information acquired by the timing information acquisition unit by being embedded in a moving image captured by the moving image capturing unit. .
[Appendix 9]
7. The appendix 4 or 6, wherein the timing information storage unit records the timing information acquired by the timing information acquisition unit as a separate file from the moving image shot by the moving image shooting unit. Imaging device.
[Appendix 10]
An audio output means for outputting audio in synchronization with a video shot by an external device;
Timing information output means for outputting timing information regarding a predetermined portion of the sound output by the sound output means to the external device;
An audio output device comprising:
[Appendix 11]
A video recording step for recording a video in synchronization with a predetermined sound;
A timing information acquisition step of acquiring timing information output from an external device relating to the predetermined location of the predetermined audio;
A timing information storage step for storing the timing information acquired in the timing information acquisition step in association with a moving image shot in the moving image shooting step;
An imaging method comprising:
[Appendix 12]
Computer
A video recording means for recording a video in synchronization with a predetermined sound;
Timing information acquisition means for acquiring timing information output from an external device relating to the predetermined location of the predetermined sound;
Timing information storage means for storing the timing information acquired by the timing information acquisition means in association with a moving image shot by the moving image shooting means;
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Imaging system, 100 ... Sound output device, 200 ... Imaging device, 111, 211 ... CPU, 112, 212 ... ROM, 113, 213 ... RAM, 114, 214 ..Bus, 115, 215 ... I / O interface, 216 ... Imaging unit, 116, 217 ... Input unit, 117, 218 ... Output unit, 118, 219 ... Storage unit, 119, 221: Power control unit, 120, 220 ... Communication unit, 121, 222 ... Drive, 131, 231 ... Removable media, 141 ... Shooting signal reception control unit, 142 ... Music output , 143 ... event transmission control unit, 241 ... shooting signal transmission control unit, 242 ... event reception control unit, 243 ... video data generation unit

Claims (15)

A video recording means for recording a video in synchronization with a predetermined sound;
Timing information acquisition means for acquiring timing information output from an external device relating to the predetermined location of the predetermined sound;
Timing information storage means for storing the timing information acquired by the timing information acquisition means in association with a moving image shot by the moving image shooting means;
An imaging apparatus comprising: The predetermined sound is output as sound from the external device,
The imaging apparatus according to claim 1, wherein the moving image capturing unit captures the moving image while recording sound output from the external device. Movie shooting means for shooting a movie in parallel with a predetermined sound output from an external device,
Timing information acquisition means for acquiring timing information output from the external device relating to a predetermined location of the predetermined sound ;
Timing information storage means for storing the timing information acquired by the timing information acquisition means in association with a moving image shot by the moving image shooting means;
An imaging apparatus comprising: The imaging apparatus according to claim 3, wherein the moving image capturing unit captures the moving image while recording a sound output from the external device. 5. The timing information storage unit records the timing information as information indicating a position of a frame of the moving image shot at a timing acquired by the timing information acquisition unit . The imaging apparatus according to item 1 . It said predetermined audio, imaging device according to claim 1, wherein in any one of 5 the audio data recorded and edited is voice reproduced. The imaging apparatus according to claim 6 , further comprising: an audio output control unit that causes an external device to control the start or end of audio output in accordance with the start or end of shooting by the moving image shooting unit. Said predetermined audio, imaging device according to claim 1, wherein in any one of 5 to be a voice of voice data to be edited in real time. It said video recording means in response to the start or end of the audio output in the external apparatus, an imaging apparatus according to claim 6 or 8, wherein the controller controls the start or end of the photographing of the moving image. The timing information storage means, image pickup of claim 6 or 8, characterized in that said timing information acquired by said timing information acquiring means, recorded embedded in video being captured by the video recording means apparatus. The said timing information storage means records the said timing information acquired by the said timing information acquisition means as a file different from the moving image currently image | photographed by the said moving image imaging means, The Claim 6 or 8 characterized by the above-mentioned. Imaging device. A video shooting process for shooting a video in synchronization with a predetermined sound,
Timing information acquisition processing for acquiring timing information output from an external device relating to a predetermined portion of the predetermined sound;
A timing information storage process for storing the timing information acquired in the timing information acquisition process in association with a moving image shot in the moving image shooting process ;
An imaging method comprising: A video shooting process for shooting a video in parallel with a predetermined sound output from an external device;
Timing information acquisition processing for acquiring timing information output from the external device relating to a predetermined location of the predetermined audio;
A timing information storage process for storing the timing information acquired in the timing information acquisition process in association with a moving image shot in the moving image shooting process;
An imaging method comprising: On the computer,
A video recording function for recording video in synchronization with a predetermined sound,
A timing information acquisition function for acquiring timing information output from an external device related to a predetermined location of the predetermined audio;
A timing information storage function for storing the timing information acquired by the timing information acquisition function in association with a moving image shot by the moving image shooting function ;
A program to realize On the computer,
A video shooting function for shooting a video in parallel with a predetermined sound output from an external device;
And timing information acquisition function of acquiring the timing information output from the external device for a given position of the previous SL predetermined sound,
A timing information storage function for storing the timing information acquired by the timing information acquisition function in association with a moving image shot by the moving image shooting function;
A program to realize

Images