JP2021064903A - Imaging apparatus, control method, and program - Google Patents

Abstract

To assign a correct time code to a frame during synchronous shooting.SOLUTION: An imaging apparatus includes setting means capable of setting whether to record a first time code that includes subframe information that extends frame information or a second time code that does not include the subframe information and changing means for changing to record the first time code when recording moving image data when the second time code is set to be recorded and a synchronization signal is input from an external device.SELECTED DRAWING: Figure 5

Description

The present invention relates to imaging devices, control methods and programs.

In recent years, video cameras have come to be able to shoot at high resolution and high frame rate. For example, shooting using a video signal called HD (High Definition) such as 4K (1 frame is 4096 x 2160) or 8K (1 frame is 8192 x 4320) in which the number of pixels in one frame is 1920 x 1080 pixels or more. It can be performed. Further, the frame rate is also shifted to a high frame rate such as 120p, 240p, 960p, which is 60p or more. Further, standardization corresponding to the above-mentioned high resolution and high frame rate shooting is also in progress.

Conventionally, the time code can be expressed only up to 60p, but the SMPTE ST 12-3 standard makes it possible to assign a time code of 60p or more. Also, at the external output terminal, the HDMI (registered trademark) 2.1 standard enables a high refresh rate and a variable refresh rate function. As related techniques, the imaging devices of Patent Document 1 and Patent Document 2 have been proposed. In the image pickup apparatus of Patent Document 1, even when recording and reproducing a moving image in which the same time code is added to a plurality of frames in an external device, it is possible to use a time code that does not overlap in each frame. Further, the image pickup apparatus of Patent Document 2 matches the phase of the video synchronization signal and the time code input from the external device with the phase of the system clock and the time code inside the image pickup apparatus.

Japanese Unexamined Patent Publication No. 2015-192227 Patent No. 5854832

When synchronous shooting is performed using a plurality of video cameras, the phase matching of each frame is performed using the time code assigned to the frame shot by each video camera. Here, one of the plurality of video cameras may shoot at a frame rate different from that of the other video cameras. In this case, the correct time code may not be assigned to consecutive frames.

An object of the present invention is to assign a correct time code to a frame during synchronous shooting.

In order to achieve the above object, the imaging apparatus of the present invention records a first time code including subframe information in which frame information is extended, or a second time code not including the subframe information. When the setting means capable of setting whether to record and the setting for recording the second time code when recording the moving image data are set and the synchronization signal is input from the external device, the first It is characterized by having a change means for changing to record the time code of.

According to the present invention, a correct time code can be assigned to a frame during synchronous shooting.

It is a figure which shows an example of the image pickup apparatus of embodiment. It is a figure which shows an example of the folder structure and the container structure of MXF. It is a figure which shows an example of a time code and an extended time code. It is a figure which shows the timing chart of the frame rate and refresh rate of moving image data. It is a flowchart which shows the flow of processing of this embodiment. It is a figure which shows an example of the timing chart of each frame in multi-shooting by two video cameras. It is a figure which shows an example of a UI screen. It is a figure which shows another example of a UI screen.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the respective embodiments.

FIG. 1 is a diagram showing an example of the image pickup apparatus 100 of the present embodiment. The image pickup device 100 is, for example, a video camera. For example, another imaging device (video camera) is connected to the imaging device 100 as an external device. Further, in the case of a system configuration in which a plurality of image pickup devices 100 are connected to a predetermined information processing device, one of the plurality of image pickup devices may be the image pickup device 100 of FIG. A video synchronization signal and time code information are input to the image pickup device 100 from an external image pickup device or a predetermined information processing device via a predetermined terminal. As a predetermined terminal, an SDI (Serial Digital Interface) terminal, an HDMI (High-Definition Multimedia Interface) terminal, or the like can be applied.

The imaging device 100 includes a system control unit 101, an imaging unit 102, an image sensor unit 103, a moving image storage unit 104, a display unit 105, a display data storage unit 106, an input unit 107, and a system clock generation unit 108. The system control unit 101 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a system timer, and the like. The processing of the present embodiment is realized by expanding the control program stored in the ROM into the RAM and executing the control program expanded in the RAM by the CPU. The CPU of the system control unit 101 operates with a clock generated by the system clock generation unit 108 shown in FIG. The system control unit 101 may be a microcomputer, a programming circuit, or the like. The system control unit 101 corresponds to a setting means, a changing means, and a display controlling means.

The imaging unit 102 includes optical units such as a focus lens, a zoom lens, an aperture, and a shutter, and performs optical processing on an incident optical image. The image sensor unit 103 performs a process of converting an optical image optically processed by the image sensor 102 into an electric signal. The converted electric signal is output to the image pickup signal control unit 109. The image pickup device unit 103 is composed of an image pickup device such as a CCD (Carehge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor).

The moving image storage unit 104 stores moving image data, and is composed of a memory card, a built-in memory, and the like. The display unit 105 displays a predetermined screen (UI screen or the like) under the control of the display control unit 111. The display data storage unit 106 stores the display data displayed on the display unit 105. The input unit 107 is a member that receives an input operation by the user, and for example, a jog dial, a dial switch, or the like can be applied.

Next, the system control unit 101 will be described. The image pickup signal control unit 109 generates an image signal by performing image processing such as A / D conversion processing and amplification processing on the electric signal output by the image pickup element unit 103. The frame rate (number of frames per second) of the generated video signal differs depending on the recording method. In the case of the NTSC system, the frame rate is either 120p, 60p, 60i, 30p or 24p. In the case of the PAL system, the frame rate is either 100p, 50p, 50i or 25p. The size of the recorded image can be set to "4096 x 2160", "3840 x 2160", "2160 x 1080", "1920 x 1080", "1280 x 720", "1440 x 1080", or the like. Hereinafter, it is assumed that the size of the recorded image (recorded image size) is “1920 × 1080” and the frame rate is set to 30p. However, the recorded image size and the frame rate may be set arbitrarily. The video signal generated by the image pickup signal control unit 109 is sent to the moving image control unit 110.

The moving image control unit 110 has a function of compressing (encoding) and decompressing (decoding) a video signal. When a video signal is sent from the imaging signal control unit 109, the moving image control unit 110 compresses the video signal and stores the moving image data composed of the compressed video signal in the moving image storage unit 104. When an instruction is sent from the input control unit 113, the moving image control unit 110 reads out the moving image data according to the instruction from the moving image storage unit 104. When the moving image control unit 110 reads the moving image data from the moving image storage unit 104, the moving image control unit 110 expands the moving image data and sends the moving image data to the display control unit 111. The display control unit 111 controls the display of moving image data on the display unit 105. As a result, the moving image data is displayed on the display unit 105. Further, when the time code is sent from the time code phase control unit 114, the moving image control unit 110 superimposes the time code on the video signal and then performs compression. The moving image control unit 110 can send the video signal output by the imaging signal control unit 109 and the moving image data read from the moving image storage unit 104 to the external output control unit 124.

Here, in the present embodiment, it is assumed that the moving image data is recorded with management information such as a time code and audio data in a container structure called MXF (Material eXchange Format). However, the moving image data may be in a file format such as AVCHD (Advanced Video Code High Definition) or MP4 (MPEG-4 Part 14 or ISO / IEC 14496-14: 2003).

FIG. 2A is a diagram showing a folder structure of MXF recorded in the moving image storage unit 104, and FIG. 2B is a diagram showing a container structure of MXF. When the moving image storage unit 104 is initialized by an instruction to the input unit 107 (such as a user's instruction), the CONTENTS folder 201 and the clip folder 202 are generated. In FIG. 2B, the clip folder 202 is shown as CLIPS001. Further, when the recording of the moving image data is started according to the instruction of the user to the input unit 107, the stream file (MXF file 204) and the editing information (XML file 205) are recorded in one clip. FIG. 2A shows an example in which "A001C001_141120XX.MXF" is recorded as the MXF file 204 and "A001C001_141120XX.XML" is recorded as the XML file 205. As a plurality of clips are recorded, the MXF file and the XML file are renamed and increased. The index file 203 (INDEX.MIF in FIG. 2A) is a file that collectively manages a plurality of clip information.

Each clip information is collectively managed in the index file 203. Therefore, even if the number of clips increases, it is not necessary to perform the analysis on a clip-by-clip basis when performing the analysis, and the index file 203 may be analyzed. As a result, the analysis time can be reduced. In addition, information such as a frame number and a time code that need to be set for each frame is recorded in the MXF file 204.

In FIG. 2B, the header 210 (Header Metadata) indicates the start of the file. Metadata about the file is recorded in the header 210. In the header 210, information on the resolution and frame rate when recording moving image data, information on the reproduction refresh rate, and the like are recorded. Each of these pieces of information is data that constitutes metadata. The metadata may contain other information. Information on the playback refresh rate will be described later. The frame 211 is frame data, and is composed of metadata 213 (System Metata), image data 214, and audio data 215. The footer 212 (Footer Metadata) is information indicating the end of the file. The frame number is recorded in the area of the frame metadata 213 with the start frame set to "0". The XML file 205 is an XML (Extension Markup Language) file in a markup language, and editing information can be written using tag information.

The external output control unit 124 outputs the moving image data sent from the moving image control unit 110 to the external device. As the external device, as described above, there are a predetermined information processing device and other imaging devices. For the external output control unit 124, an SDI (Serial Digital Interface) terminal, an HDMI (High-Definition Multimedia Interface) terminal, or the like can be adopted. The moving image storage unit 104 is a MPEG2 (Moving Picture Experts Group), H.A. 264, H. It is possible to store moving image data based on a format such as 265. The moving image storage unit 104 can write and read moving image data according to an instruction received from the moving image control unit 110.

The input control unit 113 transmits the input operation instruction received by the input unit 107 to each unit. The input unit 107 is used when the user operates the image pickup apparatus 100. The input control unit 113 sends an instruction to the moving image control unit 110 to start recording, stop recording, select a recording frame rate, and the like. Further, the input control unit 113 can select desired display data from the display data storage unit 106 by sending an instruction to the display data control unit 112. Further, the input control unit 113 can set a time code arbitrarily specified by the user by sending an instruction to the time code control unit 115.

The display data control unit 112 reads the display data from the display data storage unit 106 according to the user's instruction received by the input control unit 113. The display data storage unit 106 stores the display data, and the display data is read out according to the instruction received from the display data control unit 112. The display control unit 111 can display the display data by synthesizing the display data sent from the display data control unit 112 and the information from the moving image control unit 110, the time code phase control unit 114, and the synchronization signal phase control unit 120. Convert to a format. Then, the display control unit 111 performs display control by outputting the display data to the display unit 105.

The display unit 105 displays the display data in the display format converted by the display control unit 111. The display unit 105 is composed of, for example, a liquid crystal screen such as an LCD (Liquid Crystal Monitor) or an EVF (Electronic View Finder). However, the display unit 105 is not limited to the liquid crystal screen. The moving image storage unit 104 and the display data storage unit 106 are composed of a storage medium such as an optical disk such as an HDD (Hard Disk Drive) or a DVD (Digital Versaille Disc), or a semiconductor memory.

The time code generation unit 116 generates a time code according to an instruction received from the time code control unit 115. Timecode can be generated in units of hours, minutes, seconds, frames and subframes. The number of frames changes depending on the set recording frame rate. A subframe is extended information of a time code having a higher accuracy than a frame. FIG. 3 is a diagram showing an example of a time code and an extended time code. Here, the time code setting values defined in SMPTE ST 12-1 and SMPTE ST 12-2 are represented by hours (HH301), minutes (MM302), seconds (SS303) and frames (FF304). In HH301, the time of "00 to 23" is expressed. In MM302, the minutes of "00 to 59" are expressed. SS303 expresses seconds of "00 to 59". In FF304, a frame of "00 to 29" is expressed.

Here, when the frame rate is 120p or the like, the time code setting values defined in SMPTE ST 12-1 and SMPTE ST 12-2 cannot distinguish the frames, and the same time code value is used for different frames. Is set. On the other hand, in the time code setting value defined in SMPTE ST 12-3, a subframe (SF305) is added. As shown in the extended time code of FIG. 3, SF305 represents subframes of "00 to 31". Thereby, different time codes can be added to each frame of 960p (= 30 × 32p) by using FF304 and SF305. That is, even when the frame rate is higher than 60p, different time codes are added to each frame, so that each frame can be distinguished. Hereinafter, the information of the frame (FF304) is referred to as the frame information, and the information of the subframe (SF305) is referred to as the subframe information.

The time code control unit 115 reads the time code generated by the time code generation unit 116 and sends it to the time code phase control unit 114. Further, the time code control unit 115 can change the time code of the image pickup apparatus 100 by sending the time code sent from the time code phase control unit 114 to the time code generation unit 116. Further, the time code control unit 115 sends a time code to the time code generation unit 116 of the instruction (instruction received by the input unit 107) sent from the input control unit 113.

The time code phase control unit 114 controls the phase between the time code sent from the time code control unit 115 and the external time code sent from the external time code control unit 117. When it is necessary to shift the phase, the time code phase control unit 114 sends an amount of phase shift to the synchronous signal phase control unit 120. When the time code is sent from the external time code control unit 117, the time code phase control unit 114 sends the time code to the time code control unit 115. The time code control unit 115 changes the time code of the image pickup apparatus 100 based on the sent time code. By sharing the time code between the time code phase control unit 114 and the moving image control unit 110, the time code can be superimposed on the video signal and then compressed. In addition, the time code can be acquired from the stretched video signal. Further, the time code phase control unit 114 can display the time code on the display unit 105 by sending the phase-controlled time code to the display control unit 111.

The system clock control unit 123 controls the system clock generation unit 108 to absorb the phase shift when the phase shift amount of the system clock is sent from the synchronization signal phase control unit 120. In this case, the system clock control unit 123 performs PLL (PhaseLockLoop) control of the system clock generation unit 108, and controls to match the phases.

The synchronization signal phase control unit 120 calculates the amount of phase shift between the horizontal synchronization signal and the vertical synchronization signal of the video sent from the external synchronization signal control unit 121 and the system clock sent from the system clock control unit 123. To do. The synchronization signal phase control unit 120 sends the calculation result to the system clock control unit 123, and issues a request to shift the phase of the system clock of the image pickup apparatus 100. Further, when the internal time code sent from the time code phase control unit 114 and the external time code are out of phase, the phase shift amount is sent to the synchronization signal phase control unit 120. The synchronous signal phase control unit 120 sends the amount of phase shift to the system clock control unit 123. As a result, even when the external operation cycle and the internal operation cycle are different, it is possible to request that the phase of the system clock be shifted in consideration of the amount of time code deviation. Further, the synchronization signal phase control unit 120 sends a notification to the display control unit 111 that the phase matching is completed. As a result, it is possible to display on the display unit 105 that the phase matching is completed.

The external input signal detection unit 119 detects whether a signal (input signal) has been input from an external device. The external input signal detection unit 119 separates the time code signal (hereinafter, external time code signal) and the video synchronization signal (synchronization signal) from the input signal. The external time code signal is sent to the external time code signal detection unit 118, and the video synchronization signal is sent to the external synchronization signal detection unit 122. The external time code signal detection unit 118 detects the external time code signal. The external time code control unit 117 detects the presence / absence of the frequency and subframe information of the external time code sent from the external time code signal detection unit 118, and notifies the time code phase control unit 114 of the presence / absence. The external synchronization signal detection unit 122 detects the video synchronization signal by using, for example, an SDI terminal, a synchronization signal input terminal, or the like. The external synchronization signal control unit 121 extracts the horizontal synchronization signal and the vertical synchronization signal from the video synchronization signal, and sends the extracted horizontal synchronization signal and the vertical synchronization signal to the synchronization signal phase control unit 120.

Next, the timing chart of the frame rate and the refresh rate of the moving image data will be described. FIG. 4A is a diagram showing an example of a timing chart of the recording frame rate of the moving image data stored in the moving image storage unit 104. In FIG. 4A, the fixed frame rate (Constant Frame Rate: CFR) is a fixed frame rate (30p in FIG. 4A), and each frame is in the order of A1 frame, A2 frame, and so on. Is photographed and recorded. In FIG. 4A, the variable frame rate (VFR) has a variable recording frame rate. In the case of the variable frame rate shown in FIG. 4A, the A1 frame to the A4 frame are shot at a shooting frame rate of 30p, the A5 frame to the A8 frame are shot at a shooting frame rate of 120p, and the A9 frame and thereafter are shot at a shooting frame rate of 30p. Shoot at the shooting frame rate and record each frame in the shooting order.

Next, the refresh rate will be described. FIG. 4B is a diagram showing an example of a refresh rate timing char. The refresh rate is a cycle when the image obtained by reading the moving image data stored in the moving image storage unit 104 or the image captured by the imaging unit 102 is output to the display unit 105 or the external output control unit 124. In FIG. 4B, the constant refresh rate (CRR) shows an example in which an image is output at a fixed refresh rate of 30p. In FIG. 4B, the variable refresh rate (VRR) indicates that the reproduction refresh rate is variable. In the variable refresh rate of FIG. 4B, the A1 frame to the A4 frame is 30p, the A5 frame to the A8 frame is 120p, and the A9 frame, the A10 frame, and so on are output at 30p.

FIG. 4C is a diagram showing a timing chart when the moving image data recorded by VFR is output as a video by CRR and when the video is output by VRR. Hereinafter, it is assumed that the output destination of the video is the display unit 105, and the moving image data is reproduced by the display unit 105. When the moving image data recorded by VFR is reproduced by CRR, the frames recorded at 120p from the A5 frame to the A8 frame are reproduced as 30p. Therefore, it can be seen that from the A5 frame to the A8 frame, the slow reproduction is "1/4". On the other hand, when the moving image data recorded by VFR is reproduced by VRR, the frames recorded at 120p from the A5 frame to the A8 frame are reproduced as 120p. From this, it can be seen that the A5 frame to the A8 frame are reproduced at the same magnification as at the time of recording (reproduction at a refresh rate of 120 Hz).

Therefore, it is necessary to change the control of the time code at the time of recording when the moving image data is recorded by VFR depending on whether the CRR reproduction or the VRR reproduction is performed. Similarly, for the video output to the external output control unit 124, it is necessary to change the control of the time code at the time of recording. As shown in FIG. 4C, when the moving image data recorded by VFR is reproduced by CRR, it is necessary to control the time code at the time of VFR recording as 30p, which is the frame rate when reproducing by CRR. .. By performing this control, at the time of CRR reproduction, the portion recorded at 120p at the time of VFR recording is slow-reproduced by "1/4". On the other hand, when the reproduction is performed by VRR, the frames recorded at 120p to the A8 frame are reproduced at 120p. Even at 120p, it is necessary to control to record the time code including the subframe information so that the correct time code can be assigned. By performing this control, the portion recorded at 120p during VRR reproduction (the portion from A5 frame to A8 frame) can be reproduced at the same frame rate (120p) as during recording.

In this way, it is necessary to assign a time code in consideration of the playback refresh rate. Therefore, in the present embodiment, when the reproduction refresh rate is set to VRR, the time code including the subframe information is recorded, and when the reproduction refresh rate is set to CRR, the subframe information is not included. Record the frame rate. That is, when it is set to VRR, it is set to record a time code including subframes, and when CRR is set, it is set to record a time code not including subframes. However, when the reproduction refresh rate becomes larger than 60p, the time code including the subframe information may be recorded.

Next, the processing flow of the present embodiment will be described. FIG. 5 is a flowchart showing a processing flow of the present embodiment. As described above, in the present embodiment, multi-shooting using a plurality of video cameras can be performed. The flowchart of FIG. 5 shows a flow in which one of the plurality of video cameras, the imaging device 100, executes the process of the present embodiment when multi-shooting is performed. The system control unit 101 determines whether or not the VFR recording mode is set according to an instruction received by the user via the input unit 107 (S501). If No is determined in S501, the CFR recording mode process is executed. That is, the process of FIG. 5 is performed when VFR recording is performed. Here, the VFR recording mode is a recording mode (shooting mode) in which the shooting frame rate can be changed according to a user's instruction during shooting of moving image data. The CFR recording mode is a recording mode (shooting mode) in which the shooting frame rate cannot be changed during shooting, the shooting is performed at a shooting frame rate set before shooting, and the shot moving image data is recorded. It should be noted that each process of the flowchart of FIG. 5 is a process related to the present embodiment, and the image pickup apparatus 100 can perform other processes together with each process of the flowchart of FIG.

The system control unit 101 determines whether or not there is S502 according to an instruction from the user via the input unit 107 (S502). If No is determined in S502, the flow does not proceed to the next step and returns to S502. When there is a request to start recording, S502 determines Yes. In this case, the system control unit 101 determines whether multi-shooting is being performed (S503). The system control unit 101 can determine whether or not multi-shooting is performed based on whether the external synchronization signal detection unit 122 detects the input of the video synchronization signal (synchronization signal) from the external device.

When it is determined Yes in S503, the system control unit 101 determines whether the refresh rate setting at the time of playback is the CRR setting or the VRR setting according to the instruction from the user via the input unit 107. Is determined (S504). In the present embodiment, as described above, when the playback refresh rate set by the user is CRR, the time code control unit 115 controls without considering the subframe information, that is, the time code that does not include the subframe information. Make a record. On the other hand, when the reproduction refresh rate set by the user is VRR, the time code control unit 115 performs control in consideration of the subframe information, that is, recording the time code including the subframe information.

When the reproduction refresh rate set by the user is CRR, it is determined as Yes in S504. In this case, the system control unit 101 changes the playback refresh rate setting from CRR to VRR (S505). That is, even if the user sets the playback refresh rate to CRR, the playback refresh rate is changed from CRR to VRR. As a result, even when the playback refresh rate is set to CRR and the time code that does not include subframe information is set to be recorded, the time code control unit 115 controls in consideration of the subframe, that is, the sub. Change the setting to record the time code including the frame information. When recording moving image data with one imaging device instead of multi-shooting, it is not necessary to synchronize the video (and time code).

Therefore, a time code in a format corresponding to the playback refresh rate set by the user is recorded. However, in the case of multi-shooting, it is necessary to align the time code between a plurality of imaging devices. Then, when the moving image data is recorded by VFR and the reproduction refresh rate is set to CRR, the correct time code may not be given to each frame constituting the moving image data. Therefore, in the case of multi-shooting, even if the playback refresh rate is set to CRR, the correct time code can be recorded by changing to VRR, and the time code can be synchronized between multiple imaging devices. Will be able to.

Next, the moving image control unit 110 executes a process of temporarily holding the playback refresh rate information in order to record the playback refresh rate information in the moving image storage unit 104 as metadata that is incidental information of the moving image data. (S506). The playback refresh rate setting is automatically switched from CRR to VRR in S505. However, the playback refresh rate set for the user was CRR. Therefore, in S506, the reproduction refresh rate is changed to VRR, but the moving image control unit 110 records the metadata related to the setting of the reproduction refresh rate (metadata of the reproduction refresh rate) as CRR in the header 210. To control. The playback refresh rate metadata may be recorded in the index file 203 instead of the header 210. Further, although not shown in the flow of FIG. 5, the metadata of the playback refresh rate is recorded even during normal shooting other than multi-shooting or when the playback refresh rate is set to VRR in multi-shooting. At this time, the set playback refresh rate is recorded as the metadata of the playback refresh rate.

Next, the moving image control unit 110 opens the moving image file (S507). At this time, the metadata of the reproduction refresh rate temporarily held in S506 is recorded in the header 210 of the file. Then, the moving image control unit 110 receives an instruction to start recording in S502, then takes an image by the image sensor unit 103, performs image processing by the image pickup signal control unit 109, and sends a video signal ( The frame) is compressed and encoded (S508). The moving image control unit 110 multiplexes and adds metadata including a time code sent from the time code control unit 115 to the compressed video signal (frame), and adds a frame to the moving image storage unit 104. Remember (S509). The time code generation unit 116 performs time code increment control according to the set playback refresh rate according to the instruction of the time code control unit 115 (S510). In the present embodiment, in the case of multi-shooting, the time code generation unit 116 controls the increment of the time code according to the shooting frame rate by the VRR. In the case of normal shooting (with one imaging device) instead of multi-shooting, the set playback refresh rate, that is, VRR setting or CRR setting, and time code increment control according to the rate are controlled. Do.

The input control unit 113 determines whether or not the user has made a request to stop recording to the input unit 107 (S511). When No is determined in S511, the input control unit 113 determines whether or not the input unit 107 has been operated on by the user for switching the shooting frame rate (S512). When it is determined to be Yes in S512, the shooting frame rate at the time of shooting by the image sensor unit 103 is switched by the control unit (not shown) (S513). Then, the flow returns to S508. If No is determined in S513, the process of S513 is not performed and the flow returns to S508. If it is determined to be Yes in S511, the moving image control unit 110 closes the moving image file because the operation of requesting the stop of recording has been performed (S514).

In the above flow, whether or not multi-shooting is performed, the playback refresh rate setting is determined after the request to start recording is received in S502, and the playback refresh rate is changed according to the result. However, it may be possible to determine whether or not multi-shooting is performed and the playback refresh rate setting during the shooting standby (shooting standby) in the VFR recording mode before accepting the recording start request.

FIG. 6 is a diagram showing an example of a timing chart of each frame in multi-shooting by two video cameras. Of the two video cameras, the camera A switches the frame rate to 120p when recording at a frame rate of 30p, and then switches the frame rate to 30p. On the other hand, the camera B continues to record at a fixed frame rate of 30p. Hereinafter, 120p will be described as corresponding to the first frame rate, and 30p will be described as corresponding to the second frame rate. The first frame rate is an arbitrary frame rate using the subframe information, and the second frame rate is an arbitrary frame rate using no subframe information. Therefore, the first frame rate is higher than the second frame rate.

As shown in FIG. 6, the camera A records the A1 frame to the A3 frame at a frame rate of 30p, and the time code controls the reproduction refresh rate as VRR. Therefore, the time code is expressed in the order of hours, minutes, seconds, frames and subframes. The time code of the A1 frame is "00: 00: 00: 00.0". Since the frame rate is 30p, the time code of the A2 frame is "00: 00: 00: 01.0". Similarly, the time code of the A3 frame is "00: 00: 00: 02.0".

Here, it is assumed that when the A3 frame is being recorded, the input unit 107 is requested by the user to switch the frame rate from 30p to 120p. In this case, the imaging unit 102 and the imaging signal control unit 109 control to record at a frame rate of 120p from the A4 frame. Since the A4 frame to the A11 frame are recorded at a frame rate of 120p, which is a frame rate higher than 60p, a time code subframe is used. The time code of the A4 frame is "00: 00: 00: 03.0". The time code of the A5 frame is "00:00:00:03.1". Then, the time code of the A8 frame is "00:00:00: 04.0". Here, it is assumed that the user requests the input unit 107 to switch the frame rate from 120p to 30p at the timing when the A9 frame is recorded.

The time code of the A9 frame is "00:00:00:04.1", and the subframe is "1". When the frame rate is switched from 120p to 30p at this timing, the frame rate becomes 30p from the A10 frame. In this case, when the recorded moving image data is VRR-reproduced, the time code changes from "00: 00: 00: 04.1" to "00: 00: 00: 05.0" from A9 frame to A10 frame. , Real time cannot be maintained during VRR playback. Therefore, in the present embodiment, the moving image control unit 110 controls to record from the A12 frame to 30p when there is a request for switching the frame rate from 120p to 30p while recording the A9 frame. That is, when the moving image control unit 110 is performing recording without using the subframe information and there is a request to switch to the recording using the subframe information, the frame at the timing when the subframe information becomes zero. Switch rates. This makes it possible to maintain real time during VRR reproduction. Further, since the frame rate of each frame after the A12 frame is 30p, the subframe of each frame remains zero.

The camera B records from the B1 frame at a fixed frame rate of 30p, and the frame rate is not switched. However, even if the reproduction refresh rate is set to CRR, the reproduction refresh rate is controlled as VRR in the time code. Therefore, the time code is expressed in the order of hours, minutes, seconds, frames and subframes. The time code of the B1 frame is "00: 00: 00: 00.0", and the time code of the B2 frame is "00: 00: 00: 01.0". In camera A, frame rate switching occurs from the A4 frame, but in camera B, frame rate switching does not occur. Therefore, a B4 frame is recorded at a frame rate of 30p. The time code of the B4 frame is "00: 00: 00: 03.0". B5 frame transition, the time code frame is incremented while the time code subframe remains zero.

7 and 8 are diagrams showing an example of a UI screen for performing various settings. The UI screen is displayed on the display unit at 105. The UI screens of FIGS. 7 and 8 are displayed on the display unit 105 under the control of the display control unit 111. At this time, the display control unit 111 superimposes the OSD display on the video 400 of the moving image data input from the imaging unit 102 and displays it on the display unit 105. FIG. 7A shows a UI screen for setting the VFR recording mode. The UI screen includes a remaining recording time 401, an operating status 402, a time code display 403, and a mode selection screen 404. The remaining recording time 401 is a display indicating the recordable remaining time of the SD card when the SD card (registered trademark) is applied to the moving image storage unit 104. The operation status 402 is a display indicating whether or not the image pickup apparatus 100 is performing a recording operation. When the image pickup apparatus 100 is performing a recording operation, a predetermined mark is displayed. The time code display 403 is a display showing the time code generated by the time code generation unit 116. The mode selection screen 404 is a first screen for selecting whether to enable the VFR recording mode. That is, the mode selection screen 404 is a screen for selecting either a mode for recording at a variable frame rate or a mode for recording at a fixed frame rate. In the example of FIG. 7A, the VFR recording mode can be selected to be ON or OFF. When the VFR recording mode is set to ON, recording at a variable frame rate is selected. When the VFR recording mode is set to OFF, recording at a fixed frame rate is selected.

FIG. 7B shows a UI screen for setting the playback refresh rate mode. When the VFR recording mode is set to ON according to FIG. 7A, the operating status of the image pickup apparatus 100 is in the recording standby state of the VFR recording mode. Therefore, the display control unit 111 changes the display of the operation status 402 to "VFR STBY" indicating that the recording standby state is in effect. Further, the display control unit 111 displays a mode selection screen 404 in which it is possible to set whether to set the reproduction refresh rate mode to CRR or VRR. Here, as described above, when the playback refresh rate setting is automatically changed to VRR in S505, the display control unit 111 may not be able to select the playback refresh rate on the mode selection screen 404. Good. That is, when the reproduction refresh rate setting is automatically changed from CRR to VRR in S505, the user may not be allowed to change the time code setting. For example, the display control unit 111 may control so that neither CRR nor VRR can be selected on the mode selection screen 404, or may control so that the mode selection screen 404 is not displayed.

FIG. 8A shows a UI screen that starts VFR recording and sets the frame rate during recording. When VFR recording is being performed, the display control unit 111 changes the display of the operating status 402 to "VFR REC" indicating that VFR recording is in progress, and adds a predetermined mark. In the example of FIG. 8A, the predetermined mark is indicated by a hatched circle. When the VFR recording is started, the time code indicated by the time code display 403 advances. Further, when the VFR recording is started, the display control unit 111 displays the frame rate information 410. When the frame rate during recording is 30p and the reproduction refresh mode is set to VRR, "30fps / 30p" indicating the real time is displayed in the frame rate information 410.

In addition, the display control unit 111 displays the frame rate selection screen 411. As shown in FIG. 8A, on the frame rate selection screen 411, any one of the four shooting frame rates can be selected. The user can select an arbitrary shooting frame rate by using the input unit 107. The selectable shooting frame rate is not limited to four.

FIG. 8B shows a UI screen displayed after switching the shooting frame rate from 30p to 120p during VFR recording. The time code displayed on the time code display 403 is stepping forward. Further, it is assumed that the frame rate during recording is 120p and the playback refresh mode is set to VRR. In this case, the display unit 105 displays "120 fps / 120 p" indicating the real time in the frame rate information 410.

The present embodiment described above can be applied to the case of performing multi-shooting. Therefore, in S506 described above, the moving image control unit 110 records the metadata related to the setting of the reproduction refresh rate as CRR in the header 210. In this regard, in the case of non-multi-shooting, the metadata regarding the setting of the reproduction refresh rate (information indicating that the reproduction refresh rate is VRR or CRR) may not be recorded in the header 210. That is, when the synchronization signal is not input, it is not necessary to record the above metadata in the header 210. Further, as described above, when the playback refresh rate setting is automatically changed from CRR to VRR in S505, the playback refresh rate, that is, the time code recording method may not be allowed to be changed. It can also be tolerated. After the playback refresh rate setting is changed from CRR to VRR in S505, when the time code setting (playback refresh rate setting) is changed from VRR to CRR by the user's operation, the moving image control unit 110 moves the VFR. Recording may be prohibited (stopped if shooting is in progress).

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications and modifications can be made within the scope of the gist thereof. The present invention supplies a program that realizes one or more functions of each of the above-described embodiments to a system or device via a network or storage medium, and one or more processors of the computer of the system or device implements the program. It can also be realized by the process of reading and executing. The present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 Imaging device 104 Video storage unit 110 Video control unit 111 Display control unit 114 Time code phase control unit 115 Time code control unit 116 Time code generation unit 119 External input signal detection unit

Claims (11)

A setting means capable of setting whether to record a first time code including subframe information in which frame information is extended or to record a second time code not including the subframe information.
Change to record the first time code when the setting to record the second time code is set when recording the moving image data and the synchronization signal is input from the external device. Means and
An imaging device characterized by comprising. The setting means is set to record the first time code when the refresh rate at the time of reproduction is set to the variable refresh rate, and when the refresh rate at the time of reproduction is set to the fixed refresh rate, the setting means is described. The imaging apparatus according to claim 1, wherein a second time code is set to be recorded. The imaging device according to claim 2, wherein the setting means sets a refresh rate at the time of reproduction according to a user operation. When the recording of the second time code is changed to the recording of the first time code, control is performed so as to record information indicating that the reproduction is performed at a fixed refresh rate as ancillary information of the moving image data. The imaging apparatus according to claim 1, further comprising a control means for the operation. When the synchronization signal is not input, the control means controls so as not to record information indicating that the reproduction is at a fixed refresh rate or information indicating that the reproduction is at a variable refresh rate in the incidental information. The image pickup apparatus according to claim 4, wherein the image pickup apparatus is used. It has a variable frame rate recording mode that allows you to change the shooting frame rate during shooting.
When the variable frame rate recording mode is set, the changing means is set to record the second time code, and when a synchronization signal is input from an external device, the first change means. The imaging apparatus according to any one of claims 1 to 4, wherein the time code of the above is changed to be recorded. After the second time code recording is automatically changed to the first time code recording by the changing means, the user operates the first time code recording to the second time code recording. The imaging device according to claim 6, wherein when the recording is changed, recording in the variable frame rate recording mode is prohibited. The imaging device according to any one of claims 1 to 5, wherein when a synchronization signal is not input from an external device, the change is not performed by the changing means. The setting means has a selection screen for selecting the recording of the first time code or the recording of the second time code.
When the second time code is changed to the first time code by the changing means, the selection of the recording of the first time code or the recording of the second time code on the selection screen is performed. The imaging device according to any one of claims 1 to 5, wherein the imaging device is not possible. Control of an image pickup apparatus having a setting means capable of setting whether to record a first time code including subframe information in which frame information is extended or to record a second time code not including the subframe information. It's a method
A step of changing to record the first time code when a setting for recording the second time code is made when recording moving image data and a synchronization signal is input from an external device. ,
A control method characterized by comprising. A program for causing a computer to execute each means of the imaging device according to any one of claims 1 to 9.

Images