JP2015164266A - Moving picture recording system, imaging device and recording device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving picture recording system, an imaging device and a recording device in which video data recorded in a reverse direction corresponding to a reverse reproduction order opposite to a temporal order can be edited by using video data recorded in a forward direction.SOLUTION: In an imaging device (110), a recording processing device (124) records, in a recording medium (126), video data generated by imaging of an imaging unit (116) in a reverse direction, and allocates a frame number of an order reverse to the temporal order to each frame. A resolution converter (130) converts the video data to low-resolution video data. A data output unit (132) outputs the low-resolution video data, a frame number generation rule and a frame number initial value to an external recording device (160). The external recording device (160) records the received low-resolution video data in a forward direction, and allocates the same frame number allocated in the imaging device (110) to the same frame according to the frame number generation rule and the frame number initial value.

Description

  The present invention relates to a moving image recording system, an imaging apparatus, and a recording apparatus.

  In the imaging device that records moving images, reverse coding that encodes and records moving images in the reverse direction in advance during recording so that the reproduced image in the reverse direction can be displayed by normal reproduction (forward reproduction). A recording method is known (see Patent Document 1).

Japanese Patent Laid-Open No. 10-032787

  When editing high-resolution video (for example, so-called 4K video), high-performance hardware is required, so edit with a higher-resolution video file and apply the edited result to the original high-resolution video file. To be done. For this purpose, a moving image that is output in real time from the external terminal of the imaging device is recorded at a low resolution (or high resolution) by the external recording device while a moving image is recorded at a high resolution (or low resolution) in the imaging device body. The low resolution side is used for editing.

  Frame numbers given to moving images that are output in real time from the external terminal of the imaging device are in the order of imaging. Therefore, when the moving image file recorded on the imaging device side is in the forward direction with respect to the time axis, the recorded moving image of the imaging device and the recorded moving image of the external recording device have the same frame number, and It can be reflected in the other. However, when the moving image recording of the imaging device is reverse recording, the frame number does not correspond to the moving image recorded in the reverse direction by the imaging device and the moving image recorded in the forward direction to the external recording device, and the editing result of one moving image Cannot be reflected in the other.

  FIG. 6 is a schematic diagram showing the correspondence between the file number of the moving image file recorded in the reverse direction and the moving image file recorded in the forward direction of the external output. The abscissa indicates the time required for recording (frame order in the moving image file). The moving image file 610 is recorded in the reverse direction, and the moving image file 612 is recorded in the forward direction of the external output. Since the moving image file 610 is composed of high resolution moving image data, and the moving image file 612 is composed of low resolution moving image data, the bit rate of the moving image file 610 is higher than that of the moving image file 612.

  In the moving image file 610, the upper row shows the frame number assigned to each frame recorded as the moving image file 610, and the lower row shows the frame order at the time of shooting. In the example shown in FIG. 6, the frame number initial value for backward recording is 256, the frame number of the first recorded frame is 255, and the frame number of the frame that is decremented and recorded last is 43. Yes. In other words, the moving image file 610 is composed of 213 frames. The frame number assigned to each frame recorded as the moving image file 612 is added to the other moving image file 612.

  Generally, the number of frames accommodated in the moving image files 610 and 612 is different due to the difference in recording stop timing. This is because, if the recording operation is immediately ended in response to the recording end instruction, there is a possibility of inconvenience such as dropping a frame in the middle of transfer, so that the actual recording end is controlled. In the example illustrated in FIG. 6, the moving image file 612 has two frames more than the moving image file 610. Due to the difference in the number of accommodated frames and the non-correspondence of the frame number, it is difficult to reflect the editing result of the moving image file 612 on the moving image file 610 as it is. Preprocessing such as matching the number of frames in advance or checking the correspondence of frames between moving image files is required.

  It is an object of the present invention to provide a moving image recording system, an imaging apparatus, and a recording apparatus that can eliminate such inconveniences.

  In order to solve the problems as described above, a moving image recording system according to the present invention includes a moving image output unit that outputs moving image data, a resolution conversion unit that reduces the resolution of the moving image data and outputs it to low resolution moving image data, A recording means for recording one of the moving image data and the low-resolution moving image data by reverse recording in a playback order reverse to the time order, and assigning each frame a frame number in the reverse order to the time order A first recording means and a recording means for recording the other of the moving image data and the low-resolution moving image data in a forward direction recording in the same reproduction order as the time order, provided by the first recording means; And second recording means for assigning the same frame number to the same frame.

  According to the present invention, since the same frame number is assigned to the same frame in the recording of moving image data and the recording of low resolution moving image data, the editing result of the low resolution moving image data can be used for editing the moving image data. .

It is a schematic block diagram of one Example of this invention. It is an external view of the imaging device which comprises a present Example. 3 is an operation flowchart of the imaging apparatus of the present embodiment. It is an operation | movement flowchart of the external recording device of a present Example. It is a schematic diagram which shows the flame | frame correspondence of the two moving image files produced | generated in a present Example. It is a schematic diagram which shows the flame | frame correspondence of two moving image files in a prior art example.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of a moving image recording system according to the present invention. The embodiment shown in FIG. 1 includes an imaging device 110 with interchangeable lenses and an external recording device 160 that records a moving image signal output from the imaging device 110 in real time. The external video signal output terminal of the imaging device 110 is connected to the video input terminal of the external recording device 160 via the HDMI (registered trademark) cable 170.

  The imaging device 110 includes a main body 112 and an interchangeable lens 114 that can be attached to and detached from the main body 112. The imaging unit 116 includes a CCD type or CMOS type image sensor that converts an optical image obtained by the interchangeable lens 114 into an electric image signal, and an A / D converter that digitizes the output image signal of the image sensor. The camera image processing unit 118 uses the RAM 120 as a work area, performs known camera image processing such as gamma correction and color balance adjustment on the image data output from the imaging unit 116, and outputs moving image data of a predetermined video system. . That is, the imaging unit 116 and the camera image processing unit 118 function as a moving image output unit that outputs moving image data to be recorded. A memory management unit (MMU) 122 controls reading and writing of data from and to the RAM 120.

  The recording processing unit 124 compresses and encodes the image data output from the camera image processing unit 118 by a predetermined compression encoding method corresponding to each of the still image or the moving image and records the data on the recording medium 126. The recording medium 126 is, for example, a memory card that is built-in or removable from the main body 112.

  The resolution conversion unit 130 reduces the resolution of the image data output from the camera image processing unit 118 by pixel thinning, and supplies the obtained low resolution image data to the data output unit 132. The data output unit 132 supplies low-resolution moving image data composed of low-resolution image data from the resolution conversion unit 130 to the external recording device 160 from the HDMI output terminal 134 via the HDMI cable 170.

  The main body control unit 136 performs overall control of the imaging device 110 according to the operation and operation state of the operation device 148 including the operation switches 138 to 146. The main body control unit 136 includes, for example, a nonvolatile memory such as a ROM, a RAM, and an EEPROM, and a microcomputer incorporating various I / O circuits.

  The operation switch 138 is turned on when the release button is half-pressed, and the operation switch 140 is turned on when the release button is fully pressed. The main body control unit 136 determines the exposure and focus of the lens 114 in response to the operation switch 138 being turned on, and releases the still image shooting shutter in response to the operation switch 140 being turned on.

  The operation switch 142 is a still image / moving image switch that instructs the main body control unit 136 to select a still image capturing mode or a moving image capturing mode.

  The operation switch 144 is a recording direction instruction switch for instructing the main body control unit 136 to perform forward direction recording or reverse direction recording in the moving image shooting mode.

  The operation switch 146 is a toggle-format moving image recording button for instructing the main body control unit 136 to start / end moving image recording. The operation of the operation switch 146 is valid only when the moving image shooting mode is set by the operation switch 142.

  The display unit 150 includes a liquid crystal display (LCD), and the main body control unit 136 displays on the display unit 150 an image for which the composition of the subject is being determined and an image that is being recorded. In the still image mode, the user can also check the composition of the subject using the optical viewfinder 152.

  The interchangeable lens 114 includes a lens control unit 154 that detects the positions of a zoom lens, a focus lens, and a diaphragm and controls driving. The lens control unit 154 notifies the detection position of the zoom lens or the like to the main body control unit 136, and controls the zoom lens, the focus lens, and the diaphragm via the respective actuators according to the control signal from the main body control unit 136. The interchangeable lens 114 may include a camera shake correction optical system.

  The compression encoding of the recording processing unit 124 and the resolution conversion of the resolution converting unit 130 can be realized by software operating on a digital signal processing circuit (DSP), for example. When the processing capability of the main body control unit 136 is high, one or both of compression encoding and resolution conversion can be realized by software operating on the main body control unit 136.

  The RAM 120 temporarily stores image data output from the imaging unit 116, and is used as a work memory or buffer for processing in the camera image processing unit 118, the recording processing unit 124, and the resolution conversion unit 130.

  The external recording device 160 includes an HDMI input terminal 162, a recording processing unit 164, and an HDD 166 as a recording medium, and records output moving image data of the imaging device 110 on the HDD 166. The HDMI cable 170 is connected to the HDMI input terminal 162. The low resolution image data output from the HDMI output terminal 134 of the imaging apparatus 110 is input to the recording processing unit 164 via the HDMI cable 170 and the HDMI input terminal 162. The recording processing unit 164 compresses and encodes the low resolution image data from the HDMI input terminal 162 and records it in the HDD 166.

  HDMI can transmit data other than image data and audio data, and can also transmit control signals. The main body control unit 136 can supply data other than image data to the external recording device 160 via the HDMI cable 170, specifically, a frame number of moving image data to be supplied to the external recording device 160. In this embodiment, using this function, the frame number of the low-resolution moving image data recorded in the forward direction on the external recording device 160 and the frame number of the high-resolution moving image data recorded in the reverse direction on the recording medium 126 are matched. Let

  FIG. 2 shows an external view of the imaging device 110. 2 (1) shows a front view, FIG. 2 (2) shows a rear view, and FIG. 2 (3) shows a bottom view. Operation switches 138 and 140 are incorporated in the release button 210, and the operation switch 138 is turned on when half-pressed, and the operation switch 140 is turned on when fully pressed. A still image / moving image switch 142 is incorporated in the switching lever 212 on the back side. A recording direction instruction switch 144 is incorporated in the front switching lever 214. An HDMI output terminal 134 is disposed on the side surface of the main body.

  3 shows an operation flowchart on the imaging device 110 side for moving image recording, and FIG. 4 shows an operation flowchart on the external recording device 160 side. It is assumed that the user has set the moving image recording mode with the still image / moving image switch 142 and instructed the main body control unit 136 to start moving image recording with the moving image recording start / stop switch 146. In response to the instruction to start moving image recording, the main body control unit 136 starts the flow shown in FIG.

  In S301, the main body control unit 136 checks whether the recording direction instruction switch 144 is in the forward direction or the reverse direction. In the reverse direction (S301), the main body control unit 136 sets the maximum value as the initial value for calculating the frame number of the moving image to be recorded (S302). On the other hand, in the forward direction (S301), the main body control unit 136 sets a minimum value as an initial value for calculating the frame number of the moving image to be recorded (S303).

  In normal reproduction, frames are reproduced and displayed in the order of frame numbers. Therefore, in reverse recording in which normal reproduction is performed in the reverse direction in time, it is necessary to assign frame numbers in descending order with respect to the time axis. Therefore, for reverse recording, the frame number initial value is set to a larger value in the normal use range, for example, the maximum value, and a frame number in descending order is calculated and assigned to each frame in the input order, that is, in time order. .

  In step S304, the main body control unit 136 instructs each unit of the main body 112 and the external recording device 160 to start recording. Specifically, the main body control unit 136 causes the imaging unit 116, the camera image processing unit 118, and the recording processing unit 124 to start recording processing, and causes the resolution conversion unit 130 and the data output unit 132 to output low-resolution moving image data. Let it begin. Also, the main body control unit 136 sends a recording start control signal including frame number calculation initial value (or frame number initial value) and recording direction information as a frame number generation rule to the external recording device 160 via the HDMI cable 170. Send.

  The main body control unit 136 controls the recording processing unit 124 to record high-resolution moving image data from the imaging unit 116 on the recording medium 126 in units of frames (S305, S306). Specifically, the main body control unit 136 increments (or adds) in the case of forward recording and decrements (or subtracts in the case of backward recording) from the initial values set in S302 and S303 for each frame. ) To calculate the frame number (S305). The body control unit 136 attaches the calculated frame number and records the compressed image data of the frame in the moving image file of the recording medium 126 (S306). Until the user gives an instruction to end recording (S307), the main body control unit 136 repeats S305 and S306.

  The frame number calculation (S305) is performed by the following method, for example. That is, subtraction processing is set in the case of backward recording, and addition processing is set in the case of forward recording. When the frame number is implemented as a 32-bit integer, the main body control unit 136 sets 0 as the initial value of the frame number so as to count down from the maximum value of 0xFFFFFFFF. At this time, the main body control unit 136 subtracts 1 from the frame number initial value 0 in S307 for the image of the first frame to be recorded, and sets the frame number to 0xFFFFFFFF. In this way, the frame number is counted down from the largest value of the 32-bit integer.

  On the other hand, in the case of forward recording, the main body control unit 136 sets 0xFFFFFFFF as a frame number initial value in S303. At this time, the main body control unit 136 adds 1 to the frame number initial value 0xFFFFFFFF to set the frame number to 0 in step S307 for the first frame image to be recorded. In this way, the frame number is up-counted from the smallest 32-bit integer.

  Here, the frame number is implemented as a 32-bit integer with a maximum value of 0xFFFFFFFF and a minimum value of 0. In an implementation that uses 0xFFFFFFFF or 0 as a frame number for an exception and uses it as a special value, the maximum value and the minimum value do not necessarily match the maximum and minimum integer values. Further, addition / subtraction is not necessarily performed in increments of 1 count, such as limiting the frame number to an even number depending on the frame rate of moving image recording. In addition, when moving image recording is started by specifying a time in advance, the number of frames required for that time (for example, 1440 if the frame rate is 1 minute at 24 fps) may be set as the maximum value.

  In response to the recording end instruction (S307), the main body control unit 136 ends the recording on the recording medium 126 and instructs the external recording apparatus 160 to end the recording (S308). Specifically, the main body control unit 136 ends the recording process of the image data on the recording medium 126 by the imaging unit 116 and the output process of the image data with the reduced resolution to the external recording device 160. At the same time, the main body control unit 136 transmits a recording end control signal to the external recording device 160. Although details will be described later, the external recording device 160 ends the recording operation in response to the recording end control signal.

  In the case of reverse recording, each frame needs to be played back in the reverse order of the time axis in normal playback. Therefore, in the case of reverse recording (S309), the main body control unit 136 sets the playback order of each frame in the moving image file created in S306 (frame storage) so that the playback order is reverse to the recorded order. It is reversed in the moving image file (S310). Thus, when this moving image file is reproduced from the beginning, it is reproduced in reverse order in time.

  The main body control unit 136 writes frame playback order information that defines the playback order of frames in the header of the video file, and closes the video file (S311). The frame playback order information includes information indicating the correspondence between the frame number of each frame and the recording position on the moving image file.

  The recording operation of the external recording device 160 will be described with reference to FIG. The external recording device 160 starts the recording operation shown in FIG. 4 when receiving the recording start control signal from the imaging device 110, and ends the recording operation when receiving the recording end control signal.

  In S401, the recording processing unit 164 takes in the initial frame number value attached to the recording start control signal from the imaging device 110, and sets it as the frame number of the internal variable. In step S <b> 402, the recording processing unit 164 determines whether the moving image recording in the imaging apparatus 110 is forward recording or reverse recording from the recording method information attached to the recording start control signal from the imaging apparatus 110. In the case of reverse recording (S402), in S403, the recording processing unit 164 sets subtraction as the frame number calculation method of the moving image to be recorded. On the other hand, in the case of forward recording (S402), in S404, the recording processing unit 164 sets addition as the frame number calculation method of the moving image to be recorded.

  By determining the frame number initial value and the frame calculation method in this way, the same frame number can be assigned to the same frame in the moving image recorded by the imaging device 110 and the moving image recorded by the external recording device 160. When the number of additions (or subtractions) in the frame number calculation at the imaging device 110 is 2 or more, the number of additions (or subtractions) is transmitted from the imaging device 110 to the external recording device 160, and the frames at the external recording device 160 are transmitted. It is obvious that the number may be an addition (or subtraction) number operation.

  In S405, the recording processing unit 164 calculates the frame number by the calculation method set in S403 and S404. In step S <b> 406, the recording processing unit 164 compresses and encodes the low-resolution image data for one frame received from the imaging apparatus 110 and stores the compressed video data in the HDD 166. The recording processing unit 164 executes S405 and S406 until a recording end control signal is received from the imaging device 110 (S407).

  When the recording end control signal is received from the imaging device 110 (S407), the recording processing unit 164 ends the capturing of the image data from the HDMI input terminal 162 (S408). Then, the recording processing unit 164 writes frame playback order information that defines the playback order of frames in the header of the moving picture file in the HDD 166, and closes the moving picture file (S409). The frame playback order information includes information indicating the correspondence between the frame number of each frame and the recording position on the moving image file.

  FIG. 5 is a schematic diagram showing the file number correspondence between the moving image file recorded in the backward direction on the recording medium 126 and the moving image file recorded in the forward direction on the HDD 166. The abscissa indicates the time required for recording (frame order in the moving image file). The moving image file 510 is recorded on the recording medium 126, and the moving image file 512 is recorded on the HDD 166. Since the moving image file 510 is composed of high resolution moving image data and the moving image file 512 is composed of low resolution moving image data, the bit rate of the moving image file 510 is higher than that of the moving image file 512.

  In the moving image file 510, the upper row shows the frame number assigned to each frame recorded as the moving image file 510, and the lower row shows the frame order at the time of shooting. In the example shown in FIG. 5, the frame number initial value for backward recording is 256, the frame number of the first recorded frame is 255, and the frame number of the frame that is decremented and recorded last is 43. Yes. That is, the moving image file 510 is composed of 213 frames.

  The other moving image file 512 has a frame number attached to each frame recorded as the moving image file 512. The external recording device 160 receives 256 as the initial frame number from the imaging device 110, adds 255 obtained by decrementing this to the first recorded frame, and thereafter decrements the frame number. In general, the recording end of the external recording device 160 is delayed from that of the imaging device 110. Compared to the moving image file 510, the moving image file 512 is recorded with two frames, and the frame number of the last recorded frame is 41.

  Although the number of frames recorded in the moving image file 510 and the moving image file 512 is different, the frame numbers assigned to the respective frames are the same, so there is a problem in applying the editing result in the moving image file 512 to the moving image file 510. No. Since the moving image file 512 has a smaller amount of data than the moving image file 510, fewer resources are required for editing. Although it has a low resolution, the moving image file 512 is sufficient for editing in units of frames. As a result, editing operations can be quickly performed even in an editing system that does not have a large amount of storage or memory.

  Although the embodiment using the HDMI cable 170 as a communication medium has been described, it is needless to say that the present invention can be applied even if the imaging device 110 and the external recording device 160 are connected by communication means using other communication media.

  In the above embodiment, in order to make the frame numbers of the moving images recorded by the two moving image recording systems coincide with each other, the frame number initial value and the calculation direction (and necessary number change amount) are notified from one to the other. The same frame number was calculated. The frame number of a frame to be recorded in one moving image recording system may be notified from one moving image recording system to the other moving image recording system and added to the frame to be recorded.

Claims (10)

Video output means for outputting video data;
Resolution conversion means for reducing the resolution of the moving image data and outputting the reduced resolution moving image data;
A recording means for recording one of the moving image data and the low-resolution moving image data by reverse recording in a playback order reverse to the time order, and assigning each frame a frame number in the reverse order to the time order First recording means;
Recording means for recording the other of the moving image data and the low-resolution moving image data in forward recording in the same playback order as time order, and assigning the same frame number to the same frame as given by the first recording means A moving image recording system comprising: a second recording unit for applying the recording unit.   2. The moving image recording system according to claim 1, wherein the first recording unit records the moving image data, and the second recording unit records the low resolution moving image data.   The moving image recording system according to claim 1, wherein the moving image output unit is an imaging unit.   4. The method according to claim 1, wherein the second recording unit calculates a frame number to be given to a frame to be recorded in accordance with a frame number generation rule and a frame number initial value in the first recording unit. The moving image recording system according to claim 1.   5. The apparatus according to claim 4, wherein the second recording unit is connected as an external recording device to a device comprising the moving image output unit, the resolution conversion unit, and the first recording unit via a communication unit. The video recording system described. Imaging means for outputting video data;
Resolution conversion means for reducing the resolution of the moving image data and outputting the reduced resolution moving image data;
A recording means for recording one of the moving image data and the low-resolution moving image data by reverse recording in a playback order reverse to the time order, and assigning each frame a frame number in the reverse order to the time order Recording means;
An image pickup apparatus comprising: communication means for outputting information on the frame number given by the recording means to an external recording device.   The imaging apparatus according to claim 6, wherein the communication unit outputs a frame number generation rule and a frame number initial value to the external recording device as information on the frame number assigned by the recording unit. A recording device that records moving image data by reverse recording in a playback order that is reverse to time order and records output moving image data of an imaging device that assigns frame numbers in reverse order to time order to each frame. ,
Means for receiving the output moving image data and information relating to the frame number assigned to each frame of the moving image data recorded by the imaging device;
Recording means for recording the output moving image data in forward recording in the same playback order as in time order, and recording means for assigning the same frame number to the same frame as that provided by the imaging device according to the information on the frame number A recording apparatus.   The recording apparatus according to claim 8, wherein the output moving image data is low-resolution moving image data in which the resolution of the moving image data is reduced.   10. The recording apparatus according to claim 8, wherein the information regarding the frame number includes a frame number generation rule and a frame number initial value.

Images