JP2016208206A - Recording apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to fit to GOP unit by determining whether to prolong or reduce each frame.SOLUTION: The recording apparatus includes: recording means for recording by converting an input video signal into a moving image format; means for calculating progress with respect to a frame rate; means for prolonging a frame so as to match GOP unit of a moving image; means for reducing a frame so as to match GOP unit of a moving image; means for determining whether to prolong or reduce a frame; and means for determining which frame should be processed on the basis of a state of a still image.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a recording apparatus.

  2. Description of the Related Art Conventionally, electronic cameras that capture, record, and reproduce still images and moving images using a memory card having a solid-state memory element as a recording medium are commercially available.

  A function of saving and playing back a plurality of moving images shot in different scenes with such an electronic camera as one moving image is provided. With the above function, it is possible to provide a user merit that a sharp moving image can be generated.

  However, the disadvantage of this function is that the shooting process must be performed in real time due to the nature of the movie. From the viewpoint of CPU load and buffer load, for example, the maximum size that can be shot with still images is recorded as the movie size. Can not do it. Also, it is not possible to create a video shot at a desired shooting interval.

  In order to solve this problem, there is a technique for combining a video shot with a still image into a single moving image at a later timing. This makes it possible to generate a movie with the maximum size that can be taken with still images, and at the same time, it is possible to connect movies generated by shooting at any time. However, if this is not effective for all patterns and the user wants to create a video from a still image at any time and then resumes from that file at the next shooting, the video will be linked at the end of the original video. There is a technical limitation that recording is required.

  At this time, if photographing is performed halfway with respect to the GOP unit and recording is performed as it is, recording cannot be performed in the GOP unit. In other words, there is a possibility that the resumed video after the interruption cannot be connected.

  In order to avoid this, Patent Document 1 discloses a storage device and a frame discard method that can discard a frame according to the discard priority.

JP 2004-282390 A

  However, in Patent Document 1, there is a pattern in which a large number of frames are discarded in order to match the GOP unit. In order to solve this problem, it is possible to solve the problem by simply taking extra shots to match the GOP unit. However, as a demerit, it takes extra time from instructing the user to finish until the actual end. (For example, if 30 fps at 10-second intervals, the user must wait for a maximum of 140 seconds.)

  In such a situation, when recording is performed in units of GOPs so as to end immediately from the timing of the user's end instruction and connect the moving images, it is desirable to discard and add frames that are shot according to the situation.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a recording apparatus that can determine whether each frame is to be extended or deleted and fit it in GOP units.

  In order to achieve the above object, a recording apparatus according to the present invention includes a recording unit that converts an input video signal into a moving image format and records, a unit that calculates progress with respect to a frame rate, and a GOP unit of a moving image. Depending on the situation of the still image, the means for extending the frame to fit, the means for reducing the frame to fit the GOP unit of the video, the means for determining whether to extend or reduce the frame, and which frame to process It is characterized by having means when judged.

  According to the present invention, there is provided a recording apparatus capable of determining whether to extend or delete each frame by looking at the progress status with respect to the frame rate without giving a sense of incongruity to the user, and making it possible to adjust to each GOP unit. be able to.

It is a block diagram of a recording device. It is the schematic diagram showing the sequence of the recording device. It is a flowchart which shows the process of a recording device. It is a flowchart which shows the process of a recording device. It is a flowchart which shows the process of a recording device. It is a flowchart which shows the process of a recording device.

  Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus having an image processing function according to an embodiment of the present invention. In the present embodiment, a single-lens reflex digital still camera with interchangeable lenses will be described as an example of an imaging apparatus.

  As shown in FIG. 1, the imaging apparatus of the present embodiment mainly includes a camera body 100 and an interchangeable lens type lens unit 300.

In the lens unit 300, 310 is an imaging lens composed of a plurality of lenses, 312 is a diaphragm, and 306 is a lens mount that mechanically couples the lens unit 300 to the camera body 100. The lens mount 306 includes various functions for electrically connecting the lens unit 300 to the camera body 100. Reference numeral 320 denotes an interface for connecting the lens unit 300 to the camera body 100 in the lens mount 306, and 322 denotes a connector for electrically connecting the lens unit 300 to the camera body 100.

  The connector 322 has a function of transmitting control signals, status signals, data signals, and the like between the camera body 100 and the lens unit 300 and supplying currents of various voltages. The connector 322 may be configured to perform communication using not only electrical communication but also optical communication, voice communication, and the like. Reference numeral 340 denotes an aperture control unit that controls the aperture 312 in cooperation with a shutter control unit 40 that controls the sitter 12 of the camera body 100, which will be described later, based on photometric information from the photometry control unit 46. Reference numeral 342 denotes a focus control unit that controls focusing of the imaging lens 310, and 344 denotes a zoom control unit that controls zooming of the imaging lens 310.

  A lens system control circuit 350 controls the entire lens unit 300. The lens system control circuit 350 includes a memory for storing operation constants, variables, programs, and the like. Further, a non-volatile memory that holds identification information such as a unique number of the lens unit 300, management information, function information such as an open aperture value, a minimum aperture value, and a focal length, and current and past setting values is also provided.

  Next, the configuration of the camera body 100 will be described. Reference numeral 106 denotes a lens mount that mechanically couples the camera body 100 and the lens unit 300. Reference numerals 130 and 132 denote mirrors, which guide light rays incident on the imaging lens 310 to the optical viewfinder 104 by a single-lens reflex system. The mirror 130 may be either a quick return mirror or a half mirror. Reference numeral 12 denotes a focal plane shutter. Reference numeral 14 denotes a CCD, a CMOS sensor, or the like, which is an image sensor that photoelectrically converts a subject image. An optical element 14 a such as an optical low-pass filter is disposed in front of the image sensor 14.

  The light beam incident on the imaging lens 310 is guided by the single-lens reflex system through the aperture 312, the lens mounts 306 and 106, the mirror 130, and the shutter 12, which are light amount limiting means, and is formed on the image sensor 14 as an optical image. .

  Reference numeral 16 denotes an A / D converter that converts an analog signal (output signal) output from the image sensor 14 into a digital signal. A timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, respectively, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22. Further, the image processing circuit 20 performs predetermined arithmetic processing using the image data output from the A / D converter 16 as necessary. The system control circuit 50 controls the shutter control unit 40 and the focus adjustment unit 42 on the basis of the obtained calculation result, so that contrast-type autofocus (AF) processing, automatic exposure (AE) processing, flash pre-emission (EF) ) Can be processed. Further, the image processing circuit 20 performs predetermined arithmetic processing using the image data output from the A / D converter 16, and also performs TTL auto white balance (AWB) processing based on the obtained arithmetic result. ing.

  A memory control circuit 22 controls the A / D converter 16, timing generation circuit 18, image processing circuit 20, image display memory 24, D / A converter 26, memory 30, and compression / decompression circuit 32. Image data output from the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing circuit 20, the memory control circuit 22, or only through the memory control circuit 22.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit made up of a TFT type LCD or the like. Display image data written in the image display memory 24 is stored in the D / A converter 26. Via the image display unit 28. An electronic viewfinder (EVF) function can be realized by sequentially displaying captured image data using the image display unit 28. Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50, and when the display is turned off, the power consumption of the camera body 100 can be significantly reduced. it can.

  Reference numeral 30 denotes a memory for storing captured still images or moving images, and has a storage capacity sufficient to store a predetermined number of still images or a predetermined amount of moving images. This makes it possible to write a large amount of images to the memory 30 at high speed even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot. In moving image shooting, it is used as a frame buffer for images written continuously at a predetermined rate. Further, the memory 30 can be used as a work area for the system control circuit 50.

  Reference numeral 31 denotes an image composition circuit for composing a plurality of images to create one composite photograph. A plurality of pieces of image data written in the memory 30 are read simultaneously, a combining process is performed in the circuit, and the generated combined image data is written in the memory 30. The combining circuit is a circuit that combines the image data converted by the A / D converter 16 and written by the memory control circuit 22 or the image data processed by the image processing circuit 20.

  A compression / decompression circuit 32 compresses / decompresses image data using a known compression method. The compression / decompression circuit 32 reads an image stored in the memory 30, performs a compression process or an expansion process, and writes the processed data to the memory 30 again. It also has a function of compressing and encoding moving image data into a predetermined format, or expanding a moving image signal from predetermined compression-encoded data.

  Reference numeral 40 denotes a shutter control unit that controls the shutter 12 in cooperation with an aperture control unit 340 that controls the aperture 312 based on photometric information from the photometry control unit 46. A focus adjusting unit 42 performs AF (autofocus) processing. A light beam incident on the imaging lens 310 in the lens unit 300 is made incident as a single lens reflex system through a diaphragm 312, lens mounts 306 and 106, a mirror 130, and a focus adjustment submirror (not shown), thereby forming an optical image. The in-focus state of the captured image is measured.

  A photometry control unit 46 performs AE (automatic exposure) processing. A light beam incident on the image pickup lens 310 in the lens unit 300 is made incident as an optical image by being incident by a single lens reflex system through a diaphragm 312, lens mounts 306 and 106, a mirror 130, and a photometric sub mirror (not shown). Measure the exposure of the image.

  Further, the AF control may be performed using the measurement result by the focus adjustment unit 42 and the calculation result obtained by calculating the image data from the A / D converter 16 by the image processing circuit 20. Furthermore, exposure control may be performed using the measurement result obtained by the photometry control unit 46 and the calculation result obtained by calculating the image data from the A / D converter 16 by the image processing circuit 20.

  Reference numeral 50 denotes a system control circuit that controls the entire camera body 100, and incorporates a known CPU. A memory 52 stores constants, variables, programs, and the like for operating the system control circuit 50.

  Reference numeral 54 denotes a notification unit for notifying the outside of an operation state, a message, and the like using characters, images, sounds, and the like in accordance with execution of a program in the system control circuit 50. As the notification unit 54, for example, a display unit that performs visual display using an LCD, an LED, or the like, or a sound generating element that performs voice notification, etc., is used. . In particular, in the case of a display unit, it is installed at a single or a plurality of locations near the operation unit 70 of the camera body 100 that are easy to see. In addition, the notification unit 54 has a part of its function installed in the optical viewfinder 104.

  Among the display contents of the notification unit 54, the following are displayed on the image display unit 28 such as an LCD. First, there are displays relating to shooting modes such as single-shot / continuous-shot shooting display and self-timer display. In addition, there are displays relating to recording such as compression rate display, recording pixel number display, recording number display, and remaining image number display. In addition, there are displays relating to photographing conditions such as shutter speed display, aperture value display, exposure correction display, dimming correction display, external flash emission amount display, and red-eye reduction display. In addition, there are a macro photographing display, a buzzer setting display, a battery remaining amount display, an error display, an information display by a multi-digit number, and a recording medium 200 attachment / detachment state display. Furthermore, the attachment / detachment state display of the lens unit 300, the communication I / F operation display, the date / time display, the display indicating the connection state with the external computer, and the like are also performed.

  Further, among the display contents of the notification unit 54, examples of what is displayed in the optical finder 104 include the following. In-focus display, shooting preparation completion display, camera shake warning display, flash charge display, flash charge completion display, shutter speed display, aperture value display, exposure correction display, recording medium writing operation display, and the like.

  Reference numeral 56 denotes an electrically erasable / recordable non-volatile memory in which programs and the like to be described later are stored. For example, an EEPROM or the like is used.

  An optical information storage memory 58 stores various lens information described later obtained from the lens unit 300 via the connector 122. Reference numerals 60, 62, 64, and 70 denote operation means for inputting various operation instructions of the system control circuit 50. The operation means 60, 62, 64, and 70 are a single or a combination of a switch, a dial, a touch panel, pointing by eye-gaze detection, a voice recognition device, and the like. Composed.

  Here, a specific description of these operating means will be given. Reference numeral 60 denotes a mode dial switch which can be used to switch and set each function shooting mode such as an automatic shooting mode, a program shooting mode, a shutter speed priority shooting mode, an aperture priority shooting mode, a manual shooting mode, and a depth of focus priority (depth) shooting mode. it can. In addition, each function shooting mode such as portrait shooting mode, landscape shooting mode, close-up shooting mode, sports shooting mode, night view shooting mode, panoramic shooting mode, and the like can be switched and set.

  Reference numeral 62 denotes a shutter switch SW1, which is turned on while a shutter button (not shown) is being operated (for example, half-pressed), and instructs to start operations such as AF processing, AE processing, AWB processing, and EF processing.

  A shutter switch SW2 64 is turned on when a shutter button (not shown) is completed (for example, fully pressed), and instructs the start of a series of processes including exposure processing, development processing, and recording processing. First, in the exposure process, a signal read from the image sensor 14 is written to the memory 30 via the A / D converter 16 and the memory control circuit 22, and further, an operation in the image processing circuit 20 and the memory control circuit 22 is used. Development processing is performed. Further, in the recording process, image data is read from the memory 30, compressed by the compression / decompression circuit 32, and written to the recording medium 200.

  An operation unit 70 includes various buttons and a touch panel. For example, live view start / stop button, movie recording start / stop button, menu button, set button, multi-screen playback page break button, flash setting button, single / continuous / self-timer switching button, menu movement + (plus ) Button, menu move-(minus) button. Furthermore, a playback image movement + (plus) button, a playback image movement-(minus) button, a photographing image quality selection button, an exposure correction button, a light adjustment correction button, an external flash emission amount setting button, a date / time setting button, and the like are also included. The functions of the plus button and the minus button can be selected more easily with numerical values and functions by providing a rotary dial switch.

  In addition, there is an image display ON / OFF switch for setting ON / OFF of the image display unit 28, and a quick review ON / OFF switch for setting a quick review function for automatically reproducing image data taken immediately after shooting. Further, there is a compression mode switch that is a switch for selecting a compression rate for JPEG compression or for selecting a RAW mode in which a signal from an image sensor is directly digitized and recorded on a recording medium. In addition, there is an AF mode setting switch that can set a one-shot AF mode and a servo AF mode. In the one-shot AF mode, an autofocus operation is started when the shutter switch SW1 (62) is pressed, and once focused, the focused state is maintained. In the servo AF mode, the autofocus operation is continued while the shutter switch SW1 (62) is being pressed.

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. The power supply control unit 80 detects the presence / absence of a battery, the type of battery, and the remaining battery level, controls the DC-DC converter based on the detection result and the instruction of the system control circuit 50, and requires the necessary voltage. It is supplied to each part including the recording medium for a period.

  Reference numerals 82 and 84 denote connectors, and 86 denotes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, NiMH battery, Li-ion battery or Li polymer battery, an AC adapter, or the like.

  Reference numeral 90 denotes a recording medium such as a memory card or hard disk or an interface with a PC, and reference numeral 92 denotes a connector for connecting to a recording medium such as a memory card or hard disk or the PC. A recording medium attachment / detachment detection circuit 98 detects whether or not the recording medium 200 is attached to the connector 92.

  As the interface and the connector, it is possible to configure using interfaces that comply with various storage medium standards. For example, it is a PCMCIA (Personal Computer Memory Card International Association) card, a CF (Compact Flash (registered trademark)) card, an SD card, or the like. When the interface 90 and the connector 92 are configured using a standard conforming to a PCMCIA card, a CF card, or the like, various communication cards can be connected. As the communication card, there are a LAN card, a modem card, a USB (Universal Serial Bus) card, and an IEEE (Institut of Electrical and Electronic Engineers) 1394 card. In addition, there are a P1284 card, a SCSI (Small Computer System Interface) card, a PHS, and the like. By connecting these various communication cards, image data and management information attached to the image data can be transferred to and from other computers and peripheral devices such as a printer.

  Reference numeral 104 denotes an optical viewfinder, which guides a light beam incident on the imaging lens 310 through an aperture 312, lens mounts 306 and 106, and mirrors 130 and 132 by a single-lens reflex method, and forms an optical image for display. it can. Thereby, it is possible to perform imaging using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. Further, in the optical viewfinder 104, some functions of the notification unit 54, for example, in-focus state, camera shake warning, flash charging, shutter speed, aperture value, exposure correction, and the like are displayed.

  Reference numeral 120 denotes an interface for connecting the camera body 100 to the lens unit 300 in the lens mount 106. A connector 122 electrically connects the camera body 100 to the lens unit 300. Further, whether or not the lens unit 300 is attached to the lens mount 106 and the connector 122 is detected by a lens attachment / detachment detection unit (not shown). The connector 122 transmits a control signal, a status signal, a data signal, and the like between the camera body 100 and the lens unit 300, and has a function of supplying currents of various voltages. Further, the connector 122 may be configured to perform communication by optical communication and voice communication as well as electrical communication.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, and the like, an interface 204 with the camera body 100, and a connector 206 for connecting with the camera body 100. As the recording medium 200, a memory card such as a PCMCIA card or compact flash (registered trademark), a hard disk, or the like can be used. Of course, it may be composed of a micro DAT, a magneto-optical disk, an optical disk such as a CD-R or CD-RW, a phase change optical disk such as a DVD.

  Hereinafter, a sequence that may cause a problem will be described with reference to FIG. For example, assuming a 4 fps moving image, if recording is performed in units of 2 fps as in S500, when the next moving image is shot, the moving images can be connected to form a single moving image, but at 2 fps as in S501. If it cannot be recorded, the next moving image can be taken, but the moving image cannot be connected and recorded according to the standard.

  The case where the first embodiment of the present invention is applied to a recording apparatus will be described below with reference to FIGS.

  The overall image of FIG. 3 will be described using a flowchart. First, in S100, image and moving image recording is started by the operation member. When this is started, an imaging process for performing photoelectric conversion on the light input to the image recording apparatus is performed in S101, and a predetermined image process is performed in S102 to complete the development process. Then, a video format conversion process is performed on the image that has passed through the development processing means in step S103 so as to suit various video formats. In S104, frame rate adjustment, which is the basis of the present invention, is performed, and in S105, the moving image adjusted in frame rate is recorded on the card.

  The frame amount adjustment in FIG. 4 will be described using a flowchart. First, frame amount adjustment is started in S200. In S201, the number of determinations for determining whether to extend or delete the reference frame in S203 is determined. For example, the frame rate may be half of the frame rate here.

  Next, in step S202, the number of processed sheets corresponding to the determined number of sheets determined in step S201 is determined for each of a case where the number of processes is extended and a case of deletion. In S203, a policy for extending or deleting frames is determined in consideration of the respective numbers determined in S202.

  In S204, a determination process for each frame is performed to determine which frame is to be processed according to the policy determined in S203. In S205, it is determined whether or not the number of processed sheets is the same as the number of processed sheets determined by the combination of S202 and S203. As a result, if they are the same, the process proceeds to S207 to end the frame rate adjustment. However, if the number of sheets processed as a result of S205 is smaller than the number of sheets processed determined by the combination of S202 and S203, the process returns to S204 and is executed again.

  The determination of the policy for extending or deleting information in FIG. 5 will be described with reference to a flowchart. First, policy determination processing is started in S300. In S301, it is determined whether the number of processed sheets is smaller or larger than half the number of GOPs. If the result is larger, the policy is determined to be extended in S303, and if it is smaller, the policy is determined to be deleted in S302, and the policy determination of the deletion is ended in S304.

  The determination process for each frame in FIG. 6 will be described using a flowchart. In addition, here, since it is an embodiment, the description will be limited to the sequence to be extended.

  First, determination processing for each frame is started in S400. In step S401, a determination is made regarding motion determination. If the movement is small, the frame is copied in S404 to be extended, the addition processing is performed on the number of processed sheets in S405, and the determination process for each frame is ended in S406. This is to prevent the generation of a moving image in which the movement stops momentarily in a scene that moves violently when a frame with a large movement is extended. If the movement is large, the process proceeds to S402 for determining the in-focus state without extending the frame. In this case, even if an out-of-focus image, that is, an out-of-focus image, is extended, a meaningless frame increases. From the viewpoint of waste to the user, a policy of extending the image in focus is taken. In step S402, the in-focus state is acquired. In step S404, the frame is copied to extend the image. In step S405, the number of processed images is added. This completes the determination process for each frame. Further, it is determined that the image that is out of focus is not extended, and the process proceeds to the exposure determination of S403.

  In the exposure determination in S403, for example, the determination is performed by looking at the luminance difference between frames. When the luminance difference between frames is equal to or more than a preset threshold value as in the case of movement, if the frame is extended, the time during which the luminance changes is affected. Therefore, the extension processing is performed on a frame with a small luminance difference. If the exposure difference is greater than or equal to a preset threshold when the exposure determination is performed in S403, the determination process for each frame is terminated in S406, and if the exposure difference is small, the frame is copied in S404. In step S405, an addition process is performed on the number of processed sheets. In step S406, the determination process for each frame is completed.

  For example, if it is considered that the motion is the main video in the entire video and it will be inconvenient for the user if the motion judgment is made, the process of extending by the motion judgment is omitted and the process of extending the focus by the focus judgment and exposure judgment instead. It is possible to implement.

  According to the present embodiment, without giving the user a sense of incongruity, it is determined whether each frame is to be extended or deleted by looking at the progress status with respect to the frame rate, looking at the exposure difference, luminance difference, motion detection, and focus status. It is possible to provide a recording apparatus that can be adapted to a unit.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

100 camera body, 300 lens unit

Claims (1)

Recording means for converting the input video signal into a video format and recording;
Means for calculating progress relative to the frame rate;
Means for extending the frame to fit the GOP unit of the video,
Means to reduce the frame to fit the GOP unit of the video,
A means of deciding whether to extend or reduce,
A recording apparatus comprising means for determining which frame is to be processed based on a situation of a still image.