JP2013046259A - Video apparatus, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video apparatus, a control method, and a program that enable photographing or reproduction responsive to motion of a subject.SOLUTION: A video apparatus comprises: a motion detection unit 151 that detects a motion vector of a subject in a moving picture corresponding to moving picture data generated at a first frame rate; and a frame rate control unit 153 that changes the frame rate of the moving picture data depending on an amount of change in the motion vector of the subject detected by the motion detection unit 151.

Description

  The present invention relates to a video device, a control method, and a program that generate image data by imaging a subject and performing photoelectric conversion.

  In recent years, video equipment such as digital cameras and digital video cameras can perform shooting suitable for various shooting scenes or playback suitable for various viewing scenes. For example, a technique is known in which golf swings are continuously photographed at predetermined time intervals, and the image size and the position displayed on the display monitor are rearranged and displayed at each photographed time interval (see Patent Document 1). ).

  Further, a technique is known in which the rate of change between two consecutive frames in moving image data is detected, and the speed at which moving image data is reproduced is adjusted according to the detected rate (see Patent Document 2).

JP 2000-13734 A JP-A-11-355729

  However, the technique described above does not consider changing the shooting speed or the playback speed according to the movement of the subject. For this reason, there has been a demand for a technique that can change the photographing speed or the reproduction speed in accordance with the movement of the subject.

  The present invention has been made in view of the above, and an object of the present invention is to provide a video device, a control method, and a program that can perform shooting or reproduction according to the movement of a subject.

  In order to solve the above-described problems and achieve the object, a video apparatus according to the present invention includes a motion detection unit that detects a motion vector of a subject in a moving image corresponding to the moving image data generated at the first frame rate. A frame rate control unit that changes a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection unit.

  Further, the video equipment according to the present invention, in the above invention, an imaging unit that generates the moving image data by imaging the subject and continuously generating electronic image data at the first frame rate; A storage unit that stores the moving image data generated by the imaging unit, wherein the frame rate control unit changes a frame rate of the image data generated by the imaging unit.

  Further, in the video equipment according to the present invention, in the above invention, the frame rate control unit is configured such that when the change amount of the motion vector of the subject detected by the motion detection unit is equal to or greater than a first threshold, the imaging unit The frame rate of the image data to be generated is set to a second frame rate faster than the first frame rate.

  Further, in the video equipment according to the present invention, in the above invention, the frame rate control unit is configured such that when the change amount of the motion vector of the subject detected by the motion detection unit is greater than or equal to a first threshold value, the storage unit The number of frame rates of the image data to be stored is thinned and stored.

  The video equipment according to the present invention further includes a still image generation unit that generates still image data from the image data generated by the imaging unit in the above invention, and the frame rate control unit is controlled by the motion detection unit. When the detected change amount of the motion vector of the subject is equal to or greater than a second threshold value that is greater than the first threshold value, the still image generation unit is configured to generate the still image data.

  Further, in the video equipment according to the present invention, in the above invention, the still image generation unit is configured so that a change amount of a motion vector of a subject in a moving image corresponding to the moving image data stored in the storage unit by the motion detection unit is When the image data that is greater than or equal to a second threshold is included, at least one or more of the image data that is greater than or equal to the second threshold is acquired from the moving image data stored in the storage unit to generate the still image data It is characterized by that.

  The video equipment according to the present invention further includes a storage unit that stores the moving image data, and a display unit that displays a moving image corresponding to the moving image data stored in the storage unit. The rate control unit changes a frame rate of the moving image displayed by the display unit.

  Further, in the video equipment according to the present invention, in the above invention, the frame rate control unit is configured such that when the change amount of the motion vector of the subject detected by the motion detection unit is greater than or equal to a first threshold value, the display unit The frame rate of the moving image to be displayed is set to a third frame rate lower than the first frame rate.

  The control method according to the present invention is a control method executed by the video equipment, and is a control method executed by the video equipment, the subject in the video corresponding to the video data generated at the first frame rate. A motion detection step of detecting a motion vector of the subject, and a frame rate control step of changing a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection step. And

  The program according to the present invention is a program to be executed by a video device, and is a program to be executed by a video device, and is a motion vector of a subject in a video corresponding to video data generated at a first frame rate. And a frame rate control step of changing a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection step. .

  According to the present invention, the motion detection unit detects a motion vector of a subject in a video corresponding to the video data generated at a predetermined frame rate, and the frame rate control unit detects the motion vector of the subject detected by the motion detection unit. The frame rate of the moving image data is changed according to the amount of change. As a result, it is possible to perform shooting or reproduction according to the movement of the subject.

FIG. 1 is a block diagram showing the configuration of the video equipment according to the first embodiment of the present invention. FIG. 2 is a flowchart illustrating an outline of processing performed by the video equipment according to the first embodiment of the present invention. FIG. 3 is a flowchart showing an outline of the photographing process of FIG. FIG. 4 is a diagram schematically illustrating a situation of a subject photographed by the video equipment according to the first embodiment of the present invention. FIG. 5 is a diagram illustrating a timing chart of photographing processing by the video equipment according to the first embodiment of the present invention. FIG. 6 is a flowchart showing an outline of the reproduction display process of FIG. FIG. 7 is a flowchart showing an outline of a photographing process performed by the video equipment according to the second embodiment of the present invention. FIG. 8 is a diagram illustrating a timing chart of the photographing process by the video equipment according to the second embodiment of the present invention. FIG. 9 is a flowchart showing an outline of a photographing process performed by the video equipment according to the third embodiment of the present invention. FIG. 10 is a block diagram showing the configuration of the video equipment according to the fourth embodiment of the present invention. FIG. 11 is a flowchart showing an outline of processing performed by the video equipment according to the fourth embodiment of the present invention. FIG. 12 is a diagram schematically illustrating the amount of change in the subject vector included in the moving image played back by the video apparatus according to the fourth embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. Note that the present invention is not limited to the embodiments. In the description of the drawings, the same portions are denoted by the same reference numerals for description.

(Embodiment 1)
FIG. 1 is a block diagram showing the configuration of the video equipment according to the first embodiment of the present invention. A video device 1 shown in FIG. 1 includes a lens unit 2, a diaphragm unit 3, a shutter unit 4, an imaging unit 5, a still image generation unit 6, a moving image generation unit 7, a buffer 8, and a storage unit 9. A reproduction image generation unit 10, a display unit 11, a power supply unit 12, an operation unit 13, a bus 14, and a control unit 15.

  The lens unit 2 is configured by using one or a plurality of lenses, a motor, and the like, and collects light from a predetermined visual field region and forms an image on the imaging unit 5. The lens unit 2 has an optical zoom function for changing the angle of view and a focus function for adjusting the focus. The lens unit 2 moves the lens along the optical axis O1 in accordance with an instruction signal input from the control unit 15 via the bus 14, thereby changing the focus position, the angle of view, and the like of the lens unit 2. Do.

  The diaphragm unit 3 is configured using diaphragm blades, a motor, and the like, and adjusts the exposure by limiting the amount of incident light collected by the lens unit 2. The diaphragm 3 is driven in accordance with an instruction signal input from the controller 15 via the bus 14.

  The shutter unit 4 sets the state of the imaging unit 5 to an exposure state or a light shielding state. The shutter unit 4 is configured using a focal plane shutter, a stepping motor, or the like, and is driven according to an instruction signal input from the control unit 15.

  The imaging unit 5 receives an image collected by the lens unit 2 and converts it into an electrical signal, such as an CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and an analog signal output from the imaging device. A signal processing unit that performs analog processing, such as noise reduction processing and gain increase processing, and A / D conversion of analog signals output from the signal processing unit generates digital image data. / D conversion unit. The imaging unit 5 continuously generates image data at a predetermined frame rate in response to an instruction signal input from the control unit 15 via the bus 14, and generates the image data in the order of generation, the still image generation unit 6 or the moving image generation Output to unit 7.

  The still image generation unit 6 is configured using an image processing engine, and generates still image data by performing various types of image processing on the image data output from the imaging unit 5. Specifically, the still image generation unit 6 performs optical black subtraction processing, white balance adjustment processing, synchronization processing, color matrix calculation processing, γ correction processing, and color reproduction processing on the image data output from the imaging unit 5. Image processing including edge enhancement processing and the like is performed to generate still image data. The still image generation unit 6 outputs still image data to the buffer 8 or the moving image generation unit 7 in accordance with an instruction signal input from the control unit 15 via the bus 14. The still image generation unit 6 compresses still image data by a predetermined method, for example, JPEG (Joint Photographic Experts Group) method, and outputs the compressed data to the buffer 8.

  The moving image generation unit 7 is configured using an image processing engine, and generates moving image data by performing various image processing on the image data output from the imaging unit 5. Specifically, the moving image generation unit 7 generates moving image data by sequentially performing predetermined image processing on the image data continuously output from the imaging unit 5. As the image processing performed by the moving image generation unit 7, the same image processing as that of the still image generation unit 6 is performed. The moving image generating unit 7 generates image data constituting the moving image data by performing resizing processing on the still image data input from the still image generating unit 6. Specifically, the moving image generation unit 7 generates image data constituting the moving image data by performing a resizing process on the still image data with an image size of 1920 × 1080. The moving image generation unit 7 compresses the moving image data according to the Motion JPEG method or the MP4 (H.264) method and outputs the compressed data to the buffer 8.

  The buffer 8 is configured using a volatile memory, and temporarily stores information being processed by the control unit 15. The buffer 8 temporarily stores still image data generated by the still image generating unit 6 or image data groups as moving image data continuously generated by the moving image generating unit 7, thereby transferring data to the storage unit 9. Is executed without delay.

  The storage unit 9 is realized using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory) that is fixedly provided inside the video equipment 1. The storage unit 9 stores various programs for operating the video equipment 1 and various data and parameters used during the execution of the programs. The storage unit 9 stores still image data and moving image data. The storage unit 9 may include a computer-readable storage medium such as a memory card mounted from the outside.

  The reproduction image generation unit 10 expands the compressed still image data or moving image data stored in the storage unit 9 to generate reproduction image data, and outputs the reproduction image data to the display unit 11.

  The display part 11 is implement | achieved using the display panel which consists of a liquid crystal or organic EL (Electro Luminescence). The display unit 11 displays a still image corresponding to still image data or a moving image corresponding to moving image data. The display unit 11 displays information related to the shooting video of the video device 1 and shooting information related to shooting.

  The power supply unit 12 is connected to each component unit constituting the video equipment 1 and supplies power to each component unit. The power supply unit 12 smoothes and boosts a voltage output of a battery (not shown) attached to the video equipment 1 to a predetermined DC voltage, and supplies power to each component unit.

  The operation unit 13 includes a power switch (not shown) that switches the power state of the video equipment 1 to an on state or an off state, a still image switch 131 that receives an input of a still image release signal that gives a still image shooting instruction, and a moving image A moving image switch 132 that accepts an input of a moving image release signal that gives an instruction to shoot, a reproduction switch 133 that gives an instruction to reproduce and display still image data or moving image data stored in the storage unit 9, and a still image displayed on the display unit 11 A frame advance switch 134 that gives an instruction to switch the image to the next still image, and a frame return switch 135 that gives an instruction to switch the still image displayed on the display unit 11 to the previous still image. Note that a touch panel may be provided on the display unit 11 as a part of the operation unit 13 so that the photographer can input an operation signal on the screen of the display unit 11.

  The bus 14 is configured using a transmission path or the like that connects each component of the video equipment 1. The bus 14 transfers various data generated inside the video equipment 1 to each component of the video equipment 1.

  The control unit 15 is configured using a CPU (Central Processing Unit) or the like. The control unit 15 performs overall control of the operation of the video device 1 by performing instructions, data transfer, and the like corresponding to each unit constituting the video device 1 via the bus 14.

  A detailed configuration of the control unit 15 will be described. The control unit 15 includes a motion detection unit 151, a change amount determination unit 152, and a frame rate control unit 153.

  The motion detection unit 151 detects a motion vector of a subject in a moving image corresponding to the moving image data generated at a predetermined frame rate. Specifically, the motion detection unit 151 detects a feature point of the subject included in each of the images that move back and forth in time series, and based on the detected difference (for example, pixel difference) of the subject feature point, Detect vectors. The characteristic points of the subject include luminance information and color information. Further, the motion detection unit 151 may detect a motion vector of the subject selected according to an instruction signal or the like input via the operation unit 13. Furthermore, the motion detection unit 151 may detect the motion vector of the subject by pattern matching or other known techniques.

  The change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is greater than or equal to the first threshold value. The change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold. The first threshold value is set to a value smaller than the second threshold value. Furthermore, the first threshold value and the second threshold value can be set as appropriate.

  The frame rate control unit 153 changes the frame rate of the moving image data according to the change amount of the motion vector of the subject detected by the motion detection unit 151. Specifically, the frame rate control unit 153 determines the frame rate of the image data continuously generated by the imaging unit 5 when the amount of change in the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the first threshold. For example, the first frame rate (30 fps) is changed to a second frame rate (60 fps) faster than the first frame rate. The frame rate control unit 153 sends image data to the imaging unit 5 when the video device 1 is shooting a moving image and the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold. By outputting to the still image generation unit 6, the still image generation unit 6 generates still image data.

  For the video apparatus 1 having the above configuration, an audio input / output function, a flash function, a detachable electronic viewfinder (EVF), and an external processing device (not shown) such as a personal computer via the Internet are bidirectional. May be provided with a communication function capable of communication.

  Next, operations performed by the video equipment 1 will be described. FIG. 2 is a flowchart illustrating an outline of processing performed by the video equipment 1 according to the first embodiment.

  As shown in FIG. 2, the case where the power source of the video equipment 1 is on (step S101: Yes) and the video equipment 1 is set to the shooting mode (step S102: Yes) will be described. In this case, the video equipment 1 captures image data that the still image generation unit 6 or the moving image generation unit 7 performs image processing on the image data that the imaging unit 5 continuously generates at a minute time interval and stores the image data in the storage unit 9. Processing is executed (step S103). The details of the photographing process will be described later. After step S103, the video equipment 1 returns to step S101.

  A case where the video equipment 1 is not set to the shooting mode in step S102 (step S102: No) will be described. In this case, the video equipment 1 executes a reproduction process for displaying still image data or moving image data stored in the storage unit 9 on the display unit 11 (step S104). The content of the reproduction process will be described later. After step S104, the video equipment 1 returns to step S101.

  A case where the power source of the video equipment 1 is not on in step S101 (step S101: No) will be described. In this case, the video equipment 1 ends this process.

  Next, the photographing process described in step S103 in FIG. 2 will be described. FIG. 3 is a flowchart showing an outline of the photographing process. FIG. 4 is a diagram schematically illustrating a situation of a subject photographed by the video equipment 1. FIG. 5 is a diagram illustrating a timing chart of shooting processing by the video equipment 1. FIG. 4 shows a situation in which moving images are taken when the subject turns leftward while skiing down from left to right while skiing. FIG. 5A shows moving image shooting timing at which the imaging unit 5 generates moving image data. FIG. 5B shows the shooting timing of still image shooting. FIG. 5C shows the timing of moving image storage for storing the image data generated by the imaging unit 5 as moving image data.

  As shown in FIG. 3, the control unit 15 determines whether or not the video equipment 1 has started moving image shooting (step S201). Specifically, the control unit 15 determines whether or not a moving image shooting start instruction signal is input from the moving image switch 132 by operating the moving image switch 132. When the control unit 15 determines that the video equipment 1 has started moving image shooting (step S201: Yes), the video equipment 1 proceeds to step S202 described later. On the other hand, when the control unit 15 determines that the video device 1 has not started moving image shooting (step S201: No), the video device 1 proceeds to step S213 described later.

  In step S <b> 202, the imaging unit 5 generates image data under the control of the control unit 15.

  Subsequently, the motion detection unit 151 detects a motion vector of the subject in the image corresponding to the image data generated by the imaging unit 5 via the bus 14 (step S203).

  Thereafter, the change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is greater than or equal to the first threshold (step S204). When the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the first threshold (step S204: Yes), the video equipment 1 proceeds to step S205. On the other hand, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is not equal to or greater than the first threshold (step S204: No), the video apparatus 1 proceeds to step S206. .

In step S205, the frame rate control unit 153 increases the shooting speed of moving image shooting by the imaging unit 5 (step S205). Specifically, as shown in FIGS. 4 and 5, the frame rate control unit 153 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 within the time t _n in FIGS. When the change amount determination unit 152 determines that the threshold value is 1 or more, the frame rate of the moving image data generated by the imaging unit 5 is changed from, for example, 30 fps to 60 fps to increase the shooting speed of moving image shooting. This makes it possible to capture a large amount of image data of a scene (time t _{n in} FIG. 4) in which the subject changes drastically compared to a scene where the subject is monotonous (time t _l or time t _{m in} FIG. 4). As a result, it is possible to reproduce in slow motion a scene where the subject changes drastically when the moving image data is reproduced.

In step S206, the change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is less than the first threshold value. When the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is less than the first threshold (step S206: Yes), the frame rate control unit 153 uses the imaging unit 5 The shooting speed of moving image shooting is returned to the state at the start of shooting (step S207). Specifically, as shown in FIGS. 4 and 5, the frame rate control unit 153 sets the frame rate of the imaging unit 5 raised at time t _n in FIGS. Frame rate: 30 fps) to return the shooting speed of moving image shooting to the shooting speed at the start of shooting. Thereafter, the video equipment 1 proceeds to step S208. On the other hand, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is not less than the first threshold (step S206: No), the video apparatus 1 proceeds to step S208. .

  Subsequently, the change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is greater than or equal to the second threshold value. When the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold (step S208: Yes), the frame rate control unit 153 includes the still image generation unit. 6, the image data is acquired from the imaging unit 5 to generate still image data, which is stored in the storage unit 9 (step S209). As a result, it is possible to shoot in a scene where the subject moves most intensely, so that powerful still image data can be stored in the storage unit 9. Thereafter, the video equipment 1 proceeds to step S210.

  In step S208, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is not equal to or greater than the second threshold (step S208: No), the video equipment 1 goes to step S210. Transition.

  In step S <b> 210, the frame rate control unit 153 causes the moving image generation unit 7 to acquire image data from the imaging unit 5, generates image data as moving image data, and stores the image data in the storage unit 9. Thereafter, the video equipment 1 proceeds to step S211.

  Subsequently, the control unit 15 determines whether or not a moving image shooting end operation has been performed (step S211). Specifically, the control unit 15 determines whether or not the moving image switch 132 has been operated. When the control unit 15 determines that the movie shooting end operation has been performed (step S211: Yes), the video apparatus 1 proceeds to step S212. On the other hand, when the control unit 15 determines that the moving image shooting end operation has not been performed (step S211: No), the video apparatus 1 returns to step S202.

  In step S212, the video equipment 1 stops moving image shooting (step S212), and returns to the main routine of FIG.

  A case where the control unit 15 determines in step S201 that the video equipment 1 has not started moving image shooting (step S201) will be described. In this case, the control unit 15 determines whether or not the shooting mode of the video equipment 1 has ended (step S213). Specifically, the control unit 15 determines whether or not the regeneration switch 133 has been operated. When the control unit 15 determines that the shooting mode of the video equipment 1 has ended (step S213: Yes), the video equipment 1 returns to the main routine of FIG. On the other hand, when the control unit 15 determines that the shooting mode of the video equipment 1 has not ended (step S213: No), the video equipment 1 returns to step S201.

  Next, the reproduction display process described in step S104 in FIG. 2 will be described. FIG. 6 is a flowchart showing an outline of the reproduction display process.

  As shown in FIG. 6, the control unit 15 causes the display unit 11 to display a list of reduced images (thumbnail images) obtained by reducing the images corresponding to the image data of each image file stored in the storage unit 9 (step S301). .

  Subsequently, when a reduced image of the image file to be enlarged and displayed is selected via the operation unit 13 (step S302: Yes), the control unit 15 stores the data stored in the selected image file as moving image data. It is determined whether or not there is (step S303). When the control unit 15 determines that the data stored in the selected image file is moving image data (step S303: Yes), the video equipment 1 proceeds to step S304 described later. On the other hand, when the control unit 15 determines that the data stored in the selected image file is not moving image data (step S303: No), the video equipment 1 proceeds to step S310 described later.

  In step S304, the control unit 15 expands the moving image data stored in the selected image file in the reproduction image generation unit 10, displays the moving image corresponding to the expanded moving image data on the display unit 11, and reproduces it.

  Subsequently, the control unit 15 determines whether there is still image data in the moving image data (step S305). When the control unit 15 determines that there is still image data in the moving image data (step S305: Yes), the video equipment 1 proceeds to step S306 described later. On the other hand, when the control unit 15 determines that there is no still image data in the moving image data (step S305: No), the video equipment 1 proceeds to step S308 described later.

  In step S <b> 306, the control unit 15 determines whether it is a reproduction timing for displaying still image data on the display unit 11. When the control unit 15 determines that it is the reproduction timing for displaying the still image data on the display unit 11 (step S306: Yes), the control unit 15 selects the still image corresponding to the still image data for a predetermined time (for example, 3 seconds). Is displayed on the display unit 11 (step S307). Thereafter, the video equipment 1 proceeds to step S308. On the other hand, when the control unit 15 determines that it is not the reproduction timing for displaying the still image data on the display unit 11 (step S306: No), the video equipment 1 proceeds to step S308.

  Subsequently, the control unit 15 determines whether or not the moving image has ended (step S308). When the control unit 15 determines that the moving image has ended (step S308: Yes), the video apparatus 1 proceeds to step S309. On the other hand, when the control unit 15 determines that the moving image has not ended (step S308: No), the video equipment 1 returns to step S304.

  Subsequently, the control unit 15 determines whether or not the playback mode of the video equipment 1 has ended (step S309). Specifically, the control unit 15 determines whether or not the playback mode has been canceled by operating the playback switch 133 while the display unit 11 is displaying a still image or a moving image. When the control unit 15 determines that the playback mode of the video equipment 1 has ended (step S309: Yes), the video equipment 1 returns to the main routine of FIG. On the other hand, when the control unit 15 determines that the playback mode of the video equipment 1 has not ended (step S309: No), the video equipment 1 returns to step S301.

  In step S310, the control unit 15 causes the reproduction image generation unit 10 to expand the still image data stored in the selected image file, and causes the display unit 11 to display a still image corresponding to the expanded still image data.

  Subsequently, the control unit 15 determines whether or not a frame advance instruction signal for switching a still image or a moving image displayed on the display unit 11 is input by operating the frame advance switch 134 (step S311). ). When the frame advance instruction signal is input (step S311: Yes), the control unit 15 switches to the next image file (step S312). Thereafter, the video equipment 1 returns to step S303. On the other hand, when the frame advance instruction signal is not input within a predetermined time (for example, 3 seconds) (step S311: No), the video equipment 1 proceeds to step S309.

  In step S302, when the reduced image of the image file to be enlarged and displayed is not selected via the operation unit 13 (step S302: No), the video equipment 1 returns to step S301.

  According to Embodiment 1 of the present invention described above, the motion detection unit 151 detects the motion vector of the subject in the image corresponding to the image data continuously generated by the imaging unit 5, and the frame rate control unit 153. The frame rate of the image data generated by the imaging unit 5 is changed according to the amount of change in the motion vector of the subject detected by the motion detection unit 151. As a result, it is possible to perform shooting according to the movement of the subject.

  Furthermore, according to Embodiment 1 of the present invention, when the video equipment 1 reproduces the moving image data captured by the moving image, the user can slowly see the quick movement of the subject. Furthermore, in the conventional technique, when the movement of the subject is reproduced in slow motion, the video is intermittent (an intermittent video). On the other hand, according to the first embodiment of the present invention, the subject's quick movement is obtained. Even if it is played back in slow motion, it can be played back smoothly.

  In the first embodiment of the present invention, the case where the video apparatus 1 performs moving image shooting has been described. For example, when shooting a still image, the display unit 11 displays image data continuously generated by the imaging unit 5. It can also be applied when displaying a corresponding live view image.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The second embodiment of the present invention is different only in the shooting process of the operation performed by the video device according to the first embodiment, and the configuration of the video device has the same configuration as the video device according to the above-described embodiment. For this reason, in the following, only the photographing processing by the video equipment according to the second embodiment of the present invention will be described. In the description of the drawings, the same portions are denoted by the same reference numerals.

  FIG. 7 is a flowchart showing an outline of the photographing process (step S103 in FIG. 2) performed by the video equipment 1 according to the second embodiment. FIG. 8 is a diagram illustrating a timing chart of shooting processing by the video equipment 1. FIG. 8A shows moving image shooting timing at which the imaging unit 5 generates moving image data. FIG. 8B shows the shooting timing of still image shooting. FIG. 8C shows moving image storage timing for storing image data generated by the imaging unit 5 as moving image data. In FIG. 8, the frame rate of the image data generated by the imaging unit 5 will be described at 60 fps.

  As shown in FIG. 7, steps S401 to S404 respectively correspond to steps S201 to S204 in FIG.

In step S <b> 405, the frame rate control unit 153 starts thinning out the number of image data that the moving image generation unit 7 performs image processing on the image data generated by the imaging unit 5 and stores the image data in the storage unit 9. Specifically, as shown in FIG. 8, the frame rate control unit 153 determines that the amount of change in the motion vector of the subject detected by the motion detection unit 151 within the time t ₁ and the time t _m in FIG. When the change amount determination unit 152 determines that it is less than the threshold value, the number of the plurality of image data generated by the imaging unit 5 is changed by changing the number of frames of the image data stored in the storage unit 9 from 60 fps to 30 fps. Perform thinning process. Thereafter, the video equipment 1 proceeds to step S406. Step S406 corresponds to step S206 in FIG.

In step S <b> 407, the frame rate control unit 153 stops the thinning of the image data that the moving image generation unit 7 performs image processing on the image data generated by the imaging unit 5 and stores the image data in the storage unit 9. Specifically, as illustrated in FIG. 8, the frame rate control unit 153 is configured such that the moving image generation unit 7 performs image processing on the image data generated by the imaging unit 5 within the time t _n in FIG. The frame rate of the image data generated by the imaging unit 5 is synchronized with the number of image data stored in 9. For example, the frame rate control unit 153 stops decimation of the number of image data to be stored in the storage unit 9 by changing the frame rate from 30 fps to 60 fps.

  Steps S408 to S413 correspond to steps S208 to S213 in FIG.

  According to the second embodiment of the present invention described above, the motion detection unit 151 detects the motion vector of the subject in the image corresponding to the image data continuously generated by the imaging unit 5, and the frame rate control unit 153. The number of image data stored in the storage unit 9 is changed according to the amount of change in the motion vector of the subject detected by the motion detection unit 151. As a result, it is possible to perform shooting according to the movement of the subject.

  Furthermore, according to the second embodiment of the present invention, the number of image data stored in the storage unit 9 is synchronized with the frame rate of the image data generated by the imaging unit 5 only in a scene where the subject changes rapidly. 9 can be reduced in storage capacity, and the processing load on the moving image generating unit 7 can be reduced.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. The third embodiment of the present invention is different only in the shooting processing performed by the video equipment according to the above-described embodiment, and the configuration of the video equipment has the same configuration as the video equipment according to the above-described embodiment. For this reason, in the following, only the photographing processing by the video equipment according to the third embodiment of the present invention will be described.

  FIG. 9 is a flowchart showing an outline of the photographing process (step S103 in FIG. 2) performed by the video equipment 1 according to the third embodiment.

  As shown in FIG. 9, steps S501 to S507 correspond to steps S201 to S207 in FIG. Steps S508 to S509 correspond to steps S210 to S211 in FIG. Step S514 corresponds to step S213 in FIG.

  In step S <b> 510, the motion detection unit 151 detects the motion vector of the subject with respect to moving image data composed of a series of image data generated in moving image shooting stored in the storage unit 9.

  Subsequently, the change amount determination unit 152 determines whether there is image data in which the change amount of the motion vector of the subject detected by the motion detection unit 151 is greater than or equal to the second threshold (step S511). When the change amount determination unit 152 determines that there is image data in which the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold (step S511: Yes), the video equipment 1 performs step S512. Migrate to On the other hand, when the change amount determination unit 152 determines that there is no image data in which the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold (step S511: No), the video equipment 1 Returning to the main routine of FIG.

  In step S512, the still image generation unit 6 acquires at least one frame of image data equal to or greater than the second threshold detected by the motion detection unit 151 from the storage unit 9 via the bus 14, and 1 frame of the acquired image data Are subjected to resizing processing and image processing to generate still image data.

  Thereafter, the storage unit 9 stores the still image data generated by the still image generation unit 6 (step S513), and the video equipment 1 returns to the main routine of FIG.

  According to the third embodiment of the present invention described above, the motion detection unit 151 detects the motion vector of the moving image subject corresponding to the moving image data stored in the storage unit 9 after the end of the moving image shooting, and the frame rate control unit. When the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the second threshold value 153, image data equal to or greater than the second threshold value is obtained from the moving image data stored in the storage unit 9 in the still image generation unit 6. At least one or more are acquired to generate still image data. Thus, after the moving image shooting is completed, the still image generation unit 6 generates the still image data, so that no waiting time until the moving image shooting is resumed is generated. As a result, shooting can be performed without interrupting moving image shooting.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described. The video equipment according to the fourth embodiment of the present invention includes an input unit instead of the lens unit, the diaphragm unit, the shutter unit, and the imaging unit. Further, the operation by the video equipment according to the fourth embodiment of the present invention is different. For this reason, in the following, after describing a configuration different from the above-described embodiment, the operation of the video equipment according to the fourth embodiment of the present invention will be described. In the description of the drawings, the same portions are denoted by the same reference numerals.

  FIG. 10 is a block diagram of the configuration of the video equipment according to the fourth embodiment. As shown in FIG. 10, the video equipment 20 according to the fourth embodiment includes a storage unit 9, a reproduction image generation unit 10, a display unit 11, an operation unit 13, a power supply unit 12, a bus 14, and a control. Unit 15 and input unit 21.

  The input unit 21 is configured using an input interface, and a storage medium such as a memory card mounted from the outside is mounted. The input unit 21 outputs still image data or moving image data stored in a storage medium attached via the bus 14 to the reproduction image generation unit 10 or the storage unit 9. The input unit 21 may be a communication interface that performs bidirectional communication with an external device (not shown) such as a personal computer via the Internet.

  An operation performed by the video equipment 20 having the above configuration will be described. FIG. 11 is a flowchart illustrating an outline of processing performed by the video equipment 20 according to the fourth embodiment.

  As illustrated in FIG. 11, the control unit 15 determines whether or not the power of the video equipment 20 is on (step S601). When the control unit 15 determines that the power source of the video equipment 20 is on (step S601: Yes), the video equipment 20 proceeds to step S602. On the other hand, when the control unit 15 determines that the power source of the video equipment 20 is not on (step S601: No), the video equipment 20 ends this process.

  In step S602, the control unit 15 causes the display unit 11 to display a list of reduced images obtained by reducing images corresponding to the image data of each image file stored in the storage unit 9 (step S602).

  Subsequently, when a reduced image of the image file to be enlarged and displayed is selected via the operation unit 13 (step S603: Yes), the control unit 15 stores the data stored in the selected image file as moving image data. It is determined whether or not there is (step S604). When the control unit 15 determines that the data stored in the selected image file is moving image data (step S604: Yes), the video equipment 20 proceeds to step S605 described later. On the other hand, when the control unit 15 determines that the data stored in the selected image file is not moving image data (step S604: No), the video equipment 20 proceeds to step S612 described later.

  In step S605, the control unit 15 expands the operation data stored in the selected image file in the reproduction image generation unit 10, and displays the moving image corresponding to the expanded moving image data on the display unit 11.

  Subsequently, the motion detection unit 151 detects a motion vector of the subject included in the moving image displayed by the display unit 11 (step S606). In this case, the motion detection unit 151 may detect the motion vector of the subject set by the operation unit 13 for the subject in the moving image displayed by the display unit 11.

  Thereafter, the change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is greater than or equal to the first threshold (step S607). When the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is equal to or greater than the first threshold (step S607: Yes), the video equipment 20 proceeds to step S608. On the other hand, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is not equal to or greater than the first threshold (step S607: No), the video equipment 20 proceeds to step S609. .

  In step S608, the frame rate control unit 153 performs a process of reducing the playback speed of the moving image displayed on the display unit 11. Specifically, as shown in FIG. 12, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject is equal to or greater than the first threshold, the frame rate control unit 153 displays the display unit 11. For example, a process for slowing down the playback speed of the moving picture by changing the playback frame rate of the moving picture from the first frame rate (30 fps) to a third frame rate (15 fps) lower than the first frame rate. Do.

  Subsequently, the change amount determination unit 152 determines whether or not the change amount of the motion vector of the subject detected by the motion detection unit 151 is less than the first threshold (step S609). When the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is less than the first threshold (step S609: Yes), the frame rate control unit 153 is displayed on the display unit 11. Processing for returning the playback speed of the displayed moving image is performed (step S610). Specifically, the frame rate control unit 153 performs processing for returning the playback speed of the moving image by changing the playback frame rate of the moving image displayed on the display unit 11 from the third frame rate to the first frame rate. Do. Thereafter, the video equipment 20 proceeds to step S611. On the other hand, when the change amount determination unit 152 determines that the change amount of the motion vector of the subject detected by the motion detection unit 151 is not less than the first threshold (step S609: No), the video equipment 20 proceeds to step S611. .

  Thereafter, the control unit 15 determines whether or not the moving image data of the moving image displayed on the display unit 11 has ended (step S611). If the control unit 15 determines that the moving image data of the moving image has ended (step S611: Yes), the video equipment 20 returns to step S601. On the other hand, when the control unit 15 determines that the moving image data of the moving image has not ended (step S611: No), the video equipment 20 returns to step S606.

  Steps S612 to S614 correspond to steps S310 to S312 of FIG.

  In step S615, the control unit 15 determines whether or not a frame return instruction signal for switching between a still image or a moving image displayed on the display unit 11 is input by operating the frame return switch 135 (step S615). S615). When the frame return instruction signal is input (step S615: Yes), the control unit 15 switches to the previous image file (step S616). Thereafter, the video equipment 20 returns to step S604. On the other hand, when the control unit 15 determines that the frame return instruction signal has not been input within a predetermined time (eg, 3 seconds) (step S615: No), the video equipment 20 returns to step S601.

  According to Embodiment 4 of the present invention described above, the motion detection unit 151 detects the motion vector of the subject in the video corresponding to the video data stored in the storage unit 9, and the frame rate control unit 153 detects the motion. The frame rate of the moving image displayed on the display unit 11 is changed according to the amount of change in the motion vector of the subject detected by the unit 151. As a result, reproduction according to the movement of the subject can be performed. Furthermore, according to Embodiment 4 of the present invention, a fast-moving subject can be seen slowly.

  In the above-described embodiment, the image displayed by the display unit has been described. However, the present invention can be applied to an electronic viewfinder that is detachable from a video device, for example.

  In the above-described embodiment, the frame rate of the image data generated by the imaging unit 5 has been described as 30 fps. However, for example, any of 15 fps, 60 fps, 120 fps, and 240 fps can be applied, and the frame rate is It can be set appropriately. Similarly, the storage frame rate at which the storage unit 9 stores image data and the frame rate at which the display unit 11 displays images can be set as appropriate.

  In the above-described embodiment, the still image generation unit 6 and the moving image generation unit 7 are provided. However, for example, still image data and moving image data may be generated by one image engine.

  In the above-described embodiment, a digital camera has been described as a video device. However, for example, a digital single-lens reflex camera, a digital video camera, and an electronic device such as a mobile phone or a tablet-type mobile device having a shooting function and a display function can be used. The present invention can be applied.

DESCRIPTION OF SYMBOLS 1,20 Video equipment 2 Lens part 3 Aperture part 4 Shutter part 5 Imaging part 6 Still image generation part 7 Movie generation part 8 Buffer 9 Storage part 10 Reproduction image generation part 11 Display part 12 Power supply part 13 Operation part 15 Control part 21 Input 131 Still image switch 132 Movie switch 133 Playback switch 134 Frame advance switch 135 Frame return switch 151 Motion detection unit 152 Change amount determination unit 153 Frame rate control unit

Claims (10)

A motion detection unit that detects a motion vector of a subject in a moving image corresponding to the moving image data generated at the first frame rate;
A frame rate control unit that changes a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection unit;
Video equipment characterized by comprising: An imaging unit that generates the moving image data by imaging the subject and continuously generating electronic image data at the first frame rate;
A storage unit for storing the moving image data generated by the imaging unit;
Further comprising
The video apparatus according to claim 1, wherein the frame rate control unit changes a frame rate of the image data generated by the imaging unit.   The frame rate control unit determines a frame rate of the image data generated by the imaging unit when the change amount of the motion vector of the subject detected by the motion detection unit is greater than or equal to a first threshold. The video equipment according to claim 2, wherein the second frame rate is higher than the rate.   The frame rate control unit thins out the number of frame rates of the image data stored in the storage unit when the change amount of the motion vector of the subject detected by the motion detection unit is equal to or greater than a first threshold. The video equipment according to claim 2, wherein: A still image generating unit that generates still image data from the image data generated by the imaging unit;
The frame rate control unit sends the still image data to the still image generation unit when the change amount of the motion vector of the subject detected by the motion detection unit is greater than or equal to a second threshold value that is greater than the first threshold value. The video equipment according to claim 3, wherein the video equipment is generated.   The still image generation unit includes the image data in which a change amount of a motion vector of a subject in a moving image corresponding to the moving image data stored in the storage unit by the motion detection unit is greater than or equal to the second threshold value. The video apparatus according to claim 5, wherein the still image data is generated by acquiring at least one or more of the image data equal to or greater than the second threshold from the moving image data stored in the storage unit. A storage unit for storing the moving image data;
A display unit for displaying a moving image corresponding to the moving image data stored in the storage unit;
Further comprising
The video apparatus according to claim 1, wherein the frame rate control unit changes a frame rate of the moving image displayed by the display unit.   The frame rate control unit determines the frame rate of the moving image displayed on the display unit when the change amount of the motion vector of the subject detected by the motion detection unit is equal to or greater than a first threshold. The video equipment according to claim 7, wherein the third frame rate is lower. A control method executed by the video equipment,
A motion detection step of detecting a motion vector of a subject in the moving image corresponding to the moving image data generated at the first frame rate;
A frame rate control step of changing a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection step;
The control method characterized by including. A program to be executed by a video device,
A motion detection step of detecting a motion vector of a subject in the moving image corresponding to the moving image data generated at the first frame rate;
A frame rate control step of changing a frame rate of the moving image data in accordance with a change amount of the motion vector of the subject detected by the motion detection step;
A program characterized by having executed.

Images