JP2013055408A - Video processing device and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video processing device which allows a minimum length required in editing to be easily known.SOLUTION: A video processing device inputs video (302), acquires video information from the input video (304), acquires a recommended photographing time on the basis of the acquired video information (305), and presents information based on the acquired recommended photographing time (306).

Description

  The present invention relates to a technique for processing a moving image.

  In recent years, in addition to the popularization of home digital video cameras, there are increasing opportunities to shoot digital moving images, such as the addition of moving image shooting functions to digital single-lens reflex cameras.

  In general, viewing a video as it is taken is tedious. Therefore, it is necessary to collect and edit material videos such as shot videos and still images, and to create edited videos that can withstand viewing. At this time, the edited video can be easily viewed by changing the playback time of the cut according to the video. For example, it is desirable that the cut playback time be longer as the amount of video information increases. This is because the larger the information amount of the video, the more time it takes for the viewer to understand the content of the video.

  The operation of changing the reproduction time of the cut in accordance with the video is generally performed manually by the user, but there is a system that automatically performs the operation.

  For example, according to the method disclosed in Patent Document 1, when a slide show is reproduced, the reproduction time is shortened as the number of persons in the image increases. As a result, it is possible to display an image in which the leading role appears for a long time.

  According to the method disclosed in Patent Document 2, in the automatic page feed of an electronic album, the playback time of the page is changed according to the number of images included in the album page in the image and the time of the moving image. . This makes it possible to lengthen the playback time of a page with a large amount of information.

  By applying these methods, it is possible to easily change the playback time of the cut according to the video when editing the video.

JP 2006-245646 A JP 2002-157275 A

  In order to use the above method, it is necessary to take a sufficiently long material image in advance.

  However, it is very difficult for the user to determine the length required for editing the video being shot during shooting. Therefore, there arises a problem that the user forgets to take a video having a required length. All the videos may be taken longer, but in this case, an extra video that is not used at the time of editing presses the storage capacity, resulting in a problem that the total recording time is shortened.

  In view of the above problems, an object of the present invention is to provide a video processing apparatus capable of easily notifying a user of a minimum length required for editing.

  In order to achieve the above object, a video processing apparatus according to an aspect of the present invention has the following arrangement. That is, a video input unit for inputting video, a video information acquisition unit for acquiring video information from the video input by the video input unit, and a recommended shooting time based on the video information acquired by the video information acquisition unit Recommended photographing time acquisition means to be acquired, and presenting means for presenting information based on the recommended photographing time acquired by the recommended photographing time acquisition means.

  According to the present invention, it is possible to easily inform the user of the minimum length required for editing from the video information of the video being shot.

The figure which shows the outline of the image processing device The figure which shows the appearance of the image processing device It is a block diagram which shows a function structure. Flowchart showing the flow of processing when the user starts shooting Diagram showing the correspondence between user actions and video camera actions during video shooting Figure showing a display example of recommended shooting time and fixed shooting duration The figure which shows the example of the correspondence table of information quantity of picture and recommended photographing time Flow chart showing the flow of processing to obtain recommended shooting time Flow chart showing the flow of processing for calculating the amount of information based on the number of faces A flowchart showing a flow of processing for calculating the information amount by the number of colors

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 is a diagram showing an outline of a video processing apparatus that realizes the present embodiment.

  The imaging unit 101 includes a zoom lens, a focus lens, a shake correction lens, a diaphragm, a shutter, an optical low-pass filter, an iR cut filter, a color filter, and a sensor such as a CMOS or a CCD, and detects the amount of light of a subject.

  The A / D conversion unit 102 converts the light amount of the subject into a digital value. The signal processing unit 103 performs demosaicing processing, white balance processing, gamma processing, and the like on the digital value to generate a digital image. The D / A conversion unit 104 performs analog conversion on the digital image.

  The encoder unit 105 converts the digital image into JPEG, MPEG, H.264. A process of converting to a file format such as H.264 is performed. The media interface 106 is an interface for connecting the video processing apparatus to a PC or other media (for example, a hard disk, a memory card, a CF card, an SD card, a USB memory).

  The CPU 107 is involved in all the processes of each configuration, reads the instructions stored in the ROM 108 and RAM 109 in order, interprets them, and executes the processes according to the results. The ROM 108 and the RAM 109 provide the CPU 107 with programs, data, work areas, and the like necessary for the processing. Each process to be described later is also executed by the CPU 107 by reading a processing program stored in the ROM and RAM.

  The imaging system control unit 110 controls the imaging system instructed by the CPU 107 such as focusing, opening a shutter, and adjusting an aperture.

  The operation unit 111 corresponds to a button, a mode dial, and the like, and receives a user instruction input via these buttons. An instruction such as zooming of the lens can also be given via the operation unit 111. The character generator 112 generates characters and graphics.

  In general, a liquid crystal display is widely used as the display unit 113 and displays a captured image and characters received from the character generation unit 110 and the D / A conversion unit 104. In addition, a touch screen function may be provided, and in this case, a user instruction can be handled as an input of the operation unit 111.

  The motion detection unit 114 is composed of a known triaxial acceleration sensor, angular velocity sensor, and the like, and detects information (tilt, direction of motion, acceleration, etc.) related to the motion applied to the video processing device.

  In addition, although the component of an apparatus exists other than the above, since it is not the main point of this invention, description is abbreviate | omitted.

  The component of the present invention can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), or a device (for example, a camera, a copier, The present invention may be applied to a facsimile machine or the like.

  An object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the system reads and executes the program codes stored in the storage medium. Is also achieved.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile data storage unit, a ROM, or the like can be used. .

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. Perform some of the actual processing. Furthermore, it is needless to say that the case where the functions of the above-described embodiments are realized by the processing is included.

  Further, the program code read from the storage medium is written to a data storage unit provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing, and the processing of the above-described embodiment is realized by the processing. Needless to say.

  In the present embodiment, a video camera will be described as an example of the video processing apparatus.

  FIG. 2 is a diagram illustrating an appearance of a video camera that is a video processing apparatus according to the present embodiment.

  The button 201 is a button for instructing start / end of shooting. When the button 201 is pressed in a state where shooting is not performed, video shooting is started. When the button 201 is pressed while shooting is being performed, shooting is terminated.

  The display 202 is a display for displaying various information. This corresponds to the display unit 113 in FIG. In addition to the video being shot, characters and graphics can be displayed. Here, video mainly refers to moving images, but still images may also be taken.

  FIG. 3 is a block diagram showing a functional configuration in the present embodiment. The video processing device 301 includes a video input unit 302, a processing unit 303, a video information acquisition unit 304, a recommended video time acquisition unit 305, and a presentation unit 306. The processing unit 303 corresponds to the CPU 107 in FIG. The presentation unit 306 corresponds to the display unit 113 in FIG. 1 and the display 202 in FIG.

  When a video is input by the video input unit 302, the video information acquisition unit 304 acquires necessary information from the input video, and the recommended video time acquisition unit 305 acquires and acquires the recommended time from the acquired information. The presentation unit 306 presents the recommended time.

  FIG. 4 is a flowchart showing the flow of processing when the user starts shooting by pressing the button 201 in the video camera of this embodiment. FIG. 5 shows the correspondence between the user's shooting operation and the operation of the video camera. Each of S *** in FIG. 4 corresponds to a predetermined process (step). In S401, 0 is substituted for the flag F. In S402, it is determined whether the user's shooting operation is fixed. Whether or not the user's shooting operation is fixed is determined based on input information of the operation unit 111 and information on the motion of the video camera that can be acquired from the motion detection unit 114.

  In this embodiment, when there is no input information from the operation unit 111 and there is no movement on the video camera, it is determined that the user's shooting operation is fixed. However, when determining the movement of the video camera, a small amount of movement due to camera shake is ignored. If it is determined that the user's shooting operation is fixed, the process proceeds to S403. Otherwise, the process proceeds to S405.

  In S403, the value of the flag F is checked. If F = 0, the process proceeds to S404. Otherwise, the process proceeds to S408. In S404, 1 is assigned to the flag F. In S405, 0 is substituted for the flag F.

In S406, to get the current time _{T 0.} T ₀ is represented by the number of seconds that have elapsed since the moment the photograph button was pressed. In S407, the recommended shooting time T is acquired from the content of the video being shot. The recommended shooting time T is the minimum time (seconds) required for use in later editing. A method of acquiring the recommended shooting time T will be described later with reference to FIG.

In S408, to get the _{T 1} the current time. T ₁ is assumed to be expressed by the number of seconds elapsed from the moment the user presses the capture button. In S409, to acquire the fixed shooting duration _{T k.} T _k is the time (seconds) that has elapsed since it was determined that the user's shooting operation is fixed, and is calculated by the following equation.

T _k = T ₁ −T ₀ (1)
In S410, the recommended imaging time T obtained in S407, the fixed photographing duration _{T k} obtained in S409, is displayed on the display 202. For example, the display is performed as shown in FIG. In FIG. 6, a meter is created so that the recommended shooting time T becomes the maximum value, and the fixed shooting duration T _k is represented on the meter, so that the relationship between the recommended shooting time T and the fixed shooting duration T _k is graphically represented. it's shown.

  Further, the degree of achievement of the current shooting time may be displayed as a message in%.

  In S411, it is determined whether or not the button 201 has been pressed by the user. If it is determined that the button 201 has been pressed, the process proceeds to S412. Otherwise, the process proceeds to S402.

  In step S412, the shooting operation of the video camera is terminated, and the shot video is stored.

  In the above description, when it is determined that the shooting operation is fixed, the timing for starting the acquisition of the shooting time is set as the trigger, but the shooting time is detected from the change of the scene when a scene change is detected. You may ask for.

(Recommended shooting time acquisition process)
Here, details of acquisition of the recommended shooting time performed in S407 of FIG. 4 will be described.

  In this embodiment, in order to determine the recommended shooting time, first, the content of video is analyzed to calculate the video information amount I. The information amount I is represented by a value between 0 and 1. Further, a database in which the information amount I and the recommended shooting time T are stored in association with each other is prepared in advance, and the recommended shooting time T is acquired using the calculated information amount I as a key. An example of the database is shown in FIG. A method for calculating the information amount will be described later.

  FIG. 8 is a flowchart showing the flow of processing when acquiring the recommended shooting time in the present embodiment.

In S801, 0 is substituted into the information amount I. In S802, it calculates the amount of information I _F was based on the number of faces in the image. I _F shall be represented by a value between 0 and 1. A method for calculating the amount of information I _F, will be described later with reference to FIG.

In S803, it calculates the amount of information I _C was based on the number of colors in the image. I _C is represented by a value between 0 and 1. A method of calculating the information amount I _C will be described later with reference to FIG.

In step S804, the video information amount I is calculated. The information amount I is calculated as follows using I _F and I _C. Here, a and b are weighting values for I _F and I _C , respectively, and arbitrary values are set so that a + b = 2. In the present embodiment, it is assumed that a = b = 1.

_{I = (a · I F +} b · I C) / 2 ... (2)
In S805, the recommended shooting time is acquired from the database shown in FIG. 7 using the information amount I as a key.

Figure 9 is a flow chart illustrating in S802 of FIG. 8, a flow of a process for calculating the amount of information I _F was based on the number of faces.

  Note that the following processing is performed on a still image. As an image to be processed, one frame of video shot by a video camera is selected and used. Further, one image may be created from a plurality of frames of video and may be processed.

In S901, 0 is assigned to the _{I F.} In S902, obtains the number _{N F} of a face in an image. The detection of the face area in the image follows a known method. For example, Japanese Patent Laid-Open No. 09-252534 discloses a technique for extracting a face region using a standard face image (template) registered in advance. Japanese Patent Application Laid-Open No. 09-252534 further extracts candidate feature points such as eyeballs (black eyes) and nostrils from the extracted face region, and their arrangement and pre-registered eyes, nose, mouth A technique for detecting facial parts such as eyes, nose, and mouth from a similarity with a template such as a region is disclosed.

In step S903, a value is substituted for the maximum number of faces N _{F, MAX} . An arbitrary value of 1 or more is substituted for N _{F and MAX} . In the present embodiment _{, NF and MAX} are assumed to be 10. In S904, it compares the value of _{N F} and _{N F, MAX.} If N _F > N _{F, MAX} , the process proceeds to S905. Otherwise, the process proceeds to S906. In S905, substituting the 1.0 to _{I F.} In S906, substituting _{(N F / N F, MAX} ) to _{I F.}

Figure 10 is a flowchart showing the flow of processing for calculating in S803 of FIG. 8, the amount of information I _C was based on the number of colors.

  Note that the following processing is performed on a still image. As an image to be processed, one frame of video shot by a video camera is selected and used. Further, one image may be created from a plurality of frames of video and may be processed.

  Assume that each pixel of the image stores three channel values of R, G, and B as 8-bit colors as color information. Therefore, R, G, and B each take a value in the range of 0 to 255.

  Each pixel of the image can be accessed in a coordinate system in which the lower left of the image is the origin, + x in the right direction and + y in the upper direction. In this coordinate system, r (i, j), g (i, j), and b (i, j) represent R, G, and B values in the pixel at the position of x = i and y = j, respectively. And

  Also, the width of the image is represented by W and the height of the image is represented by H.

In S1001, 0 is substituted for I _C. In S1002, a buffer of 256 × 256 × 256 three-dimensional array FLG is created. By notation such as FLG [r] [g] [b], an arbitrary position in the array can be accessed. In S1003, 0 is assigned to all positions of the three-dimensional array FLG.

  In S1004, 0 is substituted into the variable j. In S1005, 0 is substituted into the variable i. In S1006, the value of FLG [r (i, j)] [g (i, j)] [b (i, j)] is checked. If the value of FLG [r (i, j)] [g (i, j)] [b (i, j)] is 0, the process proceeds to S1007. Otherwise, the process proceeds to S1008.

  In S1007, 1 is assigned to FLG [r (i, j)] [g (i, j)] [b (i, j)]. In S1008, 1 is added to the variable i. In S1009, the values of variables i and W are compared. If i> W, the process proceeds to S1010. Otherwise, the process proceeds to S1006. In S1010, 1 is added to the variable j.

In S1011, the variable j is compared with the value of H. If j> H, the process proceeds to S1012. Otherwise, the process proceeds to S1005. In S1012, obtains the number of colors _{N C} of the image. Color number N _C of the image is a value obtained by adding the values of all the position of the three-dimensional array FLG. In S1013, a value is substituted for the maximum number of colors N _{C and MAX} . An arbitrary value between 1 and 16777216 is substituted for N _{C and MAX} . In the present embodiment, it is assumed that N _{C and MAX} are 1000.

In S1014, the values of N _C and N _{C, MAX} are compared. If N _C > N _{C, MAX} , the process proceeds to S1015. Otherwise, the process proceeds to S1016. In S1015, 1.0 is substituted for I _C. In S1016, (N _C / N _{C, MAX} ) is substituted for I _C.

  In the above example, each pixel has values of 3 channels of R, G, and B as color information in 8 bits each. However, it may have color information in other formats. For example, if the values of 3 channels of R, G, B are each 16 bits, the range of each value is 0 to 65535, and the 3D array FLG also creates a buffer of 65535 × 65535 × 65535. . In addition, when the number of channels increases, the number of FLG dimensions increases.

  In the above example, the color for each pixel of the image is counted. However, the image may be divided into a plurality of blocks and the color for each block may be counted. For example, an average color may be obtained and counted for each block of 20 × 20 pixels.

  As described above, in the present embodiment, as described with reference to FIG. 8, the recommended shooting time is determined by determining the minimum video length required for editing using the video information amount as video information. Is obtained and presented to the user. This makes it possible to easily inform the user of the minimum length required for editing for each video. Furthermore, it is possible to reduce the compression of the storage capacity due to the shooting of extra video.

  In the present embodiment, the number of faces and the number of colors in the video are used when calculating the information amount of the video, but other items may be used. For example, the frequency of the image may be analyzed, and the amount of video information may be calculated using the number of high frequency components. Alternatively, an object may be detected and the number of objects may be used.

  In the present embodiment, the acquired recommended shooting time is only presented to the user as information, but other operations may be added. For example, when the fixed shooting duration exceeds the recommended shooting time, the shooting may be forcibly terminated.

  In the above embodiment, the recommended shooting time is acquired from the video information amount, but the present invention is not limited to this. For example, as video information, it is effective to increase the recommended shooting time as the face size is larger than the display screen. According to this, when the face is raised, it can be displayed for a long time.

  As described above, the recommended shooting time is acquired as the video information using the face size and presented to the user so that the user can easily be notified of the minimum length required for editing for each video. become.

  According to the above embodiment, by obtaining the recommended shooting time from the video information and presenting it to the user, it becomes possible to easily inform the user of the minimum length required for editing for each video. .

Claims (10)

An input means for inputting video;
Video information acquisition means for acquiring video information from the input video;
Recommended shooting time acquisition means for acquiring a recommended shooting time based on the acquired video information;
A video processing apparatus comprising: presentation means for presenting information based on the acquired recommended shooting time.   The video processing apparatus according to claim 1, wherein the video information is an information amount of video input by the video input unit.   The video processing apparatus according to claim 2, wherein the information amount of the video is acquired based on the number of faces in the video.   The video processing apparatus according to claim 2, wherein the information amount of the video is acquired based on the number of colors in the video.   The video processing apparatus according to claim 1, wherein the video information is a size of a subject of the video input by the video input unit. Fixed determination means for determining whether the shooting operation is fixed;
The video processing apparatus according to claim 1, wherein the recommended shooting time acquisition unit starts acquiring the recommended shooting time when it is determined by the fixing determination unit to be fixed.   The video processing apparatus according to claim 1, wherein the presentation unit graphically presents the recommended shooting time acquired by the recommended shooting time acquisition unit. A method for controlling a video processing apparatus,
A step of inputting video by input means;
Acquiring video information from the input video by video information acquisition means;
Obtaining recommended shooting time based on the acquired video information by recommended shooting time acquisition means;
And a step of presenting information based on the acquired recommended photographing time by a presenting means.   A non-transitory computer-readable storage medium storing a program for causing a computer to execute the video processing apparatus control method according to claim 8 by being read by the computer.   A computer-readable storage medium storing the computer program according to claim 9.

Images