KR20160034825A - Image capture apparatus, information transmission apparatus, image capture control method, information transmission method, and recording medium - Google Patents

Abstract

An image capturing apparatus (1) comprises: an image capturing portion (16); a first communications portion (20); an image capturing control portion (53). The first communications portion (20) receives data which shows a movement of a corresponding object by a sensor attached to the certain object. The image capturing control portion (53) controls the recording frame rate of an image captured by the image capturing portion (16) based on the data received by the first communications portion (20). Accordingly, since the image capturing apparatus (1) can control image capturing based on the data which shows the movement of the received object, the image capturing apparatus can control the rate to the recording frame rate of the image corresponding to the movement of the object.

Description

TECHNICAL FIELD [0001] The present invention relates to an image capturing apparatus, an information transmitting apparatus, an image capturing control method, an information transmitting method and an image capturing apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image capturing apparatus, an information transmitting apparatus, an image capturing control method, an information transmitting method, and a program for controlling a frame rate according to movement of an object.

Conventionally, as described in Japanese Patent Application Laid-Open No. 120151/1990, the position of an object as a desired subject is specified by calculating a motion vector in an image sequentially picked up, and when the specified position is at a predetermined position in the display A technique for raising the frame rate for recording is known.

However, in the technique of the patent document, since the position of an object to be a subject is specified by a motion vector, when a motion other than a desired subject in the display is captured, the frame rate for recording is increased at an unintended timing There was a risk of discarding.

SUMMARY OF THE INVENTION The present invention has been made in view of such a situation, and aims to control the recording frame rate to an image corresponding to the movement of an object.

An image pickup apparatus according to the present invention includes an image pickup means, a receiving means for receiving data indicating the movement of the object by a sensor attached to a predetermined object, and a control means for controlling, by the image pickup means And control means for controlling a recording frame rate of an image to be picked up.

The information transmitting apparatus of the present invention may further comprise: a sensor attached to a predetermined object; acquisition means for acquiring data indicating movement of the predetermined object by the sensor; And transmission means for transmitting the information of the recording frame rate to the outside based on the data representing the motion.

According to another aspect of the present invention, there is provided an imaging control method executed by an imaging apparatus including an imaging unit, the imaging control method comprising: a receiving step of receiving data indicating a movement of the object by a sensor attached to a predetermined object; And a control step of controlling a recording frame rate of an image picked up by the image pickup unit based on the data received by the image pickup unit.

According to another aspect of the present invention, there is provided an information transmission method for transmitting information of a recording frame rate, comprising an acquisition step of acquiring data indicating a motion of a predetermined object by a sensor attached to a predetermined object, And a transmitting step of transmitting information of a recording frame rate to the outside based on data concerning the motion of the object acquired by the recording /

A program recorded in the recording medium of the present invention is a program for causing a computer to function as: receiving means for receiving data indicating movement of an object by a sensor attached to a predetermined object; And control means for controlling a recording frame rate of an image picked up by the means.

The program recorded in the recording medium of the present invention may further comprise a computer for causing the computer to function as: acquiring means for acquiring data representing movement of the predetermined object by a sensor attached to the predetermined object; The information on the recording frame rate is transmitted to the outside on the basis of the data on the recording frame rate.

According to the present invention, it becomes possible to control the recording frame rate to be a recording frame rate of an image corresponding to the motion of an object.

1A is a schematic diagram for explaining the principle of photographing in the image pickup apparatus of the present embodiment.
1B is a schematic diagram for explaining the principle of photographing in the image pickup apparatus of the present embodiment.
2 is a block diagram showing the hardware configuration of an image pickup apparatus according to an embodiment of the present invention.
Fig. 3 is a functional block diagram showing a functional configuration for executing photographing processing among the functional constitution of the image pickup apparatus of Fig. 2; Fig.
4 is a schematic diagram for explaining a calculation method of the evaluation value.
5 is a flowchart for explaining the flow of photographing processing executed by the imaging apparatus of Fig. 2 having the functional configuration of Fig.
Fig. 6 is a flowchart for explaining another flow of the photographing process executed by the imaging apparatus of Fig. 2 having the functional configuration of Fig. 3;

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings.

1 is a schematic diagram for explaining the principle of photographing in the image pickup apparatus of the present embodiment.

In the present embodiment, as shown in Fig. 1A, a moving image is photographed by changing a shutter speed in accordance with the motion of an object as a subject and changing a frame rate.

Specifically, when the object to be photographed is fast, the shutter speed is changed to a high shutter speed in still image shooting and to a high frame rate in moving image shooting.

By performing such photographing control, a still image without shake can be photographed in the case of still image photographing, and in the case of moving image photographing, the moving object does not become a moving image in which the movement of the subject becomes a jump.

When the movement of an object as a subject is slow, photographing control at a slow shutter speed is executed in still image photographing, and photographing control is performed at a low frame rate in moving picture photographing.

Specifically, for example, in the case of photographing a batter as an object as an object, if the motion of the subject is stopped, that is, slow in the state holding the bat before the swing is started, the photographing control at the slow shutter speed And performs imaging control at a low frame rate (for example, 30 fps) in moving picture imaging.

In the case of the swing, since the movement of the object as the subject is fast, the photographing control at the high shutter speed is executed in the still image photographing, and the photographing control at the high frame rate (for example, 240 fps) do.

Lastly, when the swing is completed, it is judged that the movement of the object as the subject is stopped, that is, slow, the slow shutter speed is set in the still image shooting and the shooting control in which the moving image shooting is performed at a low frame rate (for example, 30 fps) .

In the moving picture photographed in this manner, it is possible to photograph a continuous-motion image or a moving image photographed as a slow motion only when the batter swings.

In the present embodiment, as shown in Fig. 1B, the movement of an object as a subject is determined based on sensor information output from a sensor unit 3 attached to an object as a subject.

That is, the sensor information outputted from the sensor unit 3 is analyzed by the image sensing apparatus main body 2, and the photographing control is executed from the analysis result.

In the present embodiment, the presence or absence of movement and the speed of movement are analyzed from the sensor information. Further, the behavior of the subject is estimated from the sensor information, and the subsequent photographing control is executed based on the estimated behavior.

In the present embodiment, on the basis of the sensor mounted on the object as the object, in order to perform the photographing control, the photographing of the movement of the object, which is the subject, is reliably performed without being affected by, for example, other moving objects Can be executed.

2 is a block diagram showing the hardware configuration of an image pickup apparatus according to an embodiment of the present invention.

The image pickup apparatus 1 includes an image pickup apparatus main body 2 and a sensor unit 3.

The imaging apparatus main body 2 is configured, for example, as a digital camera.

The imaging apparatus main body 2 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15 An input section 17, an output section 18, a storage section 19, a first communication section 20, and a drive 21. The image capturing section 16, the input section 17, the output section 18,

The CPU 11 executes various processes in accordance with a program recorded in the ROM 12 or a program loaded from the storage unit 19 into the RAM 13. [

The RAM 13 also appropriately stores data necessary for the CPU 11 to perform various processes.

The CPU 11, the ROM 12, and the RAM 13 are interconnected via a bus 14. [ The bus 14 is also connected to an input / output interface 15. The input / output interface 15 is connected to the image pickup section 16, the input section 17, the output section 18, the storage section 19, the first communication section 20 and the drive 21.

The imaging section 16 includes an optical lens section and an image sensor although not shown.

The optical lens unit is composed of a lens for condensing light, for example, a focus lens, a zoom lens, or the like, for photographing a subject.

The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal distance within a certain range.

The optical lens unit is further provided with peripheral circuits for adjusting setting parameters such as focus, exposure, white balance, and the like, if necessary.

The image sensor is composed of a photoelectric conversion element, an AFE (Analog Front End), and the like.

The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. The object image is incident on the photoelectric conversion element from the optical lens unit. Thus, the photoelectric conversion element photoelectrically converts (picks up) the image of the object, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal to the AFE as an analog signal.

The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. A digital signal is generated by various kinds of signal processing and is output as an output signal of the image pickup section 16. [

The output signal of the image pickup section 16 is hereinafter referred to as "captured image data". The data of the picked-up image is appropriately supplied to the CPU 11 or the like.

The input unit 17 is composed of various buttons and the like, and inputs various kinds of information according to the instruction operation of the user.

The output unit 18 is constituted by a display, a speaker, and the like, and outputs an image or sound.

The storage unit 19 is constituted by a hard disk or a DRAM (Dynamic Random Access Memory), and stores data of various images.

The first communication unit 20 controls communication executed with another device (not shown) through a network including the Internet. The first communication unit 20 is configured to be able to communicate wirelessly with the sensor unit 3 and more specifically to communicate with the sensor unit 3 via the Bluetooth (registered trademark) .

A removable medium 31 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted on the drive 21. The program read from the removable medium 31 by the drive 21 is installed in the storage unit 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19. [

The sensor unit 3 is mounted on an object to be detected so as to be able to detect motion, and includes a sensor unit 22 and a second communication unit 23. [

Since the sensor unit 3 is assumed to be attached to a human body as an object, the sensor unit 3 is formed into a shape of a bracelet that can be used on a wrist (arm) as shown in Fig. 1B.

In addition, if the animal is an animal such as a dog or a cat other than a person, the animal may be formed into a shape of a necklace or a shape attached to a necklace.

That is, it is possible to select an optimum attaching means in accordance with the object to be mounted.

The sensor unit 22 is composed of a gyro sensor capable of detecting three-axis acceleration and angular velocity of the X, Y, and Z axes. The sensor unit 22 outputs a signal indicative of the detected acceleration (hereinafter referred to as " sensor signal ") to the second communication unit 23. [

The second communication unit 23 transmits a sensor signal sequentially output from the sensor unit 22 to the image capturing apparatus main body 2. [

The sensor signal detected by the sensor unit 22 from the sensor unit 3 is transmitted to the image capturing apparatus main body 2 and an evaluation value concerning the operation of the subject is calculated in the image capturing apparatus main body 2, The behavior of the subject is estimated from the current operation.

Fig. 3 is a functional block diagram showing a functional configuration for executing photographing processing among the functional constitutions of the image pickup apparatus 1. Fig.

The photographing process refers to a series of processes for photographing a still image or a moving image by controlling the photographing based on the detected movement of the subject.

3, in the CPU 11, the communication control section 51, the operation state specifying section 52, the image pickup control section 53, and the storage control section 54 Function.

A sensor information storage unit 71 and an image storage unit 72 are set in one area of the storage unit 19. [

The sensor information storage unit 71 stores sensor information which is a sensor signal output from the sensor unit 22.

The image storage section 72 stores data of a still image or a moving image.

The communication control unit 51 controls the first communication unit 20 to receive the sensor signal transmitted from the second communication unit 23. The received sensor signal is stored in the sensor information storage unit 71 as sensor information.

The operation state determining unit 52 estimates the intensity or behavior of the operation based on the sensor signal that is the sensor information stored in the sensor information storage unit 71. [ The operation state specifying unit 52 specifies the operation state of the object from the intensity and behavior of the estimated operation.

Based on the sensor information stored in the sensor information storage unit 71, the operation state specifying unit 52 sets a value (hereinafter, referred to as an " evaluation value ") that becomes an index of the intensity of motion when estimating the intensity of the motion, . The evaluation value can be calculated using an existing technique such as, for example, Japanese Patent Application Laid-Open No. 2008-245815.

In the present embodiment, the evaluation value is calculated by the following method.

4 is a schematic diagram for explaining a calculation method of the evaluation value.

As shown in Fig. 4, the evaluation value first calculates the sum of squares A of the sensor signals of three axes of acceleration. Next, the derivative sum (A) of the calculated sensor signals is differentiated to calculate the derivative value (B). And converts the differential value B of the sum signal A of the sensor signal into the absolute value D. The differential value D converted into the absolute value is integrated within a continuous time, and a portion corresponding to the area of the integrated area is set as the evaluation value.

The higher the calculated evaluation value is, the more violent the movement becomes, and is reflected in the subsequent shooting control.

The evaluation value is also calculated during shooting, and is reflected in the shooting control when there is a variation in the evaluation value.

The behavioral state specifying unit 52 may be configured to determine whether or not a change in the sensor signal corresponding to a specific operation And can be calculated using various existing technologies considering periodicity and the like. For example, from the relationship between the acceleration, the angular velocity, and the periodicity of each axis of X, Y, and Z in the sensor signal, the behavior can be estimated by performing matching with a motion model in which data for each action is collected in advance.

The image pickup control section 53 photographs a still image at a shutter speed corresponding to an operation state specified from the intensity or behavior of the estimated motion and displays the moving image at a frame rate corresponding to the operation state specified from the intensity or behavior of the estimated motion And controls the image pickup section 16 to photograph the image.

More specifically, the imaging control section 53 controls the imaging section 16, which captures a still image at a high shutter speed, in a case where the motion state of the subject is such as a state in which the evaluation value is high or a behavior during swing is estimated . In addition, when the evaluation value is low or the behavior in a batted state is estimated, the imaging unit 16 for capturing a still image with a slow shutter speed is controlled.

The imaging control section 53 controls the imaging section 16 for shooting a moving image at a high frame rate when, for example, the motion state of the subject is such that the evaluation value is high or the behavior during the swing is estimated. In the case where the motion state of the subject is such that the evaluation value is low or the behavior in the state of holding the bat is estimated, the imaging unit 16 for capturing the moving image at a low frame rate is controlled.

The storage control unit 54 stores the still image or moving image data output from the image pickup unit 16 in the image storage unit 72. [

Fig. 5 is a flowchart for explaining the flow of photographing processing executed by the imaging device 1 of Fig. 2 having the functional configuration of Fig.

The photographing process is started by the user's operation of starting the photographing process to the input unit 17. [

In step S11, the communication control unit 51 controls the first communication unit 20 to receive the sensor signals sequentially transmitted from the second communication unit 23. [

In step S12, based on the sensor signal, which is the sensor information stored in the sensor information storage unit 71, the operation state specifying unit 52 specifies the operation state of the object from the intensity and behavior of the estimated operation.

More specifically, the operation state specification unit 52 calculates an evaluation value when estimating the intensity of operation. As shown in Fig. 4, the evaluation value first calculates the sum of squares A of the sensor signals of three axes of acceleration. Next, the derivative sum (A) of the calculated sensor signals is differentiated to calculate the derivative value (B). And converts the differential value B of the sum signal A of the sensor signal into the absolute value D. The differential value D converted into the absolute value is integrated within a continuous time, and a portion corresponding to the area of the integrated area is set as the evaluation value.

When the behavior is estimated, the behavior-state specifying unit 52 performs matching with the motion model by estimating the behavior based on the relationship between the acceleration, angular velocity, and periodicity of each axis of X, Y, and Z in the sensor signal. As a result, for example, the behavior of the bet is estimated.

In step S13, the image pickup control section 53 determines whether or not there is an image pickup instruction by the user through the input section 17. [

If there is no shooting instruction, NO is determined in step S13, and the process returns to step S11.

If there is a shooting instruction, the determination in step S13 is YES, and the process proceeds to step S14.

In step S14, the imaging control unit 53 determines whether or not the shooting instruction by the user through the input unit 17 is a still image.

When the photographing instruction is not a still image but a moving image, NO is determined in step S14, and the process proceeds to step S17. The processing after step S17 will be described later.

If the shooting instruction is a still image, YES is determined in step S14, and the process proceeds to step S15.

In step S15, the image pickup control section 53 controls the image pickup section 16 to shoot a still image at a shutter speed corresponding to a specific operating condition. More specifically, the imaging control section 53 controls the imaging section 16, which captures a still image at a high shutter speed, in a case where the motion state of the subject is such as a state in which the evaluation value is high or a behavior during swing is estimated . In addition, when the evaluation value is low or the behavior in a batted state is estimated, the imaging unit 16 for capturing a still image with a slow shutter speed is controlled.

In step S16, the storage control unit 54 stores the data of the still image output from the image pickup unit 16 in the image storage unit 72. [

In step S17, the image capturing control section 53 controls the image capturing section 16 to capture a moving image at a frame rate corresponding to a specific operation state. More specifically, the imaging control section 53 controls the imaging section 16 that captures a moving image at a high frame rate, for example, when the motion state of the subject is such that a behavior of a high evaluated value or a swing is estimated do. In the case where the motion state of the subject is such that the evaluation value is low or the behavior in the state of holding the bat is estimated, the imaging unit 16 for capturing the moving image at a low frame rate is controlled.

In step S18, the storage control unit 54 stores the moving image data output from the image pickup unit 16 in the image storage unit 72. [

In the above-described photographing processing, the operation state of the subject is specified before the photographing instruction for the purpose of reducing the processing burden in the photographing process. However, the present invention is not limited to this, May be configured to specify the operation status of the terminal device.

That is, the moving image / still image shooting is performed at the frame rate / shutter speed according to a specific operating condition before the shutter-pressing operation (before shooting), but the moving image / still image shooting is performed at the shutter- Accordingly, the moving image / still image shooting may be performed at the frame rate / shutter speed from the real time operation state at the shooting time.

In this case, it is more preferable to reflect the operation state at the photographing processing time, and the sensor information may be acquired at a predetermined timing from the photographing state, and the operation state may be specified from the sensor information closest to the timing of photographing .

It is also possible that a predetermined operation state (for example, a swing state) occurs after a predetermined time elapses from a preliminary operation (for example, a swing ready state) The predicted operation state may be regarded as the operation state at the time of photographing.

In the above-described photographing process, the operation state of the subject may be specified before photographing, and the operation state of the subject may be specified again after the photographing. With such a configuration, it is possible to enhance specific precision and reliability.

Still further, in the above-described imaging processing, the still image / moving image shooting is performed with the shutter speed / frame rate determined before the shooting fixed within one shot, and the still image / moving image shooting is performed. For example, Also in the case of photographing executed within a time period, photographing may be performed with the shutter speed / frame rate being fixed.

In the above-described photographing process, the process of specifying the operation state of the subject may be executed based on the fact that the preliminary operation of the photographing instruction (for example, power source activation, mode setting, half shutter, etc.) .

<Modifications>

In the above-described embodiment, the still image / moving image shooting is performed while the shutter speed / frame rate determined before shooting is fixed. However, in this example, the operation status is specified during a plurality of still image shooting or moving image shooting, The shutter speed / frame rate is changed to the corresponding shutter speed / frame rate so as to perform the subsequent still image / moving image shooting. That is, the still image / moving image shooting is performed by changing the shutter speed / frame rate so as to be variable even during shooting.

Fig. 6 is a flowchart for explaining another flow of the photographing process executed by the imaging device 1 of Fig. 2 having the functional configuration of Fig. The description of the same steps as those in the photographing process shown in Fig. 5 will be omitted.

In step S36, the image pickup control section 53 determines whether or not the image pickup has been completed based on whether the predetermined number of image pickups has been reached, whether or not the image pickup end operation has been executed, and the like.

If the photographing is completed, the determination in step S36 is YES, and the process proceeds to step S39.

On the other hand, if the shooting has not been completed, NO is determined in step S36, and the process proceeds to step S37.

In step S37, the communication control unit 51 controls the first communication unit 20 to receive the sensor signals sequentially transmitted from the second communication unit 23. [

In step S38, based on the sensor signal, which is the sensor information stored in the sensor information storage unit 71, the operation state specifying unit 52 estimates the intensity or behavior of the operation, and based on the intensity or behavior of the estimated operation, The operation state of the mobile terminal.

Thereafter, again in step S35, the image pickup control section 53 controls the image pickup section 16 to shoot a still image at a shutter speed in accordance with the newly specified operation condition in step S38.

In step S41, the image pickup control section 53 determines whether or not the image pickup is ended, based on whether a predetermined image pickup time has elapsed, whether or not the image pickup end operation has been performed, and the like.

If the photographing is ended, YES is determined in step S41, and the process proceeds to step S44.

On the other hand, if the shooting has not been completed, NO is determined in step S41, and the process proceeds to step S42.

In step S42, the communication control unit 51 controls the first communication unit 20 to receive the sensor signals sequentially transmitted from the second communication unit 23. [

In step S43, based on the sensor signal, which is the sensor information stored in the sensor information storage unit 71, the operation state specifying unit 52 estimates the intensity or behavior of the operation, and based on the intensity or behavior of the estimated operation, The operation state of the mobile terminal.

Thereafter, again in step S40, the image pickup control section 53 controls the image pickup section 16 to take a moving image at a frame rate according to the newly specified operation state in step S43.

Therefore, in the imaging apparatus 1, a still image without shaking can be photographed in the case of a still image, and a moving image in which the motion of the subject jumps can be prevented from becoming a moving image in the case of a moving image. In addition, in the image pickup apparatus 1, since the image pickup control is executed based on the sensor mounted on the object, it is possible to carry out the image pickup in which the motion of the object is certainly captured without being affected by, for example, have.

The imaging apparatus 1 configured as described above includes the imaging section 16, the first communication section 20, and the imaging control section 53.

The first communication unit 20 receives data indicating movement of the object by a sensor attached to the predetermined object.

The image pickup control section 53 controls the recording frame rate of the image picked up by the image pickup section 16 on the basis of the data received by the first communication section 20.

Thus, in the image capturing apparatus 1, the image capturing control can be performed on the basis of the data indicating the movement of the object, so that it is possible to control the image capturing apparatus 1 to have the recording frame rate of the image corresponding to the movement of the object.

The imaging apparatus 1 further includes an operation state specifying unit 52 for obtaining the state of motion of the object based on data representing the motion of the object received by the first communication unit 20. [

The image pickup control section 53 controls the recording frame rate based on the motion state of the object acquired by the operation state specifying section 52. [

Thus, in the image pickup apparatus 1, it is possible to control the recording frame rate suitable for the state of motion of the obtained object.

The operation state specifying unit 52 estimates the behavior of the object from the data indicating the motion of the object based on the timing of the imaging process by the imaging unit 16. [

Thus, in the image pickup apparatus 1, it is possible to estimate the behavior of the object in accordance with the timing of the image pickup processing by the image pickup section 16, and control of the appropriate recording frame rate is performed according to the state of movement of the obtained object .

The CPU 11 acquires the time information.

The operation state specification unit 52 estimates a preliminary operation from the data representing the motion of the object to the behavior of the predetermined object as the behavior of the object. The imaging control unit 53 performs the preliminary operation, the time obtained by the CPU 11 Based on the change in information, the recording frame rate is controlled (predicting the behavior of the object at the next time point).

In other words, the operation state specifying unit 52 estimates a preliminary operation related to the behavior of the object from the data representing the motion of the object.

The image pickup control section 53 controls the recording frame rate based on the next operation for photographing which is predicted from the preliminary operation estimated by the operation state specifying section 52. [

Specifically, for example, a series of operations consisting of a plurality of operations are stored in association with the required time and recording frame rate of each operation / operation, and the elapsed time from the time of the estimated operation to the start of imaging It is possible to perform control so as to execute photographing at a recording frame rate corresponding to each operation.

Thereby, in the image pickup apparatus 1, it is possible to predict the state of movement of the object at the shooting time from the preliminary movement acquired in advance, and therefore, the control of the recording frame rate suitable for the state of movement of the obtained object can be performed Can be executed.

The operation state specifying unit 52 estimates the behavior of the object from the data representing the motion of the object.

The motion-state specifying unit 52 specifies the motion of the object on the basis of the estimated motion of the object.

Thus, in the image pickup apparatus 1, it is possible to more precisely specify the motion of the object, and it is possible to control the recording frame rate suited only to the object.

The image pickup control section 53 controls the shutter speed of the image pickup section 16 in accordance with the motion of the object.

Thus, in the image pickup apparatus 1, for example, a still image without shaking of the photographed object can be photographed.

The image pickup control section 53 controls the recording frame rate by changing the image pickup frame rate in accordance with the movement of the subject.

This makes it possible to acquire a moving image free from motion jump in the image pickup apparatus 1.

The sensor unit 22 is a gyro sensor.

Thus, in the image pickup apparatus 1, it is possible to specify a more accurate movement of the object, and it is possible to control the recording frame rate suited only to the subject.

The sensor unit 3 includes an antenna member that is a second communication unit 23 that receives data indicating the movement of the object by the sensor unit 22. [

As a result, in the imaging apparatus 1, a more accurate movement of the object can be specified with a simple configuration.

The image pickup control section 53 controls the recording frame rate to be the recording frame rate based on the movement of the object received by the second communication section 23. [

That is, the recording frame rate of the interval corresponding to the motion state of the subject.

Thus, in the image pickup apparatus 1, it is possible to specify a more accurate movement of the object, and it is possible to control the recording frame rate suited only to the subject.

The operation state specifying unit 52 estimates the behavior of the object from the data indicating the movement of the object at least at a timing before, at the same time as, and at a later timing before the image pickup processing.

Thus, in the image pickup apparatus 1, it is possible to control the recording frame rate suited only to the subject at various timings in consideration of burden of photographing processing, closer to the photographing time, and improvement of precision of the motion state of the object.

The second communication unit 23 includes an antenna member for transmitting the data received by the first communication unit 20 to the outside by a wireless system as information on the recording frame rate.

Thus, in the image pickup apparatus 1, it is possible to specify a more accurate movement of the object with a simple configuration and to control the recording frame rate.

The present invention is not limited to the above-described embodiment, and variations, modifications, and the like within the scope of achieving the object of the present invention are included in the present invention.

In the above-described embodiment, the frame rate of the image sensing unit 16 is raised. However, the control method of the frame rate is not limited to the method of extracting the frame image from the moving image captured at the predetermined frame rate by the image sensing unit 16 The moving image may be stored so as to have a desired frame rate.

More specifically, the image pickup apparatus 1 further includes a storage control unit 54 for controlling storage processing of a plurality of consecutive images to the image storage unit 72. [

The storage control unit 54 takes out the frame image constituting the moving image from the photographed moving image so as to obtain the recording frame rate of a plurality of consecutive images corresponding to the motion of the subject in the case of photographing a plurality of consecutive images, The storage processing of a plurality of consecutive images to the image storage unit 72 is controlled by changing the recording frame rate of a plurality of images.

Alternatively, a moving image of a predetermined frame rate may be stored, and the moving image may be edited such that the moving image has a desired frame rate at the time of outputting.

In the above-described embodiment, for example, the photographing is performed at a high frame rate (for example, 100 fps) to obtain a predetermined frame rate (for example, 30 fps) (For example, an interval that is five frames crossing each other), the acquisition of the frame image (the acquisition of the frame image as a whole as a whole) is performed. As a result, When the moving image of the rate is to be captured and controlled, the interval of obtaining the frame image may be adjusted to increase the frame rate. That is, the frame rate of the final moving image may be adjusted at an interval of acquisition of the frame image in accordance with the specific result of the operation state of the object, while always photographing at a high frame rate.

More specifically, the imaging control unit 53 may be configured to change the acquisition interval of the frame image output from the imaging unit 16 so that the final frame rate of the moving image corresponds to the motion of the subject.

In the above-described embodiment, the sequential shooting control is performed while reflecting the result of the operation of the subject. However, when a time lag occurs until a specific result of the operation state of the subject is reflected in the shooting control The data output from the image pickup section 16 may be buffered in preparation for switching of the image pickup control and the time lag may be supplemented by the buffered data.

In the above-described embodiment, the sensor unit 22 is configured by a gyro sensor, but may be constituted by a sensor such as an acceleration sensor that detects acceleration only. In this case, more preferable shooting control can be performed by using an optimum sensor and an operation determination algorithm in accordance with the purpose.

In the above-described embodiment, the operation of the subject or the behavior is estimated based on the sensor information from the sensor unit 3 attached to the subject. However, for example, It is possible to estimate the intensity or behavior of the motion of the subject and to specify the operation state of the subject.

In the above-described embodiment, the table data in which the shutter speed / frame rate is correlated with the operation status of the subject determined by estimating the intensity and behavior of the motion of the subject is stored and the imaging control is executed with reference to the table data Maybe.

In the above-described embodiment, the sensor is mounted on one subject. However, the sensor may be mounted on a plurality of subjects. At this time, when sudden movement occurs or conversely movement is slowed, that is, when there is a change from the photographing control of the phenomenon, the photographing control is executed based on the movement of all the subjects or based on the movement of only one subject .

In the above-described embodiment, the imaging control is executed based on the current operation state of a specific subject by executing the intensity of motion or the estimation of the motion. However, for example, the preliminary motion of the currently executed motion The situation may be estimated and the control at the shooting time point may be executed in accordance with the operation predicted from the state of the preliminary operation. More specifically, when capturing a batting person during a swing, it is possible to specify an action of holding the bat, and as a preliminary action, the control of the shooting time assuming a subsequent swing can be performed.

In the above-described embodiment, the number of continuous shooting at the time of continuous shooting can be set according to the movement of the subject. As described above, the frame rate can be controlled by setting the number of continuous strokes in accordance with the movement of the subject in the continuous shooting. For example, a subject with a fast motion may have motion blurring, a critical scene may be momentary, etc. Since the shutter speed needs to be fast, the number of bursts and the frame rate are adjusted. At this time, an image before and after the shutter-pressing operation may be stored in accordance with the subject having a fast motion.

In the above-described embodiment, the frame rate is controlled by specifying the operation status of the subject on the side of the imaging apparatus main body 2. However, after the operation status of the subject is specified on the sensor unit 3 side, The image capturing apparatus main body 2 may be configured to execute the image capturing process at the frame rate corresponding to the operating condition. More specifically, the sensor unit 3 executes the specific processing of the operation state of the object in S12 of Fig. 5, and simultaneously transmits information of a plurality of frame rates corresponding to each of the plurality of operation states to the corresponding sensor unit 3 The sensor unit 3 is configured to read the information of the frame rate corresponding to the operation state specified by the sensor unit 3 and to transmit the frame rate information to the imaging apparatus main body 2. [ With this configuration, the imaging apparatus main body 2 only receives the frame rate according to the operation status of the subject from the sensor unit 3, and can perform imaging processing at a frame rate suitable for the operation status.

It is also possible to execute the specific processing of the operation state of the subject in step S12 of Fig. 5 on the side of the sensor unit 3, to transmit the operation state of the object specified by the specific processing to the imaging apparatus main body 2, A system in which the imaging apparatus main body 2 executes imaging processing at a frame rate corresponding to the operation state of the object may be configured. By configuring the system, the processing burden on the imaging apparatus main body 2 can be lightened.

Alternatively, the imaging control may be performed using the information of the sensor information and the operation status of the object acquired by the external device other than the imaging device 1. [ In the sensor unit 3 or the external apparatus, a judgment to be made to the image pickup control is executed, only the image pickup control instruction is transmitted to the image pickup apparatus main body 2, and on the image pickup apparatus main body 2 side, May be executed.

In the above-described embodiment, the sensor unit 22 is arranged at a position where the movement of the arm can be obtained. However, it is possible to arrange the motion to be acquired at a position where it can be specified, It is possible.

For example, it is possible to estimate various preparation states such as preparation for swing preparation and crouching start, etc. from the acceleration information in detail as operating conditions by disposing them on the whole body or limbs, not limited to the arms.

In the above-described embodiment, the frame rate is changed in two levels according to the sensor information. However, it is possible to adjust the linearity so as to change in an infinite stage according to the speed information of the object, Maybe.

In the above-described embodiment, in the image capturing apparatus main body 2, the intensity and behavior of the operation are estimated based on the information from the sensor unit 3, and the operation state of the subject is specified from the intensity and behavior of the estimated operation However, the sensor unit 3 may be configured to perform estimation / specification.

In this case, the sensor unit 3 may be configured to transmit information (sensing information, estimated / specified information) at predetermined intervals, but it is also possible to configure the sensor unit 3 22), and transmit information (sensing information or estimated / specific information).

For example, in the case where the photographing process is started by the preparatory operation for photographing (half-pressing operation of the shutter), the photographing operation (full pressing of the shutter) or the full pressing of the shutter, (Sensing information, estimated / specific information) may be transmitted.

Specifically, the sensor unit 22 acquires data representing the movement of the object at at least one of the timing before, the simultaneous timing, and the timing after the image pickup processing.

Thus, in the image pickup apparatus 1, in consideration of the burden of processing due to the concentration of the processing at the time of photographing, the closer to the photographing time point and the improvement of the precision of the motion state of the object, .

In addition, the sensor unit 3 can perform estimation / specification for the purpose of reducing processing burden on the image sensing apparatus main body 2.

In the above-described embodiment, the frame rate and the shutter speed are changed based on the estimation / specific result of the behavior state of the subject. However, the present invention is not limited to this.

It is possible to change / adjust the element in which the subject is in the preferable shooting state in the behavior state of the subject at the shooting time.

It is also possible to configure the image processing to change / adjust an element whose display state is desired on the basis of the estimation / specific result of the behavior state of the subject after photographing.

In the above-described embodiment, the image pickup apparatus 1 to which the present invention is applied is described by taking a digital camera as an example, but the present invention is not limited thereto.

For example, the present invention can be applied to an electronic apparatus having a photographing processing function in general. Specifically, for example, the present invention can be applied to a notebook type personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smart phone, a portable game machine,

The series of processes described above may be executed by hardware or by software.

In other words, the functional configuration of Fig. 3 is merely an example, and is not particularly limited. That is, it suffices that the imaging apparatus 1 is provided with a function capable of performing the above-described series of processes as a whole, and what function block is used to realize this function is not particularly limited to the example of Fig.

Further, one functional block may be constituted by a hardware group, a software group, or a combination thereof.

When a series of processes are executed by software, a program constituting the software is installed from a network or a recording medium into a computer.

The computer may be a computer that is assembled in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

The recording medium including such a program is configured not only by the removable medium 31 shown in Fig. 2, which is distributed separately from the apparatus main body for providing the program to the user, but also provided to the user in a state preassembled in the apparatus main body And a recording medium. The removable medium 31 is constituted by, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. The optical disk is constituted by, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), a Blu-ray (registered trademark) Disc (Blu-ray Disc) The magneto-optical disk is constituted by an MD (Mini-Disk) or the like. The recording medium provided to the user in a state of being assembled in advance in the apparatus main body can be stored in the ROM 12 of Fig. 2 in which a program is recorded, or a hard disk included in the storage unit 19 of Fig. 2 .

In this specification, steps describing a program to be recorded on a recording medium include not only time-series processing executed in accordance with the order, but also processing executed in parallel or individually without necessarily being processed in a time-series manner will be.

While the preferred embodiments of the present invention have been described for illustrative purposes, those embodiments are for illustrative purpose only and do not limit the technical scope of the present invention. The present invention can take other various embodiments, and various changes such as omission, substitution, and the like can be performed within a range not departing from the gist of the present invention.

These embodiments and their modifications fall within the scope and spirit of the invention described in this specification and the like, and are included in the scope of equivalents to the invention described in the claims.

One; An imaging device 2; The image-
3; Sensor unit 11. CPU
12; ROM 13; RAM
14; Bus 15; Input / output interface
16; An imaging section 17; Input
18; Output section 19; The storage unit
20; A first communication unit 21; drive
22; A sensor unit 23; The second communication section
31; A removable medium 51; The communication control unit
52; An operation state specifying unit 53; The image-
54; A storage control unit 71; The sensor information storage unit
72; The image storage unit

Claims (20)

Imaging means,
Receiving means for receiving data indicating movement of the object by a sensor attached to the predetermined object;
And control means for controlling a recording frame rate of an image picked up by said image pickup means on the basis of data received by said receiving means. The method according to claim 1,
Further comprising acquisition means for acquiring a state of movement of the object based on data representing movement of the object received by the receiving means,
Wherein the control means controls the recording frame rate based on a state of motion of the object acquired by the acquisition means. 3. The method of claim 2,
Further comprising an estimation means for estimating a behavior of the object from data representing the motion of the object,
Wherein said control means controls a recording frame rate of an image picked up by said image pickup means on the basis of the behavior of said object estimated by said estimation means. The method of claim 3,
Wherein the estimating means estimates the behavior of the object from the data indicating the motion of the object based on the timing of the imaging processing by the imaging means. The method of claim 3,
Wherein the estimating means estimates a preliminary operation related to the behavior of the object from data representing the motion of the object,
Wherein the control means controls the recording frame rate on the basis of an operation for the next photographing purpose predicted from the preliminary operation estimated by the estimation means. The method according to claim 1,
Further comprising storage control means for controlling storage processing of a plurality of consecutive images in the storage means,
Wherein the storage control means takes out the frame image constituting the moving image from the photographed moving image so that the recording frame rate of a plurality of consecutive images corresponding to the motion of the object is taken when the continuous image is photographed, Changes the storage frame rate of a plurality of images and controls storage processing of a plurality of consecutive images in the storage means. The method according to claim 1,
Wherein the control means changes the acquisition interval of the frame image output from the imaging means so that the recording frame rate of the final moving image corresponds to the motion of the object. The method according to claim 1,
Wherein the control means controls the shutter speed of the imaging means in accordance with the movement of the object. The method according to claim 1,
Wherein the control means controls the recording frame rate by changing the imaging frame rate in accordance with the movement of the object. The method according to claim 1,
Wherein the sensor is an acceleration sensor or a gyro sensor. The method according to claim 1,
Wherein the receiving means includes an antenna member for receiving data representing the movement of the object by the sensor. A sensor attached to a predetermined object,
Acquiring means for acquiring data indicating the motion of the predetermined object by the sensor;
And transmission means for externally transmitting information of a recording frame rate based on data indicating the motion of the predetermined object acquired by the acquisition means. 13. The method of claim 12,
Further comprising specifying means for specifying a state of motion of the object from data relating to the motion of the object acquired by the acquiring means,
Wherein the transmitting means transmits the information of the recording frame rate corresponding to the state of motion of the object specified by the specifying means. 14. The method of claim 13,
Further comprising an estimation means for estimating a behavior of the object from data representing the motion of the object acquired by the acquisition means,
Wherein the acquisition means acquires information on the motion of the object based on the behavior of the object estimated by the estimation means. 13. The method of claim 12,
Wherein the acquiring means acquires data representing the motion of the object at at least one of a time point before the imaging process, a time point at the same time, and a time point after the imaging process. An imaging control method executed in an imaging apparatus having an imaging means,
A receiving step of receiving data indicating a movement of the object by a sensor attached to the predetermined object;
And a control step of controlling a recording frame rate of an image picked up by the image pickup unit based on the data received by the receiving step. An imaging control method executed in an imaging apparatus having an imaging means,
A receiving step of receiving data indicating a movement of the object by a sensor attached to the predetermined object;
And a control step of controlling the shutter speed of the image pickup means based on the data received by the receiving step. An information transmitting method for transmitting information of a recording frame rate,
An acquisition step of acquiring data indicating a motion of the predetermined object by a sensor attached to the predetermined object;
And a transmitting step of externally transmitting information of a recording frame rate on the basis of data concerning the motion of the object acquired by the acquiring step. A program recorded on a recording medium,
Computer,
Receiving means for receiving data indicating movement of the object by a sensor attached to the predetermined object,
And control means for controlling a recording frame rate of an image picked up by the image pickup means on the basis of the data received by said receiving means. A program recorded on a recording medium,
Computer,
An acquisition means for acquiring data indicating a motion of the predetermined object by a sensor attached to the predetermined object,
And a function of transmitting the information of the recording frame rate to the outside on the basis of the data on the motion of the object acquired by the acquisition means.

Images