JP2010193067A - Image capturing apparatus, method and program for controlling the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that erroneous detection may occur since each user performs an operation with different strength and motion size when using an operation means for detecting a prescribed motion by acceleration detection. <P>SOLUTION: An image capturing apparatus includes a display section for displaying an optical image formed by an image sensor as an image, a change means for changing the image to be displayed on the display section, an acceleration detection means for detecting an acceleration component of deflection for output, and a motion detection means for detecting deflection given by an operator to change the image to be displayed on the display section from an output of the acceleration detection means. The motion detection means detects that an acceleration signal reaches and exceeds the first threshold, and then detects deflection given by the operator and changes an image to be displayed on the display section when the acceleration signal reaches a second threshold having a sign differing from that of the first threshold and an absolute value larger than the first threshold, and then reaches a third threshold having a sign identical to that of the second threshold and an absolute value larger than the second threshold. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for improving operability in an imaging apparatus such as a digital camera.

  Conventionally, a digital camera has been operated by selecting a menu by combining an operation member such as a button or a dial with a display device such as an LCD.

  However, in recent years, functions tend to increase, and the operation method becomes complicated, so that there is a problem that the functions of the camera are not used. Therefore, an operation method using motion detection by acceleration detection is recently attracting attention as an intuitive operation method. There is known a technique that allows a camera function to be easily used by assigning a function to an operation of shaking the camera.

  FIG. 16 is a diagram illustrating a shaking operation when the imaging device is shaken while looking at the display unit of the imaging device.

  When a person has a camera, the state in which the person holds the camera in a horizontal state (the state (1) in FIG. 16) with the right hand is the basic way of holding because of the relationship with the shutter button. When the camera is shaken, it is conceivable that the camera can be swung up or down with the wrist or elbow as the center of rotation while keeping the way it is held. For this reason, when trying to swing down the imaging apparatus, the operation is to swing up from a horizontal state, swing up and then swing down.

  In this case, the image pickup apparatus swings up from the state horizontal to the ground as shown in FIG. 16 (1) to the state shown in FIG. 16 (3) through the state shown in FIG. 16 (2). Transition. Further, the operation for swinging down shifts from the state of (3) in FIG. 16 to the state of (1) in FIG. 16, contrary to the operation of swinging up. However, since holding the camera in a horizontal state (the state (1) in FIG. 16) with the right hand is the basic way to hold it, prepare it before the main operation when shaking the camera downward (the main operation). In many cases, this operation is started after it is swung up as an operation. On the other hand, when swinging upward, the camera is often tilted downward once in order to gain momentum.

  Patent Document 1 discloses that different functions can be assigned by shaking the camera in each axial direction for detecting acceleration. The invention of Patent Document 1 is a camera having an acceleration sensor that can detect in the ± X, ± Y, and ± Z directions, and executes an operation assigned to each axis when the acceleration detection amount of each axis exceeds a threshold value It is to do.

Japanese Patent Registration No. 04008787

  However, in a camera capable of detecting acceleration, it is difficult to shake the camera accurately in the axial direction for detecting acceleration, and due to the structure of a person's arm, rotational motion centering on the elbows and wrists is not possible. It will be affected. As a result, acceleration often occurs in a different direction in which acceleration is detected.

  For this reason, if a detection method for determining whether the acceleration exceeds the threshold value as in the conventional case, an operation that is a swing in a direction different from the main operation is detected as the main operation, and there is a problem in detection accuracy.

In addition, in a camera capable of detecting acceleration, the function assigned when performing the main operation of shaking the camera after detecting the waveform of the conventional main operation is executed when the camera is shaken and when the function is executed. There is a time lag between Due to this time lag, despite trying to realize an intuitive operation method of the imaging device, there was a problem that it was difficult to use the present invention, which was made in view of the above problems, By performing detection using the characteristics of the acceleration waveform according to the actual operation method, it is possible to detect a predetermined operation with high detection accuracy and provide a technique for realizing an intuitive operation method.

  The present invention solves the above-described problems, and is an image pickup apparatus having an image pickup device that converts an optical image into an electrical signal, and displays the optical image formed by the image pickup device as an image. A change unit that changes an image displayed on the display unit, an acceleration detection unit that detects and outputs an acceleration component of a shake applied to the imaging device, and an output from the acceleration detection unit. Motion detection means for detecting a shake applied by an operator to change an image displayed on the display unit, wherein the motion detection means has the acceleration signal reach a first threshold value, and the first The acceleration signal is the same as the second threshold value after reaching a second threshold value that is different from the first threshold value and has a larger absolute value than the first threshold value after detecting that the threshold value is exceeded. Sign and said second When the third threshold value, which is smaller than the threshold value, is reached, the shake applied by the operator is detected, and the changing unit displays an image to be displayed on the display unit according to the detection result of the motion detecting unit. It is characterized by changing.

  According to the present invention, it is possible to accurately detect that a detection device, a portable device equipped with the detection device, an imaging device, or the like is shaken, and to provide an intuitive and easy-to-understand operation system. .

1 is a system configuration diagram illustrating an imaging apparatus according to an embodiment of the present invention. It is a figure explaining a specific example which gravity acceleration changes according to the inclination of an imaging device. (A) In the imaging device which concerns on this invention, it is a figure explaining a specific example of the acceleration waveform obtained by swing-up operation. (B) In the imaging device which concerns on this invention, it is a figure explaining a specific example of the acceleration waveform obtained by swing-down operation. (C) In the imaging device which concerns on this invention, it is a figure explaining a specific example of the acceleration waveform obtained by the operation | movement swung down after swinging up. It is a figure explaining a specific example of the acceleration waveform obtained by the swing operation | movement by this invention in the imaging device which concerns on this invention. 5 is a flowchart showing a flow of processing for detecting a swing motion in the imaging apparatus according to Embodiments 1 to 3 of the present invention. 6 is a flowchart showing the flow of processing in step S100 of FIG. 5 in the imaging apparatus according to Embodiment 1 of the present invention. 6 is a flowchart showing the flow of processing in step S101 of FIG. 5 in the imaging apparatus according to Embodiment 1 of the present invention. 6 is a flowchart showing the flow of processing in step S102 of FIG. 5 in the imaging apparatus according to Embodiment 1 of the present invention. 6 is a flowchart showing the flow of processing in step S100 of FIG. 5 in the imaging apparatus according to Embodiment 2 of the present invention. 6 is a flowchart showing the flow of processing in step S101 of FIG. 5 in the imaging apparatus according to Embodiment 2 of the present invention. 6 is a flowchart showing a flow of processing in step S101 in FIG. 5 in the imaging apparatus according to Embodiment 3 of the present invention. 7 is a flowchart showing a flow of processing for detecting a swinging motion in an imaging apparatus according to Embodiments 4 and 5 of the present invention. 12 is a flowchart showing the flow of processing in step S101 of FIG. 12 in the imaging apparatus according to Embodiment 4 of the present invention. 12 is a flowchart showing the flow of processing in step S104 of FIG. 12 in the imaging apparatus according to Embodiment 4 of the present invention. 12 is a flowchart showing the flow of processing in step S101 of FIG. 12 in the imaging apparatus according to Embodiment 5 of the present invention. It is a figure explaining a specific example of a swing operation | movement.

  FIG. 1 is a system configuration diagram showing an imaging apparatus according to an embodiment of the present invention. In FIG. 1, reference numeral 10 denotes an optical system of the image pickup apparatus 1, which includes a zoom lens 11a, a focus adjustment lens 11b, a shutter 12, a diaphragm unit 13, and the like. Reference numeral 14 denotes an optical axis of the optical system 10. An image sensor 21 converts an optical image into an electrical signal, and an A / D converter (analog-to-digital converter) 22 converts an analog signal output of the optical image formed by the image sensor 21 into a digital signal. A timing generator 24 supplies a clock signal and a control signal to the image sensor 21, A / D converter 22, and D / A converter 27, and is controlled by the memory control unit 25 and the system control unit 50.

  An image processing unit 23 performs predetermined pixel interpolation processing, color conversion processing, and gamma processing on the data from the A / D converter 22 or the data from the memory control unit 25. Further, the image processing unit 23 performs predetermined processing using the captured image data, and the system control unit 50 controls the exposure control unit 41 and the focus control unit 42 based on the obtained result. That is, contrast AF (autofocus) processing, AE (automatic exposure) processing, and the like are performed. Further, the image processing unit 23 can perform a predetermined calculation process using the captured image data, and can also perform an AWB (auto white balance) process based on the obtained calculation result. The specific calculation processing of the exposure control unit will be described in detail later.

  A memory control unit 25 controls the A / D converter 22, the image processing unit 23, the timing generation unit 24, the image display memory 26, the D / A converter 27, the compression / decompression unit 28, and the internal memory 29. The data of the A / D converter 22 is sent to the image display memory 26 or the internal memory 29 via the image processing unit 23 and the memory control unit 25, or the data of the A / D converter 22 is directly sent to the memory control unit 25. Written. 26 is an image display memory, and 27 is a D / A converter. Reference numeral 7 denotes an image display unit including a TFT, an LCD, and the like. Display image data written in the image display memory 26 is displayed on the image display unit 7 via a D / A converter 27. If image data captured using the image display unit 7 is sequentially displayed, an electronic finder function can be realized. The image display unit 7 not only displays an image, but also displays various menu items related to various settings of the imaging apparatus 1 together with or without displaying the image. The user can change the setting of the designated item by appropriately selecting the menu item displayed on the image display unit 7 while operating the operation switch 5.

  A compression / decompression unit 28 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the internal memory 29, performs compression processing or decompression processing, and stores the processed data in the internal memory. Write to 29. Reference numeral 29 denotes an internal memory for storing captured still images and moving images, and has a sufficient storage capacity for storing a predetermined number of still images and a predetermined time of moving images. As a result, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the internal memory 29 at high speed. The internal memory 29 can also be used as a work area for the system control unit 50.

  Reference numeral 41 denotes an exposure control unit that controls the shutter 12 and the aperture unit 13, and supports flash photography by cooperating with the strobe 9 controlled via the strobe control unit 8. Reference numeral 42 denotes a focus control unit that controls the focusing lens 11b, 43 denotes a zoom control unit that controls zooming by the smooth lens 11a, and 44 controls the operation of the barrier 2 that is a protective member disposed on the front surface of the lens. It is a barrier control unit.

  Reference numeral 9 denotes a strobe, which is controlled by the strobe control unit 8 and corresponds to the AF auxiliary light projection function and the strobe dimming function. Reference numeral 50 denotes a system control unit that controls the entire imaging apparatus 1, and reference numeral 45 denotes a volatile memory that temporarily stores constants, variables, programs, and the like for operation of the system control unit 50.

  Reference numeral 46 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM. Constants, variables, programs, and the like necessary for the operation of the imaging apparatus 1 are recorded so that they are not lost even when the imaging apparatus 1 is not operating. During operation of the imaging apparatus 1, constants, variables, programs, and the like that are recorded in response to a call instruction from the system control unit 50 are sent to the system control unit 50. The system control unit expands the called constants, variables, programs, and the like in the memory 45 so that they can be used as needed.

  The acceleration sensor 83 is an XY-axis or XY-Z-axis vibration detection sensor, and detects an acceleration component (acceleration) of shake applied to the imaging apparatus 1. The acceleration sensor 83 detects an acceleration component (acceleration) of shake applied to the imaging device 1. The acceleration sensor 83 may be a single sensor or a combination of a plurality of sensors as long as the sensor can detect vibration and posture, such as a gyro sensor and a posture sensor. Reference numeral 80 denotes an acceleration detection sensor control unit, which includes an operation detection unit 81 and an attitude detection unit 82. An acceleration signal from the acceleration sensor 83 is detected to detect the posture state of the imaging apparatus 1. Further, the motion detector 81 determines a predetermined vibration or a stationary state. Further, when the posture detection unit 82 detects that the posture is a predetermined posture, the operation input from the operation members such as the operation switch 5, the release switch 3, and the mode dial 4 is invalidated via the system control unit. Further, the acceleration detection sensor control unit 80 controls the detection cycle of the acceleration sensor with respect to the detection cycle control unit 84.

  Reference numeral 47 denotes a display unit such as a liquid crystal display device that displays an operation state, a message, and the like using characters, images, sounds, and the like in accordance with execution of a program in the system control unit 50. The display unit 47 is installed in a single or a plurality of positions near the operation unit of the image pickup apparatus 1 so as to be easily visible, and is configured by a combination of an LCD and an LED, for example. In addition, the display unit 47 may have a part of the function installed in the optical viewfinder 6. The display unit 47 displays, for example, shutter speed, aperture value, exposure correction, strobe light emission setting, and the like. Further, one or a plurality of display units 47 are installed on the front surface (optical lens side) of the image pickup apparatus 1 in order to notify the user of the completion of shooting preparation and the stationary state of the image pickup apparatus 1.

  Reference numerals 3, 4 and 5 are operation units for inputting various operation instructions of the system control unit 50, and are configured by a single or a combination of a switch, a dial, a touch panel, a voice recognition device, and the like.

  A release switch 3 is specifically configured to be pushed in two stages. The user gives a shooting preparation instruction by a half-press operation (SW1 on) that is a push operation up to the first stage, and gives a shooting instruction by a full press (SW2 on) operation that is a push operation up to the second stage. Can do. When the photographing preparation instruction SW1 is turned on, the system control unit 50 performs control so as to perform photographing preparation operations such as AF (autofocus) processing and AE (automatic exposure) processing. When the image capturing instruction SW2 is turned on, the system control unit 50 drives the shutter 12 and the aperture unit 13 via the exposure control unit 41 to perform control for capturing the subject image by the image sensor 21. Specifically, the subject image is exposed by driving the shutter 12 to open and close while the image sensor 21 is in the accumulation state. After the shutter 12 returns to the closed state and the charge accumulation of the image sensor 21 is completed, the accumulated charge is read out as a signal. The system control unit 50 and the memory control unit 25 use the A / D converter 22, the image processing unit 23, the compression / decompression unit 28, and the internal memory 29 to perform a series of development processing and image processing on the signal read from the image sensor 21. To generate image data. The generated image data is stored as an image file in the recording unit 63 of the recording medium 60 via the interface 51 and connector 52 on the imaging device 1 side, and the connector 61 and interface 62 on the recording medium 60 side that can be attached and detached. To be recorded. As the recording unit 60, a recording unit having a sufficient capacity for recording a plurality of pieces of image data, such as a hard disk or a flash memory, is suitable. Reference numeral 53 denotes a recording medium attachment / detachment detection unit that detects whether or not the recording medium 60 is attached to the imaging apparatus 1.

  Reference numeral 4 denotes a mode dial switch, which can be set by switching each function mode such as power-off, shooting mode, playback mode, PC connection mode, and the like. Reference numeral 5 denotes an operation switch including various buttons, a touch panel, and the like, and a menu button, a set button, a strobe setting button, and the like are provided.

  Reference numeral 6 denotes an optical viewfinder, which can directly check the subject. In this case, shooting can be performed using only the optical viewfinder 6 without using the electronic viewfinder function of the image display unit 7. In addition, a part of the display unit 47 may be provided in the optical viewfinder 6 so that, for example, the shutter speed and the aperture value can be confirmed.

  A power control unit 48 includes a battery detection circuit, a DC / DC converter, a switch circuit that switches a block to be energized, and the like. Then, the presence / absence of a battery, the type of battery, and the remaining battery level are detected, and the detection result is sent to the system control unit 50. Further, necessary power is appropriately supplied to each unit of the imaging apparatus 1 based on an instruction from the system control unit 50.

  A power supply 70 supplies power from the power supply unit 72 to the imaging device 1 side via the connector 71 and the connector 49 on the imaging device 1 side. The power supply unit 72 is configured by either a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like, or a combination thereof.

  A communication control unit 54 supports various communication functions such as USB, IEEE 1394, LAN, and wireless communication. Reference numeral 55 denotes a connector for connecting the imaging device 1 to another device by the communication unit 54 or an antenna for wireless communication.

  Next, a method for detecting an operation of shaking an imaging apparatus as an embodiment of the present invention using an acceleration waveform will be described with reference to FIGS.

  Examples of the acceleration generated in the imaging device include acceleration due to gravity caused by the earth's gravity and acceleration caused by movement and acceleration caused by deceleration. Gravitational acceleration is always applied to an object, and becomes zero when it falls freely. On the other hand, the acceleration that occurs when an object moves includes acceleration with a positive acceleration component that occurs when the object starts moving (acceleration) and when the object stops (decelerates) when the traveling direction is positive. ), An acceleration having a negative acceleration component is generated. At this time, in the acceleration waveform, a mountain having a positive direction appears during acceleration, and a mountain having a negative direction appears during deceleration. That is, when accelerating and decelerating, the waveform peaks in opposite directions. In addition, during the constant speed movement, no acceleration is generated, so the value is zero.

  Here, an example of an acceleration waveform when the imaging apparatus is shaken will be described.

  2 shows a coordinate system in the case where the imaging apparatus of the present embodiment is in a horizontal state with respect to the ground as in the state (1) in FIG. 16 and a state in which the imaging apparatus is swung up as in the state (3) in FIG. FIG. 5 is a diagram illustrating detection of gravitational acceleration when an acceleration sensor that detects acceleration in the X-axis direction and the Y-axis direction is mounted.

  The vertical direction of the imaging apparatus is the Y axis, and the horizontal direction is the X axis. As shown in FIG. 2A, the Y axis is a vertical direction in a plane perpendicular to the optical axis, and the upward direction is positive. Similarly, as shown in FIG. 2A, the X axis is a direction perpendicular to the Y axis in a plane perpendicular to the optical axis, and the right direction with the display unit 7 facing forward is positive. This is because a normal image pickup device operates an operation member such as a shutter with the right hand. In most cases, the operation of shaking the image pickup device is held with the right hand and swings up or down around the wrist or elbow. It is because it becomes the operation of lowering. Therefore, even if the imaging device is operated with the left hand, the same effect can be obtained by reversing the positive and negative of the X axis.

  FIG. 2A shows a state where the imaging device is arranged horizontally with respect to the ground. This state is a posture often used when viewing an image displayed on the display unit of the imaging apparatus. FIG. 2C is a diagram showing detection of gravitational acceleration in the posture of FIG. In this case, in a horizontal posture, all gravitational acceleration occurs in the Y-axis direction and is not affected by the gravitational acceleration in the X-axis direction. Therefore, the gravitational acceleration in a stationary state is 0 g level in the X-axis direction and the Y-axis direction. Becomes 1g level.

  On the other hand, FIG. 2B shows a state in which the imaging apparatus is inclined by an angle α with respect to the ground. In this case, as shown in FIG. 2D, the X-axis gravitational acceleration when the image pickup apparatus is swung up to an angle inclined by α from the horizontal is (sin α) g level, and the Y-axis gravitational acceleration is (cos α ) It becomes g level. For this reason, even in the stationary state, there is a difference between the acceleration level between the state of swinging up and the horizontal posture.

  FIGS. 3A to 3C are waveforms showing the X-axis direction component of acceleration detected from the acceleration sensor when the imaging apparatus is swung up or down. The horizontal axis represents time, and the vertical axis represents the acceleration component when the imaging apparatus is swung up from a horizontal posture.

  FIG. 3A shows the waveform of the X-axis direction component of the acceleration when the imaging apparatus is accelerated from the horizontal state at the start timing of swinging up, decelerated at the end of swinging up and stopped. That is, the state is shifted from (1) in FIG. 16 to (3) in FIG. 16 through (2) in FIG. In this case, the acceleration is detected at the peak 501 at the acceleration of the swing start and at the peak 502 at the deceleration of the swing end. In the coordinate system, since the state shown in FIG. 2 (a) is shifted to the state shown in FIG. 2 (b), the X-axis direction component of gravitational acceleration before and after swinging is 0 g level as shown in FIG. 2 (c). To (sin α) g level as shown in FIG.

  FIG. 3B shows the waveform of the X-axis component of the acceleration detected from the acceleration sensor when the imaging device is accelerated and swung down from a state where it has been swung up, decelerated and stopped when swung down to a horizontal position. Is shown. That is, the state is shifted from (3) in FIG. 16 to (1) in FIG. 16 through (2) in FIG. In this case, a peak 503 is detected at the acceleration at the start of the swing, and a peak 504 is detected at the deceleration at the end of the swing. Since the coordinate system has shifted from the state of FIG. 2B to the state of FIG. 2A, the X-axis direction component of the gravitational acceleration during the stationary state before and after swinging is expressed as (sin α ) Transition from the g level to the 0 g level as shown in FIG.

  The acceleration waveform when the image pickup apparatus is actually swung up and then lowered is a waveform that is a combination of the acceleration waveforms of FIGS. 3 (a) and 3 (b), as shown in FIG. 3 (c). Become. A peak 505 in FIG. 3C is an acceleration peak that appears due to acceleration when the swing-up operation is executed. A peak 506 is a peak of acceleration that appears when the deceleration at the time of swinging up and the acceleration at the time of swinging down are combined in a state where the swinging is finished and the swinging is about to be started. A peak 507 is an acceleration peak 507 that appears during deceleration when swinging down. The peak 505 is a first acceleration waveform, the peak 506 is a second acceleration waveform, and the peak 507 is a third acceleration waveform.

  Since the peak 506 includes the influence of gravitational acceleration, the peak tends to increase by the amount corresponding to the gravitational acceleration, and can be effectively used to detect the motion of shaking the imaging device by the acceleration. FIG. 3 (c) shows the acceleration waveform of the operation of swinging up and then swinging down. In the case of the operation of swinging up and swinging down, the waveform has an opposite phase to the waveform of FIG. 3 (c). Thus, the stationary output becomes (sin α) g level.

  FIG. 4 shows an example of the X-axis direction component of acceleration detected by the acceleration detector (acceleration sensor in this embodiment) when the imaging apparatus is actually swung down as shown in FIG. It is. The horizontal axis represents time, the vertical axis represents the output of the acceleration sensor, and the direction of acceleration is represented by a sign.

  It is assumed that the first threshold value A and the threshold value −A are threshold values for determining whether or not the imaging apparatus of the present embodiment is moving. In the horizontal state in a stationary state, the X-axis component of acceleration is not detected from FIG. 2C, and is 0 (0 g). Therefore, if the detected acceleration is in a range greater than or equal to threshold −A or less than threshold A, it is determined that the imaging apparatus is not moving. Conversely, if the detected acceleration is less than or equal to threshold −A or greater than threshold A, imaging is performed. It is determined that the device is moving.

  On the other hand, the threshold value B and the threshold value −B, which are the second threshold values, are threshold values for determining whether the imaging apparatus is shaken in a predetermined manner. For this reason, the thresholds are set in the relationship of threshold-B <threshold-A, threshold A <threshold B. Therefore, if the detected acceleration is greater than or equal to the threshold A and less than the threshold B or greater than or equal to the threshold −A and greater than −B, the imaging apparatus is moving but not being shaken in a predetermined manner. judge. On the other hand, if the detected acceleration is greater than or equal to the threshold value B or less than or equal to −B, it is determined that the imaging device is moving and is shaken in a predetermined manner.

  The third threshold value C and threshold value -C are threshold values for determining whether the imaging apparatus is shaken within a predetermined strength range. For this reason, the threshold values are set in the relationship of threshold-C <threshold-B and threshold B <threshold C. Therefore, if the detected acceleration is greater than or equal to the threshold B and less than the threshold C, or less than or equal to the threshold −B and greater than −C, it is determined that the imaging apparatus is being shaken in a predetermined manner. On the other hand, if the detected acceleration is greater than or equal to the threshold value C or less than or equal to −C, it is determined that the imaging device is too strong to swing. If the imaging device is shaken strongly, there is a high possibility that the imaging device will fall off the hand by mistake, so that a warning is given if it is determined that the imaging device is too strong. As a warning method, a warning text may be displayed on the display unit 47, or a warning sound may be emitted from a speaker (not shown).

  Of the peaks 301 to 303 shown in FIG. 4, 302 having the largest absolute value of acceleration corresponds to the second acceleration waveform in FIG. When the purpose is to swing the imaging device down, it represents a swing-down operation, and when the purpose is to swing it up, it represents a swing-up operation. In this case, reference numeral 301 denotes the first acceleration waveform in FIG. 3C, which is an acceleration of the swing-up operation that is a preparatory operation for swing-down. Reference numeral 303 denotes a third acceleration waveform in FIG. 3C, which is a waveform when deceleration at the time of swing-down is detected. If this operation is a swing-up operation, the waveform is axisymmetric with respect to the X axis (positive and negative are reversed), and the first acceleration waveform 301 and the third acceleration waveform 303 are upward. Become. It should be noted that the waveform having the largest absolute value of the acceleration does not necessarily indicate the main operation, and the main operation is more likely to be shaken more strongly than the preparation operation. The waveform detection method of this operation in the present invention will be described later.

  310 is the time when the second acceleration waveform 302 crosses the threshold A (or -A). Reference numeral 311 denotes a time when the second acceleration waveform 302 crosses the threshold A (or -A) once and then crosses again. Reference numeral 312 denotes a time when the third acceleration waveform 303 straddles the threshold A (or -A) once and then straddles again. The threshold S1 and the threshold S2 are thresholds for the time t1 while the second acceleration waveform (main operation) is equal to or higher than the threshold A or equal to or lower than the threshold −A. That is, it is the time until the second acceleration waveform 302 exceeds the threshold A and falls below A again (or falls below the threshold −A and exceeds the threshold −A again). It is assumed that the second acceleration waveform (main operation) is detected when the condition of threshold value S1 ≦ time t1 ≦ threshold value S2 is satisfied.

  Further, if the state where the imaging device is not moving (the range where the acceleration is greater than the threshold value −A and less than the threshold value A) is continued for a time equal to or longer than the threshold value E, it is determined that the swing motion is stopped. In this case, when the imaging apparatus is not moving, that is, when the acceleration is greater than the threshold value -A and the range less than the threshold value A is not continued for the threshold time E or longer, the acceleration is first set to the threshold value A or -A. It is assumed that the operation is one time from when the value is exceeded.

  Therefore, for example, the third acceleration waveform 303 in FIG. 4 is regarded as a series of operations with the first acceleration waveform 301 and the second acceleration waveform 302. Then, after the third acceleration waveform 303, when the acceleration is greater than the threshold value -A and the range less than the threshold value A is continued for a time equal to or greater than the threshold value E, the acceleration becomes the threshold value -A or less or the threshold value A or more again. Start detecting a new swing.

  In FIG. 4, there are three types of values A, B, and C as acceleration level threshold values, and in addition to these, there are values that have different signs, so that there are six values. , Six different values may be used.

  One method for detecting the direction in which the imaging device is shaken using the above features will be described with reference to the waveform in FIG. 4 representing the acceleration output when the imaging device is shaken and the flowcharts in FIGS. 5 to 8. To do.

  FIG. 5 is a flowchart showing a flow of processing in which the motion detection unit 81 swings the imaging apparatus to detect motion. With reference to the waveform of FIG. 4 as an example, processing for detecting an operation of shaking the imaging apparatus will be described.

  When the acceleration crosses the threshold value A or the threshold value -A shown in FIG. 4 (plot 310 in FIG. 4), processing for detecting that the imaging device is shaken is started. When the process of detecting that the imaging device is shaken is started, first acceleration waveform detection is performed in step S100.

  When the first acceleration waveform crosses the threshold A or -A, it is determined that the first acceleration waveform has been detected (Yes in S100). The operation in step S100 will be described later in detail with reference to FIG.

  When the first acceleration waveform is detected, a second acceleration waveform detection process is performed in step S101. When the second acceleration waveform crosses the threshold value B or -B (plot 312 in FIG. 4), it is determined that the second acceleration waveform has been detected (Yes in S101). Will be described in detail.

  In step S102, when the first acceleration waveform is detected (Yes in step S100) and the second acceleration waveform is detected (Yes in step S101), the imaging apparatus is shaken or shaken upward. It is determined whether it has fallen below. In addition, although mentioned later for details, the 2nd acceleration waveform needs to be a different sign from the threshold value straddled by the 1st acceleration waveform detection. For example, when the first acceleration waveform detection is performed by straddling the threshold value −B, the second acceleration waveform detection needs to straddle the threshold value B. This is because the first acceleration waveform detection is a preparatory operation before the main operation and is swung in the opposite direction to the main operation. The operation in step S102 will be described in detail later with reference to FIG.

  If it is determined in step S102 that the imaging device has been shaken (Yes in step S102), the swing motion detection is terminated. If any of the determination conditions from Step S100 to Step S102 is No, it is determined that the swing motion cannot be detected immediately (Step S103), and the swing motion detection is terminated.

  Next, the first acceleration waveform detection (step S100 in FIG. 5) in the present embodiment will be described in detail with reference to an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the first acceleration waveform in FIG. To do.

  In step S200, it is determined whether or not the acceleration is equal to or less than the threshold −A. When the acceleration is equal to or lower than the threshold −A (Yes in step S200), the first acceleration waveform is detected as a downward waveform (step S203), and the first acceleration waveform detection is terminated.

  If the acceleration is larger than the threshold −A (No in step S200), it is determined whether or not the acceleration is greater than or equal to the threshold A in step S204. When the acceleration is equal to or greater than the threshold A (Yes in step S204), the first acceleration waveform is detected as an upward waveform (step S207), and the first acceleration waveform detection is terminated.

  If the acceleration is less than the threshold value A in step S204, the acceleration is larger than the threshold value -A in step S200, so the threshold value is not crossed and the vehicle is in a stationary state, so the process returns to S200 again.

  Subsequently, the second acceleration waveform detection (step S101 in FIG. 5) in the present embodiment will be described in detail with reference to an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG. To do.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 5, when the acceleration becomes greater than or equal to the threshold A (step S300), the peak value (maximum value) while the acceleration is greater than or equal to the threshold A. Is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, the peak value (maximum value) of the detected waveform after exceeding the threshold A is overwritten by overwriting the peak value (maximum value) when the peak value (maximum value) exceeding the threshold A is updated. Can be measured. When the peak value (maximum value) of this waveform is equal to or greater than the threshold value B (Yes in step S301), the second acceleration waveform is detected as an upward waveform (step S304), and the process proceeds to the next process.

  However, if the peak value of the waveform is less than the threshold B in step S301 and falls below the threshold A without exceeding the threshold B (No in step S301), it is assumed that the second acceleration waveform cannot be detected (step S310). ). In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 5, when the acceleration is less than the threshold A (No in step S300), it is determined whether the acceleration is equal to or less than the threshold −A (step S305). ). When it is determined that the acceleration is equal to or lower than the threshold −A (Yes in step S305), a peak value (minimum value) while the acceleration is equal to or lower than the threshold −A is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, when the peak value (minimum value) after updating below the threshold value -A is updated, the peak value (minimum value) of the detected waveform after the threshold value -A is overwritten by overwriting the peak value (minimum value). Value) can be measured. When the peak value (minimum value) of this waveform becomes equal to or lower than threshold-B before crossing over threshold-A again (Yes in step S306), the second acceleration waveform is detected as a downward waveform (step S309). ) And proceed to the next process.

  However, if the peak value of the waveform is larger than the threshold value −B in step S306 and exceeds the threshold value −A without falling below the threshold value −B (No in step S306), it is assumed that the second acceleration waveform cannot be detected (step S306). Step S310). In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated.

  Next, the swing motion determination (step S102 in FIG. 5) in the present embodiment will be described in detail using an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG.

  In step s400, it is determined whether or not it is determined that the first acceleration waveform detected in step S203 is a downward waveform. If it is determined that the first acceleration waveform detected in step S203 is a downward waveform (Yes in step S400), the process proceeds to step S401. If it is not determined that the first acceleration waveform detected in step S203 is a downward waveform (No in step S400), that is, if it is determined that the waveform is an upward waveform in step S207, step S403 is performed. Proceed to

  In step S401, it is determined whether or not the direction of the second acceleration waveform is determined to be upward in step S304. If it is determined in step S304 that the direction of the second acceleration waveform is upward (Yes in step S401), the process proceeds to step S402, and it is determined in step S402 that the imaging apparatus has performed the swing-down operation. Here, if the direction of the second acceleration waveform is not determined to be upward in step S304 (No in step S401), the process proceeds to step S405, where it is determined that no swing motion has been detected. In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated.

  In step S403, it is determined whether or not the direction of the second acceleration waveform is determined to be downward in step S309. If it is determined in step S309 that the direction of the second acceleration waveform is downward (Yes in step S403), the process proceeds to step S405, and it is determined in step S405 that the imaging apparatus has performed a swing-up operation. Here, if the direction of the second acceleration waveform is not determined to be downward in step S309 (No in step S403), the process proceeds to step S405, where it is determined that no swing motion has been detected. In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated.

  In the present embodiment, when a portable device such as an imaging device is shaken and operated, if it is shaken with an action stronger than a predetermined shaking strength, the operator is warned that it is too strong.

  This embodiment will be described using an imaging apparatus having the same configuration as that of the first embodiment. FIG. 5 is a flowchart showing a flow of processing in which the motion detection unit 81 detects a swing motion of the imaging apparatus. With reference to the waveform of FIG. 4 as an example, processing for detecting an operation of shaking the imaging apparatus will be described.

  When the acceleration crosses the threshold value A or the threshold value -A shown in FIG. 4 (plot 310 in FIG. 4), processing for detecting that the imaging device is shaken is started. When the process of detecting that the imaging device is shaken is started, first acceleration waveform detection is performed in step S100. When the first acceleration waveform crosses the threshold A or -A, it is determined that the first acceleration waveform has been detected (Yes in S100). The operation in step S100 will be described later in detail with reference to FIG.

  When the first acceleration waveform is detected, a second acceleration waveform detection process is performed in step S101. When the second acceleration waveform crosses the threshold B or -B (plot 312 in FIG. 4), it is determined that the second acceleration waveform has been detected (Yes in S101). The operation in step S101 will be described in detail later with reference to FIG.

  In step S102, when the first acceleration waveform is detected (Yes in step S100) and the second acceleration waveform is detected (Yes in step S101), the imaging apparatus is shaken or shaken upward. It is determined whether it has fallen below. The second acceleration waveform needs to have a different sign from the threshold value straddled by the first acceleration waveform detection. For example, when the first acceleration waveform detection is performed by straddling the threshold value -A, the second acceleration waveform detection needs to straddle the threshold value B. This is because the first acceleration waveform detection is a preparatory operation before the main operation and is swung in the opposite direction to the main operation. The detailed description of the operation in step S102 is omitted because it is the same as that in step 102 of the first embodiment.

  If it is determined in step S102 that the imaging apparatus has been shaken, the swing motion detection is terminated (Yes in step S102). If any of the determination conditions from Step S100 to Step S102 is No, it is determined that the swing motion cannot be detected immediately (Step S103), and the swing motion detection is terminated.

  Next, the first acceleration waveform detection (step S100 in FIG. 5) in the present embodiment will be described in detail with reference to an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the first acceleration waveform in FIG. To do.

  In step S200, it is determined whether or not the acceleration is equal to or less than the threshold −A. When the acceleration is equal to or less than the threshold −A (Yes in step S200), the process proceeds to step S202. In step S202, it is determined whether or not the acceleration is equal to or less than a threshold −C. When the acceleration is larger than the threshold −C, the first acceleration waveform is detected as a downward waveform (step S203), and the first acceleration waveform detection is terminated. If the acceleration is equal to or lower than the threshold −C, it is assumed that the first acceleration waveform cannot be detected (step S208). A warning display indicating that the swing is too strong is displayed on the image display unit 7. Further, the warning is not limited to display only, and a voice warning may be given from a speaker (not shown). Then, the process proceeds to step 103 in FIG. 5 (No in step S100).

  If the acceleration is larger than the threshold −A (No in step S200), it is determined whether or not the acceleration is greater than or equal to the threshold A in step S204. When the acceleration is equal to or greater than the threshold A (Yes in step S204), the process proceeds to step S206. In step S206, it is determined whether the acceleration is greater than a threshold value C. When the acceleration is larger than the threshold value C, the first acceleration waveform is detected as an upward waveform (step S207), the first acceleration waveform detection is terminated, and the process proceeds to the next process. If the acceleration is larger than the threshold value C, it is assumed that the first acceleration waveform cannot be detected (step S208). In this case, the process proceeds to step 103 in FIG. 5 (No in step S100).

  If the acceleration is less than the threshold value A in step S204, the acceleration is larger than the threshold value -A in step S200, so the threshold value is not crossed and the vehicle is in a stationary state, so the process returns to S200 again.

  Subsequently, the second acceleration waveform detection (step S101 in FIG. 5) in the present embodiment will be described in detail using an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG. To do.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 5, when the acceleration becomes greater than or equal to the threshold A (step S300), the peak value (maximum value) while the acceleration is greater than or equal to the threshold A. Is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, the peak value (maximum value) of the detected waveform after exceeding the threshold A is overwritten by overwriting the peak value (maximum value) when the peak value (maximum value) exceeding the threshold A is updated. Can be measured. When the peak value (maximum value) of the waveform is equal to or greater than the threshold value B (Yes in step S301, time 310), the process proceeds to step S302.

  However, if the peak value of the waveform is less than the threshold B in step S301 and falls below the threshold A without exceeding the threshold B (No in step S301, time 311), the process proceeds to step S310. If the second acceleration waveform cannot be detected, the second acceleration waveform detection is terminated, and the next process is started. In this case, the process proceeds to step 103 in FIG. 5 (No in step S101).

  In step S302, it is determined whether the acceleration peak value (maximum value) is equal to or greater than the threshold value C. When the acceleration peak value (maximum value) is less than the threshold value C, the second acceleration waveform is detected as an upward waveform (step S304), and the second acceleration waveform detection is terminated. If the acceleration peak value (maximum value) is equal to or greater than the threshold value C (No in step S302), the acceleration waveform detection is terminated, and a warning display indicating that the swing is too strong is displayed on the image display unit 7 or the like (step S311). ). Further, the warning is not limited to display only, and a voice warning may be given from a speaker (not shown). In this case, the process proceeds to step 103 in FIG. 5 (No in step S101).

  On the other hand, immediately after the first acceleration waveform is detected in step S100 in FIG. 5, when the acceleration is less than the threshold A (No in step S300), it is determined whether the acceleration is equal to or less than the threshold −A. (Step S305). When it is determined that the acceleration is equal to or lower than the threshold −A (Yes in step S305), a peak value (minimum value) while the acceleration is equal to or lower than the threshold −A is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, when the peak value (minimum value) after updating below the threshold value -A is updated, the peak value (minimum value) of the detected waveform after the threshold value -A is overwritten by overwriting the peak value (minimum value). Value) can be measured. When the peak value (minimum value) of this waveform becomes equal to or less than threshold-B before crossing over threshold-A again (Yes in step S306), the process proceeds to step S307.

  However, if the peak value of the waveform is larger than the threshold value −B in step S306 and exceeds the threshold value −A without falling below the threshold value −B (No in step S306), it is assumed that the second acceleration waveform cannot be detected (step S306). Step S310). In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated.

  In step S307, it is determined whether or not the peak value (minimum value) of acceleration is equal to or less than the threshold −C. If the acceleration peak value (minimum value) is equal to or greater than the threshold −C, the second acceleration waveform is detected as a downward waveform (step S309), and the second acceleration waveform detection is terminated. If the peak value (minimum value) of acceleration is less than the threshold value −C (No in step S307), the acceleration waveform detection is terminated and a warning display indicating that the swing is too strong is displayed on the image display unit 7 or the like (step) S311). Further, the warning is not limited to display only, and a voice warning may be given from a speaker (not shown). In this case, the process proceeds to step 103 in FIG. 5 (No in step S101).

  As described above, regarding the second embodiment, when the swing motion is detected, the imaging apparatus displays a warning that the swing is too strong to call attention such as dropping when the swing is more than desired. As a result, when the portable device such as the imaging device is operated by shaking, it is prevented from accidentally leaving the hand of the operator and the portable device being thrown out or dropped. When it is weak, a warning may be displayed that the swing is too weak.

  The present embodiment is an embodiment in which forward playback or reverse playback of images to be reproduced is performed by shaking and operating a portable device such as an imaging apparatus having a playback mode and a shooting mode. By executing the playback mode, the user can view the image stored in the storage unit 63 through the image display unit 7 or the like.

  This embodiment will be described using an imaging apparatus having the same configuration as that of the first embodiment. FIG. 5 is a flowchart showing a flow of processing in which the motion detection unit 81 swings the imaging apparatus to detect motion. With reference to the waveform of FIG. 4 as an example, processing for detecting an operation of shaking the imaging apparatus will be described.

  When the acceleration crosses the threshold value A or the threshold value -A shown in FIG. 4 (plot 310 in FIG. 4), processing for detecting that the imaging device is shaken is started. When the process of detecting that the imaging device is shaken is started, first acceleration waveform detection is performed in step S100. If the first acceleration waveform crosses the threshold A or -A, it is determined that the first acceleration waveform has been detected (Yes in S100). Since the detailed description of the operation in step S100 is the same as that in step 100 of the first embodiment, it is omitted.

  When the first acceleration waveform is detected, a second acceleration waveform detection process is performed in step S101. When the second acceleration waveform crosses the threshold B or -B (plot 312 in FIG. 4), it is determined that the second acceleration waveform has been detected (Yes in S101). The detailed description of the operation in step S101 will be described later in detail with reference to FIG.

  In step S102, when the first acceleration waveform is detected (Yes in step S100) and the second acceleration waveform is detected (Yes in step S101), the imaging apparatus is shaken or shaken upward. It is determined whether it has fallen below. The second acceleration waveform needs to have a different sign from the threshold value straddled by the first acceleration waveform detection. For example, when the first acceleration waveform detection is performed by straddling the threshold value −B, the second acceleration waveform detection needs to straddle the threshold value B. This is because the first acceleration waveform detection is a preparatory operation before the main operation and is swung in the opposite direction to the main operation. Since the operation in step S102 is the same as the operation in step S102 in the first embodiment, detailed description in this embodiment is omitted.

  If it is determined in step S102 that the imaging apparatus has been shaken, the swing motion detection is terminated (Yes in step S102). If any of the determination conditions from Step S100 to Step S102 is No, it is determined that the swing motion cannot be detected immediately (Step S103), and the swing motion detection is terminated.

  Subsequently, the second acceleration waveform detection (step S101 in FIG. 5) in the present embodiment will be described in detail using an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG. explain.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 5, when the acceleration is greater than or equal to the threshold A (step S300), the peak value (maximum value) while the acceleration is greater than or equal to the threshold A. Is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, the peak value (maximum value) of the detected waveform after exceeding the threshold A is overwritten by overwriting the peak value (maximum value) when the peak value (maximum value) exceeding the threshold A is updated. Can be measured. When the peak value (maximum value) of this waveform is equal to or greater than the threshold value B (Yes in step S301), the second acceleration waveform is detected as an upward waveform (step S304), and the process proceeds to step S320. In step S320, the image displayed on the image display unit 7 is changed to the next image. In step S320, the image displayed on the image display unit 7 is changed to the previous image at the timing of the plot 313 in FIG. At this time, the display order of the images may be the name and number of the file, the date and time when the image was taken, and the date and time stored in the recording unit 61.

  However, if the peak value of the waveform is less than the threshold B in step S301 and falls below the threshold A without exceeding the threshold B (No in step S301), it is assumed that the second acceleration waveform cannot be detected (step S310). ). In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated and the process proceeds to the next process.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 5, when the acceleration is less than the threshold A (No in step S300), it is determined whether the acceleration is equal to or less than the threshold −A (step S305). ). When it is determined that the acceleration is equal to or lower than the threshold −A (Yes in step S305), a peak value (minimum value) while the acceleration is equal to or lower than the threshold −A is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, when the peak value (minimum value) after updating below the threshold value -A is updated, the peak value (minimum value) of the detected waveform after the threshold value -A is overwritten by overwriting the peak value (minimum value). Value) can be measured. When the peak value (minimum value) of this waveform becomes equal to or lower than threshold-B before crossing over threshold-A again (Yes in step S306), the second acceleration waveform is detected as a downward waveform (step S309). ), The process proceeds to step S321. In step S321, the image displayed on the image display unit 7 is changed to the previous image at the timing of the plot 313 in FIG. At this time, the display order of the images may be the name or number of the file, or may be the date / time of shooting or the date / time stored in the recording unit 61, but the order of the images displayed in step S320 is reversed. To be. However, this is not the case when there is a special mode that randomly determines the image display order, such as random playback.

  However, if the peak value of the waveform is larger than the threshold value −B in step S306 and exceeds the threshold value −A without falling below the threshold value −B (No in step S306), it is assumed that the second acceleration waveform cannot be detected (step S306). Step S310). In this case, the process proceeds to step 103 in FIG. 5, and the acceleration waveform detection process is immediately terminated and the process proceeds to the next process.

  Accordingly, it is possible to provide an imaging apparatus in which the image feeding direction can be changed according to the shaking direction by shaking the imaging apparatus in a predetermined direction while an image is displayed in the playback mode. In addition, since the image pickup apparatus according to the present embodiment determines which one is shaken when the second acceleration waveform is detected, image feeding can be started during this operation. Accordingly, it is possible to provide an imaging apparatus equipped with an operation system that allows the user to smoothly and intuitively send an image.

(Modification of Example 3)
Up to this point, the second acceleration waveform detection (step S101 in FIG. 5) in the third embodiment will be described in detail using the example of the swing motion waveform in FIG. 4 and the flowchart for detecting the second acceleration waveform in FIG. did. Here, for the second acceleration waveform detection (step S101 in FIG. 5) in the third embodiment, a flowchart for detecting the first acceleration waveform in FIG. 9 may be used instead of FIG. That is, in the flowchart for detecting the first acceleration waveform in FIG. 9, the same effect can be obtained by performing the process of step S320 after step S304 and performing the process of step S321 after step S304.

  In Example 3, the image was changed at the timing of the plot 313 in FIG. 4 in Step S320 and Step S321. However, as long as the effect is the same, there is no particular limitation, and it may be performed at the time point of the plot 312 (timing when the threshold value B is exceeded) or at the time point of the plot 315 (timing when the threshold value B is exceeded again). Any timing may be used as long as it is from the timing of the plot 312 to the timing of the plot 315.

  In this embodiment, waveform detection when the imaging apparatus according to this embodiment is continuously shaken will be described. This embodiment will be described using an imaging apparatus having the same configuration as that of the first embodiment.

  FIG. 12 is a flowchart illustrating a flow of processing in which the motion detection unit 81 swings the imaging apparatus to detect motion. With reference to the waveform of FIG. 4 as an example, processing for detecting an operation of shaking the imaging apparatus will be described.

  When the acceleration crosses the threshold value A or the threshold value -A shown in FIG. 4 (plot 310 in FIG. 4), processing for detecting that the imaging device is shaken is started. When the process of detecting that the imaging device is shaken is started, first acceleration waveform detection is performed in step S100.

  When the first acceleration waveform crosses the threshold A or -A, it is determined that the first acceleration waveform has been detected (Yes in S100). Since the detailed description of the operation in step S100 is the same as that in step 100 of the first embodiment, it is omitted.

  When the first acceleration waveform is detected, a second acceleration waveform detection process is performed in step S101. When the second acceleration waveform crosses the threshold B or -B (plot 312 in FIG. 4), it is determined that the second acceleration waveform has been detected (Yes in S101). The detailed description of the operation in step S101 will be described later in detail with reference to FIG.

  In step S102, when the first acceleration waveform is detected (Yes in step S100) and the second acceleration waveform is detected (Yes in step S101), the imaging apparatus is shaken or shaken upward. It is determined whether it has fallen below. The second acceleration waveform needs to have a different sign from the threshold value straddled by the first acceleration waveform detection. For example, when the first acceleration waveform detection is performed by straddling the threshold value -A, the second acceleration waveform detection needs to straddle the threshold value B. This is because the first acceleration waveform detection is a preparatory operation before the main operation and is swung in the opposite direction to the main operation. The detailed description of the operation in step S102 is omitted because it is the same as that in step 102 of the first embodiment.

  If it is determined in step S102 that the imaging apparatus has been shaken (Yes in step S102), the process proceeds to step S104. If any of the determination conditions from step S100 to step S102 is determined as No, it is determined that the swing motion cannot be detected immediately (step S103), and the process proceeds to step S104.

  In step S104, if the state in which the imaging device is not moving (the range in which the acceleration is greater than the threshold −A and less than the threshold A) continues for a time equal to or longer than the threshold E, it is determined that the swing motion has stopped. Then, it is detected that the acceleration waveform detection is completed. Then, the swing motion detection ends. The detailed description of the operation in step S104 will be described later in detail with reference to FIG.

  Next, the second acceleration waveform detection (step S101 in FIG. 12) in the present embodiment will be described in detail with reference to an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG. To do.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 12, when the acceleration is greater than or equal to the threshold A (step S300), the peak value (maximum value) while the acceleration is greater than or equal to the threshold A. Is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, the peak value (maximum value) of the detected waveform after exceeding the threshold A is overwritten by overwriting the peak value (maximum value) when the peak value (maximum value) exceeding the threshold A is updated. Can be measured. When the peak value (maximum value) of this waveform is equal to or greater than the threshold value B (Yes in step S301), the process proceeds to step S303.

  However, if the peak value of the waveform is less than the threshold B in step S301 and falls below the threshold A without exceeding the threshold B (No in step S301), it is assumed that the second acceleration waveform cannot be detected (step S310). ). In this case, the process proceeds to step 103 in FIG. 12, and the process proceeds to step S104, assuming that the acceleration waveform detection process cannot be performed.

  In step S303, it is determined whether the time t1 when the acceleration is equal to or greater than the threshold A is equal to or greater than the threshold S1 and equal to or less than the threshold S2. When the time t1 when the acceleration is equal to or greater than the threshold A is equal to or greater than the threshold S1 and equal to or less than the threshold S2 (Yes in S303), the second acceleration waveform is detected as an upward waveform (step S304), and the second Acceleration waveform detection ends. If the time t1 when the acceleration is equal to or greater than the threshold A is less than the threshold S1 or longer than the threshold S2 (No in S303), it is assumed that the second acceleration waveform cannot be detected (step S310). In this case, the process proceeds to step 103 in FIG. 12, and the process proceeds to step S104, assuming that the acceleration waveform detection process cannot be performed.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 12, when the acceleration is less than the threshold A (No in step S300), it is determined whether the acceleration is equal to or less than the threshold −A (step S305). ). When it is determined that the acceleration is equal to or lower than the threshold −A (Yes in step S305), a peak value (minimum value) while the acceleration is equal to or lower than the threshold −A is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, when the peak value (minimum value) after updating below the threshold value -A is updated, the peak value (minimum value) of the detected waveform after the threshold value -A is overwritten by overwriting the peak value (minimum value). Value) can be measured. When the peak value (minimum value) of this waveform becomes equal to or less than threshold-B before crossing over threshold-A again (Yes in step S306), the process proceeds to step S308.

  However, if the peak value of the waveform is larger than the threshold value −B in step S306 and exceeds the threshold value −A without falling below the threshold value −B (No in step S306), it is assumed that the second acceleration waveform cannot be detected (step S306). Step S310). In this case, the process proceeds to step 103 in FIG. 12, and it is determined that the acceleration waveform detection process cannot be performed, and the process proceeds to step S104 in FIG.

  In step S308, it is determined whether the time t1 when the acceleration is less than the threshold −A is equal to or greater than the threshold S1 and equal to or less than the threshold S2. When the time t1 when the acceleration is less than the threshold −A is equal to or greater than the threshold S1 and equal to or less than the threshold S2 (Yes in S308), the second acceleration waveform is detected as a downward waveform (step S309), and the second This completes the acceleration waveform detection. In addition, when the time t1 when the acceleration is less than the threshold −A is less than the threshold S1 or longer than the threshold S2 (No in S308), it is assumed that the second acceleration waveform cannot be detected (step S310). In this case, the process proceeds to step 103 in FIG. 12, and it is determined that the acceleration waveform detection process cannot be performed, and the process proceeds to step S104 in FIG.

  Next, the acceleration waveform end detection (step S104 in FIG. 12) in the present embodiment will be described in detail using an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the acceleration waveform end in FIG.

  In step S500, it is determined whether or not the acceleration is in a range not less than threshold −A and not more than threshold A. If it is determined in step S500 that the acceleration is within the range of the threshold −A or more and the threshold A or less (Yes in step S500), the process proceeds to step S501. If it is not determined in step S500 that the acceleration is within the range of threshold-A or more and threshold A or less (No in step S500), that is, if the acceleration is less than threshold-A or greater than threshold A, step The process proceeds to S504. In step S504, a time (acceleration continuation time) t2 in which the acceleration is in a state of being equal to or greater than the threshold value −A and equal to or less than the threshold value A is initialized, and the determination in step S500 is performed again.

  In step S501, acceleration continuation time t2 is measured, and the process proceeds to step S502. In step S502, it is determined whether or not the acceleration duration t2 exceeds the threshold value E. If the acceleration duration t2 is equal to or greater than the threshold value E, the process proceeds to step S503, and the end of the acceleration waveform is detected. On the other hand, when the acceleration duration t2 is less than the threshold value E, the process returns to step S500 again while continuing to count the acceleration duration t2.

  In this case, when the acceleration is not less than the threshold value -A and the range below the threshold value A is not continued for the threshold value E or longer, the operation can be performed once after the acceleration first exceeds the threshold value A or -A. Suppose there is. Therefore, for example, the peak 303 in FIG. 4 is regarded as a series of operations with the peaks 301 and 302, and it is prevented that the third acceleration waveform is determined to be a new swing.

  The imaging apparatus according to the present embodiment does not detect that the camera is shaken by determining an error when the acceleration is applied too short or too long, even if the acceleration is greater than a certain magnitude. As a result, the waveform is detected more accurately, and an intuitive and easy-to-understand operation system is provided. If the stationary state does not last for a certain period of time, one waveform is detected so that the first, second, and third acceleration waveforms corresponding to this operation can be accurately detected from the preparation operation. become.

  In this embodiment, waveform detection in an imaging apparatus equipped with all the functions of Embodiments 1 to 4 will be described. This embodiment will be described using an imaging apparatus having the same configuration as that of the first embodiment.

  FIG. 12 is a flowchart illustrating a flow of processing in which the motion detection unit 81 swings the imaging apparatus to detect motion. With reference to the waveform of FIG. 4 as an example, processing for detecting an operation of shaking the imaging apparatus will be described.

  When the acceleration crosses the threshold value A or the threshold value -A shown in FIG. 4 (plot 310 in FIG. 4), processing for detecting that the imaging device is shaken is started. When the process of detecting that the imaging device is shaken is started, first acceleration waveform detection is performed in step S100.

  When the first acceleration waveform crosses the threshold A or -A, it is determined that the first acceleration waveform has been detected (Yes in S100). Since the detailed description of the operation in step S100 is the same as that in step 100 of the second embodiment, a description thereof will be omitted.

  When the first acceleration waveform is detected, a second acceleration waveform detection process is performed in step S101. When the second acceleration waveform crosses the threshold B or -B (plot 311 in FIG. 4), it is determined that the second acceleration waveform has been detected (Yes in S101). The detailed description of the operation in step S101 will be described later in detail with reference to FIG.

  In step S102, when the first acceleration waveform is detected (Yes in step S100) and the second acceleration waveform is detected (Yes in step S101), the imaging apparatus is shaken or shaken upward. It is determined whether it has fallen below. The second acceleration waveform needs to have a different sign from the threshold value straddled by the first acceleration waveform detection. For example, when the first acceleration waveform detection is performed by straddling the threshold value -A, the second acceleration waveform detection needs to straddle the threshold value B. This is because the first acceleration waveform detection is a preparatory operation before the main operation and is swung in the opposite direction to the main operation. The detailed description of the operation in step S102 is omitted because it is the same as that in step 102 of the first embodiment.

  If it is determined in step S102 that the imaging apparatus has been shaken (Yes in step S102), the process proceeds to step S104. If any of the determination conditions from step S100 to step S102 is determined as No, it is determined that the swing motion cannot be detected immediately (step S103), and the process proceeds to step S104.

  In step S104, if the state in which the imaging device is not moving (the range in which the acceleration is greater than the threshold −A and less than the threshold A) continues for a time equal to or longer than the threshold E, it is determined that the swing motion has stopped. Then, it is detected that the acceleration waveform detection is completed. Then, the swing motion detection ends. Since the detailed description of the operation in step S104 is the same as that in the fourth embodiment, it is omitted.

  Next, the second acceleration waveform detection (step S101 in FIG. 12) in the present embodiment will be described in detail using an example of the swing motion waveform in FIG. 4 and a flowchart for detecting the second acceleration waveform in FIG. To do.

  Immediately after the first acceleration waveform is detected in step S100 of FIG. 12, when the acceleration is greater than or equal to the threshold A (step S300), the peak value (maximum value) while the acceleration is greater than or equal to the threshold A. Is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, the peak value (maximum value) of the detected waveform after exceeding the threshold A is overwritten by overwriting the peak value (maximum value) when the peak value (maximum value) exceeding the threshold A is updated. Can be measured. When the peak value (maximum value) of this waveform is equal to or greater than the threshold value B (Yes in step S301), the process proceeds to step S302.

  However, if the peak value of the waveform is less than the threshold B in step S301 and falls below the threshold A without exceeding the threshold B (No in step S301), it is assumed that the second acceleration waveform cannot be detected (step S310). ). In this case, the process proceeds to step 103 in FIG. 12, and it is determined that the acceleration waveform detection process cannot be performed, and the process proceeds to step S104 in FIG.

  In step S302, it is determined whether the acceleration peak value (maximum value) is equal to or greater than the threshold value C. When the acceleration peak value (maximum value) is less than the threshold value C, the process proceeds to step S303. If the acceleration peak value (maximum value) is equal to or greater than the threshold value C (No in step S302), the acceleration waveform detection is terminated, and a warning display indicating that the swing is too strong is displayed on the image display unit 7 or the like (step S311). ). Further, the warning is not limited to display only, and a voice warning may be given from a speaker (not shown). In this case, the process proceeds to step 103 in FIG. 12 (No in step S101).

  In step S303, it is determined whether the time t1 when the acceleration is equal to or greater than the threshold A is equal to or greater than the threshold S1 and equal to or less than the threshold S2. If the time t1 when the acceleration is equal to or greater than the threshold A is equal to or greater than the threshold S1 and equal to or less than the threshold S2 (Yes in S303), the second acceleration waveform is detected as an upward waveform (step S304), and the process proceeds to step S320. Move on.

  In step S320, the image displayed on the image display unit 7 is changed to the next image. In step S320, the image displayed on the image display unit 7 is changed to the previous image at the timing of the plot 313 in FIG. At this time, the display order of the images may be the name and number of the file, the date and time when the image was taken, and the date and time stored in the recording unit 61. Thereafter, the second acceleration waveform detection ends.

  If the time t1 when the acceleration is equal to or greater than the threshold A is less than the threshold S1 or longer than the threshold S2 (No in S303), it is assumed that the second acceleration waveform cannot be detected (step S310). In this case, the process proceeds to step 103 in FIG. 12, and it is determined that the acceleration waveform detection process cannot be performed, and the process proceeds to step S104 in FIG.

  On the other hand, immediately after the first acceleration waveform is detected in step S100 in FIG. 12, when the acceleration is less than the threshold A (No in step S300), it is determined whether the acceleration is equal to or less than the threshold −A. (Step S305). When it is determined that the acceleration is equal to or lower than the threshold −A (Yes in step S305), a peak value (minimum value) while the acceleration is equal to or lower than the threshold −A is detected. The acceleration is detected at the detection cycle of the acceleration sensor controlled by the detection cycle control unit 84. Therefore, when the peak value (minimum value) after updating below the threshold value -A is updated, the peak value (minimum value) of the detected waveform after the threshold value -A is overwritten by overwriting the peak value (minimum value). Value) can be measured. When the peak value (minimum value) of this waveform becomes equal to or less than threshold-B before crossing over threshold-A again (Yes in step S306), the process proceeds to step S307.

  However, if the peak value of the waveform is larger than the threshold value −B in step S306 and exceeds the threshold value −A without falling below the threshold value −B (No in step S306), it is assumed that the second acceleration waveform cannot be detected (step S306). Step S310). In this case, the process proceeds to step 103 in FIG. 12, and the acceleration waveform detection process is immediately terminated.

  In step S307, it is determined whether or not the peak value (minimum value) of acceleration is equal to or less than the threshold −C. If the peak value (minimum value) of acceleration is equal to or greater than the threshold value −C, the process proceeds to step S308. If the peak value (minimum value) of acceleration is less than the threshold value −C (No in step S307), the acceleration waveform detection is terminated and a warning display indicating that the swing is too strong is displayed on the image display unit 7 or the like (step) S311). Further, the warning is not limited to display only, and a voice warning may be given from a speaker (not shown). In this case, the process proceeds to step 103 in FIG. 12 (No in step S101).

  In step S308, it is determined whether the time t1 when the acceleration is less than the threshold −A is equal to or greater than the threshold S1 and equal to or less than the threshold S2. When the time t1 when the acceleration is less than the threshold −A is equal to or greater than the threshold S1 and equal to or less than the threshold S2 (Yes in S308), the second acceleration waveform is detected as a downward waveform (step S309), and step S321. Move on. In step S321, the image displayed on the image display unit 7 is changed to the previous image. In step S321, the image displayed on the image display unit 7 is changed to the previous image at the timing of the plot 313 in FIG. At this time, the display order of the images may be the name or number of the file, or may be the date / time of shooting or the date / time stored in the recording unit 61, but the order of the images displayed in step S320 is reversed. To be. However, this is not the case when there is a special mode that randomly determines the image display order, such as random playback. Then, the second acceleration waveform detection ends.

  If the time t1 when the acceleration is equal to or greater than the threshold A is less than the threshold S1 or longer than the threshold S2 (No in S308), it is assumed that the second acceleration waveform cannot be detected (step S310). In this case, the process proceeds to step 103 in FIG. 12, and the process proceeds to step S104, assuming that the acceleration waveform detection process cannot be performed.

  In Example 5, the image was changed at the timing of the plot 313 in FIG. 4 in Step S320 and Step S321. However, as long as the effect is the same, there is no particular limitation, and it may be performed at the time point of the plot 312 (timing when the threshold value B is exceeded) or at the time point of the plot 315 (timing when the threshold value B is exceeded again). Any timing may be used as long as it is from the timing of the plot 312 to the timing of the plot 315.

  With the configuration as described above, the imaging apparatus according to the present embodiment can obtain the effects of the imaging apparatuses according to the first to fourth embodiments. And it becomes possible to detect correctly that it shakes with portable devices, such as an imaging device, and can provide an intuitive and easy-to-understand operation system than before.

  As described above, the detection method of the swing operation of the imaging apparatus has been described for the first to fifth embodiments. However, the detection operation is not limited to the swing operation, and may be any operation that can use the acceleration sensor, such as shaking. . Furthermore, although the detection method has been described for the acceleration waveform, a predetermined operation may be detected after applying a filtering process such as a high-pass filter or a low-pass filter to the acceleration waveform. In the description of the embodiment, the description is limited to the X axis. However, when the threshold value is set according to the operation and type to be detected and the optical axis direction of the camera lens is set to the Z axis, which is not illustrated, Needless to say, the motion may be detected by combining a plurality of detection axes including the Y axis and the Z axis.

In addition, with respect to the third and fifth embodiments, by detecting the motion of shaking the imaging device, it is possible to support moving image playback by assigning functions for playback and stop of the captured moving image and fast forward and rewind.
In the above description, a method for detecting a predetermined motion by the acceleration detecting means has been described. However, the predetermined motion may be detected by using a means for detecting angular velocity or vibration. In the above-described embodiments, the imaging apparatus has been described. However, the same effect can be obtained with an electronic device, a communication device, or the like that can execute photographing.

(Other examples)
The object of the present invention is achieved by executing the following processing. That is, a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is a process of reading the program code. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Cases are also included.

  Furthermore, the present invention includes a case where the functions of the above-described embodiment are realized by the following processing. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

  When the present invention is applied to the above storage medium, the storage medium stores program codes corresponding to the procedure described above.

DESCRIPTION OF SYMBOLS 1 Imaging device 21 Imaging element 41 Exposure control part 50 System control part 80 Acceleration sensor control part 81 Motion detection part 82 Posture detection part 83 Acceleration sensor 84 Vibration detection period control part

Claims (5)

An imaging apparatus having an imaging element that converts an optical image into an electrical signal,
A display unit for displaying an optical image formed by the image sensor as an image;
Changing means for changing an image displayed on the display unit;
Acceleration detecting means for detecting and outputting an acceleration component of shake applied to the imaging device;
Motion detection means for detecting a shake applied by an operator to change an image displayed on the display unit by the changing means from an output of the acceleration detecting means;
The motion detection means detects that the acceleration signal has reached a first threshold value and has exceeded the first threshold value, and has a different sign from the first threshold value and has an absolute value greater than the first threshold value. When the acceleration signal reaches a third threshold having the same sign as the second threshold and an absolute value smaller than the second threshold after reaching a large second threshold, the shake applied by the operator Detect
The image pickup apparatus, wherein the changing unit changes an image displayed on the display unit in accordance with a detection result of the operation detecting unit. The motion detection means further comprises a direction determination means for determining the direction of the shake of the shake applied by the operator,
The imaging apparatus according to claim 1, wherein the direction determination unit determines a direction of shake applied by the operator based on a sign of the first threshold value or the second threshold value.   The imaging apparatus according to claim 2, wherein the changing unit changes an image displayed on the display unit according to a direction of a shake applied by the operator. An imaging device having an imaging device that converts an optical image into an electrical signal, and a display unit that displays an optical image formed by the imaging device as an image,
A changing step of changing an image displayed on the display unit;
An acceleration detection step for detecting and outputting an acceleration component of shake;
From the output of the acceleration detection step, it has an operation detection step of detecting shake added by an operator to change the image displayed on the display unit by the change step,
In the motion detection step, after detecting that the acceleration signal reaches the first threshold and exceeds the first threshold, the absolute value is different from the first threshold and has an absolute value greater than the first threshold. When the acceleration signal reaches a third threshold having the same sign as the second threshold and an absolute value smaller than the second threshold after reaching a large second threshold, the shake applied by the operator Detect
The method for controlling an imaging apparatus, wherein the changing step changes an image displayed on the display unit in accordance with a detection result of the operation detecting step.   A program for causing a computer to execute the control method according to claim 4.