JP2015130701A - Portable device and control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable device and a control method which allow a user to easily input operation instructions even under harsh conditions where input of the operation instructions is difficult.SOLUTION: An imaging apparatus 1 includes: an imaging part 201 for photographing a subject and creating image data of the subject; a display part 210 for displaying images corresponding to the image data; a touch panel 211 for receiving input of operation instructions for instructing operations performed by the imaging apparatus 1; a moving state determination part 205 for determining a moving state when the imaging apparatus conducts photographing; and a photography control part 215e for changing content of the operation instructions where the touch panel 211 receives the input according to the determination result of the moving state determination part 205.

Description

  The present invention relates to a portable device and a control method for capturing electronic images and generating electronic image data.

  In recent years, in mobile devices such as digital cameras and mobile phones with shooting functions, the zoom operation has been automated, and even if the subject moves away from or approaches the mobile device, the angle of view remains constant so that the size of the subject remains constant. A technique of an auto zoom function that keeps the image is known (see Patent Document 1).

Japanese Patent Laid-Open No. 9-149411

  By the way, conventional mobile devices are difficult to input operation instructions such as operations related to shooting, such as setting operations for setting various parameters and zoom operations, and particularly in situations where shooting is performed while moving. Since the framing operation for determining the composition of the shooting is full, it is difficult to input a desired operation instruction.

  The present invention has been made in view of the above, and provides a portable device and a control method by which a user can easily input an operation instruction even under a situation where it is difficult to input the operation instruction. For the purpose.

  In order to solve the above-described problems and achieve the object, a mobile device according to the present invention includes an imaging unit that images a subject and generates image data of the subject, and a display that displays an image corresponding to the image data. An input unit that receives an input of an operation instruction that instructs an operation performed by the mobile device, a movement state determination unit that determines a movement state when the mobile device performs shooting, and the movement And a control unit that changes a content of the operation instruction that the input unit accepts an input according to a determination result of the state determination unit.

  In the portable device according to the present invention, the moving state determination unit includes an acceleration sensor, and the moving state determination unit includes a period of acceleration change in the vertical direction of the portable device and a horizontal direction. The mobile device is determined to be in a moving state when the acceleration change period substantially coincides with the mobile device.

  The portable device according to the present invention further includes a display control unit that controls a display mode of the image displayed by the display unit in the above invention, and the display control unit displays the determination result of the movement state determination unit. Accordingly, information on the operation instruction that can be selected by the user in the moving state of the portable device is superimposed on the image and displayed on the display unit.

  In the portable device according to the present invention, the input unit includes a touch panel that is provided on a display screen of the display unit and receives an input of the operation instruction according to the position of an object that contacts from the outside. And the said control part sets the area | region which the said touch panel receives an input to the area | region of the information regarding the said operation instruction which the said display part displays.

  The portable device according to the present invention includes an optical system that includes at least a zoom lens, collects light from a predetermined field of view, and forms an image on the imaging unit, and the zoom lens as the optical system. A lens driving unit that moves along the optical axis, and a region setting unit that sets a fixed region that makes the size of the subject constant in the image displayed by the display unit, and the control unit Is characterized in that the lens driving unit is driven so as to be the size of the fixed region set by the region setting unit, and the zoom lens is moved along the optical axis.

  In the portable device according to the present invention, in the above invention, the operation instruction includes at least an auto-zoom operation for instructing setting of the fixed area and a moving image photographing operation for instructing moving image photographing of the portable device. Features.

  The portable device according to the present invention is the portable device according to the above invention, wherein the image is horizontally long, and the moving state determination unit determines that the portable device has a horizontal direction substantially equal to the horizontal direction of the portable device. It is characterized by determining the movement state of the.

  According to another aspect of the present invention, there is provided a program comprising: an imaging unit that images a subject and generates image data of the subject; and a display unit that displays an image corresponding to the image data. An input step for receiving an input of an operation instruction for instructing an operation to be performed; a movement state determination step for determining a movement state when the mobile device performs photographing; and the input step according to a determination result of the movement state determination step And a control step of changing the content of the operation instruction that accepts an input.

  According to the present invention, the movement state determination unit determines the movement state of the portable device when shooting is performed by the portable device, and the shooting control unit performs the operation performed by the portable device according to the determination result of the movement state determination unit. The content for accepting the input of the operation instruction to be instructed is changed. As a result, there is an effect that the user can easily input a desired operation instruction even in a situation where it is difficult to input the operation instruction.

FIG. 1 is a perspective view illustrating a configuration of a side facing a subject of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a perspective view illustrating a configuration of the imaging device according to the first embodiment of the present invention on the side facing the user. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment of the present invention. FIG. 4 is a diagram illustrating a configuration of the acceleration sensor that forms a part of the moving state determination unit included in the imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a diagram schematically illustrating a configuration of a moving state determination unit included in the imaging apparatus according to the first embodiment of the present invention. FIG. 6 is a diagram illustrating a temporal change in the magnitude of the acceleration detected by the acceleration sensor that forms part of the moving state determination unit when the imaging apparatus according to the first embodiment of the present invention is moved toward the subject. is there. FIG. 7 is a diagram schematically illustrating an example of a situation in which an operation instruction can be easily input when shooting is performed using the imaging apparatus according to the first embodiment of the present invention. FIG. 8 is a diagram schematically illustrating an example of a situation where it is difficult to input an operation instruction when shooting is performed using the imaging apparatus according to the first embodiment of the present invention. FIG. 9 is a diagram schematically illustrating another example of a situation where it is difficult to input an operation instruction when using the imaging apparatus according to the first embodiment of the present invention. FIG. 10 is a diagram schematically illustrating an example of input of an operation instruction that is difficult when the user performs photographing under the situation illustrated in FIG. 8. FIG. 11 is a diagram schematically illustrating an example of input of an operation instruction that is difficult when the user performs shooting under the situation illustrated in FIG. 8. FIG. 12 is a diagram schematically illustrating an example of input of an operation instruction that is difficult when the user performs photographing under the situation illustrated in FIG. 8. FIG. 13 is a diagram schematically illustrating an example in which an operation instruction can be input when the user performs shooting in the situation illustrated in FIG. 8. FIG. 14 is a diagram schematically illustrating a situation when moving using the imaging apparatus according to the first embodiment of the present invention. FIG. 15 is a diagram schematically showing a front view from the subject side under the situation shown in FIG. FIG. 16 is a diagram illustrating a change in the magnitude of acceleration detected by the acceleration sensor that forms part of the moving state determination unit under the situation illustrated in FIG. 14. FIG. 17 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to the first embodiment of the present invention. FIG. 18 is a diagram illustrating an example of an image displayed by the display unit included in the imaging apparatus according to the first embodiment of the present invention. FIG. 19 is a diagram illustrating an example of an image displayed by the display unit included in the imaging apparatus according to the first embodiment of the present invention. FIG. 20 is a flowchart showing an overview of the movement state determination process shown in FIG. FIG. 21 is a flowchart showing an outline of the auto zoom process shown in FIG. FIG. 22 is a diagram schematically illustrating the relationship between the subject image formed on the imaging surface of the imaging unit and the amount of movement of the zoom lens in the optical system. FIG. 23 is a diagram schematically illustrating a situation when the user tracks an object using the imaging device under the situation illustrated in FIG. 9. FIG. 24 is a diagram schematically showing a change in frontal state as viewed from the subject side under the situation shown in FIG. FIG. 25 is a diagram illustrating changes in the magnitude of acceleration detected by the acceleration sensor that forms part of the moving state determination unit in the situation illustrated in FIG. FIG. 26 is a diagram schematically illustrating a situation when shooting is performed while tracking an object while running parallel to a subject using the imaging apparatus in the modification according to the second embodiment of the present invention. FIG. 27 is a diagram illustrating an example of an image displayed on a display unit included in an imaging apparatus according to another embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. In the following description, an imaging apparatus such as a digital single-lens reflex camera is illustrated as an example of the portable device according to the present invention, but the present invention is not limited to this embodiment. In the description of the drawings, the same parts are denoted by the same reference numerals.

(Embodiment 1)
FIG. 1 is a perspective view illustrating a configuration of a side facing the subject (front side) of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a perspective view showing the configuration of the side (back side) facing the user of the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment of the present invention. An imaging apparatus 1 shown in FIGS. 1 to 3 includes a main body 2, a lens unit 3 that is detachable from the main body 2, and an eyepiece display unit (electronic view funder) 4 that is detachable from the main body 2. .

  As shown in FIGS. 1 to 3, the main body 2 includes an imaging unit 201, an imaging drive unit 202, a signal processing unit 203, a flash light emitting unit 204, a movement state determination unit 205, a timer 206, A first communication unit 207, a second communication unit 208, an operation input unit 209, a display unit 210, a touch panel 211, a storage unit 212, a power supply unit 213, a power supply unit 214, and a control unit 215. Have.

  The imaging unit 201 is configured using an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) that receives the light collected by the lens unit 3 and converts it into an electrical signal, and a shutter. .

  The imaging drive unit 202 has a function of driving the imaging device and the shutter according to the release signal. For example, the imaging drive unit 202 causes the signal processing unit 203 to output image data (analog signal) from the imaging element of the imaging unit 201 at a predetermined timing.

  The signal processing unit 203 performs signal processing such as amplification on the analog signal output from the imaging unit 201 and then performs A / D conversion to generate and output digital image data.

  The flash light emitting unit 204 is configured using a xenon lamp, an LED (Light Emitting Diode), or the like. The flash light emitting unit 204 irradiates strobe light that is auxiliary light toward a field of view imaged by the imaging device 1.

  FIG. 4 is a diagram illustrating a configuration of an acceleration sensor that forms part of the movement state determination unit 205. The acceleration sensor 10 shown in FIG. 4 is a capacitance type acceleration sensor formed by a MEMS (Micro Electro Mechanical Systems) process. The acceleration sensor 10 includes a metal movable portion 12 having a beam structure that is bridged in a state where ends are fixed in the vicinity of the four corners of the main surface of the rectangular parallelepiped chip 11, and the main surface of the chip 11 that is the movable portion. And 12 metallic flat plates 13 provided on the main surface to which the ends of 12 are fixed. The movable portion 12 extends in the shape of a band along the same direction of the main surface of the chip 11, and extends between two extending portions 12a whose both ends are solid and the central portions of the two extending portions 12a. It has the strip | belt-shaped connection part 12b connected along the direction orthogonal to the direction where the part 12a is extended, and the protrusion part 12c which protrudes in strip | belt shape in parallel with the direction where the extension part 12a extends from the center part of the connection part 12b.

  In the acceleration sensor 10 having the above configuration, when the acceleration in the left-right direction (arrow direction) in FIG. 4 is applied, the movable portion 12 is bent and deformed in the left-right direction except for the end portion of the extending portion 12a. For this reason, the positional relationship between the protruding portion 12c and the flat plate portion 13 changes, and the capacitance is converted. The acceleration sensor 10 outputs a signal (voltage) based on the change in capacitance.

  FIG. 5 is a diagram schematically illustrating the configuration of the movement state determination unit 205 in the imaging apparatus 1. As shown in FIG. 5, the moving state determination unit 205 includes three acceleration sensors 10 whose acceleration detection directions are orthogonal to each other. Specifically, as a coordinate system unique to the imaging device 1, an x axis parallel to the width direction of the imaging device 1, a y axis parallel to the vertical direction of the imaging device 1, and z parallel to the optical axis of the imaging device 1. Three acceleration sensors 10 that take axes and detect acceleration components in the respective axial directions are attached to predetermined positions of the main body 2 of the imaging apparatus 1.

  According to the movement state determination unit 205 having such a configuration, when the user moves the imaging device 1 toward the subject (z direction), it is possible to accurately detect the acceleration caused by this movement. Furthermore, it is possible to detect a tracking state in which the user tracks the subject using the imaging device 1. Further, the movement state determination unit 205 determines the movement state of the imaging device 1 when the horizontal direction of the image displayed on the display unit 210 is substantially equal to the horizontal direction of the imaging device 1. Note that the moving state determination unit 205 can also be used when determining camera shake or correcting an image based on this determination.

FIG. 6 is a diagram illustrating temporal changes in the magnitude of acceleration detected by the acceleration sensor 10 that forms part of the moving state determination unit 205 when the imaging apparatus 1 is moved toward the subject. In FIG. 6, a curve L _z1 represents a time change in the magnitude of acceleration in the z-axis direction (see FIG. 5) of the imaging device 1. In FIG. 6, the horizontal axis indicates time, and the vertical axis indicates the magnitude of acceleration detected by the acceleration sensor 10. In FIG. 6, the acceleration in the direction in which the imaging apparatus 1 travels toward the subject is positive.

As shown in FIG. 6, the magnitude of the acceleration in the z-axis direction of the imaging apparatus 1, the user starts moving toward the image pickup device 1 to the object side at the time t _1, the movement of the imaging device 1 at time t _{2 Shows} a pulse-like time change (see curve L _z1 ). Thus, the movement state determination unit 205 can determine the movement of the imaging device 1 according to the change in acceleration when the imaging device 1 moves.

  The timer 206 has a timekeeping function and a shooting date / time determination function. The timer 206 outputs the date / time data to the control unit 215 in order to add the date / time data to the captured image data.

  The first communication unit 207 is a communication interface for performing communication with the lens unit 3 attached to the main body unit 2. The second communication unit 208 is a communication interface for performing communication with the eyepiece display unit 4 attached to the main body unit 2. Note that the second communication unit 208 can also communicate with an accessory attached to the main body unit 2, such as an electronic flash or a microphone.

  As shown in FIGS. 1 and 2, the operation input unit 209 inputs a power switch 209 a that switches the power state of the imaging apparatus 1 to an on state or an off state, and a still image release signal that gives a still image shooting instruction. A switch 209b, a shooting mode switching switch 209c for inputting a switching signal for giving instructions for switching various shooting modes set in the image pickup apparatus 1, and a display destination for displaying a live view image on the display unit 210 or the eyepiece display unit 4 And a display changeover switch 209d for inputting a changeover signal for giving a changeover instruction.

  The display unit 210 is realized using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 210 displays a horizontally long image corresponding to the image data. The display unit 210 displays information related to operation instructions of the imaging apparatus 1 and shooting information related to shooting.

  The touch panel 211 is provided on the display screen of the display unit 210. The touch panel 211 detects a position touched by the user based on information displayed on the display unit 210, and receives an operation instruction for instructing an operation performed by the imaging apparatus 1 according to the detected touch position. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the present embodiment, any type of touch panel is applicable.

  The storage unit 212 is realized using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory) that is fixedly provided inside the imaging apparatus 1. The storage unit 212 stores various programs for operating the imaging apparatus 1, the program according to the first embodiment, various data and parameters used during the execution of the program, and the like. The storage unit 212 includes a feature storage unit 212a that stores the feature of the subject included in the image data. The storage unit 212 stores image data and information such as information on the lens unit 3 that can be attached to the main body unit 2 and information on correction of image data according to the type of the lens unit 3. Note that the storage unit 212 may include a computer-readable storage medium such as a memory card mounted from the outside.

  The power supply unit 213 is configured using a battery that is detachably attached to the imaging apparatus 1. The power supply unit 214 supplies power from the power supply unit 213 to each component (including the lens unit 3 and the eyepiece display unit 4 to be mounted) of the imaging device 1. The power supply unit 214 may supply the amount of electricity supplied from an external power source (not shown) to each component of the imaging device 1.

  The control unit 215 is configured using a CPU (Central Processing Unit) or the like. The control unit 215 controls the operation of the imaging apparatus 1 by performing instructions and data transfer corresponding to the respective units constituting the imaging apparatus 1 in accordance with instruction signals, switching signals, and the like from the operation input unit 209 and the touch panel 211. To control. The control unit 215 includes an image processing unit 215a, a face detection unit 215b, an area setting unit 215c, an electronic zoom unit 215d, a shooting control unit 215e, and a display control unit 215f.

  The image processing unit 215 a performs various types of image processing on the image data input from the signal processing unit 203 and outputs the processed image data to the storage unit 212. Specifically, the image processing unit 215a performs image processing including at least edge enhancement, white balance, color correction, and γ correction on the image data.

  The face detection unit 215b detects a human face included in the image corresponding to the image data by pattern matching. Note that the face detection unit 215b may detect not only a person's face but also a face such as a dog or a cat. Furthermore, the face detection unit 215b may detect a human face using a known technique other than pattern matching.

  When an instruction signal for instructing auto zoom is input from the operation input unit 209 or the touch panel 211, the region setting unit 215c is large regardless of the distance between the imaging device 1 and the subject in the image displayed on the display unit 210. Set a fixed area to keep the height constant. For example, the region setting unit 215c sets a region obtained by multiplying a human face region detected by the face detection unit 215b by a predetermined coefficient (for example, 1.5 times) as a region to be tracked by auto zoom. Furthermore, the region setting unit 215c may set a region where the lens unit 3 is focused in the image displayed on the display unit 210 as a fixed region.

  The electronic zoom unit 215d trims a part of the image corresponding to the image data, and enlarges the trimmed image. Specifically, the electronic zoom unit 215d performs electronic zoom by trimming a region of an image in accordance with an instruction signal instructing a zoom magnification input from the touch panel 211 and enlarging the trimmed image.

  The shooting control unit 215e performs control to start a still image shooting operation in the imaging device 1 when a still image release signal is input. Here, the still image shooting operation in the imaging device 1 is an operation in which the signal processing unit 203 and the image processing unit 215a perform predetermined processing on the image data output from the imaging unit 201 by driving the imaging driving unit 202. . The image data processed in this way is stored in the storage unit 212 by the imaging control unit 215e. The imaging control unit 215e changes the content of the operation instruction that the touch panel 211 receives input according to the determination result of the movement state determination unit 205. Specifically, the imaging control unit 215e can select an operation instruction received by the touch panel 211 in the initial state of the imaging apparatus 1 when the movement state determination unit 205 determines that the imaging apparatus 1 is in the movement state. From the content of the first operation instruction, the content of the second operation instruction that can be selected by the user in the moving state of the imaging apparatus 1 is set.

  In addition, when the moving state determination unit 205 determines that the imaging apparatus 1 is in the moving state, the shooting control unit 215e sets a region where the touch panel 211 receives an input to a predetermined region, for example, the right region only. Here, the initial state is a state in which the display unit 210 first displays information related to the operation instruction in the photographing mode of the imaging apparatus 1. Note that the shooting control unit 215e changes the content of the operation instruction that the touch panel 211 receives input, but changes the correspondence between the operation that the mechanical switch, for example, the display changeover switch 209d receives, and the operation of the imaging apparatus 1. May be.

  The display control unit 215f causes the display unit 210 to display information regarding an operation instruction that instructs the operation of the imaging device 1 as an icon when the imaging device 1 performs shooting. When the imaging apparatus 1 is in the moving state, the display control unit 215f displays an icon corresponding to the content of the second operation instruction on the display unit 210 in an area where input can be received on the touch panel 211, for example, the right area. Display. The display control unit 215f superimposes the frame corresponding to the region including the face of the person detected by the face detection unit 215b and the frame corresponding to the focused region of the lens unit 3 on the image displayed on the display unit 210. Let

  The main body 2 having the above-described configuration may be provided with a voice input / output function, a communication function for bidirectionally communicating with an external personal computer (not shown) via the Internet, and the like.

  The lens unit 3 includes an optical system 301, a lens driving unit 302, a diaphragm driving unit 303, a lens operation unit 304, a lens storage unit 305, a lens communication unit 306, and a lens control unit 307.

  The optical system 301 is configured using one or a plurality of lenses. The optical system 301 condenses light from a predetermined visual field area and forms an image of the collected light on the imaging unit 201. The optical system 301 adjusts exposure by changing the focal length of the optical system 301 to change the angle of view of the optical system 301 and the amount of incident light collected by the optical system 301. A diaphragm mechanism 301b for performing

  The lens driving unit 302 is configured using a stepping motor, a DC motor, or the like. The lens driving unit 302 changes the focus position, the focal length, and the like of the optical system 301 by moving the lens of the optical system 301 on the optical axis. Specifically, the lens driving unit 302 changes the focal length of the optical system 301 by moving the zoom lens 301a along the optical axis.

  The aperture driving unit 303 is configured using a stepping motor or the like. The aperture driving unit 303 adjusts the amount of light incident on the imaging unit 201 by driving the aperture mechanism 301b.

  The lens operation unit 304 is a zoom ring or a focus ring provided around the lens barrel of the lens unit 3 and receives a signal for operating the lens in the optical system 301. The lens operation unit 304 may be a push switch or the like.

  The lens storage unit 305 stores a control program for determining the position and movement of the zoom lens 301a and the like of the optical system 301. The lens storage unit 305 stores the magnification, focal length, aberration, F value (brightness No), and the like of the zoom lens 301a.

  The lens communication unit 306 is a communication interface for communicating with the first communication unit 207 of the main body unit 2 when the lens unit 3 is attached to the main body unit 2.

  The lens control unit 307 is configured using a CPU (Central Processing Unit) or the like. The lens control unit 307 controls the operation of the lens unit 3 according to the instruction signal from the main body unit 2.

  The eyepiece display unit 4 is realized using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The eyepiece display unit 4 displays a live view image corresponding to the image data. The eyepiece display unit 4 superimposes and displays information related to operation instructions or shooting conditions on the live view image. The eyepiece display unit 4 includes an eyepiece communication unit 401 that communicates with the second communication unit 208 of the main body unit 2 when attached to the main body unit 2.

  In the imaging apparatus 1 having the above configuration, a situation in which it is difficult for a user to input an operation instruction when shooting using the imaging apparatus 1 will be described. FIG. 7 is a diagram schematically illustrating an example of a situation in which an operation instruction can be easily input when shooting using the imaging device 1. FIG. 8 is a diagram schematically illustrating an example of a severe situation in which it is difficult to input an operation instruction when shooting using the imaging device 1. FIG. 9 is a diagram schematically illustrating another example of a situation where it is difficult to input an operation instruction when using the imaging device 1.

  As shown in FIG. 7, in a situation where it is easy for the user to input an operation instruction, for example, in a situation where shooting is performed while the user is stopped, the main body 2 with the right hand is used to prevent camera shake during shooting. While holding the lens, the index finger of the right hand is attached to the release switch 209b, while the lens operation unit 304 can be operated with the thumb and middle finger of the left hand while supporting the lens unit 3 with the left hand. Furthermore, the user can determine the composition of shooting by inputting a desired operation instruction while looking through the eyepiece display unit 4, for example, by performing a zoom operation for operating the lens operation unit 304.

  On the other hand, as shown in FIG. 8, when the user can input an operation instruction only with the right hand, such as when the user walks and shoots with a baggage, the release switch 209b is operated. There is no room for only shooting operations. Furthermore, there is no room to look into the eyepiece display unit 4. In this case, the user must enlarge the visual field region by viewing the live view image displayed on the display unit 210.

  In addition, as shown in FIG. 9, even when the user tracks and shoots the subject while skiing down on skis or the like, it is necessary to take an appropriate balance so as not to fall on the snow surface. In addition to being forced, there is no room to look into the eyepiece display unit 4.

  As described above, in the above-described situation, an operation in which it is difficult for the user to input an operation instruction when shooting using the imaging device 1 will be described in detail. 10 to 12 are diagrams schematically illustrating an example of an operation in which it is difficult to input an operation instruction when the user performs shooting in the situation illustrated in FIG. FIG. 13 is a diagram schematically illustrating an example of an operation capable of inputting an operation instruction when the user performs shooting under the situation illustrated in FIG. 8.

  As shown in FIG. 10 and FIG. 11, a touch operation that touches the touch panel 211 with the left hand while supporting the imaging device 1 with the right hand, or a multi-touch operation that touches a plurality of locations on the touch panel 211 to display an enlarged display, etc. It is a very difficult operation when shooting while walking. Further, as shown in FIG. 12, in order to prevent the subject from missing a photo opportunity, the switching operation for operating the shooting mode switch 209c under the situation where the user can always press the release switch 209b with the index finger of the right hand. A zoom operation or the like that has to be operated by moving the line of sight from the display unit 210 is a very difficult operation.

  On the other hand, as shown in FIG. 13, in a situation where the user can press the release switch 209b at any time with the index finger of the right hand, a touch operation or a slide operation with the thumb of the right hand can be performed on the touch panel 211. Therefore, in the first embodiment, the imaging control unit 215e changes the area in which the touch panel 211 receives input according to the determination result of the movement state determination unit 205. Specifically, when the moving state determination unit 205 determines that the imaging apparatus 1 is in the moving state, the shooting control unit 215e sets the region in which the touch panel 211 receives input only to the right region. Further, the display control unit 215f selects the content of the icon related to the operation instruction displayed on the display unit 210 from the first operation instruction that can be selected by the user in the initial state of the imaging device 1, in the moving state of the imaging device 1. Switch to possible second operation instruction. Thus, the user can input an operation instruction even in a situation where shooting while moving or shooting while tracking a subject. Here, the right region is a region on the right side that is substantially half the display region of the display unit 210. Specifically, this is a range where the right thumb can touch the touch panel 211 with the index finger of the right hand attached to the release switch 209b.

Next, a determination method in which the movement state determination unit 205 determines the movement state of the imaging apparatus 1 will be described. FIG. 14 is a diagram schematically illustrating a situation when the user moves using the imaging apparatus 1. FIG. 15 is a diagram schematically showing a front view from the subject side under the situation shown in FIG. FIG. 16 is a diagram illustrating changes in the magnitude of acceleration detected by the acceleration sensor 10 that forms part of the moving state determination unit 205 under the situation illustrated in FIG. In FIG. 16, the vertical axis indicates the acceleration magnitude a, and the horizontal axis indicates time t. Further, the curve L _y2 indicates the magnitude of acceleration a detected by the acceleration sensor in the y-axis direction when the upward direction in the y-axis direction is positive, and z when the curve L _z2 is positive in the advancing direction of the z-axis. A magnitude a of acceleration detected by the axial acceleration sensor is shown. Further, time _{t a} ~ time _{t e} correspond to each time _{t a} ~ time _{t e} of Figure 14.

As shown in FIGS. 14 and 15, the imaging device 1 greatly increases in the vertical direction in accordance with the movement of the foot accompanying the movement of the user (in FIG. 14, the stepped foot is represented by diagonal lines). Shake. In accordance with this vertical movement, the acceleration in the y-axis direction (see curve _y2 ) is detected by the acceleration sensor 10 at a wavelength having a substantially constant change periodically. Furthermore, the imaging device 1 moves largely forward when the user steps on the foot. The acceleration in the z-axis direction (see the curve _z2 ) is also detected by the acceleration sensor 10 at a wavelength having a substantially constant change in accordance with the movement that moves before this.

  Therefore, in the first embodiment, the moving state determination unit 205 detects the acceleration change period in the vertical direction (y-axis direction) and the horizontal direction (z-axis) when the imaging device 1 performs shooting. ) Is substantially the same as the acceleration change period, it is determined that the imaging apparatus 1 is in the moving state (tracking state). Further, the period of change in acceleration in the vertical direction and horizontal direction determined by the moving state determination unit 205 may be about 1 second. Further, the movement state determination unit 205 moves the imaging device 1 when the rate of change of acceleration in the vertical direction (y-axis direction) of the imaging device 1 and the rate of change of acceleration in the horizontal direction (z-axis) substantially coincide. You may determine with it being in a state (tracking state). Further, the moving state determination unit 205 determines the state of the user such as walking, downhill or sliding, and performs tracking shooting or parallel shooting based on the determination result and how the user holds the imaging device 1. You may determine whether it is in a state. In addition, the moving state determination unit 205 determines the moving state based on the acceleration detected by the acceleration sensor 10, but the determination is based on the atmospheric pressure due to the up and down changes accompanying walking, downhill or sliding, and the moving direction is determined using an electronic compass. The determination may be made based on the relationship of the direction in which the imaging device 1 is directed, or may be determined using the periodicity of image blurring, and the acceleration sensor 10 is not necessarily required. In FIG. 16, as shown in FIG. 15, the description of the acceleration in the x-axis direction is omitted because the shaking in the left-right direction (x-axis direction) accompanying the movement of the user is small.

  Next, an operation performed by the imaging apparatus 1 having the above configuration will be described. FIG. 17 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1.

  As illustrated in FIG. 17, first, the control unit 215 determines whether or not the imaging device 1 is set to the shooting mode (step S101). When the imaging device 1 is set to the shooting mode (step S101: Yes), the imaging device 1 proceeds to step S102 described later. On the other hand, when the imaging device 1 is not set to the imaging mode (step S101: No), the imaging device 1 proceeds to step S117 described later.

  A case where the imaging apparatus 1 is set to the shooting mode in step S101 (step S101: Yes) will be described. In this case, the display control unit 215f causes the display unit 210 to display a live view image corresponding to image data that the imaging unit 201 continuously generates at a constant minute time interval (step S102).

  Subsequently, the movement state determination unit 205 executes a movement determination process for determining the movement state of the imaging device 1 when the imaging device 1 performs shooting (step S103), and the imaging device 1 proceeds to step S104.

  A case where the imaging device 1 is moving in step S104 (step S104: Yes) will be described. In this case, the display control unit 215f sets the display mode 2 in which information related to the second operation instruction is displayed on the display unit 210 (step S105). Specifically, as illustrated in FIG. 18, the display control unit 215f causes the display unit 210 to display icons A1 and A2 superimposed on the live view image as information related to the second operation instruction. The icon A1 is an icon that accepts an input of a start or stop instruction signal for moving image shooting via the touch panel 211. The icon A2 is an icon that accepts an input of an instruction signal for starting or stopping an auto zoom process for maintaining the size of a subject included in an image constant via the touch panel 211.

  Subsequently, the imaging control unit 215e sets the detection area where the touch panel 211 receives input to the right area (step S106). Accordingly, the user can input an operation instruction based on the icon displayed in the right area. Note that the detection area set by the imaging control unit 215e for the touch panel 211 can be set as appropriate.

  Thereafter, when the user inputs an operation instruction for touching the touch panel 211 or operating the release switch 209b within the area of the icon displayed on the screen of the display unit 210 (step S107: Yes), the operation instruction is displayed. At the time of auto zoom operation (step S108: Yes), the imaging control unit 215e executes auto zoom processing (step S109). Thereafter, the imaging apparatus 1 proceeds to step S111. On the other hand, when the operation instruction is not an auto-zoom operation (step S108: No), the shooting control unit 215e executes control according to the operation instruction, for example, a still image shooting operation or a moving image shooting operation (step S110: Yes). ), The imaging apparatus 1 proceeds to step S111.

  In step S107, when there is no operation instruction (step S107: No), the imaging apparatus 1 proceeds to step S111.

  In step S111, when the power switch 209a is pressed (step S111: Yes), the control unit 215 performs control to turn off the power (step S112), and ends the series of processes.

  In step S111, when the power switch 209a is not pressed (step S111: No), the imaging apparatus 1 returns to step S101.

  A case where the imaging device 1 is not moving in step S104 (step S104: No) will be described. In this case, the display control unit 215f sets the display mode 1 in which information related to the first operation instruction is displayed on the display unit 210 (step S113). Specifically, as illustrated in FIG. 19, the display control unit 215f causes icons A11 to A17 related to a plurality of operation instructions as information related to the first operation instruction to be superimposed on the live view image and displayed on the display unit 210.

  Subsequently, the imaging control unit 215e sets the area where the touch panel 211 accepts input as the entire area (step S114). Thereby, the user can input a desired operation instruction by touching the touch panel 211 in the area of the icon displayed on the display unit 210 under a situation where the operation instruction is easy.

  Thereafter, when the user inputs an operation instruction for touching the touch panel 211 or operating the release switch 209b within the area of the icon displayed on the screen of the display unit 210 (step S115: Yes), the imaging control unit 215e Then, control according to the operation instruction is executed (step S116), and the imaging apparatus 1 proceeds to step S111.

  Next, a case where the imaging apparatus 1 is not set to the shooting mode in step S101 (step S101: No) will be described. In this case, when the imaging apparatus 1 is set to the reproduction mode (step S117: Yes), the display control unit 215f displays a file list on the display unit 210 (step S118).

  Subsequently, when a file to be enlarged and displayed is selected via the operation input unit 209 or the touch panel 211 (step S119: Yes), the display control unit 215f reproduces and displays the selected file on the display unit 210 ( Step S120).

  Thereafter, when another image file is newly selected (step S121: Yes), the imaging device 1 returns to step S120. On the other hand, when another image file has not been selected (step S121: No), the imaging device 1 proceeds to step S122.

  In step S121, when an instruction to end image reproduction is input through the operation input unit 209 or the touch panel 211 (step S122: Yes), the imaging apparatus 1 proceeds to step S111. On the other hand, when an instruction to end image reproduction is not input (step S121: No), the imaging apparatus 1 returns to step S118.

  In step S117, when the imaging device 1 is not set to the reproduction mode (step S117: No), the imaging device 1 proceeds to step S111.

  Next, the movement state determination process in step S103 shown in FIG. 17 will be described. FIG. 20 is a flowchart showing an overview of the movement state determination process shown in FIG.

  As illustrated in FIG. 20, first, the movement state determination unit 205 stores acceleration data of acceleration detected by the acceleration sensor 10 in the storage unit 212 (step S201).

  Subsequently, when there is acceleration data for the past one second in the storage unit 212 (step S202: Yes), the movement state determination unit 205 periodically changes the acceleration in the y-axis direction (step S203: Yes). When the change in acceleration in the z-axis direction is periodic (step S204: Yes), it is determined that the imaging device 1 is moving (step S205). Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  On the other hand, the movement state determination unit 205, when there is no acceleration data for the past one second in the storage unit 212 (step S202: No), and when the change in acceleration in the y-axis direction is not periodic (step S203: No) ) Or when the change in acceleration in the z-axis direction is not periodic (step S204: No), it is determined that the imaging device 1 is not moving (step S206). Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, the auto zoom process in step S109 shown in FIG. 17 will be described. FIG. 21 is a flowchart showing an outline of the auto zoom process shown in FIG.

  As shown in FIG. 21, first, the region setting unit 215c acquires a pattern at the center of the image as a fixed region in which the size of the subject included in the image displayed by the display unit 210 is constant (step S301). Specifically, the region setting unit 215c acquires the feature portion of the subject in the region of the central portion of the image used for pattern matching described later, and stores the acquired feature portion in the feature storage unit 212a of the storage unit 212. .

  Subsequently, the imaging control unit 215e determines whether there is a similar pattern in a frame of image data adjacent to the pattern set by the region setting unit 215c (step S302). When there is a similar pattern (step S302: Yes), the imaging apparatus 1 proceeds to step S303 described later. On the other hand, when there is no similar pattern (step S302: No), the imaging device 1 proceeds to step S305 described later.

  In step S303, the imaging control unit 215e determines whether the size of the similar pattern is reduced. When the size of the similar pattern is reduced (step S303: Yes), the lens driving unit 302 is driven via the lens control unit 307 so that the size of the fixed region set by the region setting unit 215c is obtained. The zoom lens 301a is moved to the infinity side (step S304).

FIG. 22 is a diagram schematically illustrating the relationship between the subject image formed on the imaging surface of the imaging unit 201 and the amount of movement of the zoom lens in the optical system 301. As illustrated in FIG. 22, the imaging control unit 215 e performs a change to increase the focal length of the optical system 301 by moving the zoom lens 301 a toward the infinity side along the optical axis. The imaging control unit 215e adjusts the focus with respect to the subject Df by moving a focus lens (not shown) or the like along the optical axis in accordance with the movement of the zoom lens 301a. Thus, the subject Df is formed as a subject image (D ₁ → D ₂ ) on the imaging surface of the imaging unit 201 with the same size as that before the subject Df moves away from the imaging device 1 even when the distance from the imaging device 1 is increased. Is done. As described above, even if the distance between the imaging apparatus 1 and the subject changes, it is possible to perform imaging while tracking the subject with a substantially constant size. Note that the imaging control unit 215e may perform control so that the subject becomes a substantially constant size by causing the electronic zoom unit 215d to perform electronic zoom.

  In step S305, the imaging control unit 215e determines whether an instruction signal for ending the auto zoom operation is input from the touch panel 211. When the instruction signal for ending the auto zoom operation is input (step S305: Yes), the imaging apparatus 1 returns to the main routine shown in FIG. On the other hand, when the instruction signal for ending the auto zoom operation has not been input (step S305: No), the imaging apparatus 1 returns to step S302.

  A case where the size of the similar pattern is not reduced in step S303 (step S303: No) will be described. In this case, the imaging control unit 215e determines whether or not the size of the similar pattern is enlarged (step S306). When the size of the similar pattern is enlarged (step S306: Yes), the lens driving unit 302 is driven via the lens control unit 307 so that the size of the fixed region set by the region setting unit 215c is obtained. The zoom lens 301a is moved to the closest side (step S307). Thereafter, the imaging apparatus 1 proceeds to step S305.

  If the size of the similar pattern is not enlarged in step S306 (step S306: No), the imaging device 1 proceeds to step S305.

  According to the first embodiment described above, the imaging control unit 215e changes the content of the operation instruction received by the touch panel 211 when the movement state determination unit 205 determines that the imaging device 1 is in the movement state. Accordingly, the user can easily input the operation instruction even in a situation where it is difficult to input the operation instruction.

  Furthermore, according to the first embodiment, when the movement state determination unit 205 substantially matches the period of acceleration change in the vertical direction of the imaging apparatus 1 and the period of acceleration change in the horizontal direction, the imaging apparatus 1 Is determined to be in a moving state. As a result, if the imaging apparatus 1 is in the moving state, the content of the operation instruction received by the touch panel 211 can be reliably switched to the second operation instruction.

  Furthermore, according to the first embodiment, when the imaging control unit 215e receives an instruction signal for instructing an automatic zoom operation from the touch panel 211, the size of the fixed region set by the region setting unit 215c is obtained. In this manner, the lens driving unit 302 is driven via the lens control unit 307 to move the zoom lens 301a of the optical system 301 along the optical axis. As a result, even if the distance between the imaging apparatus 1 and the subject changes, the subject can be photographed with a substantially constant size without performing a zoom operation each time.

  Further, according to the first embodiment, the movement state determination unit 205 determines the movement state when the imaging device 1 is in the horizontal state. As a result, the user can perform shooting in a state where a large visual field area is secured for the display unit 210.

  In the first embodiment, the moving state determination unit 205 moves the imaging apparatus 1 when the period of the acceleration change in the vertical direction of the imaging apparatus 1 and the period of the acceleration change in the horizontal direction substantially coincide. For example, when a threshold is set for the magnitude of acceleration in the vertical and horizontal directions, and the magnitude of acceleration in the vertical and horizontal directions periodically exceeds the threshold The imaging device 1 may be determined to be in a moving state. Further, the moving state determination unit 205 may determine that the imaging device 1 is in a moving state when the rate of change in acceleration in the vertical direction and the horizontal direction is approximately constant periodically.

  In the first embodiment, the movement state determination unit 205 determines the movement state of the imaging device 1 using the three acceleration sensors 10 whose detection directions are orthogonal to each other. For example, the movement state determination unit 205 is included in adjacent image data. The imaging device using the change rate of the subject image, the change rate of the region including the face of the person detected by the face detection unit 215b, the degree of coincidence of adjacent image data, the change rate of the shooting distance between the subject and the imaging device 1, etc. The movement state of 1 may be determined.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The imaging device 1 according to the second embodiment of the present invention has the same configuration as the imaging device 1 according to the first embodiment described above, and is different only in a situation where the movement state determination unit 205 determines. For this reason, description of the configuration of the imaging apparatus 1 is omitted.

FIG. 23 is a diagram schematically illustrating a situation when the user tracks a subject using the imaging device 1 under the situation illustrated in FIG. 9. FIG. 24 is a diagram schematically showing a change in frontal state as viewed from the subject side under the situation shown in FIG. FIG. 25 is a diagram illustrating changes in the magnitude of acceleration detected by the acceleration sensor 10 that forms part of the moving state determination unit 205 under the situation illustrated in FIG. In FIG. 25, the vertical axis indicates the acceleration magnitude a, and the horizontal axis indicates time t. Further, the curve L _y3 indicates the magnitude of acceleration detected by the acceleration sensor in the y-axis direction, the curve L _z3 indicates the magnitude of acceleration detected by the acceleration sensor in the z-axis direction, and the curve L _x3 indicates that in the x-axis direction. Indicates the magnitude of acceleration detected by the acceleration sensor. Further, the time point t _a to the time point t _c correspond to the time point t _a to the time point t _c in FIG.

As shown in FIG. 23 and FIG. 24, the imaging apparatus 1 operates in the vertical direction (in FIG. 23, the weight-bearing foot is represented by diagonal lines) in accordance with the left / right weight movement accompanying ski downhill. It swings greatly in the y-axis direction) and the traveling direction (z-axis direction). In accordance with the fluctuations in the vertical direction and the traveling direction, the acceleration in the y-axis direction (see the curve _y3 ) and the acceleration in the z-axis direction (see the curve _z3 ) have a wavelength having a substantially constant change periodically. It is detected by the acceleration sensor 10. Furthermore, the imaging device 1 swings slightly in the left / right (x-axis direction) direction with respect to the traveling direction in accordance with the left / right weight shift accompanying the user's downhill. The acceleration sensor 10 also detects the acceleration in the x-axis direction (see the curve _x3 ) according to the left / right shaking.

  As described above, when the user tracks and shoots the subject while skiing down on the ski, the acceleration change period in the vertical direction (y-axis direction) of the imaging apparatus 1 and the acceleration change in the traveling direction (z-axis). The period is almost the same. Therefore, in the second embodiment, the moving state determination unit 205 detects the acceleration change period in the vertical direction (y-axis direction) of the imaging device 1 and the horizontal direction (z-axis) when the imaging device 1 performs shooting. ) In the acceleration change period substantially coincides with each other, it is determined that the imaging apparatus 1 is in the tracking state (moving state).

  According to the second embodiment described above, similarly to the first embodiment described above, the user can easily perform a desired operation even in a situation where it is difficult to input an operation instruction.

  In the second embodiment, the situation in which the subject is tracked from behind has been described. However, the present invention can also be applied to the case where the user tracks and photographs the subject while running parallel to the subject. FIG. 26 is a diagram schematically illustrating a situation when the user performs tracking and shooting while using the imaging device 1 while running parallel to the subject. Under such circumstances, the imaging device 1 shakes greatly in the vertical direction (y-axis direction) and the traveling direction (x-axis direction). In accordance with the fluctuations in the vertical direction and the traveling direction, the acceleration in the y-axis direction and the acceleration in the x-axis direction are detected by the acceleration sensor 10 at wavelengths having a substantially constant change periodically. As described above, the moving state determination unit 205 can determine whether or not the imaging apparatus 1 is in the moving state even when the user performs tracking and shooting while parallel to the subject.

(Other embodiments)
In the first and second embodiments described above, the display control unit 215f displays the auto zoom operation and moving image shooting operation icons on the display unit 210 as information related to the second imaging operation. For example, FIG. As illustrated, information regarding each imaging operation may be displayed in the right region of the display unit 210 as icons A21 to A26 as information regarding the second operation instruction. Further, the display control unit 215f may change the positions of the icons A21 to A26 displayed on the display unit 210 while rotating according to a slide operation performed on the touch panel 211 by the user. Thereby, the user can input a desired operation instruction by performing a slide operation on the touch panel 211 even under severe conditions.

  In the first and second embodiments described above, the display control unit 215f causes the display unit 210 to display information regarding the auto zoom operation and the moving image shooting operation as the second imaging operation. Can be changed as appropriate. For example, when the display control unit 215f operates the MENU icon A11 (see FIG. 19) displayed on the display unit 210 as information related to the first operation instruction in the initial state of the imaging apparatus 1, the content of the second operation instruction is displayed. May be changed.

  In the first and second embodiments described above, the lens unit 3 is detachable from the main body unit 2. However, the lens unit 3 and the main body unit 2 may be integrally formed.

  In the first and second embodiments described above, the mobile device is described as a digital single-lens digital camera. For example, various types of digital video cameras, camera-equipped mobile phones, personal computers, and the like having a shooting function and a display function are provided. It can be applied to electronic equipment.

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Main body part 3 Lens part 4 Eyepiece display part 10 Acceleration sensor 201 Imaging part 202 Imaging drive part 203 Signal processing part 204 Flash light emission part 205 Movement state determination part 206 Timer 207 First communication part 208 Second communication part 209 Operation Input unit 210 Display unit 211 Touch panel 212 Storage unit 212a Feature storage unit 213 Power supply unit 214 Power supply unit 215 Control unit 215a Image processing unit 215b Face detection unit 215c Area setting unit 215d Electronic zoom unit 215e Imaging control unit 215f Display control unit 301 Optical System 301a Zoom lens 301b Aperture mechanism 302 Lens drive unit 303 Aperture drive unit 304 Lens operation unit 305 Lens storage unit 306 Lens communication unit 307 Lens control unit 401 Eyepiece communication unit

Claims (5)

In a portable device including an imaging unit that images a subject and generates image data of the subject, and a display unit that displays an image corresponding to the image data,
A touch panel that receives an input of an operation instruction that instructs an operation performed by the mobile device;
A moving state determination unit that determines a moving state when the portable device performs shooting;
In accordance with the determination result of the movement state determination unit, the control unit that changes the content of the operation instruction that the touch panel receives input;
A portable device comprising: In a portable device including an imaging unit that images a subject and generates image data of the subject, and a display unit that displays an image corresponding to the image data,
A touch panel that receives an input of an operation instruction that instructs an operation performed by the mobile device;
A moving state determination unit that determines a moving state when the portable device performs shooting;
A control unit that changes a detection area in which the touch panel receives an input according to a determination result of the movement state determination unit;
A portable device comprising:   The mobile device according to claim 2, wherein the control unit sets a detection region that receives input from the touch panel as a right region in the display region of the display unit. An imaging unit that images a subject and generates image data of the subject, a display unit that displays an image corresponding to the image data, and a touch panel that receives an input of an operation instruction that instructs an operation performed by the portable device. A control method executed by a mobile device provided,
A moving state determination step for determining a moving state when the portable device performs shooting;
A control step of changing a content of the operation instruction in which the touch panel accepts an input according to a determination result of the movement state determination step;
The control method characterized by including. An imaging unit that images a subject and generates image data of the subject, a display unit that displays an image corresponding to the image data, and a touch panel that receives an input of an operation instruction that instructs an operation performed by the portable device. A control method executed by a mobile device provided,
A moving state determination step for determining a moving state when the portable device performs shooting;
A control step of changing a detection region in which the touch panel accepts an input according to a determination result of the movement state determination step;
The control method characterized by including.

Images