WO2017164140A1

WO2017164140A1 - Electronic device and method for controlling same

Info

Publication number: WO2017164140A1
Application number: PCT/JP2017/011080
Authority: WO
Inventors: 知宏太田
Original assignee: キヤノン株式会社
Priority date: 2016-03-22
Filing date: 2017-03-21
Publication date: 2017-09-28

Abstract

Disclosed are: an electronic device that achieves both the convenience of a touch operation and an accurate position specification; and a method for controlling the same. When an area corresponding to a predetermined condition has been detected from an image, the electronic device performs a function corresponding to a position where a touch has been detected by a touch detection means. In addition, when the area corresponding to the predetermined condition has not been detected or area detection is not performed, the electronic device does not perform a process corresponding to the position where the touch has been detected by the touch detection means, but performs a process corresponding to a touch position movement operation.

Description

Electronic device and control method thereof

The present invention relates to an electronic device and a control method thereof.

A digital camera that includes a touch display that displays a live view image and can specify a focus detection area (AF frame) and an area (AE area) that should be properly exposed by automatic exposure control (AE) as a touch position of the touch display. Known (Patent Document 1).

JP 2012-203143 A

At present, the number of pixels of many digital cameras is over 16 to 20 million pixels, while the resolution of the touch display is about 400,000 to 1.2 million pixels and the size is only about 3 type. Some smartphones and tablet terminals have a higher resolution and larger touch display, but are limited to 4 million pixels and 10 type at most.

Therefore, since the captured image displayed on the touch display is considerably reduced, it is not easy to accurately specify the intended position by the touch operation. In particular, when the AF frame or AE area is specified at the time of shooting, it is necessary to touch the screen by holding the electronic device with one hand while using the finger of the other hand or extending the finger of the hand holding the device. Therefore, it is more difficult to specify the intended position accurately.

The present invention has been made in view of the problems of the prior art, and an object of the present invention is to provide an electronic device that realizes both convenience of touch operation and accurate position designation and a control method thereof.

The above-described object is to set the first operation mode when an area corresponding to a predetermined condition is detected from the image, and to set the first operation mode when the area is not detected or when the area is not detected. A setting means for setting the operation mode 2, a touch detection means for detecting an operation on the touch detection surface, and a control means. When the first operation mode is set, the touch detection means touches When the function corresponding to the position where the touch is detected is executed and the second operation mode is set, the process corresponding to the touch position moving operation is performed instead of the process corresponding to the position where the touch is detected by the touch detection means. It is achieved by an electronic device characterized by having control means for performing control so as to execute processing.

According to the present invention, it is possible to provide an electronic device that realizes both convenience of touch operation and accurate position designation and a control method thereof.

Other features and advantages of the present invention will become apparent from the following description with reference to the accompanying drawings. In the accompanying drawings, the same or similar components are denoted by the same reference numerals.

The accompanying drawings are included in the specification, constitute a part thereof, show an embodiment of the present invention, and are used to explain the principle of the present invention together with the description.
The perspective view which shows the external appearance example of the digital camera which concerns on embodiment of this invention The perspective view which shows the external appearance example of the digital camera which concerns on embodiment of this invention The perspective view which shows the external appearance example of the remote control which concerns on embodiment 1 is a block diagram showing a functional configuration example of a digital camera according to an embodiment. 1 is a block diagram showing an example of a functional configuration of a remote control according to an embodiment The flowchart regarding the operation of the digital camera according to the embodiment The flowchart regarding the operation of the digital camera according to the embodiment The flowchart regarding the operation of the digital camera according to the embodiment The flowchart regarding the operation of the digital camera according to the embodiment The flowchart regarding the operation of the digital camera according to the embodiment The flowchart regarding the operation of the digital camera according to the embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the remote control which concerns on embodiment The figure which shows the example of a screen display in the digital camera which concerns on embodiment The figure which shows the example of a screen display in the digital camera which concerns on embodiment The figure which shows the example of a screen display in the digital camera which concerns on embodiment The figure which shows the example of a screen display in the digital camera which concerns on embodiment The figure which shows the example of a screen display in the digital camera which concerns on embodiment The flowchart regarding the operation of the remote control according to the embodiment

Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings.
● (Digital camera 100)
1A and 1B are perspective views of an external appearance of a single-lens reflex digital camera 100 (hereinafter simply referred to as a camera 100), which is an example of an electronic apparatus according to the present embodiment, viewed from above the front and below the back, respectively. .

The display unit 128 provided on the back of the camera 100 is a touch display. The display unit 128 is used to display various information such as a captured image and a setting value of the camera 100. The display unit 128 also functions as an operation unit that receives a touch operation. In the case of a device having an independent viewfinder such as the camera 100 of the present embodiment, a touch sensor that does not have a display function such as a touch pad may be used instead of the display unit 128, or a device other than the display unit 128 may be used. A touch sensor may be arranged at the position. Here, the viewfinder may be optical or electronic. In the case of a device that does not have the display unit 128, the operation on the touch display is replaced by operating the touch sensor while looking through the viewfinder (while visually recognizing the display unit visible through the eyepiece of the viewfinder). Can do. The same applies to a device that detects that the user is looking through the finder and disables the display while the touch sensor function of the display unit 128 remains valid.

The shutter button 161 is an operation unit for inputting a shooting preparation instruction and a shooting start instruction. The mode switch 160 is an operation unit for switching the shooting mode of the camera 100 and the like. The terminal cover 191 protects a connector of a cable used for communication with an external device. Dial 171 is used to change setting values such as shutter speed and aperture. A power switch 172 switches the power of the camera 100 on and off.

The dial 173 is used for moving a frame to be selected and for sending / returning a displayed image. The dial 173 can be pressed in the vertical and horizontal directions, functions as a cross key 174, and is provided with a SET button 175 on the rotating shaft portion. The cross key 174 is used for moving the cursor, and the SET button 175 is used for determining a selection item, inputting a confirmation response, and the like.

The live view (LV) button 176 is used to switch on and off live view display on the display unit 128 in the still image shooting mode of the camera 100. The LV button 176 is used to start / stop moving image shooting (recording) in the moving image shooting mode of the camera 100.

The enlarge button 177 is used to switch the enlargement mode of live view display on and off, and to change the enlargement ratio. The enlarge button 177 is used to increase the display magnification of the playback image in the playback mode of the camera 100. The playback button 178 is used for switching between the shooting mode and the playback mode of the camera 100. When the playback button 178 is pressed in the shooting mode, the camera 100 shifts to the playback mode and displays the latest image among the images recorded on the recording medium on the display unit 128.

The lid 120 that can be opened and closed protects the storage portion of the recording medium and the stored recording medium from dust and the like. The grip 190 is formed in a shape that allows the user to easily hold the camera 100 with one hand, and a battery is accommodated therein. The mirror 112 is moved up and down by an actuator controlled by the system control unit 150 (FIG. 3A) to switch the traveling direction of the light beam from the lens unit. The terminal 110 is in contact with a terminal provided on a lens unit to which the camera 100 can be attached and detached, and is used for supplying power from the camera 100 to the lens unit and for the camera 100 to communicate with the lens unit.

The eyepiece 116 is an optical viewfinder eyepiece. By looking into the eyepiece 116, the user can observe the subject image formed by the lens unit and the set values such as the shutter speed, aperture value, photographing sensitivity, and AF frame.

● (Remote controller 200)
FIG. 2 is a perspective view showing an external appearance example of a remote controller 200 (hereinafter simply referred to as a remote controller 200) of the camera 100. FIG. The remote controller 200 enables remote operation of the camera 100 by communicating with the camera 100. The remote controller 200 and the camera 100 can communicate with each other through a wired medium or a wireless medium, but in this embodiment, wired communication using the connection cable 291 is performed. The connector of the connection cable 291 is connected to the connector in the terminal cover 191 of the camera 100. The camera 100 and the remote controller 200 can perform two-way communication with a connection cable 291.

The power switch 272 switches the power of the remote control 200 on and off. The display unit 228 is a touch display. Although the display unit 228 has the same aspect ratio as the display unit 128 of the camera 100, in this embodiment, the camera 100 does not transmit the live view image to the remote controller 200, and the live view image is not displayed on the display unit 228. .

The function of the operation buttons 271 arranged three by three above and below the display unit 228 changes according to the display content of the display unit 228. The cross key 274 has keys corresponding to up, down, left, and right, and a SET button 275 is disposed at the center of the cross key 274. The cross key 274 is mainly used for inputting an instruction for moving a cursor, and the SET key 275 is mainly used for inputting an instruction for executing or determining a selected item. The HOME button 276 is used to instruct a transition to the HOME screen of the remote controller 200. The MENU button 277 is used for instructing the transition of the remote control 200 to the MENU screen. The BACK button 278 is used to instruct a cancel instruction or a transition to the previous screen. Various key buttons 271, 273 to 278 other than the power switch 272 are included in the operation unit 270 (FIG. 3B) of the remote controller 200.

● (Functional configuration of camera and remote control)
3A is a block diagram showing an example of the functional configuration of the camera 100, and FIG. 3B is a block diagram showing an example of the functional configuration of the remote controller 200. The components shown in FIGS. The lens unit 140 (hereinafter simply referred to as the lens 140) is an interchangeable lens that can be attached to and detached from the camera 100. The lens 140 includes a lens group 103 including movable lenses such as a focus lens and a variable power lens. The terminal 146 contacts the terminal 110 when the lens 140 is attached to the camera 100, and enables bidirectional communication between the lens 140 and the camera 100, power supply from the camera 100 to the lens 140, and the like.

The lens control unit 144 is a programmable processor such as a CPU or MPU, and controls the operation of the lens 140 by reading the program stored in the nonvolatile memory 145 into the system memory 147 and executing it. The lens control unit 144 controls the aperture mechanism 102 via the aperture drive circuit 142 through communication with the system control unit 150 via the

terminals

146 and 110, and controls the movable lens of the lens group 103 via the AF drive circuit 143. Control the position. The AF / MF switch (SW) 148 is a switch for switching whether to use the autofocus function of the lens 140, and the setting value is notified from the lens control unit 144 to the system control unit 150. There is also a lens 140 that does not have the AF / MF switch 148.

In the camera 100, the focusing screen 113, the pentaprism 114, and the eyepiece lens 116 constitute an optical viewfinder. By observing the subject image formed on the focusing screen 113 of the optical viewfinder through the pentaprism 114 and the eyepiece lens 116, the user can confirm the photographing range, the in-focus position, and the like. The AE sensor 117 provided in the optical viewfinder measures the luminance of the subject image formed by the lens 140.

The focus detection unit 111 has an AF sensor that divides the lens 140 into pupils, and outputs defocus information (direction and amount) to the system control unit 150. The system control unit 150 notifies the lens control unit 144 of the movement amount and movement direction of the focus lens based on the defocus information. The lens control unit 144 moves the focus lens 140 via the notified direction and amount and the AF driving circuit 143.

The quick return mirror 112 (hereinafter simply referred to as the mirror 112) switches the traveling direction of the light beam incident from the lens 140 between the optical finder direction and the imaging unit 122 direction. FIG. 3A shows a state in which the mirror 112 is down, and the light beam travels in the direction of the optical viewfinder. When exposing the imaging unit 122 (during still image shooting, live view shooting, and recording moving image shooting), the mirror 112 is raised, and the light beam travels in the direction of the imaging unit 122. Note that the mirror 112 has a half mirror region so that the focus detection unit 111 can receive a part of the light beam in a state where the mirror 112 is down.

The mechanical shutter 101 opens and closes under the control of the system control unit 150 to expose the imaging unit 122 for a predetermined time. Note that the mechanical shutter 101 is kept open during a period in which the electronic shutter is used, such as during moving image shooting.
The imaging unit 122 includes a plurality of pixels and includes an imaging element that converts an optical image into an electrical signal by photoelectric conversion. The A / D converter 123 converts the analog signal generated by the imaging unit 122 into digital data.

The image processing unit 124 applies predetermined image processing to the data from the A / D converter 123 or the memory control unit 115. Examples of image processing include, but are not limited to, demosaic, white balance adjustment, gradation correction, scaling (resizing), color conversion, encoding, decoding, and area detection. The area detection is a process for detecting an area that satisfies a predetermined condition, such as an area having a specific pattern or feature (for example, a face of a person or an animal, or an area having a specific color or brightness) from an image. Also called subject detection. In addition, the image processing unit 124 can also perform recognition processing of a person and detection of facial expressions, eyebrows, red eyes, and the like. In the following, it is assumed that the image processing unit 124 executes face detection processing for detecting a human face as an example of subject detection.

Also, the image processing unit 124 can generate control information from an image (captured image) acquired by shooting. For example, when contrast AF is performed, the image processing unit 124 can generate an AF evaluation value in the focus detection area and provide it to the system control unit 150. The image processing unit 124 may generate a brightness evaluation value or a brightness histogram. Further, the image processing unit 124 can detect a destination of a predetermined image region in a sense of a plurality of images (for example, a plurality of moving image frames) acquired by time-series shooting. The detection of the movement direction and the movement amount of the specific area between the images can be performed using a known method as a motion vector detection process using template matching, for example, but is not limited thereto. For example, by setting a focus detection area (AF frame) as a template, the AF frame can be tracked, and tracking AF described later can be realized.

Digital data output from the A / D converter 123 is written into the memory 132 through at least the memory control unit 115 of the image processing unit 124 and the memory control unit 115. The memory 132 stores image data read from the recording medium 185 in addition to the digital data output from the A / D converter 123. The memory 132 has a storage capacity for functioning as a buffer memory during continuous shooting.

The memory 132 also serves as a video memory, and stores images to be displayed on the display unit 128 and image (OSD) data representing various information such as camera setting values. The D / A converter 125 converts the display image data (captured image and OSD composite image) stored in the memory 132 into an analog signal and supplies the analog signal to the display unit 128, so that the display image is displayed. Displayed in the section 128.

The display unit 128 is, for example, a touch display provided with a touch panel 128a on the screen. There is no limitation on the position detection method of the touch panel 128a, and for example, a capacitive touch panel can be used. In the figure, the touch panel 128a is described as a separate configuration from the display unit 128 for convenience, but the function of the touch panel may be incorporated in the display unit 128 like an in-cell touch display. By displaying the moving image on the display unit 128 while shooting, the display unit 128 can function as an EVF. An image displayed for causing the display unit 128 to function as an EVF is referred to as a live view image.

The nonvolatile memory 156 is a memory that can be electrically erased and recorded, such as an EEPROM. The nonvolatile memory 156 stores a program to be executed by the system control unit 150, various setting values, GUI data, and the like.

The system control unit 150 is a programmable processor such as a CPU or MPU, and controls the operation of the camera 100 by reading the program stored in the nonvolatile memory 156 into the system memory 152 and executing it. The system control unit 150 also performs display control by controlling the memory 132, the D / A converter 125, and the display unit 128.

Further, the system control unit 150 performs automatic exposure control (AE) processing based on luminance information obtained from the AE sensor 117 and automatic focus detection (AF) processing based on defocus information obtained from the focus detection unit 111. Further, the system control unit 150 uses information obtained by the image processing unit 124 for AE processing and AF processing as necessary. For example, the system control unit 150 performs an AF process in which a focus detection area (AF frame) is set on a person's face using the detection result of the face area in the image processing unit 124, or the person's face is properly exposed. Thus, AE processing and flash light control can be performed. The system control unit 150 can also perform AF (tracking AF) following the movement of the face by causing the image processing unit 124 to track the area corresponding to the specific face. Further, when executing contrast AF, the system control unit 150 can perform imaging while changing the position of the focus lens, and can search for a focus lens position where the AF evaluation value obtained by the image processing unit 124 is maximized.

The system timer 153 measures the time used for various controls and the time of the built-in clock.
The mode switch 160 switches the operation mode of the camera 100 to one of a still image recording mode, a moving image recording mode, a reproduction mode, and the like. Still image recording modes include auto shooting mode, auto scene discrimination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), scene mode, program AE mode, custom mode, and the like. The scene mode is a mode in which parameters are automatically set according to the type of shooting scene, such as sports, snow scenes, and fireworks. At least one of these modes may be selectable by the changeover switch 160. Alternatively, after selecting the still image shooting mode with the mode switch 160, any of a plurality of modes included in the still image shooting mode may be selected using another operation member. The video shooting mode may also include a plurality of modes.

The first shutter switch 162 is turned on when the shutter button 161 is half-pressed to generate the first shutter switch signal SW1. The system control unit 150 starts operations such as AF processing and AE processing using the first shutter switch signal SW1 as an instruction for shooting preparation. The second shutter switch 164 is turned on when the shutter button 161 is fully pressed, and generates a second shutter switch signal SW2. The system control unit 150 uses the second shutter switch signal SW2 as an instruction to start shooting, and performs a series of shooting and recording processes from exposure and reading of the imaging unit 122 to generation of image data and writing of image data to the recording medium 185. Start.

The operation unit 170 collectively shows the operation members (the dial 171 to the enlargement button 177) shown in FIGS. 1A to 1B. The functions of these operation members may be dynamically assigned according to the display content of the display unit 128, for example. For example, functions such as a menu button, an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button may be assigned. For example, when the menu button is operated, the system control unit 150 causes the display unit 128 to display a menu screen for the user to perform various settings. For example, the user can input various settings and instructions from the menu screen by combining the operations of the cross key 174 and the SET button 175 or by operating the touch panel 128a. In addition,

Depending on the screen displayed on the display unit 128, an operation by operating a button or key included in the operation unit 170 can be set in advance and stored in the nonvolatile memory 156. This setting may be changeable by the user.

The power supply control unit 180 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a power supply is installed, the type of power supply, and the remaining battery level. Further, the power supply control unit 180 controls the DC-DC converter based on these detection results and the control of the system control unit 150, and supplies a necessary voltage to each unit including the recording medium 185 for a necessary period.

The power supply unit 130 may be a primary battery, a secondary battery, or an AC adapter. The recording medium I / F 118 is an interface with the recording medium 185. The recording medium 185 may be a memory card or a hard disk. There may be a detachable recording medium and a fixed recording medium.

The external I / F 193 is a communication interface with an external device, and has a connector for connecting a cable. For example, a USB interface for connecting a personal computer or the like, an HDMI (registered trademark) for connecting an external monitor, an interface for the remote control 200, and a corresponding connector are provided. The communication I / F 192 is a communication interface with an external device, and includes an antenna for wireless communication, a modulation / demodulation circuit, and the like. The communication I / F 192 includes, for example, an antenna and a circuit for performing wireless communication in accordance with a standard such as a wireless LAN or Bluetooth (registered trademark).

In the present embodiment, the system control unit 150 can perform automatic focus detection (AF) by setting a focus detection area (AF frame) at a fixed position, a subject area, or an arbitrary position designated by the user. It is. The fixed position may be, for example, the center of the screen. The subject area may be a face area detected by the image processing unit 124 from the live view image, for example. The arbitrary position designated by the user may be, for example, a position in the image designated by a combination of the cross key 174 and the SET button 175 or a touch operation of the touch panel 128a. Hereinafter, setting AF frames at positions designated by touch operations and executing AF is referred to as touch AF.

The system control unit 150 serving as a touch detection unit can detect the following operation or state on the touch detection surface (display surface of the display unit 128) of the touch panel 128a.
-A finger or pen that has not touched the touch panel 128a touches the touch panel 128a anew. That is, the start of touch (hereinafter referred to as touch-down).
The touch panel 128a is being touched with a finger or a pen (hereinafter referred to as touch-on).
The touch panel 128a is moved while being touched with a finger or a pen (hereinafter referred to as touch-move).
-The finger or pen that touched the touch panel 128a is released. That is, the end of touch (hereinafter referred to as touch-up).
A state in which nothing touches the touch panel 128a (hereinafter referred to as touch-off).

When touchdown is detected, it is also detected that touch-on is performed at the same time. After touch-down, unless touch-up is detected, normally touch-on continues to be detected. The touch move is detected in a state where touch-on is detected. Even if the touch-on is detected, the touch move is not detected unless the touch position is moved. After it is detected that all fingers or pens that have been touched are touched up, the touch is turned off.

These operations / states and the position coordinates where the finger or pen touches the touch panel 128a are notified to the system control unit 150 through the internal bus. The system control unit 150 determines what operation (touch operation) has been performed on the touch panel 128a based on the notified information. Regarding the touch move, the moving direction of the finger or pen moving on the touch panel 128a can also be determined for each vertical component / horizontal component on the touch panel 128a based on the change of the position coordinates.

When it is detected that a touch move has been performed over a predetermined distance, it is determined that a slide operation (drag operation) has been performed. An operation in which a finger is touched on the touch panel 128a, quickly moved by a certain distance, and then released is called a flick. In other words, the flick is an operation of quickly tracing the touch panel 128a with a finger. When it is detected that a touch move is performed at a predetermined speed or more at a predetermined distance or more and a touch-up is detected as it is, it can be determined that a flick has been performed (it can be determined that a flick has occurred following the slide operation).

Furthermore, a touch operation in which a plurality of locations (for example, two points) are simultaneously touched to bring the touch positions closer to each other is referred to as pinch-in, and a touch operation that moves away from each other is referred to as pinch-out. Pinch-out and pinch-in are collectively referred to as pinch operation (or simply pinch). The touch panel 128a may be any of various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. good. Depending on the method, there are a method for detecting that there is a touch due to contact with the touch panel, and a method for detecting that there is a touch due to the approach of a finger or pen to the touch panel, but either method may be used.

Next, the remote controller 200 will be described.
The nonvolatile memory 256 is an electrically erasable / recordable memory such as an EEPROM. The nonvolatile memory 256 stores a program to be executed by the remote control unit 250, various setting values, GUI data, and the like.

The remote controller control unit 250 is a programmable processor such as a CPU or MPU, and controls the operation of the remote controller 200 by reading a program stored in the nonvolatile memory 256 into the system memory 252 and executing it.
The memory 232 is used as a video memory of the display unit 228, and the remote control unit 250 stores display image data. The display image data stored in the memory 232 is converted into an analog signal by the D / A converter 213 and supplied to the display unit 228, whereby the display image is displayed on the display unit 228. The remote control unit 250 also performs display control by controlling the memory 232, the D / A converter 213, and the display unit 228.

The display unit 228 is a touch display provided with a touch panel 228a on a screen. Similar to the touch panel 128a of the camera 100, the method of the touch panel 228a is not limited. Further, the function of the touch panel may be incorporated in the display portion 228.
The system timer 253 measures the time used for various controls and the time of the built-in clock.

The operation unit 270 collectively shows various key buttons 271, 273 to 278 other than the power switch 272 in FIG. The function of the operation button 271 may be dynamically assigned, and the name of the currently assigned function may be displayed on the display unit 228. Examples of assigned functions include, but are not limited to, an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button.

When the HOME button 276 is pressed, the remote control unit 250 reads the GUI data from the nonvolatile memory 256 and displays a predetermined HOME screen on the display unit 228. Similarly, when the MENU button 277 is pressed, the remote control control unit 250 reads the GUI data from the nonvolatile memory 256 and causes the display unit 228 to display a predetermined MENU screen.

In addition, the remote control unit 250 performs display control corresponding to the screen, such as moving the focus (highlighting of the selected item) on the GUI screen according to the operation of the cross key 274. When the SET button 275 is operated, the remote controller control unit 250 executes processing corresponding to the item selected at that time, or changes the screen. Depending on the screen displayed on the display unit 228, an operation by operating a button or key included in the operation unit 270 can be set in advance and stored in the nonvolatile memory 256. This setting may be changeable by the user.

The power supply control unit 280 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a power supply is installed, the type of power supply, and the remaining battery level. Further, the power supply control unit 280 controls the DC-DC converter based on the detection result and the control of the system control unit 150, and supplies a necessary voltage to each unit for a necessary period.

The power supply unit 230 may be a primary battery, a secondary battery, or an AC adapter. The external I / F 293 is a communication interface with the camera 100, and a cable 291 is connected thereto. Communication with the camera 100 is performed under the control of the remote control unit 250 via the external I / F 293. The communication I / F 292 is a communication interface with an external device, and includes an antenna for wireless communication, a modulation / demodulation circuit, and the like. The communication I / F 292 includes an antenna and a circuit for performing wireless communication conforming to a standard such as a wireless LAN or Blurtooth (registered trademark), for example.

The remote controller 250 can detect various touch operations by detecting the presence or absence of a touch on the touch detection surface of the touch panel 228a (the display surface of the display unit 228) and the temporal change (speed) of the touched position. Here, it is assumed that the same touch operation as that of the system control unit 150 described above can be recognized.

● (Description of operation-Camera 100)
Next, with reference to FIGS. 4AA to 4CB, in the photographing system shown in FIGS. 3A and 3B, an operation executed while the camera 100 captures and displays a live view image in a photographing standby state or during moving image recording. Will be described. The operations shown in the flowcharts of FIGS. 4AA to 4CB are realized by the system control unit 150 reading the program stored in the nonvolatile memory 156 into the system memory 132 and executing the program, and controlling each unit of the camera 100.

Of the operations described below, input from the remote control 200 may be input from the operation unit 170 of the camera 100 (including the touch panel 128a and the AF / MF switch 148 of the lens 140). Further, the output process to the remote controller 200 may not be performed when the remote controller 200 is not connected or when the remote controller 200 is invalid.

In step S4001, the system control unit 150 determines whether an AF mode change request has been received from the remote controller 200 (or the operation unit 170) via the external I / F 193. If it is determined that the AF mode change request has been received, the processing is received in step S4002. If it is not determined that the process has been performed, the process advances to step S4003. In the present embodiment, the “AF mode” means an operating state of autofocus (AF). The “AF mode change request” means a request that affects the AF operation state, for example, a parameter value change request. In the present embodiment, as specific examples, setting of whether to enable face detection, subject tracking target setting, tracking start, tracking end instruction, manual focus (MF) and autofocus switching instruction are set in the AF mode. Although illustrated as a change request, it is not limited to these.

In this embodiment, when face detection is effective, the user can select a subject to be focused. Also, the user can select the position of the area (AF frame) where focus detection is performed. In addition, tracking AF that performs AF while tracking the main subject selected by the user (the subject at the position of the face area or the AF frame) is possible, and the user can start and end tracking AF or change the tracking target area. It can be carried out.

In S4002, the system control unit 150 changes the AF mode in accordance with the AF mode change request. For example, the system control unit 150 can change the AF mode by changing a parameter value stored in the system memory 152 and corresponding to the current AF mode.

In S4003, the system control unit 150 refers to the system memory 152 to determine whether or not the current AF mode is the tracking standby state. If it is determined that the tracking standby state is determined, the process proceeds to S4016. The process proceeds to S4004.
In step S4004, the system control unit 150 refers to the system memory 152 to determine whether or not the current AF mode is in the tracking state. If it is determined that the tracking state is in progress, the process proceeds to step S4014 in FIG. If not, the process proceeds to S4005.

In step S4005, the system control unit 150 refers to the system memory 152 to determine whether or not the current AF mode is valid for face detection. If it is determined that face detection is valid, the process proceeds to step S4006. The process proceeds to S4007 in FIG. 4AB.
In S4006, the system control unit 150 determines whether or not a face is detected in the image frame captured by the imaging unit 122. If it is determined that the face is detected, the system control unit 150 determines that the face is detected (S4008). For example, the process proceeds to S4011 in FIG.

In step S4007, the system control unit 150 refers to the system memory 152 to determine whether the current AF mode is AF or MF. If it is determined to be AF, the process proceeds to step S4011 in FIG. 4AB. If it is determined to be MF, the system control unit 150 in FIG. The process proceeds to S4013.

In step S4008, the system control unit 150 determines whether the relative position timer realized by the system timer 153 is operating. The relative position timer is an example of a unit that measures a certain time. Measurement (counting) starts in S4204, which will be described later, and stops when a certain time elapses (when the count reaches a predetermined value (eg, 0)). If it is determined that the relative position timer is in operation, the system control unit 150 proceeds to S4011, and if it is not determined to be in operation, the system control unit 150 proceeds to S4009.

In step S4009, the system control unit 150 notifies the remote control 200 via the external I / F 193 of the display screen type (area selection screen) and detected individual face information (for example, identification information, position, and size). . When a plurality of faces are detected, the system control unit 150 determines one of the plurality of faces as a main face according to a predetermined condition, and notifies the remote controller 200 which face is the main face. To do. The main face selection condition is not particularly limited, but for example, one or more of the conditions such as the face closest to the center of the screen, the largest face, and the face closest to the distance can be used. Note that if the face designated by the user as the main face is detected, the system control unit 150 determines that face as the main face. Instead of notifying the type of display screen, the display screen data itself may be transmitted.

FIG. 5A shows an example of an area selection screen that the remote control unit 250 displays on the display unit 228 in response to the notification in S4009.
Reference numeral 5001a denotes a guide display indicating that one of the devices included in the operation unit 270 is assigned the function of instructing the transition to the tracking standby state.
Reference numeral 5002a denotes a guide display indicating that an AF / MF switching instruction function is assigned to one of the devices included in the operation unit 270.
Reference numeral 5003a denotes a display indicating the current focus mode of the camera 100. In the example of FIG. 5A, the current focus mode is AF.

Reference numeral 5004 denotes a guide display indicating that the face detection valid / invalid switching function is assigned to one of the devices included in the operation unit 270.
Reference numeral 5005a denotes a display indicating whether the current face detection function of the camera 100 is valid or invalid. In the example of FIG. 5A, the face detection function is currently valid.

Reference numerals

6003, 6004a, and 6004b are face frames displayed by the remote control unit 250 based on the notified face information, and are examples of mark display that is a guide for the position and size of the detected face. Here, three faces are detected, and the display of the face frame 6003 corresponding to the main face is different from the

other face frames

6004a and 6004b. The remote control unit 250 displays the face frame by converting the position and size of the face area indicated by the image coordinates in the face information according to the resolution of the display unit 228.

Of the input devices included in the operation unit 270, there is no particular limitation on devices corresponding to the guide displays 5001a to 5003a displayed on the edge of the display unit 228. Further, the guide displays 5001a to 5003a may be configured to be touched as they are using the touch panel 228a.

In this way, the user can see the screen of FIG.
The subject (face) selection, the transition instruction to the tracking standby state, the AF / MF switching, and the face detection valid / invalid switching can be performed from the remote controller 200.

In this embodiment, the live view image is not displayed on the display unit 228 of the remote controller 200, but the user can easily designate a desired face from the remote controller 200 by displaying a face frame based on the face information. Note that the remote control unit 250 may display an area selection screen that does not display a face frame, as shown in FIG. 5F. In this case, a guide display 5006a for informing the user of the function and operation method assigned to the touch panel 228a can be performed.

When a screen on which the area detected by the camera 100 can be selected is displayed on the display unit 228 as in the area selection screen of FIG. 5A, the absolute position operation on the touch panel 228a of the remote control 200 is validated (operation position information). Is valid).
Therefore, in S4010, the system control unit 150 performs an absolute position operation process to be described later using FIG. 4BA, and returns the process to S4003.

In S4011, the system control unit 150 notifies the remote controller 200 of the type of display screen (AF frame position change screen) via the external I / F 193. Instead of notifying the type of display screen, the display screen data itself may be transmitted.

FIG. 5B shows an example of an AF frame position change screen displayed on the display unit 228 by the remote control unit 250 in response to the notification in S4011. This screen indicates that the camera 100 is in a state of accepting an AF frame moving operation. The same display elements as those in FIG. 5A are given the same numbers, and descriptions thereof are omitted.

Reference numeral 5006b denotes a guide display indicating that the AF frame can be moved from the current position to a position corresponding to the direction and distance of the drag operation by dragging the touch panel 228a.
As described above, regarding the position change of the AF frame, the relative position operation is enabled instead of the absolute position operation of the touch panel 228a (operation direction and amount information is enabled).

In S4012, the system control unit 150 performs a relative position operation process, which will be described later with reference to FIG. 4BB, and returns the process to S4003.

In S4013, the system control unit 150 notifies the remote controller 200 of the type of display screen (touch operation invalid screen) via the external I / F 193, and the process proceeds to S4015. Instead of notifying the type of display screen, the display screen data itself may be transmitted.

FIG. 5C shows an example of a touch operation invalidation screen that the remote control unit 250 displays on the display unit 228 in response to the notification in S4013. This screen indicates that the camera 100 is in a state where it cannot accept the operation of the AF frame and the face frame. The same display elements as those in FIG. 5A are given the same numbers, and descriptions thereof are omitted.

In the example of FIG. 5C, since the function of instructing the transition to the tracking standby state is invalid, the guide display 5001b is displayed in a color different from the valid state shown in FIG. 5A, for example.
5003b indicates that the current focus mode is MF.
5005b indicates that the current face detection function is invalid.
Reference numeral 5007c denotes a guide display indicating that an operation on the touch panel 228a (except for operations on the guide displays 5002a and 5004) is invalid.

In S4014, the system control unit 150 notifies the remote controller 200 of the display screen type (tracking screen) via the external I / F 193, and the process proceeds to S4015. Instead of notifying the type of display screen, the display screen data itself may be transmitted.

FIG. 5D shows an example of a tracking screen that the remote control unit 250 displays on the display unit 228 in response to the notification in S4014. The tracking screen indicates that the camera 100 is currently performing an AF operation while tracking the selected subject or AF frame (during tracking AF), and touch operations (except for operations on the guide display 5001c) are invalid. It is a screen which notifies that there is.

A guide display 5001c indicates that one of the devices included in the operation unit 270 is assigned a tracking end instruction function.
Reference numeral 5007d denotes a guide display indicating that the AF mode of the camera 100 is in tracking AF and the operation of the touch panel 228a is invalid.

In S4015, the system control unit 150 performs position operation invalidation processing, which will be described later, using FIG. 4CA, and returns the processing to S4003.

In S4016, the system control unit 150 notifies the remote controller 200 of the type of display screen (tracking standby screen) via the external I / F 193, and the process proceeds to S4017. Instead of notifying the type of display screen, the display screen data itself may be transmitted.

FIG. 5E shows an example of a tracking standby screen displayed on the display unit 228 by the remote control unit 250 in response to the notification in S4016. The tracking standby screen is a screen for notifying that the AF mode of the camera 100 is in the tracking standby state and that the tracking standby frame can be moved by a drag operation.

A guide display 5001d indicates that the tracking start instruction function is assigned to one of the devices included in the operation unit 270.
Reference numeral 5002b denotes a guide display indicating that the tracking cancel instruction function is assigned to one of the devices included in the operation unit 270.
A guide display 5006e indicates that the AF mode of the camera 100 is in the tracking standby state, and that the tracking standby frame can be moved from the current position to a position corresponding to the direction and distance of the drag operation by dragging the touch panel 228a. is there. The tracking standby frame is a target face or AF frame for which tracking AF is performed. When an instruction to start tracking is given, the camera 100 starts tracking AF with the tracking standby frame at the time of the instruction as a tracking target. To do.

In S4017, the system control unit 150 performs a tracking standby operation process to be described later with reference to FIG. 4CB, and returns the process to S4003.

FIG. 4BA is a flowchart illustrating details of the absolute position operation process executed by the system control unit 150 in step S4010.
In step S4101, the system control unit 150 notifies the remote controller 200 via the external I / F 193 to operate the touch panel 228a in the absolute position operation mode. The absolute position operation mode is a mode in which the position (coordinates) of the touch operation is validated.

In step S4102, the system control unit 150 updates the face detection state as necessary.
In step S4103, the system control unit 150 transmits information (identification information, position, and size) of each currently detected face to the remote control 200 via the external I / F 193. Note that since the face information is transmitted to the remote controller 200 in S4009, the processing in S4102 and S4103 may not be performed. Further, the process of S4103 may be executed only when the face detection result is different from the execution of S4009 in S4102.

In S4104, the system control unit 150 determines whether or not the identification information of the selected face has been received from the remote controller 200. If it is determined that it has been received, the process proceeds to S4105. If it is not determined to be received, the process proceeds to S4107. Proceed with the process.
In step S4105, the system control unit 150 determines the face corresponding to the face identification information received in step S4104 as the main face, and advances the process to step S4106.
In step S4106, for example, the system control unit 150 sets an AF frame in an area including the main face, performs focus control (focus detection), and advances the process to step S4107.

In step S4107, the system control unit 150 displays a live view screen including a mark display (face frame) indicating the detected face on the display unit 128 as illustrated in FIG. 6A, for example, and ends the absolute position operation process. .
A status display 6001 indicates that moving image shooting is being performed or that moving image shooting is being paused. It is not displayed in shooting standby mode. Here, a display example during moving image shooting is shown.
Reference numeral 6002 denotes a display showing the time code of the moving image being shot.
Reference numeral 6003 denotes a frame display indicating the main face among the detected faces.
Both 6004a and 6004b are frame displays indicating faces other than the main face among the detected faces, and are displayed in a manner different from the main face frame 6003.

Reference numerals

6005a, 6005b, and 6005c are subjects corresponding to detection targets (here, human faces) of the subject detection process included in the image captured by the imaging unit 122.

FIG. 4BB is a flowchart illustrating details of the relative position operation process executed by the system control unit 150 in step S4012.
In step S4201, the system control unit 150 notifies the remote controller 200 via the external I / F 193 to operate the touch panel 228a in the relative position operation mode. The relative position operation mode is a mode in which not the touch operation position but the movement amount and the movement direction of the touch operation position are validated.

In step S4202, the system control unit 150 determines whether or not information (movement information) regarding the movement amount and direction of the touch operation has been received from the remote controller 200. If it is determined that the information has been received, the system control unit 150 determines that the information has been received. If not, the process proceeds to S4205.
In step S4203, the system control unit 150 determines the movement destination position of the AF frame from the current position of the AF frame and the movement information received in step S4202, and advances the process to step S4204.
In step S4204, the system control unit 150 resets the relative position timer, starts counting, and advances the process to step S4205. As described above, the relative position timer is a timer for measuring a certain time, and is realized using the system timer 153. The relative position timer may be a count-up timer or a count-down timer.

When the relative position operation mode and the absolute position operation mode are frequently switched, the position of the AF frame is frequently moved, which causes focus control unintended by the user. The fixed time measured by the relative position timer is a time for switching (transitioning) between the relative position operation and the absolute position operation, and about several seconds is considered appropriate for switching without a sense of incongruity. The system control unit 150 sets an initial value and a target value of the relative position timer, and starts counting. Instead of measuring the fixed time, the condition for starting or ending counting may be that the focus control in S4205 is in a stable state. By preventing frequent switching between the relative position operation mode and the absolute position operation mode of the touch panel 228a, it is possible to realize focus control without a sense of incongruity.

In step S4205, the system control unit 150 performs focus control based on the current AF frame position, and advances the process to step S4206.
In step S4206, the system control unit 150 displays a live view screen including a mark display indicating the current AF frame on the display unit 128 as illustrated in FIG. 6B, for example, and ends the relative position operation processing. In FIG. 6B, the same reference numerals are assigned to the same display elements as in FIG. 6A, and duplicate descriptions are omitted.
Reference numeral 6006 denotes a display indicating the current AF frame position.
Reference numeral 6007 denotes a subject in the image.

FIG. 4CA is a flowchart illustrating details of the position operation invalidation process executed by the system control unit 150 in step S4015.
In step S4301, the system control unit 150 notifies the remote control 200 via the external I / F 193 that the absolute position operation and the relative position operation of the touch panel 228a are invalid.
In S4302, similarly to S4004, the system control unit 150 determines whether the AF mode is being tracked. If it is determined that tracking is in progress, the process proceeds to S4303. If not determined to be tracking, the process proceeds to S4305.

In S4305, the system control unit 150 displays a live view screen without a frame display on the display unit 128 as shown in FIG. 6C, for example, and ends the position operation invalidation process. In FIG. 6C, the same reference numerals are assigned to the same display elements as in FIG. 6A, and duplicate descriptions are omitted. When tracking is not in progress, frames 6003, 6004a, 6004b (FIG. 6A) and AF frame 6006 (FIG. 6B) indicating the detected subject area are not displayed on the live view screen.

In S4303, the system control unit 150 determines whether or not the subject has been lost in the tracking process (tracking has failed). If it is determined that tracking has failed, the process proceeds to S4304. If tracking is not determined to have failed, S4306 is determined. And proceed with each process.
In step S4304, the system control unit 150 ends the tracking process, changes the parameter value corresponding to the AF mode stored in the system memory 152 to a state without tracking, and ends the position operation invalidation process. Thus, focus control without tracking is performed until tracking is set again.

In step S4306, the system control unit 150 updates the AF frame setting to the movement position of the subject that is being detected, which is detected by the image processing unit 124.
In step S4307, the system control unit 150 performs focus control on the AF frame updated in step S4306.
In step S4308, the system control unit 150 displays, on the display unit 128, a live view screen including a mark display (tracking frame) indicating the tracking target subject as illustrated in FIG. . In FIG. 6D, the same reference numerals are assigned to the same display elements as in FIG. 6A, and duplicate descriptions are omitted.
Reference numeral 6008 denotes a frame (tracking frame) display indicating the subject being tracked.

FIG. 4CB is a flowchart showing details of the tracking standby operation process executed by the system control unit 150 in S4017.
In step S4401, the system control unit 150 notifies the remote controller 200 via the external I / F 193 to operate the touch panel 228a in the relative position operation mode.
In S4402, the system control unit 150 determines whether or not information (movement information) regarding the movement amount and movement direction of the touch operation has been received from the remote controller 200. If it is determined that the information has been received, the system control unit 150 determines that the information has been received. If not, the process proceeds to S4404.

In S4403, the system control unit 150 determines the movement destination position of the tracking frame from the current position of the tracking frame (AF frame) and the movement information received in S4402, and advances the process to S4404. In step S4404, the system control unit 150 displays a live view screen including a display (tracking standby frame) indicating a subject to be tracked at the start of tracking on the display unit 128 as illustrated in FIG. 6D, for example. The process ends. In FIG. 6B, the same number is assigned to the same display element as in FIG.
6E in FIG. 6E is a display showing the position of the tracking frame (tracking standby frame) after movement. At this time, the tracking operation has not started. When the system control unit 150 receives an instruction to start tracking from the remote controller 200, the system control unit 150 starts tracking processing using the tracking standby frame at that time as the tracking frame.

FIG. 7 is a flowchart showing an operation performed by the remote controller 200 in conjunction with the operation of the camera 100 described with reference to FIGS. 4AA to 4CB. The operation shown in the flowchart of FIG. 7 is realized by the remote controller control unit 250 controlling each unit of the remote controller 200 based on a program stored in the nonvolatile memory 256.

In step S7001, the remote control unit 250 receives information on the screen to be displayed on the display unit 228, the operation mode of the touch panel 228a, and information on the detected face from the camera 100 via the external I / F 293. Here, the screen information is information that the camera 100 notifies in any one of S4009, S4011, S4013, S4014, and S4016. The mode of the touch panel 228a is information that the camera 100 notifies in any of S4101, S4201, S4301, and S4401. The face information is information notified by the camera 100 in steps S4009 and S4103. The touch panel 228a has a plurality of operation modes including an absolute position operation mode (first operation mode) and a relative position operation mode (second operation mode). Remote control unit 250 sets one of a plurality of operation modes on touch panel 228a in accordance with the operation mode received from camera 100.

In step S7002, the remote control unit 250 displays the screen shown in any of FIGS. 5A to 5F on the display unit 228 based on the screen identification information (or screen data) received in step S7001.
In step S7003, the remote control control unit 250 determines whether an effective device operation (operation other than the touch operation) corresponding to the screen being displayed has been detected. If it is determined that the detection has been detected, the control proceeds to step S7004. If not, the process proceeds to S7005. For example, when the screen of FIG. 5A is being displayed, an operation of a device (any of buttons and keys included in the operation unit 270) assigned to the

guide displays

5001a, 5002a, and 5004 is included in the effective operation. The display screen and the effective operation are associated with each other and stored in, for example, the non-volatile memory 256 of the remote controller 200. The remote control unit 250 determines whether the detected operation is an effective operation for the current display screen. The determination can be made with reference to the nonvolatile memory 256.

In step S7004, the remote control control unit 250 generates an AF mode change request corresponding to the valid operation detected in step S7003, transmits the AF mode change request to the camera 100 via the external I / F 293, and returns the process to step S7001.

In S7005, the remote controller control unit 250 determines whether or not the currently set operation mode is the absolute position operation mode. If it is determined to be the absolute position operation mode, the process proceeds to S7006, and if it is not determined to be the absolute position operation mode. The process proceeds to S7009.
In step S7006, the remote control control unit 250 determines whether a touchdown operation of the touch panel 228a with respect to a position in the display unit 228 other than the

guide displays

5001a, 5002a, and 5004 has been detected. Here, the main face is set according to the position where the touch-down operation is detected, but a position where another touch operation such as touch-up or double-tap operation is detected may be used. If it is determined that a specific touch operation (here, a touch-down operation) has been detected, remote control control unit 250 advances the process to S7007, and if not detected, returns the process to S7001.

In S7007, the remote control unit 250 is designated by the touch operation from the position (coordinates) where the touch operation detected in S7006 is performed and the face information (or display position and size of each face frame) received in S7001. The face is determined, and the process proceeds to S7008. More specifically, when face information corresponding to the position (coordinates) where the touch operation is performed exists (when the position where the touch operation is performed is within the face frame), the corresponding face information is specified. Judge as a face. If no face exists at the position where the touch operation is performed (touch position), no face is selected in the processes of S7007 and S7008.
In step S7008, the remote control control unit 250 transmits the face identification information determined in step S7007 to the camera 100 via the external I / F 293 as the selected face information, and the process returns to step S7001.

In step S7009, the remote control unit 250 determines whether the currently set operation mode is the relative position operation mode. If it is determined that the operation mode is the relative position operation mode, the process advances to step S7010 to determine the relative position operation mode. If not, the process returns to S7001.
In step S7010, the remote control control unit 250 determines whether a drag operation on the touch panel 228a (a touch move in which the moving distance of the touch position is a predetermined distance or more) is detected. If it is determined that the remote control unit 250 has detected, the process proceeds to step S7011, and if it is not determined that it has been detected, the process returns to step S7001. Here, the drag operation is an example of an effective touch operation associated with the display screen in which the relative position operation mode is specified, and may be another touch operation such as a flick operation.

In S7011, the remote control unit 250 converts the direction and distance of the drag operation detected in S7010 into frame movement information. When the distance of the drag operation detected by the touch panel 228a is converted into a distance on the captured image, an appropriate magnification is set so that the movement amount of the AF frame and the tracking standby frame with respect to the drag operation of the touch panel 228a does not become excessively large. Apply. For example, the moving distance is represented by the number of pixels, and the number of pixels of the display unit 228 is set to 1/10 of the number of pixels of resolution of the captured image in the horizontal and vertical directions. In this case, if the movement amount of the drag operation with respect to the touch panel 228a is simply converted, it is converted into a movement amount that is 10 times the drag operation amount in the horizontal direction and the vertical direction, so that fine adjustment of the position is not easy. Therefore, the remote control unit 250 converts the distance of the drag operation using a magnification smaller than the number of pixels of the captured image / the number of pixels of the display unit 228 in the horizontal or vertical direction. When the remote controller 200 and the camera 100 are connected, information may be exchanged between the system control unit 150 and the remote control unit 250 to determine the initial value of the magnification. Therefore, the operation amount may be transmitted as it is from the remote controller 250 to the camera 100, and the system controller 150 may perform the conversion process of S7011.

When the distance of the drag operation is not the number of pixels but the actual moving distance, the moving distance in the horizontal (vertical) direction / the moving distance after conversion in the horizontal (vertical) direction / imaging rather than the moving distance in the horizontal (vertical) direction / touch panel size. What is necessary is just to make the magnitude | size of an image small. However, the size of the captured image is assumed to be a size converted by a predetermined ppi (for example, 72 ppi or 96 ppi).

In addition, when the pixel pitch of the display unit 228 is very small, the distance of the drag operation may be converted into the number of pixels when 72 ppi or 96 ppi is set, and further converted into the distance on the captured image. Note that a function of dynamically adjusting the sensitivity of the movement amount of the AF frame or the tracking standby frame with respect to the drag operation of the touch panel 228a may be assigned to any of the devices included in the operation unit 270.

In S7012, the remote control unit 250 transmits the frame movement information generated in S7011 to the camera 100 via the external I / F 293, and returns the process to S7001.

As described above, according to the present embodiment, when a region detected using a camera function is selected, for example, when a specific subject is selected, a touch sensing device such as a touch panel is used. The absolute position specification is valid. On the other hand, when the area is not detected using the camera function or when the movement of the AF frame or the tracking frame is instructed, the absolute position designation with respect to the touch sensing device is invalidated and the relative position designation is valid. I did it. In other words, whether the position of the touch operation on the touch sensing device is valid or whether the operation direction or amount is valid is dynamically switched depending on whether or not a specific area is detected by the camera.

When selecting an area detected by the camera, an accurate position can be specified even with a small or touch-sensitive device that does not display an image by specifying an arbitrary position within or near the area. Therefore, the position of the touch operation with respect to the touch sensing device is validated. On the other hand, in other cases, not the position of the touch operation but at least one of the operation direction and the operation amount is validated. Thereby, the convenience of the touch operation can be enjoyed while preventing an unintended result by designating the absolute position of the image with a small size or a touch-sensitive device on which no image is displayed. Since the camera automatically switches between these, it is even more convenient. Further, when subject tracking is performed, a common operation procedure can be used to start and end tracking from a tracking standby state regardless of whether or not a tracking target subject is detected.

More specifically, when the absolute position designation is valid (the absolute position operation mode is set) and the touchdown (start of touch) is detected, the remote control unit 250 detects the position where the touchdown is detected. It is determined whether (touch down position) is a position corresponding to any face information (whether it is a touch down with respect to any face frame). When the touchdown position is a position corresponding to any face information, the remote controller control unit 250 transmits the face of the corresponding face information to the camera 100 as the selected face information. That is, when the absolute position designation is valid, the remote control unit 250 executes a process corresponding to the touchdown position (a process of selecting a face corresponding to the touchdown position).

In this case, it is assumed that the remote control unit 250 selects the face corresponding to the touch-down position regardless of which face has been selected before detecting the touch-down. Further, it is assumed that even if no movement (touch move) or touch-up of the touch position is detected, if the touch-down position is within the face frame, remote control unit 250 selects the face corresponding to the face frame. In other words, when the absolute position designation is valid, a function uniquely corresponding to the touch position is executed. Further, the processing is not based on the set value before the touch operation is detected (the position of the AF frame or the tracking frame before the touch operation is detected). Instead of selecting a face by touchdown, when a touchup occurs, a face corresponding to the touch position detected last before the touchup may be selected.

On the other hand, when the relative position designation is valid (the relative position operation mode is set), the remote control unit 250 does not move the AF frame and the tracking frame only by detecting the touchdown (start of touch), and touches it. Maintain the position before the start of. When the touchdown is detected and subsequently the movement of the touch position (touch move) is detected, the remote controller control unit 250 generates frame movement information (including the movement amount and movement direction of the touch position) and sends it to the camera 100. A process for moving the AF frame or the tracking frame is performed. The AF frame or the tracking frame is moved in the direction and the movement amount based on the frame movement information from the position set before the touch that is the generation factor of the frame movement information is performed.

That is, when the relative position designation is valid, the touchdown position is used to calculate the moving amount and moving direction of the touch position, but does not directly correspond to the movement destination of the AF frame or the tracking frame. Regardless of the start position of the touch move, if the movement amount and movement direction of the touch position are the same, the movement direction and movement amount of the AF frame or tracking frame are the same. In other words, when the relative position designation is valid, processing corresponding to the movement amount and movement direction of the touch position is executed, and the function uniquely corresponding to the touch position is not executed. When the relative position designation is valid, the process is based on the setting value before the touch operation is detected (the position of the AF frame or the tracking frame before the touch operation is detected). Specifically, the set value before the touch operation is performed is changed by the change amount corresponding to the movement amount and the movement direction of the touch position.

In addition, since the Live View image is displayed on the camera display along with information such as the area detection results and the current AF frame, more accurate operation is possible by operating the camera's external remote control while viewing the camera display. It can be performed.
Also, the absolute position designation is not validated until a predetermined condition is satisfied after the absolute position designation becomes invalid. Therefore, when the detection by the area detection function of the camera is not stable, it is possible to prevent the valid / invalid designation of the absolute position designation for the touch sensitive device from being switched in a short time.

(Other embodiments)
The present invention can also be used for functions other than focus control. For example, the position of the area (AF frame or tracking standby frame) determined according to the touch operation or information on the selected area may be used for the exposure control (AE) process or the white balance control process.

Also, the area detected by the camera function is not limited to the subject area such as the face area. For example, at least one of a high luminance region (for example, a whiteout region) whose luminance exceeds a first predetermined value and a low luminance region (for example, a blackout region) whose luminance is lower than a second predetermined value may be detected. Further, an area having a specific color (for example, an empty area) may be detected.

Also, a part of the flow in FIGS. 4AA to 4CB may be performed by the remote control unit 250 in the remote controller 200, or a part of the flow in FIG. 7 may be performed by the system control unit 150 in the camera 100. . For example, the coordinate conversion processing in S7007 and S7011 may be performed in the camera 100. In that case, the remote controller 200 transmits the event information of the type of touch operation (touch down operation or drag operation), the operation position, the operation direction, and the operation amount to the camera 100 instead of S7008 and S7012. Even if it does in this way, the effect equivalent to the above-mentioned embodiment can be acquired.

Alternatively, the camera 100 and the remote controller 200 may be an integrated device incorporated in one housing. In that case, the external I / F 193 and the external I / F 293 are replaced with a bus connection inside the apparatus. Further, equivalent modules such as the system control unit 150 and the remote control unit 250 can be integrated into one module. Even with such a configuration, an effect equivalent to that of the present embodiment can be obtained.

The camera 100 and the remote controller 200 may be integrated into one housing, and a remote controller corresponding to a separate remote controller 200 may be connected. In this way, when the cameraman and the assistant take a picture as a team, both the cameraman who handles the camera 100 and the assistant who handles the separate remote controller 200 can perform the frame operation in the same procedure.

Note that each of the system control unit 150 and the remote control unit 250 may be realized by one piece of hardware, or may be realized by sharing a plurality of pieces of hardware. The hardware that implements the system control unit 150 and the remote control unit 250 may be a programmable processor such as a CPU or dedicated hardware such as an ASIC.

Furthermore, in the above-described embodiment, the operation of the touch panel 228a included in the remote controller 200 connected to the camera 100 has been mainly described. However, the use of the remote controller 200 is not essential to the present invention, and the present invention can be implemented with the camera 100 alone. It is.
For example, when the camera 100 is used alone, for example,
-When the proximity sensor provided near the viewfinder detects that the user is using the viewfinder (optical viewfinder or electronic viewfinder)-When the display is displayed on the display in the viewfinder-Operation of the operation unit 170 The system control unit 150 executes the above-described operation of the remote control unit 250 including setting of the operation mode according to the detection state of the subject area, the operation according to the operation mode, and the like. .

Specifically, the system control unit 150 may perform the same control operation for the display unit 128 and the touch panel 128a as those performed by the remote control unit 250 for the display unit 228 and the touch panel 228a. Further, in this case, in the same manner as the control described as being displayed on the display unit 128 by the system control unit 150 in each embodiment described above, when the finder is an electronic view finder, a live view is displayed on the display unit in the finder. In addition, mark display such as a face frame, an AF frame, and a tracking frame may be performed. When the viewfinder is an optical viewfinder, live view display is omitted, and the face frame, AF frame, tracking frame, etc. are displayed on the display unit in the viewfinder so that they can be seen superimposed on the optical image. Just do it. Even when live view display on the display unit 128 is not performed, the touch panel 128a can be used in the same manner as the touch panel 228a of the remote controller 200 described above by enabling the operation on the touch panel 128a.

Further, although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to the specific embodiments described, and various forms within the scope of the present invention are not limited thereto. include. Further, the above-described embodiment is merely an embodiment of the present invention. Furthermore, various aspects described in the embodiments can be appropriately combined.

In the above-described embodiment, an embodiment in which the present invention is applied to a digital still camera as an example of an electronic device or a photographing system using the camera will be described. However, the present invention can be applied to any electronic device having an imaging function and a touch sensor (touch panel, touch pad). Note that the touch sensor need not be incorporated in the display device or disposed on the display device. Electronic devices to which the present invention can be applied include, but are not limited to, personal computers, tablet terminals, portable electronic devices (PDAs), mobile phones, image viewers, media players, game machines, electronic book readers, and the like. In addition, the present invention can be applied to these electronic devices, but is particularly useful in portable electronic devices in which the touch sensor installation area is small.

The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

The present invention is not limited to the above embodiment, and various changes and modifications can be made without departing from the spirit and scope of the present invention. Therefore, in order to make the scope of the present invention public, the following claims are attached.

This application claims priority on the basis of Japanese Patent Application No. 2016-57556 filed on Mar. 22, 2016 and Japanese Patent Application No. 2017-23475 filed on Feb. 10, 2017. , The entire contents of which are incorporated herein by reference.

Claims

The first operation mode is set when an area corresponding to a predetermined condition is detected from the image, and the second operation is performed when the area is not detected or when the area is not detected. Setting means for setting the mode;
Touch detection means for detecting an operation on the touch detection surface;
Control means,
When the first operation mode is set, a function corresponding to the position where the touch is detected by the touch detection unit is executed,
When the second operation mode is set, a process corresponding to a movement operation of the touch position is executed instead of a process corresponding to the position where the touch is detected by the touch detection unit.
Control means for controlling
An electronic device comprising:
2. The electronic apparatus according to claim 1, wherein the image is an image captured by an imaging unit, and the region corresponding to the predetermined condition is a region of a specific subject.
3. The electronic device according to claim 2, wherein the specific subject is a human face.
4. The function according to claim 1, wherein the function corresponding to the position where the touch is detected is a function of selecting an area corresponding to the position where the touch is detected among the detected areas. 5. The electronic device described.
5. The electronic apparatus according to claim 4, wherein the selected area is set as a main subject, and is a target to be focused by AF when photographing with an imaging unit.
When the first operation mode is set, the control means controls to execute a function corresponding to the position where the touch is detected in response to the touch detection means detecting a touch. The electronic device according to claim 1, wherein the electronic device is an electronic device.
When the second operation mode is set, the control means does not move a mark designating a part of the image from before the touch is detected even if the touch detection means detects a touch. When the movement of the touch position is detected, the processing is performed according to the movement amount and the moving direction of the touch position as the processing according to the movement of the touch position. The electronic device according to any one of claims 1 to 6.
8. The electronic apparatus according to claim 7, wherein the mark is a mark indicating a position to be focused by AF at the time of photographing with an imaging means.
9. The electronic device according to claim 1, wherein the touch detection surface is different from a display surface of the image.
Imaging means;
With the viewfinder,
First display means visible through the viewfinder;
A second display means that is visible without going through the viewfinder,
The image is an image captured by the imaging means;
The touch detection surface is a display surface of the second display means;
When the image is displayed on the first display unit, the control unit responds to the function corresponding to the position where the touch is detected or the movement operation of the touch position according to the detection state of the region. The electronic apparatus according to claim 1, wherein the electronic apparatus is controlled to perform the process.
11. The electronic device according to claim 1, wherein the detection of the area is performed by an imaging device connected to the electronic device so as to be able to communicate.
The setting means does not change from the second operation mode to the first operation mode until a predetermined condition is satisfied when the region is detected from a state where the region is not detected. The electronic device according to any one of claims 1 to 11.
13. The electronic apparatus according to claim 12, wherein the predetermined condition is that a predetermined time has elapsed since the execution of the process.
Detecting means for detecting a region corresponding to a predetermined condition from the image;
Control means for controlling the operation of the touch sensing device according to whether or not the region is detected by the detection means,
The control means validates the absolute position operation on the touch sensing device when the area is detected by the detection means, and operates the absolute position operation on the touch sensing device when the area is not detected by the detection means. An electronic device characterized by invalidating and enabling relative position operation.
The first operation mode is set when an area corresponding to a predetermined condition is detected from the image, and the second operation is performed when the area is not detected or when the area is not detected. A setting process for setting the mode;
A touch detection process for detecting an operation on the touch detection surface;
A control process,
When the first operation mode is set, the function corresponding to the position where the touch is detected in the touch detection step is executed,
When the second operation mode is set, a process corresponding to a movement operation of the touch position is executed instead of a process corresponding to the position where the touch is detected in the touch detection step.
A control process to control,
A method for controlling an electronic device, comprising:
A detection step of detecting a region corresponding to a predetermined condition from the image;
When the area is detected in the detection step, the absolute position operation for the touch sensing device is enabled, and when the area is not detected in the detection step, the absolute position operation for the touch sensing device is disabled, and the relative position operation is performed. A control process for enabling
A method for controlling an electronic device, comprising:
The program for functioning a computer as each means of the electronic device of any one of Claims 1-14.
A computer-readable storage medium storing a program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 14.